2024-09-11T22:49:39.920 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-11T22:49:39.940 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T22:49:40.107 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901448 branch: squid description: fs/top/{begin/{0-install 1-ceph 2-logrotate 3-modules} cluster/{1-node} conf/{client mds mgr mon osd} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health pg_health} supported-random-distros$/{ubuntu_latest} tasks/fstop} email: ceph-qa@ceph.com first_in_suite: false job_id: '7901448' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi meta: - desc: 1 ceph cluster with 1 mon, 1 mgr, 3 osds, 2 mds, 2 clients mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: squid ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.b - osd.0 - osd.1 - osd.2 - client.0 - client.1 seed: 481 sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc sleep_before_teardown: 0 subset: 57/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi012.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI6W/JO+zQGx41XMY7UoAJk/Xsgba74zCvvTxqEdYVi7gZE01tFqNf0ysd3SIwgZhTFNHGZpotKCjreL+ZEg7+8= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_fstop teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-11T22:49:40.108 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa; will attempt to use it 2024-09-11T22:49:40.108 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks 2024-09-11T22:49:40.108 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-11T22:49:40.110 INFO:teuthology.task.internal:Checking packages... 2024-09-11T22:49:40.134 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc' 2024-09-11T22:49:40.134 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-11T22:49:40.134 INFO:teuthology.packaging:ref: None 2024-09-11T22:49:40.134 INFO:teuthology.packaging:tag: None 2024-09-11T22:49:40.134 INFO:teuthology.packaging:branch: squid 2024-09-11T22:49:40.134 INFO:teuthology.packaging:sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T22:49:40.135 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=squid 2024-09-11T22:49:40.358 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-298-gb53b6d3e-1jammy 2024-09-11T22:49:40.360 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-11T22:49:40.366 INFO:teuthology.task.internal:no buildpackages task found 2024-09-11T22:49:40.366 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-11T22:49:40.396 INFO:teuthology.task.internal:Saving configuration 2024-09-11T22:49:40.411 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-11T22:49:40.421 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-11T22:49:40.454 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi012.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901448', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 22:44:26.713208', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPKj9fF+El/cjRJYNGu+zeSyGAlVuNEweC2DkPPb/qQx'} 2024-09-11T22:49:40.454 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-11T22:49:40.461 INFO:teuthology.task.internal:roles: ubuntu@smithi012.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.b', 'osd.0', 'osd.1', 'osd.2', 'client.0', 'client.1'] 2024-09-11T22:49:40.461 INFO:teuthology.run_tasks:Running task console_log... 2024-09-11T22:49:40.523 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc843a7b130>, signals=[15]) 2024-09-11T22:49:40.523 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-11T22:49:40.529 INFO:teuthology.task.internal:Opening connections... 2024-09-11T22:49:40.529 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi012.front.sepia.ceph.com 2024-09-11T22:49:40.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T22:49:40.620 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-11T22:49:40.625 DEBUG:teuthology.orchestra.run.smithi012:> uname -m 2024-09-11T22:49:40.733 INFO:teuthology.orchestra.run.smithi012.stdout:x86_64 2024-09-11T22:49:40.733 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release 2024-09-11T22:49:40.778 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-11T22:49:40.778 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="Ubuntu" 2024-09-11T22:49:40.778 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="22.04" 2024-09-11T22:49:40.778 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-11T22:49:40.778 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_CODENAME=jammy 2024-09-11T22:49:40.779 INFO:teuthology.orchestra.run.smithi012.stdout:ID=ubuntu 2024-09-11T22:49:40.779 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE=debian 2024-09-11T22:49:40.779 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-11T22:49:40.779 INFO:teuthology.orchestra.run.smithi012.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-11T22:49:40.779 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-11T22:49:40.779 INFO:teuthology.orchestra.run.smithi012.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-11T22:49:40.779 INFO:teuthology.orchestra.run.smithi012.stdout:UBUNTU_CODENAME=jammy 2024-09-11T22:49:40.780 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2024-09-11T22:49:40.808 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-11T22:49:40.816 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-11T22:49:40.925 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-11T22:49:40.925 DEBUG:teuthology.orchestra.run.smithi012:> test '!' -e /home/ubuntu/cephtest 2024-09-11T22:49:40.930 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-11T22:49:40.946 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-11T22:49:40.946 DEBUG:teuthology.orchestra.run.smithi012:> test -z $(ls -A /var/lib/ceph) 2024-09-11T22:49:40.980 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-11T22:49:41.013 INFO:teuthology.run_tasks:Running task kernel... 2024-09-11T22:49:41.027 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-11T22:49:41.027 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-11T22:49:41.027 DEBUG:teuthology.orchestra.run.smithi012:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T22:49:41.032 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T22:49:41.033 DEBUG:teuthology.orchestra.run.smithi012:> uname -r 2024-09-11T22:49:41.082 INFO:teuthology.orchestra.run.smithi012.stdout:5.15.0-56-generic 2024-09-11T22:49:41.082 INFO:teuthology.task.kernel:Running kernel on smithi012: 5.15.0-56-generic 2024-09-11T22:49:41.083 DEBUG:teuthology.orchestra.run.smithi012:> sudo apt-get clean 2024-09-11T22:49:41.208 DEBUG:teuthology.orchestra.run.smithi012:> sudo apt-get update 2024-09-11T22:49:41.336 INFO:teuthology.orchestra.run.smithi012.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-11T22:49:41.366 INFO:teuthology.orchestra.run.smithi012.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-11T22:49:41.429 INFO:teuthology.orchestra.run.smithi012.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-11T22:49:41.454 INFO:teuthology.orchestra.run.smithi012.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-11T22:49:41.570 INFO:teuthology.orchestra.run.smithi012.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-11T22:49:41.674 INFO:teuthology.orchestra.run.smithi012.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-11T22:49:41.679 INFO:teuthology.orchestra.run.smithi012.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-11T22:49:41.682 INFO:teuthology.orchestra.run.smithi012.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-11T22:49:41.682 INFO:teuthology.orchestra.run.smithi012.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-11T22:49:41.700 INFO:teuthology.orchestra.run.smithi012.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-11T22:49:41.700 INFO:teuthology.orchestra.run.smithi012.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-11T22:49:41.704 INFO:teuthology.orchestra.run.smithi012.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-11T22:49:41.704 INFO:teuthology.orchestra.run.smithi012.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-11T22:49:41.712 INFO:teuthology.orchestra.run.smithi012.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-11T22:49:41.717 INFO:teuthology.orchestra.run.smithi012.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-11T22:49:41.719 INFO:teuthology.orchestra.run.smithi012.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-11T22:49:41.719 INFO:teuthology.orchestra.run.smithi012.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-11T22:49:41.719 INFO:teuthology.orchestra.run.smithi012.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-11T22:49:41.733 INFO:teuthology.orchestra.run.smithi012.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-11T22:49:41.734 INFO:teuthology.orchestra.run.smithi012.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-11T22:49:41.754 INFO:teuthology.orchestra.run.smithi012.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-11T22:49:41.754 INFO:teuthology.orchestra.run.smithi012.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-11T22:49:41.755 INFO:teuthology.orchestra.run.smithi012.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-11T22:49:41.755 INFO:teuthology.orchestra.run.smithi012.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-11T22:49:41.756 INFO:teuthology.orchestra.run.smithi012.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-11T22:49:41.756 INFO:teuthology.orchestra.run.smithi012.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-11T22:49:41.756 INFO:teuthology.orchestra.run.smithi012.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-11T22:49:41.757 INFO:teuthology.orchestra.run.smithi012.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-11T22:49:41.911 INFO:teuthology.orchestra.run.smithi012.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-11T22:49:42.194 INFO:teuthology.orchestra.run.smithi012.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-11T22:49:42.367 INFO:teuthology.orchestra.run.smithi012.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-11T22:49:42.379 INFO:teuthology.orchestra.run.smithi012.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-11T22:49:42.380 INFO:teuthology.orchestra.run.smithi012.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-11T22:49:42.381 INFO:teuthology.orchestra.run.smithi012.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-11T22:49:42.466 INFO:teuthology.orchestra.run.smithi012.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-11T22:49:42.474 INFO:teuthology.orchestra.run.smithi012.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-11T22:49:42.474 INFO:teuthology.orchestra.run.smithi012.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-11T22:49:42.487 INFO:teuthology.orchestra.run.smithi012.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-11T22:49:42.523 INFO:teuthology.orchestra.run.smithi012.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-11T22:49:42.529 INFO:teuthology.orchestra.run.smithi012.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-11T22:49:42.531 INFO:teuthology.orchestra.run.smithi012.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-11T22:49:42.532 INFO:teuthology.orchestra.run.smithi012.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-11T22:49:42.532 INFO:teuthology.orchestra.run.smithi012.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-11T22:49:42.613 INFO:teuthology.orchestra.run.smithi012.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-11T22:49:48.316 INFO:teuthology.orchestra.run.smithi012.stdout:Fetched 15.8 MB in 2s (7,153 kB/s) 2024-09-11T22:49:49.775 INFO:teuthology.orchestra.run.smithi012.stdout:Reading package lists... 2024-09-11T22:49:49.793 DEBUG:teuthology.orchestra.run.smithi012:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-11T22:49:49.848 INFO:teuthology.orchestra.run.smithi012.stdout:Reading package lists... 2024-09-11T22:49:50.040 INFO:teuthology.orchestra.run.smithi012.stdout:Building dependency tree... 2024-09-11T22:49:50.041 INFO:teuthology.orchestra.run.smithi012.stdout:Reading state information... 2024-09-11T22:49:50.218 INFO:teuthology.orchestra.run.smithi012.stdout:The following packages were automatically installed and are no longer required: 2024-09-11T22:49:50.218 INFO:teuthology.orchestra.run.smithi012.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-11T22:49:50.218 INFO:teuthology.orchestra.run.smithi012.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-11T22:49:50.218 INFO:teuthology.orchestra.run.smithi012.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-11T22:49:50.218 INFO:teuthology.orchestra.run.smithi012.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-11T22:49:50.219 INFO:teuthology.orchestra.run.smithi012.stdout: python2.7-minimal 2024-09-11T22:49:50.219 INFO:teuthology.orchestra.run.smithi012.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-11T22:49:50.220 INFO:teuthology.orchestra.run.smithi012.stdout:The following additional packages will be installed: 2024-09-11T22:49:50.220 INFO:teuthology.orchestra.run.smithi012.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-11T22:49:50.220 INFO:teuthology.orchestra.run.smithi012.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-11T22:49:50.220 INFO:teuthology.orchestra.run.smithi012.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-11T22:49:50.221 INFO:teuthology.orchestra.run.smithi012.stdout:Suggested packages: 2024-09-11T22:49:50.222 INFO:teuthology.orchestra.run.smithi012.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-11T22:49:50.222 INFO:teuthology.orchestra.run.smithi012.stdout:Recommended packages: 2024-09-11T22:49:50.222 INFO:teuthology.orchestra.run.smithi012.stdout: thermald 2024-09-11T22:49:50.271 INFO:teuthology.orchestra.run.smithi012.stdout:The following NEW packages will be installed: 2024-09-11T22:49:50.272 INFO:teuthology.orchestra.run.smithi012.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-11T22:49:50.272 INFO:teuthology.orchestra.run.smithi012.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-11T22:49:50.272 INFO:teuthology.orchestra.run.smithi012.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-11T22:49:50.273 INFO:teuthology.orchestra.run.smithi012.stdout:The following packages will be upgraded: 2024-09-11T22:49:50.273 INFO:teuthology.orchestra.run.smithi012.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-11T22:49:50.325 INFO:teuthology.orchestra.run.smithi012.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-11T22:49:50.325 INFO:teuthology.orchestra.run.smithi012.stdout:Need to get 113 MB of archives. 2024-09-11T22:49:50.325 INFO:teuthology.orchestra.run.smithi012.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-11T22:49:50.325 INFO:teuthology.orchestra.run.smithi012.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-11T22:49:50.746 INFO:teuthology.orchestra.run.smithi012.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-11T22:49:50.865 INFO:teuthology.orchestra.run.smithi012.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-11T22:49:51.696 INFO:teuthology.orchestra.run.smithi012.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-11T22:49:51.697 INFO:teuthology.orchestra.run.smithi012.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-11T22:49:51.697 INFO:teuthology.orchestra.run.smithi012.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-11T22:49:51.828 INFO:teuthology.orchestra.run.smithi012.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-11T22:49:51.851 INFO:teuthology.orchestra.run.smithi012.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-11T22:49:52.265 INFO:teuthology.orchestra.run.smithi012.stdout:Fetched 113 MB in 2s (72.2 MB/s) 2024-09-11T22:49:52.455 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-11T22:49:54.475 INFO:teuthology.orchestra.run.smithi012.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-11T22:49:54.479 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-11T22:49:54.544 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T22:49:56.754 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-11T22:49:56.776 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-11T22:49:56.871 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T22:49:57.291 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-11T22:49:57.312 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-11T22:49:57.341 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T22:50:04.003 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-11T22:50:04.102 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-11T22:50:04.410 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-11T22:50:04.530 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-11T22:50:04.841 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-11T22:50:04.864 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-11T22:50:04.908 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-11T22:50:10.312 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-11T22:50:10.349 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-11T22:50:10.387 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T22:50:13.761 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-11T22:50:13.882 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-11T22:50:14.233 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-11T22:50:14.354 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T22:50:14.480 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-11T22:50:14.609 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T22:50:15.949 INFO:teuthology.orchestra.run.smithi012.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-11T22:50:15.949 INFO:teuthology.orchestra.run.smithi012.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-11T22:50:15.949 INFO:teuthology.orchestra.run.smithi012.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-11T22:50:15.950 INFO:teuthology.orchestra.run.smithi012.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-11T22:50:16.118 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T22:50:18.011 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T22:50:19.462 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-11T22:50:19.588 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-11T22:50:19.715 INFO:teuthology.orchestra.run.smithi012.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T22:50:19.768 INFO:teuthology.orchestra.run.smithi012.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-11T22:50:19.768 INFO:teuthology.orchestra.run.smithi012.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-11T22:50:34.434 INFO:teuthology.orchestra.run.smithi012.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-11T22:50:34.435 INFO:teuthology.orchestra.run.smithi012.stdout:Sourcing file `/etc/default/grub' 2024-09-11T22:50:34.442 INFO:teuthology.orchestra.run.smithi012.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-11T22:50:34.468 INFO:teuthology.orchestra.run.smithi012.stdout:Generating grub configuration file ... 2024-09-11T22:50:34.732 INFO:teuthology.orchestra.run.smithi012.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-11T22:50:34.758 INFO:teuthology.orchestra.run.smithi012.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-11T22:50:35.045 INFO:teuthology.orchestra.run.smithi012.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-11T22:50:35.050 INFO:teuthology.orchestra.run.smithi012.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-11T22:50:35.122 INFO:teuthology.orchestra.run.smithi012.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-11T22:50:35.128 INFO:teuthology.orchestra.run.smithi012.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-11T22:50:35.287 INFO:teuthology.orchestra.run.smithi012.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-11T22:50:35.287 INFO:teuthology.orchestra.run.smithi012.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-11T22:50:35.287 INFO:teuthology.orchestra.run.smithi012.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-11T22:50:35.322 INFO:teuthology.orchestra.run.smithi012.stdout:done 2024-09-11T22:50:35.795 DEBUG:teuthology.orchestra.run.smithi012:> dpkg -s linux-image-generic 2024-09-11T22:50:35.818 INFO:teuthology.orchestra.run.smithi012.stdout:Package: linux-image-generic 2024-09-11T22:50:35.818 INFO:teuthology.orchestra.run.smithi012.stdout:Status: install ok installed 2024-09-11T22:50:35.818 INFO:teuthology.orchestra.run.smithi012.stdout:Priority: optional 2024-09-11T22:50:35.818 INFO:teuthology.orchestra.run.smithi012.stdout:Section: kernel 2024-09-11T22:50:35.818 INFO:teuthology.orchestra.run.smithi012.stdout:Installed-Size: 21 2024-09-11T22:50:35.819 INFO:teuthology.orchestra.run.smithi012.stdout:Maintainer: Ubuntu Kernel Team 2024-09-11T22:50:35.819 INFO:teuthology.orchestra.run.smithi012.stdout:Architecture: amd64 2024-09-11T22:50:35.819 INFO:teuthology.orchestra.run.smithi012.stdout:Source: linux-meta 2024-09-11T22:50:35.819 INFO:teuthology.orchestra.run.smithi012.stdout:Version: 5.15.0.119.119 2024-09-11T22:50:35.819 INFO:teuthology.orchestra.run.smithi012.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-11T22:50:35.819 INFO:teuthology.orchestra.run.smithi012.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-11T22:50:35.819 INFO:teuthology.orchestra.run.smithi012.stdout:Recommends: thermald 2024-09-11T22:50:35.819 INFO:teuthology.orchestra.run.smithi012.stdout:Description: Generic Linux kernel image 2024-09-11T22:50:35.819 INFO:teuthology.orchestra.run.smithi012.stdout: This package will always depend on the latest generic kernel image 2024-09-11T22:50:35.819 INFO:teuthology.orchestra.run.smithi012.stdout: available. 2024-09-11T22:50:35.819 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-11T22:50:35.820 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-11T22:50:35.820 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-11T22:50:35.820 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-11T22:50:35.820 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi012.front.sepia.ceph.com, path=None, version=distro) 2024-09-11T22:50:35.820 DEBUG:teuthology.orchestra.run.smithi012:> sudo apt-get clean 2024-09-11T22:50:35.988 DEBUG:teuthology.orchestra.run.smithi012:> sudo apt-get update 2024-09-11T22:50:36.110 INFO:teuthology.orchestra.run.smithi012.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-11T22:50:36.120 INFO:teuthology.orchestra.run.smithi012.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-11T22:50:36.124 INFO:teuthology.orchestra.run.smithi012.stdout:Hit:3 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-11T22:50:36.137 INFO:teuthology.orchestra.run.smithi012.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-11T22:50:37.583 INFO:teuthology.orchestra.run.smithi012.stdout:Reading package lists... 2024-09-11T22:50:37.601 DEBUG:teuthology.orchestra.run.smithi012:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-11T22:50:37.664 INFO:teuthology.orchestra.run.smithi012.stdout:Reading package lists... 2024-09-11T22:50:37.882 INFO:teuthology.orchestra.run.smithi012.stdout:Building dependency tree... 2024-09-11T22:50:37.883 INFO:teuthology.orchestra.run.smithi012.stdout:Reading state information... 2024-09-11T22:50:38.080 INFO:teuthology.orchestra.run.smithi012.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-11T22:50:38.080 INFO:teuthology.orchestra.run.smithi012.stdout:The following packages were automatically installed and are no longer required: 2024-09-11T22:50:38.080 INFO:teuthology.orchestra.run.smithi012.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-11T22:50:38.080 INFO:teuthology.orchestra.run.smithi012.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-11T22:50:38.080 INFO:teuthology.orchestra.run.smithi012.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-11T22:50:38.081 INFO:teuthology.orchestra.run.smithi012.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-11T22:50:38.081 INFO:teuthology.orchestra.run.smithi012.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-11T22:50:38.081 INFO:teuthology.orchestra.run.smithi012.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-11T22:50:38.128 INFO:teuthology.orchestra.run.smithi012.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-11T22:50:38.130 DEBUG:teuthology.orchestra.run.smithi012:> dpkg -s linux-image-generic 2024-09-11T22:50:38.142 INFO:teuthology.orchestra.run.smithi012.stdout:Package: linux-image-generic 2024-09-11T22:50:38.142 INFO:teuthology.orchestra.run.smithi012.stdout:Status: install ok installed 2024-09-11T22:50:38.143 INFO:teuthology.orchestra.run.smithi012.stdout:Priority: optional 2024-09-11T22:50:38.143 INFO:teuthology.orchestra.run.smithi012.stdout:Section: kernel 2024-09-11T22:50:38.143 INFO:teuthology.orchestra.run.smithi012.stdout:Installed-Size: 21 2024-09-11T22:50:38.143 INFO:teuthology.orchestra.run.smithi012.stdout:Maintainer: Ubuntu Kernel Team 2024-09-11T22:50:38.143 INFO:teuthology.orchestra.run.smithi012.stdout:Architecture: amd64 2024-09-11T22:50:38.143 INFO:teuthology.orchestra.run.smithi012.stdout:Source: linux-meta 2024-09-11T22:50:38.143 INFO:teuthology.orchestra.run.smithi012.stdout:Version: 5.15.0.119.119 2024-09-11T22:50:38.143 INFO:teuthology.orchestra.run.smithi012.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-11T22:50:38.143 INFO:teuthology.orchestra.run.smithi012.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-11T22:50:38.143 INFO:teuthology.orchestra.run.smithi012.stdout:Recommends: thermald 2024-09-11T22:50:38.143 INFO:teuthology.orchestra.run.smithi012.stdout:Description: Generic Linux kernel image 2024-09-11T22:50:38.143 INFO:teuthology.orchestra.run.smithi012.stdout: This package will always depend on the latest generic kernel image 2024-09-11T22:50:38.143 INFO:teuthology.orchestra.run.smithi012.stdout: available. 2024-09-11T22:50:38.144 DEBUG:teuthology.orchestra.run.smithi012:> mktemp 2024-09-11T22:50:38.189 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/tmp.GhGNuAdl0w 2024-09-11T22:50:38.190 DEBUG:teuthology.orchestra.run.smithi012:> sudo cp /boot/grub/grub.cfg /tmp/tmp.GhGNuAdl0w 2024-09-11T22:50:38.246 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0666 /tmp/tmp.GhGNuAdl0w 2024-09-11T22:50:38.359 DEBUG:teuthology.orchestra.remote:smithi012:/tmp/tmp.GhGNuAdl0w is 10KB 2024-09-11T22:50:38.372 DEBUG:teuthology.orchestra.run.smithi012:> rm -fr /tmp/tmp.GhGNuAdl0w 2024-09-11T22:50:38.377 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-11T22:50:38.429 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T22:50:38.429 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-11T22:50:38.429 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-11T22:50:38.491 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-11T22:50:38.491 DEBUG:teuthology.orchestra.run.smithi012:> sudo update-grub 2024-09-11T22:50:39.746 INFO:teuthology.orchestra.run.smithi012.stderr:Sourcing file `/etc/default/grub' 2024-09-11T22:50:39.747 INFO:teuthology.orchestra.run.smithi012.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-11T22:50:39.749 INFO:teuthology.orchestra.run.smithi012.stderr:Generating grub configuration file ... 2024-09-11T22:50:39.958 INFO:teuthology.orchestra.run.smithi012.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-11T22:50:39.965 INFO:teuthology.orchestra.run.smithi012.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-11T22:50:40.192 INFO:teuthology.orchestra.run.smithi012.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-11T22:50:40.198 INFO:teuthology.orchestra.run.smithi012.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-11T22:50:40.240 INFO:teuthology.orchestra.run.smithi012.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-11T22:50:40.245 INFO:teuthology.orchestra.run.smithi012.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-11T22:50:40.364 INFO:teuthology.orchestra.run.smithi012.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-11T22:50:40.364 INFO:teuthology.orchestra.run.smithi012.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-11T22:50:40.364 INFO:teuthology.orchestra.run.smithi012.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-11T22:50:40.382 INFO:teuthology.orchestra.run.smithi012.stderr:done 2024-09-11T22:50:40.384 DEBUG:teuthology.orchestra.run.smithi012:> sudo shutdown -r now 2024-09-11T22:51:10.413 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-11T22:51:10.414 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-09-11T22:51:10.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T22:52:10.487 DEBUG:teuthology.orchestra.remote:timed out 2024-09-11T22:52:19.497 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-09-11T22:52:19.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T22:52:21.049 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.12 2024-09-11T22:52:33.059 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-09-11T22:52:33.059 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T22:52:33.299 DEBUG:teuthology.orchestra.run.smithi012:> true 2024-09-11T22:52:33.973 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-09-11T22:52:33.973 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-119-generic"... 2024-09-11T22:52:33.973 DEBUG:teuthology.orchestra.run.smithi012:> uname -r 2024-09-11T22:52:34.022 INFO:teuthology.orchestra.run.smithi012.stdout:5.15.0-119-generic 2024-09-11T22:52:34.022 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-11T22:52:34.022 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T22:52:34.022 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-11T22:52:35.023 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-11T22:52:35.023 DEBUG:teuthology.orchestra.run.smithi012:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-11T22:52:35.094 INFO:teuthology.orchestra.run.smithi012.stdout:ttyS1 2024-09-11T22:52:35.127 DEBUG:teuthology.parallel:result is None 2024-09-11T22:52:35.127 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-11T22:52:35.135 INFO:teuthology.task.internal:Creating test directory... 2024-09-11T22:52:35.135 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T22:52:35.140 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-11T22:52:35.175 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-11T22:52:35.225 INFO:teuthology.task.internal:Creating archive directory... 2024-09-11T22:52:35.226 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T22:52:35.238 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-11T22:52:35.275 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-11T22:52:35.276 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T22:52:35.294 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T22:52:35.303 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T22:52:35.305 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-11T22:52:35.326 INFO:teuthology.task.internal:Configuring sudo... 2024-09-11T22:52:35.326 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T22:52:35.362 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-11T22:52:35.377 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-11T22:52:35.378 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T22:52:35.410 DEBUG:teuthology.orchestra.run.smithi012:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T22:52:35.459 DEBUG:teuthology.orchestra.run.smithi012:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T22:52:35.507 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T22:52:35.507 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T22:52:35.566 DEBUG:teuthology.orchestra.run.smithi012:> sudo service rsyslog restart 2024-09-11T22:52:35.646 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-11T22:52:35.655 INFO:teuthology.task.internal:Starting timer... 2024-09-11T22:52:35.655 INFO:teuthology.run_tasks:Running task pcp... 2024-09-11T22:52:35.688 INFO:teuthology.run_tasks:Running task selinux... 2024-09-11T22:52:35.736 DEBUG:teuthology.task.selinux:Excluding smithi012: OS 'ubuntu' does not support SELinux 2024-09-11T22:52:35.736 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-11T22:52:35.736 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-11T22:52:35.737 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-11T22:52:35.737 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-11T22:52:35.798 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-11T22:52:35.810 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-11T22:52:35.811 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi012.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-11T23:00:15.670 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi012.front.sepia.ceph.com')] 2024-09-11T23:00:15.685 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-09-11T23:00:15.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:00:15.779 DEBUG:teuthology.orchestra.run.smithi012:> true 2024-09-11T23:00:15.861 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-09-11T23:00:15.861 INFO:teuthology.run_tasks:Running task clock... 2024-09-11T23:00:15.872 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-11T23:00:15.873 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T23:00:15.873 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T23:00:15.929 INFO:teuthology.orchestra.run.smithi012.stdout:11 Sep 23:00:15 ntpd[18403]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-11T23:00:15.929 INFO:teuthology.orchestra.run.smithi012.stdout:11 Sep 23:00:15 ntpd[18403]: Command line: ntpd -gq 2024-09-11T23:00:15.929 INFO:teuthology.orchestra.run.smithi012.stdout:11 Sep 23:00:15 ntpd[18403]: ---------------------------------------------------- 2024-09-11T23:00:15.929 INFO:teuthology.orchestra.run.smithi012.stdout:11 Sep 23:00:15 ntpd[18403]: ntp-4 is maintained by Network Time Foundation, 2024-09-11T23:00:15.930 INFO:teuthology.orchestra.run.smithi012.stdout:11 Sep 23:00:15 ntpd[18403]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-11T23:00:15.930 INFO:teuthology.orchestra.run.smithi012.stdout:11 Sep 23:00:15 ntpd[18403]: corporation. Support and training for ntp-4 are 2024-09-11T23:00:15.930 INFO:teuthology.orchestra.run.smithi012.stdout:11 Sep 23:00:15 ntpd[18403]: available at https://www.nwtime.org/support 2024-09-11T23:00:15.930 INFO:teuthology.orchestra.run.smithi012.stdout:11 Sep 23:00:15 ntpd[18403]: ---------------------------------------------------- 2024-09-11T23:00:15.931 INFO:teuthology.orchestra.run.smithi012.stdout:11 Sep 23:00:15 ntpd[18403]: proto: precision = 0.046 usec (-24) 2024-09-11T23:00:15.931 INFO:teuthology.orchestra.run.smithi012.stdout:11 Sep 23:00:15 ntpd[18403]: basedate set to 2022-02-04 2024-09-11T23:00:15.931 INFO:teuthology.orchestra.run.smithi012.stdout:11 Sep 23:00:15 ntpd[18403]: gps base set to 2022-02-06 (week 2196) 2024-09-11T23:00:15.931 INFO:teuthology.orchestra.run.smithi012.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-11T23:00:15.932 INFO:teuthology.orchestra.run.smithi012.stdout:11 Sep 23:00:15 ntpd[18403]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-11T23:00:15.932 INFO:teuthology.orchestra.run.smithi012.stdout:11 Sep 23:00:15 ntpd[18403]: restrict ::: KOD does nothing without LIMITED. 2024-09-11T23:00:15.932 INFO:teuthology.orchestra.run.smithi012.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-11T23:00:15.933 INFO:teuthology.orchestra.run.smithi012.stdout:11 Sep 23:00:15 ntpd[18403]: Listen and drop on 0 v6wildcard [::]:123 2024-09-11T23:00:15.933 INFO:teuthology.orchestra.run.smithi012.stdout:11 Sep 23:00:15 ntpd[18403]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-11T23:00:15.933 INFO:teuthology.orchestra.run.smithi012.stdout:11 Sep 23:00:15 ntpd[18403]: Listen normally on 2 lo 127.0.0.1:123 2024-09-11T23:00:15.933 INFO:teuthology.orchestra.run.smithi012.stdout:11 Sep 23:00:15 ntpd[18403]: Listen normally on 3 ens1f0 172.21.15.12:123 2024-09-11T23:00:15.934 INFO:teuthology.orchestra.run.smithi012.stdout:11 Sep 23:00:15 ntpd[18403]: Listen normally on 4 lo [::1]:123 2024-09-11T23:00:15.934 INFO:teuthology.orchestra.run.smithi012.stdout:11 Sep 23:00:15 ntpd[18403]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fef8:25ea%4]:123 2024-09-11T23:00:15.934 INFO:teuthology.orchestra.run.smithi012.stdout:11 Sep 23:00:15 ntpd[18403]: Listening on routing socket on fd #22 for interface updates 2024-09-11T23:00:16.930 INFO:teuthology.orchestra.run.smithi012.stderr:11 Sep 23:00:16 ntpd[18403]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:00:16.930 INFO:teuthology.orchestra.run.smithi012.stderr:11 Sep 23:00:16 ntpd[18403]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:00:16.930 INFO:teuthology.orchestra.run.smithi012.stderr:11 Sep 23:00:16 ntpd[18403]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:00:16.930 INFO:teuthology.orchestra.run.smithi012.stderr:11 Sep 23:00:16 ntpd[18403]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:00:16.930 INFO:teuthology.orchestra.run.smithi012.stderr:11 Sep 23:00:16 ntpd[18403]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:00:16.930 INFO:teuthology.orchestra.run.smithi012.stderr:11 Sep 23:00:16 ntpd[18403]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:00:16.930 INFO:teuthology.orchestra.run.smithi012.stderr:11 Sep 23:00:16 ntpd[18403]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T23:00:16.930 INFO:teuthology.orchestra.run.smithi012.stderr:11 Sep 23:00:16 ntpd[18403]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T23:00:18.930 INFO:teuthology.orchestra.run.smithi012.stderr:11 Sep 23:00:18 ntpd[18403]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:00:18.930 INFO:teuthology.orchestra.run.smithi012.stderr:11 Sep 23:00:18 ntpd[18403]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:00:18.930 INFO:teuthology.orchestra.run.smithi012.stderr:11 Sep 23:00:18 ntpd[18403]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:00:18.930 INFO:teuthology.orchestra.run.smithi012.stderr:11 Sep 23:00:18 ntpd[18403]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:00:18.930 INFO:teuthology.orchestra.run.smithi012.stderr:11 Sep 23:00:18 ntpd[18403]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T23:00:18.930 INFO:teuthology.orchestra.run.smithi012.stderr:11 Sep 23:00:18 ntpd[18403]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T23:00:19.930 INFO:teuthology.orchestra.run.smithi012.stderr:11 Sep 23:00:19 ntpd[18403]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:00:19.931 INFO:teuthology.orchestra.run.smithi012.stderr:11 Sep 23:00:19 ntpd[18403]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:00:19.931 INFO:teuthology.orchestra.run.smithi012.stderr:11 Sep 23:00:19 ntpd[18403]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:00:19.931 INFO:teuthology.orchestra.run.smithi012.stderr:11 Sep 23:00:19 ntpd[18403]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:00:19.931 INFO:teuthology.orchestra.run.smithi012.stderr:11 Sep 23:00:19 ntpd[18403]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:00:19.931 INFO:teuthology.orchestra.run.smithi012.stderr:11 Sep 23:00:19 ntpd[18403]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:00:19.931 INFO:teuthology.orchestra.run.smithi012.stderr:11 Sep 23:00:19 ntpd[18403]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T23:00:19.931 INFO:teuthology.orchestra.run.smithi012.stderr:11 Sep 23:00:19 ntpd[18403]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T23:00:19.931 INFO:teuthology.orchestra.run.smithi012.stderr:11 Sep 23:00:19 ntpd[18403]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:00:19.931 INFO:teuthology.orchestra.run.smithi012.stderr:11 Sep 23:00:19 ntpd[18403]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:00:19.931 INFO:teuthology.orchestra.run.smithi012.stderr:11 Sep 23:00:19 ntpd[18403]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T23:00:19.932 INFO:teuthology.orchestra.run.smithi012.stderr:11 Sep 23:00:19 ntpd[18403]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T23:00:20.930 INFO:teuthology.orchestra.run.smithi012.stderr:11 Sep 23:00:20 ntpd[18403]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:00:20.930 INFO:teuthology.orchestra.run.smithi012.stderr:11 Sep 23:00:20 ntpd[18403]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:00:20.930 INFO:teuthology.orchestra.run.smithi012.stderr:11 Sep 23:00:20 ntpd[18403]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:00:20.930 INFO:teuthology.orchestra.run.smithi012.stderr:11 Sep 23:00:20 ntpd[18403]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:00:20.930 INFO:teuthology.orchestra.run.smithi012.stderr:11 Sep 23:00:20 ntpd[18403]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T23:00:20.930 INFO:teuthology.orchestra.run.smithi012.stderr:11 Sep 23:00:20 ntpd[18403]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T23:00:21.930 INFO:teuthology.orchestra.run.smithi012.stderr:11 Sep 23:00:21 ntpd[18403]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:00:21.931 INFO:teuthology.orchestra.run.smithi012.stderr:11 Sep 23:00:21 ntpd[18403]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:00:21.931 INFO:teuthology.orchestra.run.smithi012.stderr:11 Sep 23:00:21 ntpd[18403]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:00:21.931 INFO:teuthology.orchestra.run.smithi012.stderr:11 Sep 23:00:21 ntpd[18403]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:00:21.931 INFO:teuthology.orchestra.run.smithi012.stderr:11 Sep 23:00:21 ntpd[18403]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:00:21.931 INFO:teuthology.orchestra.run.smithi012.stderr:11 Sep 23:00:21 ntpd[18403]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:00:21.931 INFO:teuthology.orchestra.run.smithi012.stderr:11 Sep 23:00:21 ntpd[18403]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T23:00:21.931 INFO:teuthology.orchestra.run.smithi012.stderr:11 Sep 23:00:21 ntpd[18403]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T23:00:21.931 INFO:teuthology.orchestra.run.smithi012.stderr:11 Sep 23:00:21 ntpd[18403]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:00:21.931 INFO:teuthology.orchestra.run.smithi012.stderr:11 Sep 23:00:21 ntpd[18403]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:00:21.932 INFO:teuthology.orchestra.run.smithi012.stderr:11 Sep 23:00:21 ntpd[18403]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T23:00:21.932 INFO:teuthology.orchestra.run.smithi012.stderr:11 Sep 23:00:21 ntpd[18403]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T23:00:22.930 INFO:teuthology.orchestra.run.smithi012.stderr:11 Sep 23:00:22 ntpd[18403]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:00:22.930 INFO:teuthology.orchestra.run.smithi012.stderr:11 Sep 23:00:22 ntpd[18403]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:00:22.930 INFO:teuthology.orchestra.run.smithi012.stderr:11 Sep 23:00:22 ntpd[18403]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T23:00:22.930 INFO:teuthology.orchestra.run.smithi012.stderr:11 Sep 23:00:22 ntpd[18403]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T23:00:22.930 INFO:teuthology.orchestra.run.smithi012.stderr:11 Sep 23:00:22 ntpd[18403]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T23:00:22.930 INFO:teuthology.orchestra.run.smithi012.stderr:11 Sep 23:00:22 ntpd[18403]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T23:00:22.931 INFO:teuthology.orchestra.run.smithi012.stdout:11 Sep 23:00:22 ntpd[18403]: ntpd: time slew +0.000025 s 2024-09-11T23:00:22.931 INFO:teuthology.orchestra.run.smithi012.stdout:ntpd: time slew +0.000025s 2024-09-11T23:00:22.931 INFO:teuthology.orchestra.run.smithi012.stderr:11 Sep 23:00:22 ntpd[18403]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-11T23:00:22.931 INFO:teuthology.orchestra.run.smithi012.stderr:11 Sep 23:00:22 ntpd[18403]: can't open /var/log/ntpstats/loopstats.20240911: Permission denied 2024-09-11T23:00:22.997 INFO:teuthology.orchestra.run.smithi012.stdout: remote refid st t when poll reach delay offset jitter 2024-09-11T23:00:22.997 INFO:teuthology.orchestra.run.smithi012.stdout:============================================================================== 2024-09-11T23:00:22.997 INFO:teuthology.orchestra.run.smithi012.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-11T23:00:22.998 INFO:teuthology.orchestra.run.smithi012.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-11T23:00:22.998 INFO:teuthology.orchestra.run.smithi012.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-11T23:00:22.998 INFO:teuthology.orchestra.run.smithi012.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-11T23:00:22.998 INFO:teuthology.run_tasks:Running task install... 2024-09-11T23:00:23.006 DEBUG:teuthology.task.install:project ceph 2024-09-11T23:00:23.006 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}} 2024-09-11T23:00:23.007 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'} 2024-09-11T23:00:23.007 INFO:teuthology.task.install:Using flavor: default 2024-09-11T23:00:23.013 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-11T23:00:23.013 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-11T23:00:23.014 DEBUG:teuthology.orchestra.run.smithi012:> sudo apt-key list | grep Ceph 2024-09-11T23:00:23.100 INFO:teuthology.orchestra.run.smithi012.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-11T23:00:23.130 INFO:teuthology.orchestra.run.smithi012.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-11T23:00:23.130 INFO:teuthology.orchestra.run.smithi012.stdout:uid [ unknown] Ceph.com (release key) 2024-09-11T23:00:23.131 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-11T23:00:23.131 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-11T23:00:23.131 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:00:23.292 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default/ 2024-09-11T23:00:23.293 INFO:teuthology.task.install.deb:Package version is 19.1.1-298-gb53b6d3e-1jammy 2024-09-11T23:00:23.414 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T23:00:23.414 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-11T23:00:23.429 DEBUG:teuthology.orchestra.run.smithi012:> sudo apt-get update 2024-09-11T23:00:23.602 INFO:teuthology.orchestra.run.smithi012.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-11T23:00:23.657 INFO:teuthology.orchestra.run.smithi012.stdout:Ign:2 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy InRelease 2024-09-11T23:00:23.680 INFO:teuthology.orchestra.run.smithi012.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-11T23:00:23.703 INFO:teuthology.orchestra.run.smithi012.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-11T23:00:23.722 INFO:teuthology.orchestra.run.smithi012.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-11T23:00:23.724 INFO:teuthology.orchestra.run.smithi012.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-11T23:00:23.752 INFO:teuthology.orchestra.run.smithi012.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,404 B] 2024-09-11T23:00:23.804 INFO:teuthology.orchestra.run.smithi012.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-11T23:00:23.886 INFO:teuthology.orchestra.run.smithi012.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-11T23:00:24.032 INFO:teuthology.orchestra.run.smithi012.stdout:Fetched 29.0 kB in 0s (69.3 kB/s) 2024-09-11T23:00:25.059 INFO:teuthology.orchestra.run.smithi012.stdout:Reading package lists... 2024-09-11T23:00:25.077 DEBUG:teuthology.orchestra.run.smithi012:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-298-gb53b6d3e-1jammy cephadm=19.1.1-298-gb53b6d3e-1jammy ceph-mds=19.1.1-298-gb53b6d3e-1jammy ceph-mgr=19.1.1-298-gb53b6d3e-1jammy ceph-common=19.1.1-298-gb53b6d3e-1jammy ceph-fuse=19.1.1-298-gb53b6d3e-1jammy ceph-test=19.1.1-298-gb53b6d3e-1jammy ceph-volume=19.1.1-298-gb53b6d3e-1jammy radosgw=19.1.1-298-gb53b6d3e-1jammy python3-rados=19.1.1-298-gb53b6d3e-1jammy python3-rgw=19.1.1-298-gb53b6d3e-1jammy python3-cephfs=19.1.1-298-gb53b6d3e-1jammy python3-rbd=19.1.1-298-gb53b6d3e-1jammy libcephfs2=19.1.1-298-gb53b6d3e-1jammy libcephfs-dev=19.1.1-298-gb53b6d3e-1jammy librados2=19.1.1-298-gb53b6d3e-1jammy librbd1=19.1.1-298-gb53b6d3e-1jammy rbd-fuse=19.1.1-298-gb53b6d3e-1jammy python3-cephfs=19.1.1-298-gb53b6d3e-1jammy cephfs-shell=19.1.1-298-gb53b6d3e-1jammy cephfs-top=19.1.1-298-gb53b6d3e-1jammy cephfs-mirror=19.1.1-298-gb53b6d3e-1jammy 2024-09-11T23:00:25.150 INFO:teuthology.orchestra.run.smithi012.stdout:Reading package lists... 2024-09-11T23:00:25.361 INFO:teuthology.orchestra.run.smithi012.stdout:Building dependency tree... 2024-09-11T23:00:25.361 INFO:teuthology.orchestra.run.smithi012.stdout:Reading state information... 2024-09-11T23:00:25.579 INFO:teuthology.orchestra.run.smithi012.stdout:The following packages were automatically installed and are no longer required: 2024-09-11T23:00:25.579 INFO:teuthology.orchestra.run.smithi012.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-11T23:00:25.579 INFO:teuthology.orchestra.run.smithi012.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-11T23:00:25.579 INFO:teuthology.orchestra.run.smithi012.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-11T23:00:25.580 INFO:teuthology.orchestra.run.smithi012.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-11T23:00:25.580 INFO:teuthology.orchestra.run.smithi012.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-11T23:00:25.580 INFO:teuthology.orchestra.run.smithi012.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-11T23:00:25.580 INFO:teuthology.orchestra.run.smithi012.stdout:The following additional packages will be installed: 2024-09-11T23:00:25.580 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-11T23:00:25.580 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-11T23:00:25.582 INFO:teuthology.orchestra.run.smithi012.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-11T23:00:25.582 INFO:teuthology.orchestra.run.smithi012.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-11T23:00:25.582 INFO:teuthology.orchestra.run.smithi012.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-11T23:00:25.582 INFO:teuthology.orchestra.run.smithi012.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-11T23:00:25.582 INFO:teuthology.orchestra.run.smithi012.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-11T23:00:25.582 INFO:teuthology.orchestra.run.smithi012.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-11T23:00:25.582 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-11T23:00:25.582 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-09-11T23:00:25.582 INFO:teuthology.orchestra.run.smithi012.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-09-11T23:00:25.582 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-11T23:00:25.582 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-11T23:00:25.582 INFO:teuthology.orchestra.run.smithi012.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-11T23:00:25.582 INFO:teuthology.orchestra.run.smithi012.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-11T23:00:25.583 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-11T23:00:25.583 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-11T23:00:25.583 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-09-11T23:00:25.583 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-09-11T23:00:25.583 INFO:teuthology.orchestra.run.smithi012.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-09-11T23:00:25.583 INFO:teuthology.orchestra.run.smithi012.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-09-11T23:00:25.583 INFO:teuthology.orchestra.run.smithi012.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-09-11T23:00:25.583 INFO:teuthology.orchestra.run.smithi012.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-09-11T23:00:25.583 INFO:teuthology.orchestra.run.smithi012.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-09-11T23:00:25.583 INFO:teuthology.orchestra.run.smithi012.stdout:Suggested packages: 2024-09-11T23:00:25.584 INFO:teuthology.orchestra.run.smithi012.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-11T23:00:25.584 INFO:teuthology.orchestra.run.smithi012.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-11T23:00:25.584 INFO:teuthology.orchestra.run.smithi012.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-11T23:00:25.584 INFO:teuthology.orchestra.run.smithi012.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-11T23:00:25.584 INFO:teuthology.orchestra.run.smithi012.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-11T23:00:25.584 INFO:teuthology.orchestra.run.smithi012.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-11T23:00:25.584 INFO:teuthology.orchestra.run.smithi012.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-11T23:00:25.584 INFO:teuthology.orchestra.run.smithi012.stdout:Recommended packages: 2024-09-11T23:00:25.584 INFO:teuthology.orchestra.run.smithi012.stdout: btrfs-tools 2024-09-11T23:00:25.698 INFO:teuthology.orchestra.run.smithi012.stdout:The following NEW packages will be installed: 2024-09-11T23:00:25.699 INFO:teuthology.orchestra.run.smithi012.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-11T23:00:25.699 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-11T23:00:25.700 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-11T23:00:25.700 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-09-11T23:00:25.700 INFO:teuthology.orchestra.run.smithi012.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-11T23:00:25.700 INFO:teuthology.orchestra.run.smithi012.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-09-11T23:00:25.700 INFO:teuthology.orchestra.run.smithi012.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-09-11T23:00:25.701 INFO:teuthology.orchestra.run.smithi012.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-09-11T23:00:25.701 INFO:teuthology.orchestra.run.smithi012.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-09-11T23:00:25.701 INFO:teuthology.orchestra.run.smithi012.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-11T23:00:25.701 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-11T23:00:25.702 INFO:teuthology.orchestra.run.smithi012.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-09-11T23:00:25.702 INFO:teuthology.orchestra.run.smithi012.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-09-11T23:00:25.702 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-11T23:00:25.702 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-11T23:00:25.702 INFO:teuthology.orchestra.run.smithi012.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-11T23:00:25.702 INFO:teuthology.orchestra.run.smithi012.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-11T23:00:25.702 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-11T23:00:25.702 INFO:teuthology.orchestra.run.smithi012.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-11T23:00:25.702 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-09-11T23:00:25.702 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-11T23:00:25.702 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-11T23:00:25.702 INFO:teuthology.orchestra.run.smithi012.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-11T23:00:25.702 INFO:teuthology.orchestra.run.smithi012.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-11T23:00:25.702 INFO:teuthology.orchestra.run.smithi012.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-11T23:00:25.703 INFO:teuthology.orchestra.run.smithi012.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-11T23:00:25.703 INFO:teuthology.orchestra.run.smithi012.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-11T23:00:25.703 INFO:teuthology.orchestra.run.smithi012.stdout: socat unzip xmlstarlet zip 2024-09-11T23:00:25.844 INFO:teuthology.orchestra.run.smithi012.stdout:0 upgraded, 124 newly installed, 0 to remove and 331 not upgraded. 2024-09-11T23:00:25.844 INFO:teuthology.orchestra.run.smithi012.stdout:Need to get 181 MB of archives. 2024-09-11T23:00:25.844 INFO:teuthology.orchestra.run.smithi012.stdout:After this operation, 831 MB of additional disk space will be used. 2024-09-11T23:00:25.845 INFO:teuthology.orchestra.run.smithi012.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-298-gb53b6d3e-1jammy [3,588 kB] 2024-09-11T23:00:25.889 INFO:teuthology.orchestra.run.smithi012.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-09-11T23:00:25.972 INFO:teuthology.orchestra.run.smithi012.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-11T23:00:26.018 INFO:teuthology.orchestra.run.smithi012.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-09-11T23:00:26.034 INFO:teuthology.orchestra.run.smithi012.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-298-gb53b6d3e-1jammy [3,243 kB] 2024-09-11T23:00:26.081 INFO:teuthology.orchestra.run.smithi012.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-298-gb53b6d3e-1jammy [719 kB] 2024-09-11T23:00:26.090 INFO:teuthology.orchestra.run.smithi012.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-298-gb53b6d3e-1jammy [356 kB] 2024-09-11T23:00:26.095 INFO:teuthology.orchestra.run.smithi012.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-298-gb53b6d3e-1jammy [32.8 kB] 2024-09-11T23:00:26.095 INFO:teuthology.orchestra.run.smithi012.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-298-gb53b6d3e-1jammy [180 kB] 2024-09-11T23:00:26.099 INFO:teuthology.orchestra.run.smithi012.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-298-gb53b6d3e-1jammy [67.6 kB] 2024-09-11T23:00:26.100 INFO:teuthology.orchestra.run.smithi012.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-298-gb53b6d3e-1jammy [333 kB] 2024-09-11T23:00:26.105 INFO:teuthology.orchestra.run.smithi012.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-298-gb53b6d3e-1jammy [6,875 kB] 2024-09-11T23:00:26.213 INFO:teuthology.orchestra.run.smithi012.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-11T23:00:26.219 INFO:teuthology.orchestra.run.smithi012.stdout:Get:14 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-298-gb53b6d3e-1jammy [112 kB] 2024-09-11T23:00:26.221 INFO:teuthology.orchestra.run.smithi012.stdout:Get:15 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-298-gb53b6d3e-1jammy [472 kB] 2024-09-11T23:00:26.227 INFO:teuthology.orchestra.run.smithi012.stdout:Get:16 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-298-gb53b6d3e-1jammy [25.9 MB] 2024-09-11T23:00:26.305 INFO:teuthology.orchestra.run.smithi012.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-11T23:00:26.319 INFO:teuthology.orchestra.run.smithi012.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-11T23:00:26.369 INFO:teuthology.orchestra.run.smithi012.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-11T23:00:26.541 INFO:teuthology.orchestra.run.smithi012.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-11T23:00:26.550 INFO:teuthology.orchestra.run.smithi012.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-11T23:00:26.577 INFO:teuthology.orchestra.run.smithi012.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-11T23:00:26.585 INFO:teuthology.orchestra.run.smithi012.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-11T23:00:26.587 INFO:teuthology.orchestra.run.smithi012.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-11T23:00:26.604 INFO:teuthology.orchestra.run.smithi012.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-11T23:00:26.609 INFO:teuthology.orchestra.run.smithi012.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-11T23:00:26.614 INFO:teuthology.orchestra.run.smithi012.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-11T23:00:26.616 INFO:teuthology.orchestra.run.smithi012.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-11T23:00:26.624 INFO:teuthology.orchestra.run.smithi012.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-11T23:00:26.699 INFO:teuthology.orchestra.run.smithi012.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-11T23:00:26.721 INFO:teuthology.orchestra.run.smithi012.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-11T23:00:26.785 INFO:teuthology.orchestra.run.smithi012.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-11T23:00:26.785 INFO:teuthology.orchestra.run.smithi012.stdout:Get:33 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-298-gb53b6d3e-1jammy [5,145 kB] 2024-09-11T23:00:26.788 INFO:teuthology.orchestra.run.smithi012.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-11T23:00:26.789 INFO:teuthology.orchestra.run.smithi012.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-11T23:00:26.789 INFO:teuthology.orchestra.run.smithi012.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-11T23:00:26.790 INFO:teuthology.orchestra.run.smithi012.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-11T23:00:26.790 INFO:teuthology.orchestra.run.smithi012.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-11T23:00:26.791 INFO:teuthology.orchestra.run.smithi012.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-11T23:00:26.792 INFO:teuthology.orchestra.run.smithi012.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-11T23:00:26.851 INFO:teuthology.orchestra.run.smithi012.stdout:Get:41 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-298-gb53b6d3e-1jammy [245 kB] 2024-09-11T23:00:26.854 INFO:teuthology.orchestra.run.smithi012.stdout:Get:42 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-298-gb53b6d3e-1jammy [124 kB] 2024-09-11T23:00:26.855 INFO:teuthology.orchestra.run.smithi012.stdout:Get:43 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-298-gb53b6d3e-1jammy [1,555 kB] 2024-09-11T23:00:26.868 INFO:teuthology.orchestra.run.smithi012.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-11T23:00:26.869 INFO:teuthology.orchestra.run.smithi012.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-11T23:00:26.869 INFO:teuthology.orchestra.run.smithi012.stdout:Get:46 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-298-gb53b6d3e-1jammy [6,143 kB] 2024-09-11T23:00:26.950 INFO:teuthology.orchestra.run.smithi012.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-11T23:00:26.951 INFO:teuthology.orchestra.run.smithi012.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-11T23:00:26.952 INFO:teuthology.orchestra.run.smithi012.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-11T23:00:26.952 INFO:teuthology.orchestra.run.smithi012.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-11T23:00:26.954 INFO:teuthology.orchestra.run.smithi012.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-11T23:00:26.955 INFO:teuthology.orchestra.run.smithi012.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-11T23:00:26.956 INFO:teuthology.orchestra.run.smithi012.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-11T23:00:26.956 INFO:teuthology.orchestra.run.smithi012.stdout:Get:54 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-298-gb53b6d3e-1jammy [22.8 MB] 2024-09-11T23:00:26.958 INFO:teuthology.orchestra.run.smithi012.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-11T23:00:27.031 INFO:teuthology.orchestra.run.smithi012.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-11T23:00:27.032 INFO:teuthology.orchestra.run.smithi012.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-11T23:00:27.114 INFO:teuthology.orchestra.run.smithi012.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-11T23:00:27.114 INFO:teuthology.orchestra.run.smithi012.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-11T23:00:27.115 INFO:teuthology.orchestra.run.smithi012.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-11T23:00:27.116 INFO:teuthology.orchestra.run.smithi012.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-11T23:00:27.118 INFO:teuthology.orchestra.run.smithi012.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-11T23:00:27.122 INFO:teuthology.orchestra.run.smithi012.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-11T23:00:27.123 INFO:teuthology.orchestra.run.smithi012.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-11T23:00:27.126 INFO:teuthology.orchestra.run.smithi012.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-11T23:00:27.195 INFO:teuthology.orchestra.run.smithi012.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-11T23:00:27.201 INFO:teuthology.orchestra.run.smithi012.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-11T23:00:27.276 INFO:teuthology.orchestra.run.smithi012.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-11T23:00:27.277 INFO:teuthology.orchestra.run.smithi012.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-11T23:00:27.282 INFO:teuthology.orchestra.run.smithi012.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-11T23:00:27.403 INFO:teuthology.orchestra.run.smithi012.stdout:Get:71 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-298-gb53b6d3e-1jammy [14.1 kB] 2024-09-11T23:00:27.404 INFO:teuthology.orchestra.run.smithi012.stdout:Get:72 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-298-gb53b6d3e-1jammy [877 kB] 2024-09-11T23:00:27.414 INFO:teuthology.orchestra.run.smithi012.stdout:Get:73 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-298-gb53b6d3e-1jammy [2,462 kB] 2024-09-11T23:00:27.442 INFO:teuthology.orchestra.run.smithi012.stdout:Get:74 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-298-gb53b6d3e-1jammy [794 kB] 2024-09-11T23:00:27.446 INFO:teuthology.orchestra.run.smithi012.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-11T23:00:27.447 INFO:teuthology.orchestra.run.smithi012.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-11T23:00:27.450 INFO:teuthology.orchestra.run.smithi012.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-11T23:00:27.451 INFO:teuthology.orchestra.run.smithi012.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-11T23:00:27.452 INFO:teuthology.orchestra.run.smithi012.stdout:Get:79 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-298-gb53b6d3e-1jammy [152 kB] 2024-09-11T23:00:27.453 INFO:teuthology.orchestra.run.smithi012.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-11T23:00:27.454 INFO:teuthology.orchestra.run.smithi012.stdout:Get:81 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-298-gb53b6d3e-1jammy [2,284 kB] 2024-09-11T23:00:27.476 INFO:teuthology.orchestra.run.smithi012.stdout:Get:82 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-298-gb53b6d3e-1jammy [8,625 kB] 2024-09-11T23:00:27.490 INFO:teuthology.orchestra.run.smithi012.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-11T23:00:27.521 INFO:teuthology.orchestra.run.smithi012.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-11T23:00:27.522 INFO:teuthology.orchestra.run.smithi012.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-11T23:00:27.557 INFO:teuthology.orchestra.run.smithi012.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-11T23:00:27.558 INFO:teuthology.orchestra.run.smithi012.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-11T23:00:27.613 INFO:teuthology.orchestra.run.smithi012.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-298-gb53b6d3e-1jammy [14.2 kB] 2024-09-11T23:00:27.613 INFO:teuthology.orchestra.run.smithi012.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-298-gb53b6d3e-1jammy [51.4 MB] 2024-09-11T23:00:27.613 INFO:teuthology.orchestra.run.smithi012.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-11T23:00:27.614 INFO:teuthology.orchestra.run.smithi012.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-11T23:00:27.615 INFO:teuthology.orchestra.run.smithi012.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-11T23:00:27.616 INFO:teuthology.orchestra.run.smithi012.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-11T23:00:27.617 INFO:teuthology.orchestra.run.smithi012.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-11T23:00:27.618 INFO:teuthology.orchestra.run.smithi012.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-11T23:00:27.626 INFO:teuthology.orchestra.run.smithi012.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-11T23:00:27.694 INFO:teuthology.orchestra.run.smithi012.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-11T23:00:27.698 INFO:teuthology.orchestra.run.smithi012.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-11T23:00:27.699 INFO:teuthology.orchestra.run.smithi012.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-11T23:00:27.776 INFO:teuthology.orchestra.run.smithi012.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-11T23:00:27.782 INFO:teuthology.orchestra.run.smithi012.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-09-11T23:00:27.783 INFO:teuthology.orchestra.run.smithi012.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-11T23:00:27.785 INFO:teuthology.orchestra.run.smithi012.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-11T23:00:27.786 INFO:teuthology.orchestra.run.smithi012.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-11T23:00:27.798 INFO:teuthology.orchestra.run.smithi012.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-11T23:00:27.799 INFO:teuthology.orchestra.run.smithi012.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-11T23:00:27.857 INFO:teuthology.orchestra.run.smithi012.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-11T23:00:27.858 INFO:teuthology.orchestra.run.smithi012.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-11T23:00:27.860 INFO:teuthology.orchestra.run.smithi012.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-11T23:00:27.939 INFO:teuthology.orchestra.run.smithi012.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-11T23:00:27.943 INFO:teuthology.orchestra.run.smithi012.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-11T23:00:27.944 INFO:teuthology.orchestra.run.smithi012.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-11T23:00:27.961 INFO:teuthology.orchestra.run.smithi012.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-11T23:00:27.962 INFO:teuthology.orchestra.run.smithi012.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-11T23:00:27.963 INFO:teuthology.orchestra.run.smithi012.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-11T23:00:27.968 INFO:teuthology.orchestra.run.smithi012.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-11T23:00:28.021 INFO:teuthology.orchestra.run.smithi012.stdout:Get:117 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-11T23:00:28.684 INFO:teuthology.orchestra.run.smithi012.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-298-gb53b6d3e-1jammy [130 kB] 2024-09-11T23:00:28.686 INFO:teuthology.orchestra.run.smithi012.stdout:Get:119 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.1.1-298-gb53b6d3e-1jammy [237 kB] 2024-09-11T23:00:28.691 INFO:teuthology.orchestra.run.smithi012.stdout:Get:120 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.1.1-298-gb53b6d3e-1jammy [34.0 kB] 2024-09-11T23:00:28.691 INFO:teuthology.orchestra.run.smithi012.stdout:Get:121 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.1.1-298-gb53b6d3e-1jammy [23.5 kB] 2024-09-11T23:00:28.692 INFO:teuthology.orchestra.run.smithi012.stdout:Get:122 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-298-gb53b6d3e-1jammy [39.0 kB] 2024-09-11T23:00:28.693 INFO:teuthology.orchestra.run.smithi012.stdout:Get:123 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-298-gb53b6d3e-1jammy [13.6 MB] 2024-09-11T23:00:28.893 INFO:teuthology.orchestra.run.smithi012.stdout:Get:124 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-298-gb53b6d3e-1jammy [91.5 kB] 2024-09-11T23:00:29.546 INFO:teuthology.orchestra.run.smithi012.stdout:Fetched 181 MB in 3s (57.0 MB/s) 2024-09-11T23:00:29.679 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-11T23:00:29.775 INFO:teuthology.orchestra.run.smithi012.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-11T23:00:29.781 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-09-11T23:00:29.819 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-09-11T23:00:30.089 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-11T23:00:30.116 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-11T23:00:30.147 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-11T23:00:30.467 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-cmd2. 2024-09-11T23:00:30.493 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-09-11T23:00:30.533 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-09-11T23:00:30.878 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-11T23:00:30.905 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-11T23:00:30.986 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-11T23:00:31.315 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-11T23:00:31.342 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-11T23:00:31.381 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-11T23:00:31.726 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-11T23:00:31.753 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-11T23:00:31.793 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-11T23:00:32.155 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-11T23:00:32.182 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-11T23:00:32.246 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-11T23:00:32.658 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-11T23:00:32.685 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-11T23:00:32.724 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-11T23:00:33.069 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-11T23:00:33.096 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-11T23:00:33.135 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-11T23:00:33.438 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-11T23:00:33.465 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-11T23:00:33.505 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-11T23:00:33.825 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package librados2. 2024-09-11T23:00:33.852 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../010-librados2_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:00:33.891 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking librados2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:00:34.336 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package librbd1. 2024-09-11T23:00:34.362 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../011-librbd1_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:00:34.402 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking librbd1 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:00:34.821 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libcephfs2. 2024-09-11T23:00:34.837 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../012-libcephfs2_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:00:34.871 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libcephfs2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:00:35.132 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-rados. 2024-09-11T23:00:35.148 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../013-python3-rados_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:00:35.191 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-rados (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:00:35.552 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-11T23:00:35.579 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T23:00:35.618 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-ceph-argparse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:00:35.871 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-cephfs. 2024-09-11T23:00:35.898 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../015-python3-cephfs_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:00:35.946 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-cephfs (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:00:36.224 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-11T23:00:36.239 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../016-python3-ceph-common_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T23:00:36.274 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-ceph-common (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:00:36.560 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-prettytable. 2024-09-11T23:00:36.587 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-09-11T23:00:36.626 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-11T23:00:36.871 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-rbd. 2024-09-11T23:00:36.897 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../018-python3-rbd_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:00:36.937 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-rbd (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:00:37.274 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-11T23:00:37.300 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-11T23:00:37.340 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-11T23:00:37.609 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-11T23:00:37.636 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-11T23:00:37.676 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-11T23:00:37.945 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-11T23:00:37.961 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-11T23:00:37.995 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-11T23:00:38.324 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package lua5.1. 2024-09-11T23:00:38.351 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-11T23:00:38.390 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-11T23:00:38.702 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package lua-any. 2024-09-11T23:00:38.729 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-09-11T23:00:38.768 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-11T23:00:39.004 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package zip. 2024-09-11T23:00:39.020 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-09-11T23:00:39.054 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking zip (3.0-12build2) ... 2024-09-11T23:00:39.357 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package unzip. 2024-09-11T23:00:39.384 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-11T23:00:39.424 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-11T23:00:39.794 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package luarocks. 2024-09-11T23:00:39.821 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-11T23:00:39.861 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-11T23:00:40.265 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package librgw2. 2024-09-11T23:00:40.293 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../027-librgw2_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:00:40.335 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking librgw2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:00:40.846 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-rgw. 2024-09-11T23:00:40.862 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../028-python3-rgw_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:00:40.895 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-rgw (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:00:41.232 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-11T23:00:41.259 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-11T23:00:41.300 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-11T23:00:41.610 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libradosstriper1. 2024-09-11T23:00:41.637 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../030-libradosstriper1_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:00:41.676 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libradosstriper1 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:00:42.046 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-common. 2024-09-11T23:00:42.073 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../031-ceph-common_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:00:42.104 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-common (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:00:43.526 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-base. 2024-09-11T23:00:43.553 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../032-ceph-base_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:00:43.603 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-base (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:00:44.414 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-11T23:00:44.441 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-11T23:00:44.480 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-11T23:00:44.800 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-cheroot. 2024-09-11T23:00:44.827 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-11T23:00:44.866 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-11T23:00:45.144 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-11T23:00:45.171 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-11T23:00:45.211 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-11T23:00:45.480 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-11T23:00:45.507 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-11T23:00:45.547 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-11T23:00:45.850 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-11T23:00:45.877 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-11T23:00:45.916 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-11T23:00:46.219 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-tempora. 2024-09-11T23:00:46.246 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-09-11T23:00:46.286 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-11T23:00:46.547 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-portend. 2024-09-11T23:00:46.574 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-09-11T23:00:46.605 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-11T23:00:46.908 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-11T23:00:46.936 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-11T23:00:46.975 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-11T23:00:47.261 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-11T23:00:47.288 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-11T23:00:47.327 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-11T23:00:47.648 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-natsort. 2024-09-11T23:00:47.675 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-09-11T23:00:47.714 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-11T23:00:48.009 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-logutils. 2024-09-11T23:00:48.036 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-09-11T23:00:48.075 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-11T23:00:48.378 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-11T23:00:48.394 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-11T23:00:48.436 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-11T23:00:48.706 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-mako. 2024-09-11T23:00:48.733 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-11T23:00:48.773 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-11T23:00:49.084 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-11T23:00:49.111 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-11T23:00:49.151 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-11T23:00:49.437 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-11T23:00:49.464 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-11T23:00:49.503 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-11T23:00:49.823 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-webob. 2024-09-11T23:00:49.850 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-11T23:00:49.889 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-11T23:00:50.243 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-waitress. 2024-09-11T23:00:50.270 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-11T23:00:50.312 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-11T23:00:50.595 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-tempita. 2024-09-11T23:00:50.622 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-11T23:00:50.653 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-11T23:00:50.941 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-paste. 2024-09-11T23:00:50.967 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-11T23:00:51.006 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-11T23:00:51.334 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-11T23:00:51.350 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-11T23:00:51.392 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-11T23:00:51.662 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-11T23:00:51.689 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-11T23:00:51.728 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-11T23:00:52.032 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-webtest. 2024-09-11T23:00:52.060 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-09-11T23:00:52.098 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-11T23:00:52.419 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-pecan. 2024-09-11T23:00:52.437 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-11T23:00:52.476 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-11T23:00:52.847 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-certifi. 2024-09-11T23:00:52.875 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-09-11T23:00:52.914 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-11T23:00:53.200 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-idna. 2024-09-11T23:00:53.227 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../057-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-11T23:00:53.258 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-11T23:00:53.561 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-urllib3. 2024-09-11T23:00:53.588 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-11T23:00:53.628 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-11T23:00:53.948 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-requests. 2024-09-11T23:00:53.975 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-11T23:00:54.023 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-11T23:00:54.317 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-11T23:00:54.344 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-11T23:00:54.383 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-11T23:00:54.654 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-11T23:00:54.681 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T23:00:54.720 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-mgr-modules-core (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:00:55.116 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-11T23:00:55.144 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:00:55.183 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:00:55.444 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-11T23:00:55.460 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-11T23:00:55.502 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-11T23:00:55.805 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-openssl. 2024-09-11T23:00:55.832 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-09-11T23:00:55.871 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-11T23:00:56.208 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-mgr. 2024-09-11T23:00:56.235 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../065-ceph-mgr_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:00:56.274 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-mgr (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:00:56.636 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-mon. 2024-09-11T23:00:56.663 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../066-ceph-mon_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:00:56.694 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-mon (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:00:57.273 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-osd. 2024-09-11T23:00:57.300 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../067-ceph-osd_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:00:57.347 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-osd (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:00:58.417 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph. 2024-09-11T23:00:58.445 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../068-ceph_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:00:58.484 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:00:58.786 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-fuse. 2024-09-11T23:00:58.813 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../069-ceph-fuse_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:00:58.852 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-fuse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:01:00.277 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-mds. 2024-09-11T23:01:00.302 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../070-ceph-mds_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:01:00.341 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-mds (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:01:00.736 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package cephadm. 2024-09-11T23:01:00.763 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../071-cephadm_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:01:00.802 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking cephadm (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:01:01.080 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-11T23:01:01.107 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-11T23:01:01.163 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-11T23:01:01.474 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-11T23:01:01.490 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-11T23:01:01.541 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-11T23:01:02.479 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-babel. 2024-09-11T23:01:02.497 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-11T23:01:02.537 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-11T23:01:02.832 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-jinja2. 2024-09-11T23:01:02.859 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-11T23:01:02.890 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-11T23:01:03.210 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-11T23:01:03.237 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T23:01:03.268 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-mgr-cephadm (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:01:03.571 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-11T23:01:03.599 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-09-11T23:01:03.637 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-11T23:01:03.915 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-routes. 2024-09-11T23:01:03.943 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-11T23:01:03.981 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-11T23:01:04.268 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-11T23:01:04.284 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T23:01:04.318 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-mgr-dashboard (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:01:05.556 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-11T23:01:05.573 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-11T23:01:05.614 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-11T23:01:06.118 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-joblib. 2024-09-11T23:01:06.146 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-11T23:01:06.185 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-11T23:01:06.538 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-11T23:01:06.566 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-11T23:01:06.681 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-11T23:01:06.993 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-sklearn. 2024-09-11T23:01:07.021 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-11T23:01:07.059 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-11T23:01:07.735 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-11T23:01:07.763 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T23:01:07.801 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:01:08.772 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-cachetools. 2024-09-11T23:01:08.799 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-09-11T23:01:08.837 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-11T23:01:09.141 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-11T23:01:09.168 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-11T23:01:09.215 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-11T23:01:09.519 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-11T23:01:09.547 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-11T23:01:09.585 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-11T23:01:09.871 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-rsa. 2024-09-11T23:01:09.888 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-09-11T23:01:09.921 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-11T23:01:10.242 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-google-auth. 2024-09-11T23:01:10.270 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-09-11T23:01:10.309 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-11T23:01:10.587 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-11T23:01:10.603 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-11T23:01:10.636 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-11T23:01:10.965 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-websocket. 2024-09-11T23:01:10.993 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-09-11T23:01:11.031 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-11T23:01:11.343 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-11T23:01:11.371 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-11T23:01:11.409 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-11T23:01:11.998 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-11T23:01:12.015 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T23:01:12.048 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:01:12.334 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-11T23:01:12.362 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-11T23:01:12.401 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-11T23:01:12.737 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-11T23:01:12.765 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-11T23:01:12.805 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-11T23:01:13.057 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package jq. 2024-09-11T23:01:13.159 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-11T23:01:13.160 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-11T23:01:13.325 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package socat. 2024-09-11T23:01:13.342 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-11T23:01:13.383 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-11T23:01:13.678 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package xmlstarlet. 2024-09-11T23:01:13.695 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-11T23:01:13.736 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-11T23:01:14.057 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-test. 2024-09-11T23:01:14.086 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../099-ceph-test_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:01:14.115 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-test (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:01:16.428 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-volume. 2024-09-11T23:01:16.453 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../100-ceph-volume_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T23:01:16.494 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-volume (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:01:16.849 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-11T23:01:16.877 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../101-cephfs-mirror_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:01:16.915 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking cephfs-mirror (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:01:17.226 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-colorama. 2024-09-11T23:01:17.254 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-09-11T23:01:17.293 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-09-11T23:01:17.553 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package cephfs-shell. 2024-09-11T23:01:17.581 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../103-cephfs-shell_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T23:01:17.620 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking cephfs-shell (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:01:17.839 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package cephfs-top. 2024-09-11T23:01:17.856 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../104-cephfs-top_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T23:01:17.897 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking cephfs-top (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:01:18.150 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-11T23:01:18.178 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../105-libcephfs-dev_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:01:18.217 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libcephfs-dev (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:01:18.528 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-11T23:01:18.556 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-11T23:01:18.594 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-11T23:01:18.882 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-11T23:01:18.969 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-09-11T23:01:18.969 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-11T23:01:19.311 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package nvme-cli. 2024-09-11T23:01:19.323 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-11T23:01:19.361 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-11T23:01:19.808 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package pkg-config. 2024-09-11T23:01:19.836 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-11T23:01:19.866 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-11T23:01:20.135 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-11T23:01:20.152 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-11T23:01:20.193 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-11T23:01:20.697 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-11T23:01:20.725 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-11T23:01:20.763 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-11T23:01:21.008 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-pastescript. 2024-09-11T23:01:21.036 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-09-11T23:01:21.074 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-11T23:01:21.377 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-pluggy. 2024-09-11T23:01:21.406 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-11T23:01:21.444 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-11T23:01:21.755 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-psutil. 2024-09-11T23:01:21.783 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-11T23:01:21.821 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-11T23:01:22.166 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-py. 2024-09-11T23:01:22.194 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-09-11T23:01:22.233 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-11T23:01:22.553 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-pygments. 2024-09-11T23:01:22.581 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-11T23:01:22.619 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-11T23:01:23.056 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-11T23:01:23.085 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-11T23:01:23.123 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-11T23:01:23.409 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-toml. 2024-09-11T23:01:23.437 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-09-11T23:01:23.475 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-11T23:01:23.711 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-pytest. 2024-09-11T23:01:23.728 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-11T23:01:23.795 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-11T23:01:24.132 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-simplejson. 2024-09-11T23:01:24.160 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-11T23:01:24.198 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-11T23:01:24.443 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-11T23:01:24.459 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-11T23:01:24.492 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-11T23:01:25.205 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package radosgw. 2024-09-11T23:01:25.233 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../122-radosgw_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:01:25.262 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking radosgw (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:01:26.082 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package rbd-fuse. 2024-09-11T23:01:26.111 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../123-rbd-fuse_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T23:01:26.149 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking rbd-fuse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:01:26.446 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-11T23:01:26.695 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-11T23:01:26.796 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-11T23:01:27.062 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-11T23:01:27.376 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-11T23:01:27.781 INFO:teuthology.orchestra.run.smithi012.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-11T23:01:27.849 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up cephadm (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:01:28.415 INFO:teuthology.orchestra.run.smithi012.stdout:Adding system user cephadm....done 2024-09-11T23:01:28.538 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-11T23:01:28.814 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-11T23:01:29.074 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-11T23:01:29.175 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-11T23:01:29.426 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-11T23:01:29.685 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-11T23:01:29.811 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-11T23:01:30.113 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-11T23:01:30.490 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-11T23:01:30.733 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-09-11T23:01:31.001 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-11T23:01:31.294 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-11T23:01:31.545 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-11T23:01:31.805 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-11T23:01:32.072 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-11T23:01:32.324 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-ceph-argparse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:01:32.583 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-11T23:01:32.709 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-11T23:01:32.835 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-09-11T23:01:33.094 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-11T23:01:33.220 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-11T23:01:33.480 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-11T23:01:33.863 INFO:teuthology.orchestra.run.smithi012.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-11T23:01:33.894 INFO:teuthology.orchestra.run.smithi012.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-11T23:01:33.983 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-11T23:01:34.109 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-11T23:01:34.477 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-11T23:01:34.603 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-11T23:01:34.879 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-11T23:01:35.138 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-11T23:01:35.447 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up zip (3.0-12build2) ... 2024-09-11T23:01:35.574 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-11T23:01:36.267 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-11T23:01:36.527 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-11T23:01:36.628 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-11T23:01:36.729 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-11T23:01:37.047 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-11T23:01:37.431 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-11T23:01:37.682 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-11T23:01:38.059 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-11T23:01:38.360 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-09-11T23:01:38.661 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-11T23:01:39.021 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-11T23:01:39.280 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-11T23:01:39.381 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-ceph-common (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:01:39.674 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-11T23:01:40.000 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-11T23:01:41.232 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-11T23:01:41.475 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-11T23:01:41.608 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-11T23:01:41.868 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-11T23:01:41.994 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-11T23:01:42.120 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-11T23:01:42.430 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-11T23:01:42.689 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-11T23:01:42.932 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-11T23:01:43.058 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-11T23:01:43.367 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-11T23:01:43.619 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-11T23:01:43.870 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-11T23:01:44.129 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-11T23:01:44.388 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-11T23:01:44.656 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-11T23:01:44.765 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-11T23:01:45.058 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-11T23:01:45.193 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-11T23:01:45.485 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-11T23:01:45.796 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-11T23:01:46.054 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-11T23:01:46.172 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-11T23:01:46.292 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-11T23:01:46.381 INFO:teuthology.orchestra.run.smithi012.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-11T23:01:46.651 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-11T23:01:46.753 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-11T23:01:47.171 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-11T23:01:47.430 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-11T23:01:47.556 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-11T23:01:47.808 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-11T23:01:47.933 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-11T23:01:48.252 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-11T23:01:48.536 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-11T23:01:48.828 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-11T23:01:49.040 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-11T23:01:49.316 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-11T23:01:49.584 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-11T23:01:49.827 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-11T23:01:50.287 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-11T23:01:50.589 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-11T23:01:50.942 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-11T23:01:51.068 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up librados2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:01:51.402 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libsqlite3-mod-ceph (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:01:51.720 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-11T23:01:52.056 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libcephfs2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:01:52.182 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libradosstriper1 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:01:52.308 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-11T23:01:52.601 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up librbd1 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:01:52.727 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-mgr-modules-core (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:01:52.853 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-fuse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:01:53.064 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-11T23:01:53.065 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-11T23:01:53.563 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libcephfs-dev (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:01:53.689 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-rados (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:01:53.815 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up librgw2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:01:53.941 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up cephfs-top (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:01:54.050 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-11T23:01:55.296 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-rbd (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:01:55.397 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up rbd-fuse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:01:55.523 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-rgw (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:01:55.649 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-cephfs (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:01:55.775 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up cephfs-shell (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:01:55.901 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-common (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:01:56.385 INFO:teuthology.orchestra.run.smithi012.stdout:Adding group ceph....done 2024-09-11T23:01:56.754 INFO:teuthology.orchestra.run.smithi012.stdout:Adding system user ceph....done 2024-09-11T23:01:56.931 INFO:teuthology.orchestra.run.smithi012.stdout:Setting system user ceph properties....done 2024-09-11T23:01:56.949 INFO:teuthology.orchestra.run.smithi012.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-11T23:01:57.103 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-11T23:01:57.444 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-11T23:01:57.911 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up cephfs-mirror (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:01:58.126 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-11T23:01:58.126 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-11T23:01:58.613 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-test (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:01:58.738 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up radosgw (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:01:59.207 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-11T23:01:59.207 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-11T23:01:59.709 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-base (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:02:00.142 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-11T23:02:00.635 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-mds (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:02:00.866 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-11T23:02:00.866 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-11T23:02:01.312 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-mgr (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:02:01.521 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-11T23:02:01.521 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-11T23:02:01.972 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-osd (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:02:02.270 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-11T23:02:02.270 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-11T23:02:02.732 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-mgr-k8sevents (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:02:02.858 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:02:03.034 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-mon (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:02:03.251 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-11T23:02:03.251 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-11T23:02:03.775 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-mgr-cephadm (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:02:03.953 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:02:04.063 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-mgr-dashboard (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:02:04.214 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-volume (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T23:02:04.617 INFO:teuthology.orchestra.run.smithi012.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-11T23:02:04.718 INFO:teuthology.orchestra.run.smithi012.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-11T23:02:04.870 INFO:teuthology.orchestra.run.smithi012.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-11T23:02:05.596 INFO:teuthology.orchestra.run.smithi012.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-11T23:02:06.244 INFO:teuthology.orchestra.run.smithi012.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-11T23:02:06.247 DEBUG:teuthology.orchestra.run.smithi012:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-11T23:02:06.302 INFO:teuthology.orchestra.run.smithi012.stdout:Reading package lists... 2024-09-11T23:02:06.515 INFO:teuthology.orchestra.run.smithi012.stdout:Building dependency tree... 2024-09-11T23:02:06.516 INFO:teuthology.orchestra.run.smithi012.stdout:Reading state information... 2024-09-11T23:02:06.732 INFO:teuthology.orchestra.run.smithi012.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-09-11T23:02:06.733 INFO:teuthology.orchestra.run.smithi012.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-11T23:02:06.733 INFO:teuthology.orchestra.run.smithi012.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-11T23:02:06.733 INFO:teuthology.orchestra.run.smithi012.stdout:The following packages were automatically installed and are no longer required: 2024-09-11T23:02:06.733 INFO:teuthology.orchestra.run.smithi012.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-11T23:02:06.733 INFO:teuthology.orchestra.run.smithi012.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-11T23:02:06.733 INFO:teuthology.orchestra.run.smithi012.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-11T23:02:06.734 INFO:teuthology.orchestra.run.smithi012.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-11T23:02:06.734 INFO:teuthology.orchestra.run.smithi012.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-11T23:02:06.734 INFO:teuthology.orchestra.run.smithi012.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-11T23:02:06.734 INFO:teuthology.orchestra.run.smithi012.stdout:The following additional packages will be installed: 2024-09-11T23:02:06.735 INFO:teuthology.orchestra.run.smithi012.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-09-11T23:02:06.735 INFO:teuthology.orchestra.run.smithi012.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-09-11T23:02:06.735 INFO:teuthology.orchestra.run.smithi012.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-09-11T23:02:06.735 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-09-11T23:02:06.735 INFO:teuthology.orchestra.run.smithi012.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-11T23:02:06.737 INFO:teuthology.orchestra.run.smithi012.stdout:Suggested packages: 2024-09-11T23:02:06.737 INFO:teuthology.orchestra.run.smithi012.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-09-11T23:02:06.737 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-09-11T23:02:06.737 INFO:teuthology.orchestra.run.smithi012.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-09-11T23:02:06.783 INFO:teuthology.orchestra.run.smithi012.stdout:The following NEW packages will be installed: 2024-09-11T23:02:06.784 INFO:teuthology.orchestra.run.smithi012.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-09-11T23:02:06.784 INFO:teuthology.orchestra.run.smithi012.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-09-11T23:02:06.784 INFO:teuthology.orchestra.run.smithi012.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-09-11T23:02:06.784 INFO:teuthology.orchestra.run.smithi012.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-09-11T23:02:06.784 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-09-11T23:02:06.785 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-09-11T23:02:06.785 INFO:teuthology.orchestra.run.smithi012.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-11T23:02:06.786 INFO:teuthology.orchestra.run.smithi012.stdout:The following packages will be upgraded: 2024-09-11T23:02:06.787 INFO:teuthology.orchestra.run.smithi012.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-09-11T23:02:06.970 INFO:teuthology.orchestra.run.smithi012.stdout:4 upgraded, 39 newly installed, 0 to remove and 327 not upgraded. 2024-09-11T23:02:06.970 INFO:teuthology.orchestra.run.smithi012.stdout:Need to get 55.8 MB of archives. 2024-09-11T23:02:06.970 INFO:teuthology.orchestra.run.smithi012.stdout:After this operation, 203 MB of additional disk space will be used. 2024-09-11T23:02:06.970 INFO:teuthology.orchestra.run.smithi012.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-09-11T23:02:07.592 INFO:teuthology.orchestra.run.smithi012.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-11T23:02:07.608 INFO:teuthology.orchestra.run.smithi012.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-11T23:02:07.732 INFO:teuthology.orchestra.run.smithi012.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-11T23:02:07.734 INFO:teuthology.orchestra.run.smithi012.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-11T23:02:07.735 INFO:teuthology.orchestra.run.smithi012.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-11T23:02:07.763 INFO:teuthology.orchestra.run.smithi012.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-09-11T23:02:07.764 INFO:teuthology.orchestra.run.smithi012.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-09-11T23:02:07.768 INFO:teuthology.orchestra.run.smithi012.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-09-11T23:02:07.771 INFO:teuthology.orchestra.run.smithi012.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-11T23:02:07.772 INFO:teuthology.orchestra.run.smithi012.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.3 [86.9 kB] 2024-09-11T23:02:07.774 INFO:teuthology.orchestra.run.smithi012.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-11T23:02:07.836 INFO:teuthology.orchestra.run.smithi012.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-11T23:02:07.837 INFO:teuthology.orchestra.run.smithi012.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-11T23:02:07.837 INFO:teuthology.orchestra.run.smithi012.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-09-11T23:02:07.918 INFO:teuthology.orchestra.run.smithi012.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-09-11T23:02:08.690 INFO:teuthology.orchestra.run.smithi012.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-09-11T23:02:08.695 INFO:teuthology.orchestra.run.smithi012.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-09-11T23:02:08.695 INFO:teuthology.orchestra.run.smithi012.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-09-11T23:02:08.701 INFO:teuthology.orchestra.run.smithi012.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libndp0 amd64 1.8-0ubuntu3.1 [12.4 kB] 2024-09-11T23:02:08.707 INFO:teuthology.orchestra.run.smithi012.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-09-11T23:02:08.718 INFO:teuthology.orchestra.run.smithi012.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.13-0ubuntu0.22.04.1 [149 kB] 2024-09-11T23:02:08.722 INFO:teuthology.orchestra.run.smithi012.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-09-11T23:02:08.739 INFO:teuthology.orchestra.run.smithi012.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-09-11T23:02:08.740 INFO:teuthology.orchestra.run.smithi012.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-11T23:02:08.813 INFO:teuthology.orchestra.run.smithi012.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-09-11T23:02:08.826 INFO:teuthology.orchestra.run.smithi012.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-09-11T23:02:08.841 INFO:teuthology.orchestra.run.smithi012.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-09-11T23:02:08.917 INFO:teuthology.orchestra.run.smithi012.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-09-11T23:02:08.923 INFO:teuthology.orchestra.run.smithi012.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-09-11T23:02:08.924 INFO:teuthology.orchestra.run.smithi012.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-09-11T23:02:08.925 INFO:teuthology.orchestra.run.smithi012.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-09-11T23:02:08.927 INFO:teuthology.orchestra.run.smithi012.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.13-0ubuntu0.22.04.1 [1,225 kB] 2024-09-11T23:02:08.948 INFO:teuthology.orchestra.run.smithi012.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-09-11T23:02:08.951 INFO:teuthology.orchestra.run.smithi012.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.13-0ubuntu0.22.04.1 [16.2 MB] 2024-09-11T23:02:09.503 INFO:teuthology.orchestra.run.smithi012.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-09-11T23:02:09.503 INFO:teuthology.orchestra.run.smithi012.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-09-11T23:02:09.503 INFO:teuthology.orchestra.run.smithi012.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-09-11T23:02:09.504 INFO:teuthology.orchestra.run.smithi012.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-09-11T23:02:09.504 INFO:teuthology.orchestra.run.smithi012.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-09-11T23:02:09.505 INFO:teuthology.orchestra.run.smithi012.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2.1 [1,482 kB] 2024-09-11T23:02:09.531 INFO:teuthology.orchestra.run.smithi012.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-09-11T23:02:09.532 INFO:teuthology.orchestra.run.smithi012.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-09-11T23:02:09.967 INFO:teuthology.orchestra.run.smithi012.stdout:Preconfiguring packages ... 2024-09-11T23:02:10.123 INFO:teuthology.orchestra.run.smithi012.stdout:Fetched 55.8 MB in 3s (20.4 MB/s) 2024-09-11T23:02:10.427 INFO:teuthology.orchestra.run.smithi012.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173985 files and directories currently installed.) 2024-09-11T23:02:10.433 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-11T23:02:10.584 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-11T23:02:11.208 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-09-11T23:02:12.229 INFO:teuthology.orchestra.run.smithi012.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-09-11T23:02:12.509 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package flex. 2024-09-11T23:02:12.614 INFO:teuthology.orchestra.run.smithi012.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173985 files and directories currently installed.) 2024-09-11T23:02:12.620 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-11T23:02:12.665 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-11T23:02:13.190 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-11T23:02:13.371 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-11T23:02:13.799 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-11T23:02:14.327 INFO:teuthology.orchestra.run.smithi012.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174058 files and directories currently installed.) 2024-09-11T23:02:14.333 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-11T23:02:14.462 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-11T23:02:14.838 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-11T23:02:14.944 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-11T23:02:15.272 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-11T23:02:15.568 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package bison. 2024-09-11T23:02:15.666 INFO:teuthology.orchestra.run.smithi012.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174058 files and directories currently installed.) 2024-09-11T23:02:15.671 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-11T23:02:15.714 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-11T23:02:16.156 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-11T23:02:16.184 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-09-11T23:02:16.224 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-09-11T23:02:16.559 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package dump. 2024-09-11T23:02:16.587 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-09-11T23:02:16.626 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking dump (0.4b47-3) ... 2024-09-11T23:02:16.923 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package indent. 2024-09-11T23:02:16.950 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-09-11T23:02:16.988 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-11T23:02:17.249 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-11T23:02:17.266 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-11T23:02:17.341 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-11T23:02:17.670 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-11T23:02:17.698 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.3_amd64.deb ... 2024-09-11T23:02:17.737 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-11T23:02:17.973 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-11T23:02:17.990 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-11T23:02:18.031 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-11T23:02:18.368 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-11T23:02:18.397 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-11T23:02:18.435 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-11T23:02:18.671 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-11T23:02:18.688 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-11T23:02:18.729 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-11T23:02:18.940 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libjson-perl. 2024-09-11T23:02:18.957 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-09-11T23:02:18.990 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-09-11T23:02:19.277 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libllvm14:amd64. 2024-09-11T23:02:19.306 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-09-11T23:02:19.343 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-11T23:02:21.113 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-11T23:02:21.142 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-11T23:02:21.171 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-11T23:02:21.432 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-11T23:02:21.449 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-11T23:02:21.491 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-11T23:02:21.802 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-11T23:02:21.830 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-11T23:02:21.868 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-11T23:02:22.213 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-11T23:02:22.242 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3.1_amd64.deb ... 2024-09-11T23:02:22.280 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-11T23:02:23.076 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-11T23:02:23.104 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-09-11T23:02:23.134 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-11T23:02:23.479 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-11T23:02:23.507 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../16-libpq5_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-11T23:02:23.545 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-11T23:02:23.882 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-11T23:02:23.910 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-11T23:02:23.948 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-11T23:02:24.226 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-11T23:02:24.243 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-11T23:02:24.276 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-11T23:02:24.487 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-11T23:02:24.503 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-11T23:02:24.545 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-11T23:02:25.082 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-11T23:02:25.111 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-09-11T23:02:25.149 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-09-11T23:02:25.502 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package modemmanager. 2024-09-11T23:02:25.530 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-11T23:02:25.569 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-11T23:02:26.193 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package network-manager. 2024-09-11T23:02:26.221 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-09-11T23:02:26.259 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-09-11T23:02:26.792 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ppp. 2024-09-11T23:02:26.820 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-09-11T23:02:27.074 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-09-11T23:02:27.363 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package pptp-linux. 2024-09-11T23:02:27.392 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-09-11T23:02:27.430 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-09-11T23:02:27.666 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-11T23:02:27.683 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-09-11T23:02:27.724 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-09-11T23:02:28.221 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-11T23:02:28.249 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-09-11T23:02:28.287 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking postgresql-client-common (238) ... 2024-09-11T23:02:28.599 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package postgresql-client-14. 2024-09-11T23:02:28.628 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../27-postgresql-client-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-11T23:02:28.666 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-11T23:02:29.237 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package postgresql-common. 2024-09-11T23:02:29.266 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-09-11T23:02:29.324 INFO:teuthology.orchestra.run.smithi012.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-11T23:02:29.343 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking postgresql-common (238) ... 2024-09-11T23:02:29.805 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package postgresql-14. 2024-09-11T23:02:29.833 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../29-postgresql-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-11T23:02:29.875 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-11T23:02:31.149 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package postgresql. 2024-09-11T23:02:31.180 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-09-11T23:02:31.215 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking postgresql (14+238) ... 2024-09-11T23:02:31.468 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package postgresql-client. 2024-09-11T23:02:31.484 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-09-11T23:02:31.526 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking postgresql-client (14+238) ... 2024-09-11T23:02:31.778 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-11T23:02:31.807 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-09-11T23:02:31.845 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking postgresql-contrib (14+238) ... 2024-09-11T23:02:32.114 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package tcl8.6. 2024-09-11T23:02:32.142 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-09-11T23:02:32.172 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-11T23:02:32.450 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package tcl. 2024-09-11T23:02:32.479 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-09-11T23:02:32.522 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-09-11T23:02:32.870 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package wpasupplicant. 2024-09-11T23:02:32.898 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2.1_amd64.deb ... 2024-09-11T23:02:32.944 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-11T23:02:33.282 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-11T23:02:33.299 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-09-11T23:02:33.340 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-09-11T23:02:33.701 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-11T23:02:33.730 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-09-11T23:02:33.777 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-11T23:02:34.065 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up postgresql-client-common (238) ... 2024-09-11T23:02:34.265 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-11T23:02:34.366 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-11T23:02:34.501 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-11T23:02:34.627 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-09-11T23:02:34.769 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-11T23:02:34.904 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-11T23:02:35.441 INFO:teuthology.orchestra.run.smithi012.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-11T23:02:35.526 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-11T23:02:35.920 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-11T23:02:35.920 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-11T23:02:36.454 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-11T23:02:36.580 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-09-11T23:02:36.697 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-11T23:02:36.798 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-09-11T23:02:36.907 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-11T23:02:37.050 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-11T23:02:37.176 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-11T23:02:37.302 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-09-11T23:02:37.940 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-11T23:02:38.125 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up dump (0.4b47-3) ... 2024-09-11T23:02:38.219 INFO:teuthology.orchestra.run.smithi012.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-11T23:02:38.518 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-11T23:02:38.778 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-11T23:02:38.904 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up tcl (8.6.11+1build2) ... 2024-09-11T23:02:39.030 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libjson-perl (4.04000-1) ... 2024-09-11T23:02:39.147 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-11T23:02:39.221 INFO:teuthology.orchestra.run.smithi012.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-11T23:02:39.290 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-11T23:02:39.400 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-11T23:02:39.576 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-11T23:02:39.702 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-11T23:02:39.836 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-09-11T23:02:40.004 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up postgresql-client (14+238) ... 2024-09-11T23:02:40.130 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-09-11T23:02:40.582 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:02:40.582 INFO:teuthology.orchestra.run.smithi012.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-11T23:02:40.582 INFO:teuthology.orchestra.run.smithi012.stdout:which means they are currently configured by ifupdown: 2024-09-11T23:02:40.582 INFO:teuthology.orchestra.run.smithi012.stdout:- ens1f0 2024-09-11T23:02:40.582 INFO:teuthology.orchestra.run.smithi012.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-11T23:02:40.582 INFO:teuthology.orchestra.run.smithi012.stdout:remove their configuration from /etc/network/interfaces. 2024-09-11T23:02:40.582 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:02:40.705 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-11T23:02:41.078 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-11T23:02:41.411 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-11T23:02:41.899 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-11T23:02:42.051 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-11T23:02:42.202 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-09-11T23:02:42.345 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up postgresql-common (238) ... 2024-09-11T23:02:43.253 INFO:teuthology.orchestra.run.smithi012.stdout:Adding user postgres to group ssl-cert 2024-09-11T23:02:43.476 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:02:43.476 INFO:teuthology.orchestra.run.smithi012.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-11T23:02:43.676 INFO:teuthology.orchestra.run.smithi012.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-11T23:02:43.676 INFO:teuthology.orchestra.run.smithi012.stdout:Removing obsolete dictionary files: 2024-09-11T23:02:44.250 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-11T23:02:44.621 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-11T23:02:44.956 INFO:teuthology.orchestra.run.smithi012.stdout:Creating new PostgreSQL cluster 14/main ... 2024-09-11T23:02:44.974 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-09-11T23:02:45.016 INFO:teuthology.orchestra.run.smithi012.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-11T23:02:45.016 INFO:teuthology.orchestra.run.smithi012.stdout:This user must also own the server process. 2024-09-11T23:02:45.016 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:02:45.016 INFO:teuthology.orchestra.run.smithi012.stdout:The database cluster will be initialized with locale "en_US". 2024-09-11T23:02:45.016 INFO:teuthology.orchestra.run.smithi012.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-11T23:02:45.016 INFO:teuthology.orchestra.run.smithi012.stdout:The default text search configuration will be set to "english". 2024-09-11T23:02:45.016 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:02:45.016 INFO:teuthology.orchestra.run.smithi012.stdout:Data page checksums are disabled. 2024-09-11T23:02:45.016 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:02:45.016 INFO:teuthology.orchestra.run.smithi012.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-09-11T23:02:45.017 INFO:teuthology.orchestra.run.smithi012.stdout:creating subdirectories ... ok 2024-09-11T23:02:45.017 INFO:teuthology.orchestra.run.smithi012.stdout:selecting dynamic shared memory implementation ... posix 2024-09-11T23:02:45.033 INFO:teuthology.orchestra.run.smithi012.stdout:selecting default max_connections ... 100 2024-09-11T23:02:45.055 INFO:teuthology.orchestra.run.smithi012.stdout:selecting default shared_buffers ... 128MB 2024-09-11T23:02:45.068 INFO:teuthology.orchestra.run.smithi012.stdout:selecting default time zone ... Etc/UTC 2024-09-11T23:02:45.069 INFO:teuthology.orchestra.run.smithi012.stdout:creating configuration files ... ok 2024-09-11T23:02:45.186 INFO:teuthology.orchestra.run.smithi012.stdout:running bootstrap script ... ok 2024-09-11T23:02:45.890 INFO:teuthology.orchestra.run.smithi012.stdout:performing post-bootstrap initialization ... ok 2024-09-11T23:02:46.580 INFO:teuthology.orchestra.run.smithi012.stdout:syncing data to disk ... ok 2024-09-11T23:02:46.972 INFO:teuthology.orchestra.run.smithi012.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-11T23:02:49.744 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-11T23:02:49.869 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up postgresql-contrib (14+238) ... 2024-09-11T23:02:49.995 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up postgresql (14+238) ... 2024-09-11T23:02:50.121 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-11T23:02:50.242 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-11T23:02:50.484 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-11T23:02:50.484 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-11T23:02:51.041 INFO:teuthology.orchestra.run.smithi012.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-11T23:02:51.134 INFO:teuthology.orchestra.run.smithi012.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-11T23:02:51.427 INFO:teuthology.orchestra.run.smithi012.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-11T23:02:51.571 INFO:teuthology.orchestra.run.smithi012.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-11T23:02:52.898 INFO:teuthology.orchestra.run.smithi012.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-09-11T23:02:53.007 INFO:teuthology.orchestra.run.smithi012.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-11T23:02:53.497 INFO:teuthology.orchestra.run.smithi012.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-11T23:02:53.503 DEBUG:teuthology.parallel:result is None 2024-09-11T23:02:53.504 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:02:53.652 DEBUG:teuthology.orchestra.run.smithi012:> dpkg-query -W -f '${Version}' ceph 2024-09-11T23:02:53.671 INFO:teuthology.orchestra.run.smithi012.stdout:19.1.1-298-gb53b6d3e-1jammy 2024-09-11T23:02:53.672 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298-gb53b6d3e-1jammy 2024-09-11T23:02:53.672 INFO:teuthology.task.install:The correct ceph version 19.1.1-298-gb53b6d3e-1jammy is installed. 2024-09-11T23:02:53.674 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-11T23:02:53.674 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T23:02:53.674 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T23:02:53.729 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-11T23:02:53.730 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T23:02:53.730 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T23:02:53.784 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T23:02:53.839 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-11T23:02:53.840 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T23:02:53.840 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T23:02:53.992 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T23:02:54.005 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-11T23:02:54.005 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T23:02:54.005 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T23:02:54.059 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T23:02:54.119 INFO:teuthology.run_tasks:Running task ceph... 2024-09-11T23:02:54.201 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-11T23:02:54.201 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 777 /var/log/ceph 2024-09-11T23:02:54.215 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-11T23:02:54.215 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-11T23:02:54.271 INFO:tasks.ceph:Creating extra log directories... 2024-09-11T23:02:54.272 DEBUG:teuthology.orchestra.run.smithi012:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-11T23:02:54.331 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-11T23:02:54.332 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-11T23:02:54.332 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-11T23:02:54.332 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T23:02:54.332 DEBUG:teuthology.orchestra.run.smithi012:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-11T23:02:54.376 DEBUG:teuthology.orchestra.run.smithi012:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-11T23:02:54.458 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-11T23:02:54.458 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-11T23:02:54.458 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901448', 'branch': 'squid', 'description': 'fs/top/{begin/{0-install 1-ceph 2-logrotate 3-modules} cluster/{1-node} conf/{client mds mgr mon osd} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health pg_health} supported-random-distros$/{ubuntu_latest} tasks/fstop}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7901448', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'meta': [{'desc': '1 ceph cluster with 1 mon, 1 mgr, 3 osds, 2 mds, 2 clients'}], 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.x', 'mds.a', 'mds.b', 'osd.0', 'osd.1', 'osd.2', 'client.0', 'client.1']], 'seed': 481, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'sleep_before_teardown': 0, 'subset': '57/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi012.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI6W/JO+zQGx41XMY7UoAJk/Xsgba74zCvvTxqEdYVi7gZE01tFqNf0ysd3SIwgZhTFNHGZpotKCjreL+ZEg7+8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_fstop']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-11_21:24:17', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-11T23:02:54.459 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-11T23:02:54.504 DEBUG:teuthology.orchestra.run.smithi012:> sudo install -d -m0777 -- /var/run/ceph 2024-09-11T23:02:54.564 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T23:02:54.564 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T23:02:54.612 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T23:02:54.612 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_1 2024-09-11T23:02:54.661 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T23:02:54.662 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:02:54.662 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 876 Links: 1 2024-09-11T23:02:54.662 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:02:54.662 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-09-11 22:56:42.846848264 +0000 2024-09-11T23:02:54.662 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-09-11 22:56:42.614850336 +0000 2024-09-11T23:02:54.662 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-09-11 22:56:42.614850336 +0000 2024-09-11T23:02:54.662 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: - 2024-09-11T23:02:54.662 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T23:02:54.714 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2024-09-11T23:02:54.715 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2024-09-11T23:02:54.715 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000450403 s, 1.1 MB/s 2024-09-11T23:02:54.716 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T23:02:54.765 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_2 2024-09-11T23:02:54.812 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T23:02:54.812 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:02:54.812 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 891 Links: 1 2024-09-11T23:02:54.812 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:02:54.812 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-09-11 22:56:43.314844084 +0000 2024-09-11T23:02:54.812 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-09-11 22:56:43.074846227 +0000 2024-09-11T23:02:54.812 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-09-11 22:56:43.074846227 +0000 2024-09-11T23:02:54.812 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: - 2024-09-11T23:02:54.813 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T23:02:54.867 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2024-09-11T23:02:54.867 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2024-09-11T23:02:54.867 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000441648 s, 1.2 MB/s 2024-09-11T23:02:54.868 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T23:02:54.921 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_3 2024-09-11T23:02:54.972 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T23:02:54.972 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:02:54.972 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 905 Links: 1 2024-09-11T23:02:54.972 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:02:54.972 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-09-11 22:56:43.822839546 +0000 2024-09-11T23:02:54.972 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-09-11 22:56:43.558841903 +0000 2024-09-11T23:02:54.972 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-09-11 22:56:43.558841903 +0000 2024-09-11T23:02:54.973 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: - 2024-09-11T23:02:54.973 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T23:02:55.026 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2024-09-11T23:02:55.027 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2024-09-11T23:02:55.027 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000438032 s, 1.2 MB/s 2024-09-11T23:02:55.028 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T23:02:55.077 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_4 2024-09-11T23:02:55.124 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T23:02:55.124 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:02:55.124 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 921 Links: 1 2024-09-11T23:02:55.124 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:02:55.124 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-09-11 22:56:44.286835401 +0000 2024-09-11T23:02:55.124 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-09-11 22:56:44.034837652 +0000 2024-09-11T23:02:55.124 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-09-11 22:56:44.034837652 +0000 2024-09-11T23:02:55.124 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: - 2024-09-11T23:02:55.124 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T23:02:55.179 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2024-09-11T23:02:55.179 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2024-09-11T23:02:55.179 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.00038324 s, 1.3 MB/s 2024-09-11T23:02:55.180 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T23:02:55.229 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-11T23:02:55.229 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi012.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2024-09-11T23:02:55.229 INFO:tasks.ceph:Generating config... 2024-09-11T23:02:55.230 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-11T23:02:55.231 INFO:tasks.ceph:[client] debug client = 20 2024-09-11T23:02:55.231 INFO:tasks.ceph:[client] debug ms = 1 2024-09-11T23:02:55.231 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-11T23:02:55.231 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-11T23:02:55.231 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-11T23:02:55.231 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-11T23:02:55.231 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-11T23:02:55.231 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-11T23:02:55.231 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-11T23:02:55.231 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-11T23:02:55.231 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-11T23:02:55.231 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-11T23:02:55.231 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-11T23:02:55.231 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-11T23:02:55.232 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-11T23:02:55.232 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-11T23:02:55.232 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-11T23:02:55.232 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-11T23:02:55.232 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-11T23:02:55.232 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-11T23:02:55.232 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-11T23:02:55.232 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-11T23:02:55.232 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-11T23:02:55.232 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-11T23:02:55.232 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-11T23:02:55.232 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-11T23:02:55.232 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-11T23:02:55.233 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-11T23:02:55.233 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-11T23:02:55.233 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-11T23:02:55.233 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-11T23:02:55.233 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-11T23:02:55.233 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-11T23:02:55.233 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-11T23:02:55.233 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-11T23:02:55.233 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-11T23:02:55.233 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-11T23:02:55.233 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-11T23:02:55.233 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-11T23:02:55.233 INFO:tasks.ceph:Setting up mon.a... 2024-09-11T23:02:55.234 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-11T23:02:55.303 INFO:teuthology.orchestra.run.smithi012.stdout:creating /etc/ceph/ceph.keyring 2024-09-11T23:02:55.312 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-11T23:02:55.394 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T23:02:55.450 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.12')] 2024-09-11T23:02:55.451 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.12'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mds.a': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-11T23:02:55.452 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T23:02:55.452 DEBUG:teuthology.orchestra.run.smithi012:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-11T23:02:55.496 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.12 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-11T23:02:55.571 INFO:teuthology.orchestra.run.smithi012.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-11T23:02:55.571 INFO:teuthology.orchestra.run.smithi012.stdout:monmaptool: generated fsid 8be14356-3340-4500-91a2-4cbc6b511f65 2024-09-11T23:02:55.571 INFO:teuthology.orchestra.run.smithi012.stdout:setting min_mon_release = quincy 2024-09-11T23:02:55.571 INFO:teuthology.orchestra.run.smithi012.stdout:epoch 0 2024-09-11T23:02:55.571 INFO:teuthology.orchestra.run.smithi012.stdout:fsid 8be14356-3340-4500-91a2-4cbc6b511f65 2024-09-11T23:02:55.571 INFO:teuthology.orchestra.run.smithi012.stdout:last_changed 2024-09-11T23:02:55.572619+0000 2024-09-11T23:02:55.571 INFO:teuthology.orchestra.run.smithi012.stdout:created 2024-09-11T23:02:55.572619+0000 2024-09-11T23:02:55.571 INFO:teuthology.orchestra.run.smithi012.stdout:min_mon_release 17 (quincy) 2024-09-11T23:02:55.571 INFO:teuthology.orchestra.run.smithi012.stdout:election_strategy: 1 2024-09-11T23:02:55.571 INFO:teuthology.orchestra.run.smithi012.stdout:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2024-09-11T23:02:55.571 INFO:teuthology.orchestra.run.smithi012.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-11T23:02:55.573 DEBUG:teuthology.orchestra.run.smithi012:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-11T23:02:55.624 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 8be14356-3340-4500-91a2-4cbc6b511f65... 2024-09-11T23:02:55.625 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-11T23:02:55.698 INFO:teuthology.orchestra.run.smithi012.stdout:[global] 2024-09-11T23:02:55.699 INFO:teuthology.orchestra.run.smithi012.stdout: chdir = "" 2024-09-11T23:02:55.699 INFO:teuthology.orchestra.run.smithi012.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-11T23:02:55.699 INFO:teuthology.orchestra.run.smithi012.stdout: auth supported = cephx 2024-09-11T23:02:55.699 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:02:55.699 INFO:teuthology.orchestra.run.smithi012.stdout: filestore xattr use omap = true 2024-09-11T23:02:55.699 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:02:55.700 INFO:teuthology.orchestra.run.smithi012.stdout: mon clock drift allowed = 1.000 2024-09-11T23:02:55.700 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:02:55.700 INFO:teuthology.orchestra.run.smithi012.stdout: osd crush chooseleaf type = 0 2024-09-11T23:02:55.700 INFO:teuthology.orchestra.run.smithi012.stdout: auth debug = true 2024-09-11T23:02:55.700 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:02:55.701 INFO:teuthology.orchestra.run.smithi012.stdout: ms die on old message = true 2024-09-11T23:02:55.701 INFO:teuthology.orchestra.run.smithi012.stdout: ms die on bug = true 2024-09-11T23:02:55.701 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:02:55.701 INFO:teuthology.orchestra.run.smithi012.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-11T23:02:55.701 INFO:teuthology.orchestra.run.smithi012.stdout: mon pg warn max object skew = 0 2024-09-11T23:02:55.702 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:02:55.702 INFO:teuthology.orchestra.run.smithi012.stdout: # disable pg_autoscaler by default for new pools 2024-09-11T23:02:55.702 INFO:teuthology.orchestra.run.smithi012.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-11T23:02:55.702 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:02:55.702 INFO:teuthology.orchestra.run.smithi012.stdout: osd pool default size = 2 2024-09-11T23:02:55.702 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:02:55.703 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd allow primary affinity = true 2024-09-11T23:02:55.703 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd allow pg remap = true 2024-09-11T23:02:55.703 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on legacy crush tunables = false 2024-09-11T23:02:55.703 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on crush straw calc version zero = false 2024-09-11T23:02:55.703 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on no sortbitwise = false 2024-09-11T23:02:55.704 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on osd down out interval zero = false 2024-09-11T23:02:55.704 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on too few osds = false 2024-09-11T23:02:55.704 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-11T23:02:55.704 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-11T23:02:55.704 INFO:teuthology.orchestra.run.smithi012.stdout: mon_allow_pool_size_one = true 2024-09-11T23:02:55.704 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:02:55.705 INFO:teuthology.orchestra.run.smithi012.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-11T23:02:55.705 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:02:55.705 INFO:teuthology.orchestra.run.smithi012.stdout: osd default data pool replay window = 5 2024-09-11T23:02:55.705 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:02:55.705 INFO:teuthology.orchestra.run.smithi012.stdout: mon allow pool delete = true 2024-09-11T23:02:55.706 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:02:55.706 INFO:teuthology.orchestra.run.smithi012.stdout: mon cluster log file level = debug 2024-09-11T23:02:55.706 INFO:teuthology.orchestra.run.smithi012.stdout: debug asserts on shutdown = true 2024-09-11T23:02:55.706 INFO:teuthology.orchestra.run.smithi012.stdout: mon health detail to clog = false 2024-09-11T23:02:55.706 INFO:teuthology.orchestra.run.smithi012.stdout: mon host = 172.21.15.12 2024-09-11T23:02:55.706 INFO:teuthology.orchestra.run.smithi012.stdout: fsid = 8be14356-3340-4500-91a2-4cbc6b511f65 2024-09-11T23:02:55.707 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:02:55.707 INFO:teuthology.orchestra.run.smithi012.stdout:[osd] 2024-09-11T23:02:55.707 INFO:teuthology.orchestra.run.smithi012.stdout: osd journal size = 100 2024-09-11T23:02:55.707 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:02:55.707 INFO:teuthology.orchestra.run.smithi012.stdout: osd scrub load threshold = 5.0 2024-09-11T23:02:55.708 INFO:teuthology.orchestra.run.smithi012.stdout: osd scrub max interval = 600 2024-09-11T23:02:55.708 INFO:teuthology.orchestra.run.smithi012.stdout: osd mclock profile = high_recovery_ops 2024-09-11T23:02:55.708 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:02:55.708 INFO:teuthology.orchestra.run.smithi012.stdout: osd recover clone overlap = true 2024-09-11T23:02:55.708 INFO:teuthology.orchestra.run.smithi012.stdout: osd recovery max chunk = 1048576 2024-09-11T23:02:55.708 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:02:55.709 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug shutdown = true 2024-09-11T23:02:55.709 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug op order = true 2024-09-11T23:02:55.709 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug verify stray on activate = true 2024-09-11T23:02:55.709 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug trim objects = true 2024-09-11T23:02:55.709 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:02:55.710 INFO:teuthology.orchestra.run.smithi012.stdout: osd open classes on start = true 2024-09-11T23:02:55.710 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug pg log writeout = true 2024-09-11T23:02:55.710 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:02:55.710 INFO:teuthology.orchestra.run.smithi012.stdout: osd deep scrub update digest min age = 30 2024-09-11T23:02:55.710 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:02:55.710 INFO:teuthology.orchestra.run.smithi012.stdout: osd map max advance = 10 2024-09-11T23:02:55.711 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:02:55.711 INFO:teuthology.orchestra.run.smithi012.stdout: journal zero on create = true 2024-09-11T23:02:55.711 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:02:55.711 INFO:teuthology.orchestra.run.smithi012.stdout: filestore ondisk finisher threads = 3 2024-09-11T23:02:55.711 INFO:teuthology.orchestra.run.smithi012.stdout: filestore apply finisher threads = 3 2024-09-11T23:02:55.712 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:02:55.712 INFO:teuthology.orchestra.run.smithi012.stdout: bdev debug aio = true 2024-09-11T23:02:55.712 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug misdirected ops = true 2024-09-11T23:02:55.712 INFO:teuthology.orchestra.run.smithi012.stdout: bdev async discard = True 2024-09-11T23:02:55.712 INFO:teuthology.orchestra.run.smithi012.stdout: bdev enable discard = True 2024-09-11T23:02:55.712 INFO:teuthology.orchestra.run.smithi012.stdout: bluestore allocator = bitmap 2024-09-11T23:02:55.713 INFO:teuthology.orchestra.run.smithi012.stdout: bluestore block size = 96636764160 2024-09-11T23:02:55.713 INFO:teuthology.orchestra.run.smithi012.stdout: bluestore fsck on mount = True 2024-09-11T23:02:55.713 INFO:teuthology.orchestra.run.smithi012.stdout: debug bluefs = 1/20 2024-09-11T23:02:55.713 INFO:teuthology.orchestra.run.smithi012.stdout: debug bluestore = 1/20 2024-09-11T23:02:55.713 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2024-09-11T23:02:55.714 INFO:teuthology.orchestra.run.smithi012.stdout: debug osd = 20 2024-09-11T23:02:55.714 INFO:teuthology.orchestra.run.smithi012.stdout: debug rocksdb = 4/10 2024-09-11T23:02:55.714 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd backfillfull_ratio = 0.85 2024-09-11T23:02:55.714 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd full ratio = 0.9 2024-09-11T23:02:55.714 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd nearfull ratio = 0.8 2024-09-11T23:02:55.714 INFO:teuthology.orchestra.run.smithi012.stdout: osd failsafe full ratio = 0.95 2024-09-11T23:02:55.715 INFO:teuthology.orchestra.run.smithi012.stdout: osd objectstore = bluestore 2024-09-11T23:02:55.715 INFO:teuthology.orchestra.run.smithi012.stdout: osd op complaint time = 180 2024-09-11T23:02:55.715 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:02:55.715 INFO:teuthology.orchestra.run.smithi012.stdout:[mgr] 2024-09-11T23:02:55.715 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2024-09-11T23:02:55.716 INFO:teuthology.orchestra.run.smithi012.stdout: debug mgr = 20 2024-09-11T23:02:55.716 INFO:teuthology.orchestra.run.smithi012.stdout: debug mon = 20 2024-09-11T23:02:55.716 INFO:teuthology.orchestra.run.smithi012.stdout: debug auth = 20 2024-09-11T23:02:55.716 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min pgs per osd = 4 2024-09-11T23:02:55.716 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min bytes per osd = 10 2024-09-11T23:02:55.716 INFO:teuthology.orchestra.run.smithi012.stdout: mgr/telemetry/nag = false 2024-09-11T23:02:55.717 INFO:teuthology.orchestra.run.smithi012.stdout: debug client = 20 2024-09-11T23:02:55.717 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:02:55.717 INFO:teuthology.orchestra.run.smithi012.stdout:[mon] 2024-09-11T23:02:55.717 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2024-09-11T23:02:55.717 INFO:teuthology.orchestra.run.smithi012.stdout: debug mon = 20 2024-09-11T23:02:55.718 INFO:teuthology.orchestra.run.smithi012.stdout: debug paxos = 20 2024-09-11T23:02:55.718 INFO:teuthology.orchestra.run.smithi012.stdout: debug auth = 20 2024-09-11T23:02:55.718 INFO:teuthology.orchestra.run.smithi012.stdout: mon data avail warn = 5 2024-09-11T23:02:55.718 INFO:teuthology.orchestra.run.smithi012.stdout: mon mgr mkfs grace = 240 2024-09-11T23:02:55.718 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min pgs per osd = 4 2024-09-11T23:02:55.719 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd reporter subtree level = osd 2024-09-11T23:02:55.719 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd prime pg temp = true 2024-09-11T23:02:55.719 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min bytes per osd = 10 2024-09-11T23:02:55.719 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:02:55.719 INFO:teuthology.orchestra.run.smithi012.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-11T23:02:55.719 INFO:teuthology.orchestra.run.smithi012.stdout: auth mon ticket ttl = 660 # 11m 2024-09-11T23:02:55.720 INFO:teuthology.orchestra.run.smithi012.stdout: auth service ticket ttl = 240 # 4m 2024-09-11T23:02:55.720 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:02:55.720 INFO:teuthology.orchestra.run.smithi012.stdout: # don't complain about insecure global_id in the test suite 2024-09-11T23:02:55.720 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-11T23:02:55.720 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-11T23:02:55.721 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:02:55.721 INFO:teuthology.orchestra.run.smithi012.stdout: # 1m isn't quite enough 2024-09-11T23:02:55.721 INFO:teuthology.orchestra.run.smithi012.stdout: mon_down_mkfs_grace = 2m 2024-09-11T23:02:55.721 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:02:55.721 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_filestore_osds = false 2024-09-11T23:02:55.721 INFO:teuthology.orchestra.run.smithi012.stdout: mon down mkfs grace = 300 2024-09-11T23:02:55.722 INFO:teuthology.orchestra.run.smithi012.stdout: mon op complaint time = 120 2024-09-11T23:02:55.722 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on pool no app = False 2024-09-11T23:02:55.722 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:02:55.722 INFO:teuthology.orchestra.run.smithi012.stdout:[client] 2024-09-11T23:02:55.722 INFO:teuthology.orchestra.run.smithi012.stdout: rgw cache enabled = true 2024-09-11T23:02:55.722 INFO:teuthology.orchestra.run.smithi012.stdout: rgw enable ops log = true 2024-09-11T23:02:55.722 INFO:teuthology.orchestra.run.smithi012.stdout: rgw enable usage log = true 2024-09-11T23:02:55.723 INFO:teuthology.orchestra.run.smithi012.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-11T23:02:55.723 INFO:teuthology.orchestra.run.smithi012.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-11T23:02:55.723 INFO:teuthology.orchestra.run.smithi012.stdout: client mount timeout = 600 2024-09-11T23:02:55.723 INFO:teuthology.orchestra.run.smithi012.stdout: debug client = 20 2024-09-11T23:02:55.723 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2024-09-11T23:02:55.723 INFO:teuthology.orchestra.run.smithi012.stdout: rados mon op timeout = 900 2024-09-11T23:02:55.723 INFO:teuthology.orchestra.run.smithi012.stdout: rados osd op timeout = 900 2024-09-11T23:02:55.723 INFO:teuthology.orchestra.run.smithi012.stdout:[mon.a] 2024-09-11T23:02:55.723 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.a] 2024-09-11T23:02:55.723 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.b] 2024-09-11T23:02:55.724 INFO:teuthology.orchestra.run.smithi012.stdout:[mds] 2024-09-11T23:02:55.724 INFO:teuthology.orchestra.run.smithi012.stdout: debug mds = 20 2024-09-11T23:02:55.724 INFO:teuthology.orchestra.run.smithi012.stdout: debug mds balancer = 20 2024-09-11T23:02:55.724 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2024-09-11T23:02:55.724 INFO:teuthology.orchestra.run.smithi012.stdout: mds debug frag = True 2024-09-11T23:02:55.725 INFO:teuthology.orchestra.run.smithi012.stdout: mds debug scatterstat = True 2024-09-11T23:02:55.725 INFO:teuthology.orchestra.run.smithi012.stdout: mds op complaint time = 180 2024-09-11T23:02:55.725 INFO:teuthology.orchestra.run.smithi012.stdout: mds verify scatter = True 2024-09-11T23:02:55.725 INFO:teuthology.orchestra.run.smithi012.stdout: osd op complaint time = 180 2024-09-11T23:02:55.725 INFO:teuthology.orchestra.run.smithi012.stdout: rados mon op timeout = 900 2024-09-11T23:02:55.725 INFO:teuthology.orchestra.run.smithi012.stdout: rados osd op timeout = 900 2024-09-11T23:02:55.727 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-11T23:02:55.727 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-11T23:02:55.822 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-11T23:02:55.823 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T23:02:55.823 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-11T23:02:55.827 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T23:02:55.827 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-11T23:02:55.875 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi012.front.sepia.ceph.com 2024-09-11T23:02:55.875 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T23:02:55.875 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-11T23:02:55.876 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T23:02:55.939 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T23:02:55.939 DEBUG:teuthology.orchestra.run.smithi012:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-11T23:02:55.987 INFO:tasks.ceph:Setting up mon nodes... 2024-09-11T23:02:55.988 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-11T23:02:55.988 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-11T23:02:56.074 INFO:teuthology.orchestra.run.smithi012.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-11T23:02:56.077 INFO:tasks.ceph:Setting up mds nodes... 2024-09-11T23:02:56.077 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-11T23:02:56.161 INFO:teuthology.orchestra.run.smithi012.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-11T23:02:56.165 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-11T23:02:56.220 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-11T23:02:56.310 INFO:teuthology.orchestra.run.smithi012.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-11T23:02:56.313 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-11T23:02:56.367 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-11T23:02:56.368 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-11T23:02:56.445 INFO:teuthology.orchestra.run.smithi012.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-11T23:02:56.456 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-11T23:02:56.530 INFO:teuthology.orchestra.run.smithi012.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-11T23:02:56.540 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-11T23:02:56.540 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi012.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2024-09-11T23:02:56.541 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-11T23:02:56.594 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-11T23:02:56.594 INFO:tasks.ceph:role: osd.0 2024-09-11T23:02:56.595 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi012.front.sepia.ceph.com 2024-09-11T23:02:56.595 DEBUG:teuthology.orchestra.run.smithi012:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-11T23:02:56.655 INFO:teuthology.orchestra.run.smithi012.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T23:02:56.655 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T23:02:56.655 INFO:teuthology.orchestra.run.smithi012.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T23:02:56.655 INFO:teuthology.orchestra.run.smithi012.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-11T23:02:56.655 INFO:teuthology.orchestra.run.smithi012.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T23:02:56.655 INFO:teuthology.orchestra.run.smithi012.stdout: = sunit=0 swidth=0 blks 2024-09-11T23:02:56.655 INFO:teuthology.orchestra.run.smithi012.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T23:02:56.656 INFO:teuthology.orchestra.run.smithi012.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-11T23:02:56.656 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T23:02:56.656 INFO:teuthology.orchestra.run.smithi012.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T23:02:57.135 INFO:teuthology.orchestra.run.smithi012.stdout:Discarding blocks...Done. 2024-09-11T23:02:57.137 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi012.front.sepia.ceph.com -o noatime 2024-09-11T23:02:57.137 DEBUG:teuthology.orchestra.run.smithi012:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-11T23:02:57.282 DEBUG:teuthology.orchestra.run.smithi012:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-11T23:02:57.294 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:02:57.294 INFO:teuthology.orchestra.run.smithi012.stderr:sudo: /sbin/restorecon: command not found 2024-09-11T23:02:57.294 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-11T23:02:57.348 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-11T23:02:57.348 INFO:tasks.ceph:role: osd.1 2024-09-11T23:02:57.348 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi012.front.sepia.ceph.com 2024-09-11T23:02:57.348 DEBUG:teuthology.orchestra.run.smithi012:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-11T23:02:57.412 INFO:teuthology.orchestra.run.smithi012.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T23:02:57.412 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T23:02:57.412 INFO:teuthology.orchestra.run.smithi012.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T23:02:57.412 INFO:teuthology.orchestra.run.smithi012.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-11T23:02:57.412 INFO:teuthology.orchestra.run.smithi012.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T23:02:57.412 INFO:teuthology.orchestra.run.smithi012.stdout: = sunit=0 swidth=0 blks 2024-09-11T23:02:57.412 INFO:teuthology.orchestra.run.smithi012.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T23:02:57.412 INFO:teuthology.orchestra.run.smithi012.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-11T23:02:57.412 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T23:02:57.413 INFO:teuthology.orchestra.run.smithi012.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T23:02:57.862 INFO:teuthology.orchestra.run.smithi012.stdout:Discarding blocks...Done. 2024-09-11T23:02:57.864 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi012.front.sepia.ceph.com -o noatime 2024-09-11T23:02:57.864 DEBUG:teuthology.orchestra.run.smithi012:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-11T23:02:57.958 DEBUG:teuthology.orchestra.run.smithi012:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-11T23:02:57.968 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:02:57.968 INFO:teuthology.orchestra.run.smithi012.stderr:sudo: /sbin/restorecon: command not found 2024-09-11T23:02:57.968 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-11T23:02:58.022 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-11T23:02:58.022 INFO:tasks.ceph:role: osd.2 2024-09-11T23:02:58.022 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi012.front.sepia.ceph.com 2024-09-11T23:02:58.022 DEBUG:teuthology.orchestra.run.smithi012:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-11T23:02:58.083 INFO:teuthology.orchestra.run.smithi012.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T23:02:58.083 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T23:02:58.083 INFO:teuthology.orchestra.run.smithi012.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T23:02:58.083 INFO:teuthology.orchestra.run.smithi012.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-11T23:02:58.083 INFO:teuthology.orchestra.run.smithi012.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T23:02:58.083 INFO:teuthology.orchestra.run.smithi012.stdout: = sunit=0 swidth=0 blks 2024-09-11T23:02:58.083 INFO:teuthology.orchestra.run.smithi012.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T23:02:58.083 INFO:teuthology.orchestra.run.smithi012.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-11T23:02:58.084 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T23:02:58.084 INFO:teuthology.orchestra.run.smithi012.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T23:02:58.540 INFO:teuthology.orchestra.run.smithi012.stdout:Discarding blocks...Done. 2024-09-11T23:02:58.543 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi012.front.sepia.ceph.com -o noatime 2024-09-11T23:02:58.543 DEBUG:teuthology.orchestra.run.smithi012:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-11T23:02:58.668 DEBUG:teuthology.orchestra.run.smithi012:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-11T23:02:58.680 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:02:58.680 INFO:teuthology.orchestra.run.smithi012.stderr:sudo: /sbin/restorecon: command not found 2024-09-11T23:02:58.681 DEBUG:teuthology.orchestra.run.smithi012:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T23:02:58.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:02:58.793+0000 7fd1f70ae7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-11T23:02:58.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:02:58.793+0000 7fd1f70ae7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-11T23:02:58.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:02:58.793+0000 7fd1f70ae7c0 -1 bdev(0x563911ec7800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-11T23:02:58.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:02:58.793+0000 7fd1f70ae7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-11T23:03:02.431 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-11T23:03:02.446 DEBUG:teuthology.orchestra.run.smithi012:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T23:03:02.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:02.521+0000 7f48fa51c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-11T23:03:02.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:02.525+0000 7f48fa51c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-11T23:03:02.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:02.525+0000 7f48fa51c7c0 -1 bdev(0x55db62aa1800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-11T23:03:02.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:02.525+0000 7f48fa51c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-11T23:03:05.664 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-11T23:03:05.720 DEBUG:teuthology.orchestra.run.smithi012:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T23:03:05.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:05.805+0000 7f63bac657c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-11T23:03:05.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:05.805+0000 7f63bac657c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-11T23:03:05.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:05.805+0000 7f63bac657c0 -1 bdev(0x55c30eaa1800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-11T23:03:05.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:05.805+0000 7f63bac657c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-11T23:03:09.167 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-11T23:03:09.224 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-11T23:03:09.224 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T23:03:09.225 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-11T23:03:09.279 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T23:03:09.280 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-11T23:03:09.336 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T23:03:09.336 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-11T23:03:09.391 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T23:03:09.392 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-11T23:03:09.448 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T23:03:09.448 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-11T23:03:09.504 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T23:03:09.504 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-11T23:03:09.560 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T23:03:09.560 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-11T23:03:09.607 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T23:03:09.608 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-11T23:03:09.656 INFO:tasks.ceph:Adding keys to all mons... 2024-09-11T23:03:09.656 DEBUG:teuthology.orchestra.run.smithi012:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-11T23:03:09.710 INFO:teuthology.orchestra.run.smithi012.stdout:[mgr.x] 2024-09-11T23:03:09.710 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCgIeJmgNCCBBAAS9gR6zgZL5ZX8chT2/0RUw== 2024-09-11T23:03:09.710 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.a] 2024-09-11T23:03:09.710 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCgIeJmhYe5CRAAlzmzDPKc12SodkPehqtl6w== 2024-09-11T23:03:09.711 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.b] 2024-09-11T23:03:09.711 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCgIeJmnvKREhAAp9c3Qvihpy4qTm50E9U26Q== 2024-09-11T23:03:09.711 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.0] 2024-09-11T23:03:09.711 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCiIeJmy2qOLxAARUVUTFfFVrdRIhNhThjbTw== 2024-09-11T23:03:09.711 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.1] 2024-09-11T23:03:09.711 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCmIeJmuc99HxAA0QxYJ1hvAsHb4uZPlh9GdA== 2024-09-11T23:03:09.711 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.2] 2024-09-11T23:03:09.711 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCpIeJmBDhCMBAAipbJzeGy0AughJ+PfcX8ZA== 2024-09-11T23:03:09.711 INFO:teuthology.orchestra.run.smithi012.stdout:[client.0] 2024-09-11T23:03:09.711 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCgIeJmTz6nGhAAveLcJxI+RD0GsD9nnR2S/w== 2024-09-11T23:03:09.711 INFO:teuthology.orchestra.run.smithi012.stdout:[client.1] 2024-09-11T23:03:09.711 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCgIeJmkfu2HxAAKhML2j7GrGF1q/7cuNJtSA== 2024-09-11T23:03:09.712 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-11T23:03:09.802 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T23:03:09.852 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T23:03:09.896 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T23:03:09.979 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T23:03:10.064 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T23:03:10.152 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T23:03:10.197 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T23:03:10.284 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-11T23:03:10.284 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-11T23:03:10.294 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-11T23:03:10.386 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-11T23:03:10.397 DEBUG:teuthology.orchestra.run.smithi012:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-11T23:03:10.442 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-11T23:03:10.443 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-11T23:03:10.443 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-11T23:03:10.488 INFO:tasks.ceph.mon.a:Started 2024-09-11T23:03:10.489 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-11T23:03:10.489 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-11T23:03:10.489 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-11T23:03:10.491 INFO:tasks.ceph.mgr.x:Started 2024-09-11T23:03:10.491 INFO:tasks.ceph:Setting crush tunables to default 2024-09-11T23:03:10.491 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --cluster ceph osd crush tunables default 2024-09-11T23:03:10.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.605+0000 7f62565f7640 1 Processor -- start 2024-09-11T23:03:10.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.605+0000 7f62565f7640 1 -- start start 2024-09-11T23:03:10.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.605+0000 7f62565f7640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f62500a4730 0x7f62500a2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:10.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.605+0000 7f62565f7640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62500a1f30 con 0x7f62500a30e0 2024-09-11T23:03:10.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.605+0000 7f62565f7640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f62500a4300 con 0x7f62500a4730 2024-09-11T23:03:10.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.605+0000 7f624ffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f62500a4730 0x7f62500a2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:10.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.605+0000 7f624ffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f62500a4730 0x7f62500a2970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39504/0 (socket says 172.21.15.12:39504) 2024-09-11T23:03:10.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.605+0000 7f624ffff640 1 -- 172.21.15.12:0/3491285087 learned_addr learned my addr 172.21.15.12:0/3491285087 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:10.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.605+0000 7f624f7fe640 1 --1- 172.21.15.12:0/3491285087 >> v1:172.21.15.12:6789/0 conn(0x7f62500a30e0 0x7f62500a4b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43538/0 (socket says 172.21.15.12:43538) 2024-09-11T23:03:10.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.605+0000 7f624ffff640 1 -- 172.21.15.12:0/3491285087 >> v2:172.21.15.12:3300/0 conn(0x7f62500a4730 msgr2=0x7f62500a2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T23:03:10.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.605+0000 7f624ffff640 1 -- 172.21.15.12:0/3491285087 >> v2:172.21.15.12:3300/0 conn(0x7f62500a4730 msgr2=0x7f62500a2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T23:03:10.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.605+0000 7f624ffff640 1 --2- 172.21.15.12:0/3491285087 >> v2:172.21.15.12:3300/0 conn(0x7f62500a4730 0x7f62500a2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T23:03:10.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.609+0000 7f624ffff640 1 --2- 172.21.15.12:0/3491285087 >> v2:172.21.15.12:3300/0 conn(0x7f62500a4730 0x7f62500a2970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:03:10.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.629+0000 7f624effd640 1 -- 172.21.15.12:0/3491285087 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2860266496 0 0) 0x7f62500a1f30 con 0x7f62500a30e0 2024-09-11T23:03:10.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.629+0000 7f624effd640 1 -- 172.21.15.12:0/3491285087 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6238003530 con 0x7f62500a30e0 2024-09-11T23:03:10.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.629+0000 7f624effd640 1 -- 172.21.15.12:0/3491285087 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1828800429 0 0) 0x7f6238003530 con 0x7f62500a30e0 2024-09-11T23:03:10.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.629+0000 7f624effd640 1 -- 172.21.15.12:0/3491285087 >> v2:172.21.15.12:3300/0 conn(0x7f62500a4730 msgr2=0x7f62500a2970 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T23:03:10.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.629+0000 7f624effd640 1 --2- 172.21.15.12:0/3491285087 >> v2:172.21.15.12:3300/0 conn(0x7f62500a4730 0x7f62500a2970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:10.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.629+0000 7f624effd640 1 -- 172.21.15.12:0/3491285087 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62500a5220 con 0x7f62500a30e0 2024-09-11T23:03:10.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.629+0000 7f624effd640 1 -- 172.21.15.12:0/3491285087 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 2106515244 0 0) 0x7f62440015b0 con 0x7f62500a30e0 2024-09-11T23:03:10.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.629+0000 7f624effd640 1 -- 172.21.15.12:0/3491285087 >> v1:172.21.15.12:6789/0 conn(0x7f62500a30e0 legacy=0x7f62500a4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:10.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.629+0000 7f624effd640 1 --2- 172.21.15.12:0/3491285087 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62380039c0 0x7f6238003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:10.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.629+0000 7f624effd640 1 -- 172.21.15.12:0/3491285087 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f62500a4300 con 0x7f62380039c0 2024-09-11T23:03:10.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.629+0000 7f624ffff640 1 --2- 172.21.15.12:0/3491285087 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62380039c0 0x7f6238003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:10.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.629+0000 7f624ffff640 1 -- 172.21.15.12:0/3491285087 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6238003530 con 0x7f62380039c0 2024-09-11T23:03:10.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.633+0000 7f624ffff640 1 --2- 172.21.15.12:0/3491285087 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62380039c0 0x7f6238003dc0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f6240009810 tx=0x7f624001c6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=104c0f5b21d853ac server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:10.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.633+0000 7f624effd640 1 -- 172.21.15.12:0/3491285087 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f624000f040 con 0x7f62380039c0 2024-09-11T23:03:10.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.633+0000 7f624effd640 1 -- 172.21.15.12:0/3491285087 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62400a6560 con 0x7f62380039c0 2024-09-11T23:03:10.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.633+0000 7f624effd640 1 -- 172.21.15.12:0/3491285087 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62400a6880 con 0x7f62380039c0 2024-09-11T23:03:10.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.633+0000 7f62565f7640 1 -- 172.21.15.12:0/3491285087 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62380039c0 msgr2=0x7f6238003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:10.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.633+0000 7f62565f7640 1 --2- 172.21.15.12:0/3491285087 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62380039c0 0x7f6238003dc0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f6240009810 tx=0x7f624001c6d0 comp rx=0 tx=0).stop 2024-09-11T23:03:10.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.633+0000 7f62565f7640 1 -- 172.21.15.12:0/3491285087 shutdown_connections 2024-09-11T23:03:10.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.633+0000 7f62565f7640 1 --2- 172.21.15.12:0/3491285087 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62380039c0 0x7f6238003dc0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:10.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.633+0000 7f62565f7640 1 --2- 172.21.15.12:0/3491285087 >> v2:172.21.15.12:3300/0 conn(0x7f62500a4730 0x7f62500a2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:10.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.633+0000 7f62565f7640 1 -- 172.21.15.12:0/3491285087 >> 172.21.15.12:0/3491285087 conn(0x7f6250067e00 msgr2=0x7f6250068210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:10.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.633+0000 7f62565f7640 1 -- 172.21.15.12:0/3491285087 shutdown_connections 2024-09-11T23:03:10.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.633+0000 7f62565f7640 1 -- 172.21.15.12:0/3491285087 wait complete. 2024-09-11T23:03:10.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.633+0000 7f62565f7640 1 Processor -- start 2024-09-11T23:03:10.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.633+0000 7f62565f7640 1 -- start start 2024-09-11T23:03:10.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.633+0000 7f62565f7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62380039c0 0x7f625009cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:10.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.633+0000 7f62565f7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f625013c710 con 0x7f62380039c0 2024-09-11T23:03:10.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.633+0000 7f624ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62380039c0 0x7f625009cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:10.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.633+0000 7f624ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62380039c0 0x7f625009cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39542/0 (socket says 172.21.15.12:39542) 2024-09-11T23:03:10.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.633+0000 7f624ffff640 1 -- 172.21.15.12:0/1558409705 learned_addr learned my addr 172.21.15.12:0/1558409705 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:10.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.637+0000 7f624ffff640 1 -- 172.21.15.12:0/1558409705 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f625009c530 con 0x7f62380039c0 2024-09-11T23:03:10.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.637+0000 7f624ffff640 1 --2- 172.21.15.12:0/1558409705 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62380039c0 0x7f625009cf70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f62400192e0 tx=0x7f6238005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:10.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.637+0000 7f624cff9640 1 -- 172.21.15.12:0/1558409705 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f624000f000 con 0x7f62380039c0 2024-09-11T23:03:10.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.637+0000 7f624cff9640 1 -- 172.21.15.12:0/1558409705 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62400b6070 con 0x7f62380039c0 2024-09-11T23:03:10.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.637+0000 7f62565f7640 1 -- 172.21.15.12:0/1558409705 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6250071e50 con 0x7f62380039c0 2024-09-11T23:03:10.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.637+0000 7f624cff9640 1 -- 172.21.15.12:0/1558409705 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62400ba460 con 0x7f62380039c0 2024-09-11T23:03:10.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.637+0000 7f62565f7640 1 -- 172.21.15.12:0/1558409705 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6250071b40 con 0x7f62380039c0 2024-09-11T23:03:10.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.637+0000 7f624cff9640 1 -- 172.21.15.12:0/1558409705 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f62400c1060 con 0x7f62380039c0 2024-09-11T23:03:10.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.637+0000 7f624cff9640 1 -- 172.21.15.12:0/1558409705 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6240006020 con 0x7f62380039c0 2024-09-11T23:03:10.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.637+0000 7f62565f7640 1 -- 172.21.15.12:0/1558409705 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62500a2970 con 0x7f62380039c0 2024-09-11T23:03:10.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.653+0000 7f624cff9640 1 -- 172.21.15.12:0/1558409705 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f62400ac030 con 0x7f62380039c0 2024-09-11T23:03:10.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.713+0000 7f62565f7640 1 -- 172.21.15.12:0/1558409705 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f625006cd70 con 0x7f62380039c0 2024-09-11T23:03:10.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.717+0000 7f624cff9640 1 -- 172.21.15.12:0/1558409705 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f62400162c0 con 0x7f62380039c0 2024-09-11T23:03:10.720 INFO:teuthology.orchestra.run.smithi012.stderr:adjusted tunables profile to default 2024-09-11T23:03:10.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.717+0000 7f62565f7640 1 -- 172.21.15.12:0/1558409705 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62380039c0 msgr2=0x7f625009cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:10.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.717+0000 7f62565f7640 1 --2- 172.21.15.12:0/1558409705 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62380039c0 0x7f625009cf70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f62400192e0 tx=0x7f6238005840 comp rx=0 tx=0).stop 2024-09-11T23:03:10.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.717+0000 7f62565f7640 1 -- 172.21.15.12:0/1558409705 shutdown_connections 2024-09-11T23:03:10.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.717+0000 7f62565f7640 1 --2- 172.21.15.12:0/1558409705 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62380039c0 0x7f625009cf70 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:10.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.717+0000 7f62565f7640 1 -- 172.21.15.12:0/1558409705 >> 172.21.15.12:0/1558409705 conn(0x7f6250067e00 msgr2=0x7f625013afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:10.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.717+0000 7f62565f7640 1 -- 172.21.15.12:0/1558409705 shutdown_connections 2024-09-11T23:03:10.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:10.717+0000 7f62565f7640 1 -- 172.21.15.12:0/1558409705 wait complete. 2024-09-11T23:03:10.738 INFO:tasks.ceph:check_enable_crimson: False 2024-09-11T23:03:10.738 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-11T23:03:10.738 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T23:03:10.738 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-11T23:03:10.748 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T23:03:10.748 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-11T23:03:10.805 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T23:03:10.805 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-11T23:03:10.861 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --cluster ceph osd new 153b72a1-40b1-400d-93ea-333e733f9bc1 0 2024-09-11T23:03:10.898 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:03:10.893+0000 7f28e25d7180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T23:03:11.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.013+0000 7fee0c233640 1 Processor -- start 2024-09-11T23:03:11.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.013+0000 7fee0c233640 1 -- start start 2024-09-11T23:03:11.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.017+0000 7fee0c233640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fee040a4650 0x7fee040a2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:11.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.017+0000 7fee0c233640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee040a1f30 con 0x7fee040a4a30 2024-09-11T23:03:11.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.017+0000 7fee0c233640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fee040a2e90 con 0x7fee040a4650 2024-09-11T23:03:11.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.017+0000 7fee097ce640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fee040a4a30 0x7fee04136850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43552/0 (socket says 172.21.15.12:43552) 2024-09-11T23:03:11.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.017+0000 7fee09fcf640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fee040a4650 0x7fee040a2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:11.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.017+0000 7fee097ce640 1 -- 172.21.15.12:0/3027248129 learned_addr learned my addr 172.21.15.12:0/3027248129 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:03:11.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.017+0000 7fee09fcf640 1 -- 172.21.15.12:0/3027248129 >> v1:172.21.15.12:6789/0 conn(0x7fee040a4a30 legacy=0x7fee04136850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:11.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.017+0000 7fee09fcf640 1 -- 172.21.15.12:0/3027248129 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee040a06f0 con 0x7fee040a4650 2024-09-11T23:03:11.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.017+0000 7fee09fcf640 1 --2- 172.21.15.12:0/3027248129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee040a4650 0x7fee040a2950 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fee00009740 tx=0x7fee0001c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e163fcfcd1600fd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:11.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.017+0000 7fee08fcd640 1 -- 172.21.15.12:0/3027248129 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee000b0070 con 0x7fee040a4650 2024-09-11T23:03:11.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.017+0000 7fee08fcd640 1 -- 172.21.15.12:0/3027248129 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee000ab530 con 0x7fee040a4650 2024-09-11T23:03:11.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.017+0000 7fee08fcd640 1 -- 172.21.15.12:0/3027248129 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee000ab830 con 0x7fee040a4650 2024-09-11T23:03:11.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.021+0000 7fee0c233640 1 -- 172.21.15.12:0/3027248129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee040a4650 msgr2=0x7fee040a2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:11.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.021+0000 7fee0c233640 1 --2- 172.21.15.12:0/3027248129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee040a4650 0x7fee040a2950 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fee00009740 tx=0x7fee0001c390 comp rx=0 tx=0).stop 2024-09-11T23:03:11.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.021+0000 7fee0c233640 1 -- 172.21.15.12:0/3027248129 shutdown_connections 2024-09-11T23:03:11.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.021+0000 7fee0c233640 1 --2- 172.21.15.12:0/3027248129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee040a4650 0x7fee040a2950 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:11.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.021+0000 7fee0c233640 1 -- 172.21.15.12:0/3027248129 >> 172.21.15.12:0/3027248129 conn(0x7fee040a9320 msgr2=0x7fee040a9730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:11.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.021+0000 7fee0c233640 1 -- 172.21.15.12:0/3027248129 shutdown_connections 2024-09-11T23:03:11.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.021+0000 7fee0c233640 1 -- 172.21.15.12:0/3027248129 wait complete. 2024-09-11T23:03:11.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.021+0000 7fee0c233640 1 Processor -- start 2024-09-11T23:03:11.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.021+0000 7fee0c233640 1 -- start start 2024-09-11T23:03:11.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.021+0000 7fee0c233640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee040a4650 0x7fee041347c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:11.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.021+0000 7fee0c233640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fee0413ed10 con 0x7fee040a4650 2024-09-11T23:03:11.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.021+0000 7fee09fcf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee040a4650 0x7fee041347c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:11.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.021+0000 7fee09fcf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee040a4650 0x7fee041347c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39564/0 (socket says 172.21.15.12:39564) 2024-09-11T23:03:11.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.021+0000 7fee09fcf640 1 -- 172.21.15.12:0/1410852763 learned_addr learned my addr 172.21.15.12:0/1410852763 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:11.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.021+0000 7fee09fcf640 1 -- 172.21.15.12:0/1410852763 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee0413b090 con 0x7fee040a4650 2024-09-11T23:03:11.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.021+0000 7fee09fcf640 1 --2- 172.21.15.12:0/1410852763 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee040a4650 0x7fee041347c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fee000ae040 tx=0x7fee0001abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:11.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.021+0000 7fedfa7fc640 1 -- 172.21.15.12:0/1410852763 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee000b0050 con 0x7fee040a4650 2024-09-11T23:03:11.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.021+0000 7fedfa7fc640 1 -- 172.21.15.12:0/1410852763 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee000b1040 con 0x7fee040a4650 2024-09-11T23:03:11.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.021+0000 7fee0c233640 1 -- 172.21.15.12:0/1410852763 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee04135b40 con 0x7fee040a4650 2024-09-11T23:03:11.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.021+0000 7fedfa7fc640 1 -- 172.21.15.12:0/1410852763 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee000b5740 con 0x7fee040a4650 2024-09-11T23:03:11.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.021+0000 7fee0c233640 1 -- 172.21.15.12:0/1410852763 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee0413c150 con 0x7fee040a4650 2024-09-11T23:03:11.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.021+0000 7fedfa7fc640 1 -- 172.21.15.12:0/1410852763 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fee000be030 con 0x7fee040a4650 2024-09-11T23:03:11.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.021+0000 7fedfa7fc640 1 -- 172.21.15.12:0/1410852763 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fee000bc070 con 0x7fee040a4650 2024-09-11T23:03:11.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.025+0000 7fee0c233640 1 -- 172.21.15.12:0/1410852763 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee0413bc00 con 0x7fee040a4650 2024-09-11T23:03:11.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.025+0000 7fedfa7fc640 1 -- 172.21.15.12:0/1410852763 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fee000c5020 con 0x7fee040a4650 2024-09-11T23:03:11.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.097+0000 7fee0c233640 1 -- 172.21.15.12:0/1410852763 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd new", "uuid": "153b72a1-40b1-400d-93ea-333e733f9bc1", "id": 0} v 0) -- 0x7fee040a2950 con 0x7fee040a4650 2024-09-11T23:03:11.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.097+0000 7fedfa7fc640 1 -- 172.21.15.12:0/1410852763 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "153b72a1-40b1-400d-93ea-333e733f9bc1", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fee000a4e20 con 0x7fee040a4650 2024-09-11T23:03:11.102 INFO:teuthology.orchestra.run.smithi012.stdout:0 2024-09-11T23:03:11.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.097+0000 7fee0c233640 1 -- 172.21.15.12:0/1410852763 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee040a4650 msgr2=0x7fee041347c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:11.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.097+0000 7fee0c233640 1 --2- 172.21.15.12:0/1410852763 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee040a4650 0x7fee041347c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fee000ae040 tx=0x7fee0001abd0 comp rx=0 tx=0).stop 2024-09-11T23:03:11.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.101+0000 7fee0c233640 1 -- 172.21.15.12:0/1410852763 shutdown_connections 2024-09-11T23:03:11.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.101+0000 7fee0c233640 1 --2- 172.21.15.12:0/1410852763 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee040a4650 0x7fee041347c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:11.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.101+0000 7fee0c233640 1 -- 172.21.15.12:0/1410852763 >> 172.21.15.12:0/1410852763 conn(0x7fee040a9320 msgr2=0x7fee0406ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:11.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.101+0000 7fee0c233640 1 -- 172.21.15.12:0/1410852763 shutdown_connections 2024-09-11T23:03:11.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.101+0000 7fee0c233640 1 -- 172.21.15.12:0/1410852763 wait complete. 2024-09-11T23:03:11.120 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --cluster ceph osd new 94669e49-ee4f-4acf-9e25-e94374dda8a0 1 2024-09-11T23:03:11.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.237+0000 7fa65e81d640 1 Processor -- start 2024-09-11T23:03:11.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.237+0000 7fa65e81d640 1 -- start start 2024-09-11T23:03:11.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.241+0000 7fa65e81d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa65809fc40 0x7fa65813ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:11.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.241+0000 7fa65e81d640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6580a1c00 con 0x7fa65813a200 2024-09-11T23:03:11.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.241+0000 7fa65e81d640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fa6580a0e40 con 0x7fa65809fc40 2024-09-11T23:03:11.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.241+0000 7fa6577fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa65809fc40 0x7fa65813ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:11.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.241+0000 7fa657fff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa65813a200 0x7fa65813a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43564/0 (socket says 172.21.15.12:43564) 2024-09-11T23:03:11.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.241+0000 7fa657fff640 1 -- 172.21.15.12:0/3745534705 learned_addr learned my addr 172.21.15.12:0/3745534705 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:03:11.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.241+0000 7fa656ffd640 1 -- 172.21.15.12:0/3745534705 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3588925939 0 0) 0x7fa6580a1c00 con 0x7fa65813a200 2024-09-11T23:03:11.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.241+0000 7fa656ffd640 1 -- 172.21.15.12:0/3745534705 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa640003530 con 0x7fa65813a200 2024-09-11T23:03:11.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.241+0000 7fa6577fe640 1 -- 172.21.15.12:0/3745534705 >> v1:172.21.15.12:6789/0 conn(0x7fa65813a200 legacy=0x7fa65813a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:11.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.241+0000 7fa6577fe640 1 -- 172.21.15.12:0/3745534705 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa65809f350 con 0x7fa65809fc40 2024-09-11T23:03:11.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.245+0000 7fa6577fe640 1 --2- 172.21.15.12:0/3745534705 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa65809fc40 0x7fa65813ef80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa64c009740 tx=0x7fa64c01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdcc27b2755734af server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:11.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.245+0000 7fa656ffd640 1 -- 172.21.15.12:0/3745534705 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa64c0b0070 con 0x7fa65809fc40 2024-09-11T23:03:11.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.245+0000 7fa656ffd640 1 -- 172.21.15.12:0/3745534705 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa64c0ab530 con 0x7fa65809fc40 2024-09-11T23:03:11.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.245+0000 7fa656ffd640 1 -- 172.21.15.12:0/3745534705 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa64c0ab830 con 0x7fa65809fc40 2024-09-11T23:03:11.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.245+0000 7fa65e81d640 1 -- 172.21.15.12:0/3745534705 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa65809fc40 msgr2=0x7fa65813ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:11.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.245+0000 7fa65e81d640 1 --2- 172.21.15.12:0/3745534705 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa65809fc40 0x7fa65813ef80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa64c009740 tx=0x7fa64c01c390 comp rx=0 tx=0).stop 2024-09-11T23:03:11.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.245+0000 7fa65e81d640 1 -- 172.21.15.12:0/3745534705 shutdown_connections 2024-09-11T23:03:11.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.245+0000 7fa65e81d640 1 --2- 172.21.15.12:0/3745534705 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa65809fc40 0x7fa65813ef80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:11.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.245+0000 7fa65e81d640 1 -- 172.21.15.12:0/3745534705 >> 172.21.15.12:0/3745534705 conn(0x7fa65806da30 msgr2=0x7fa65806de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:11.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.245+0000 7fa65e81d640 1 -- 172.21.15.12:0/3745534705 shutdown_connections 2024-09-11T23:03:11.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.245+0000 7fa65e81d640 1 -- 172.21.15.12:0/3745534705 wait complete. 2024-09-11T23:03:11.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.245+0000 7fa65e81d640 1 Processor -- start 2024-09-11T23:03:11.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.245+0000 7fa65e81d640 1 -- start start 2024-09-11T23:03:11.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.245+0000 7fa65e81d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa65813a200 0x7fa6580a31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:11.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.245+0000 7fa65e81d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa658141ce0 con 0x7fa65813a200 2024-09-11T23:03:11.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.245+0000 7fa657fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa65813a200 0x7fa6580a31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:11.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.245+0000 7fa657fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa65813a200 0x7fa6580a31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39586/0 (socket says 172.21.15.12:39586) 2024-09-11T23:03:11.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.245+0000 7fa657fff640 1 -- 172.21.15.12:0/3166504545 learned_addr learned my addr 172.21.15.12:0/3166504545 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:11.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.245+0000 7fa657fff640 1 -- 172.21.15.12:0/3166504545 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6580ac0f0 con 0x7fa65813a200 2024-09-11T23:03:11.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.245+0000 7fa657fff640 1 --2- 172.21.15.12:0/3166504545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa65813a200 0x7fa6580a31b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa64800c450 tx=0x7fa64800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:11.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.245+0000 7fa654ff9640 1 -- 172.21.15.12:0/3166504545 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa648017070 con 0x7fa65813a200 2024-09-11T23:03:11.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.245+0000 7fa654ff9640 1 -- 172.21.15.12:0/3166504545 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa648005c20 con 0x7fa65813a200 2024-09-11T23:03:11.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.245+0000 7fa654ff9640 1 -- 172.21.15.12:0/3166504545 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa648007070 con 0x7fa65813a200 2024-09-11T23:03:11.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.245+0000 7fa65e81d640 1 -- 172.21.15.12:0/3166504545 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6580a45d0 con 0x7fa65813a200 2024-09-11T23:03:11.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.245+0000 7fa65e81d640 1 -- 172.21.15.12:0/3166504545 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6580a6880 con 0x7fa65813a200 2024-09-11T23:03:11.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.245+0000 7fa654ff9640 1 -- 172.21.15.12:0/3166504545 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa64801a070 con 0x7fa65813a200 2024-09-11T23:03:11.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.249+0000 7fa654ff9640 1 -- 172.21.15.12:0/3166504545 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fa648012400 con 0x7fa65813a200 2024-09-11T23:03:11.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.249+0000 7fa65e81d640 1 -- 172.21.15.12:0/3166504545 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa65813a660 con 0x7fa65813a200 2024-09-11T23:03:11.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.249+0000 7fa654ff9640 1 -- 172.21.15.12:0/3166504545 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fa64801c440 con 0x7fa65813a200 2024-09-11T23:03:11.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.321+0000 7fa65e81d640 1 -- 172.21.15.12:0/3166504545 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd new", "uuid": "94669e49-ee4f-4acf-9e25-e94374dda8a0", "id": 1} v 0) -- 0x7fa6580a7080 con 0x7fa65813a200 2024-09-11T23:03:11.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.321+0000 7fa654ff9640 1 -- 172.21.15.12:0/3166504545 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "94669e49-ee4f-4acf-9e25-e94374dda8a0", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fa648007260 con 0x7fa65813a200 2024-09-11T23:03:11.326 INFO:teuthology.orchestra.run.smithi012.stdout:1 2024-09-11T23:03:11.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.325+0000 7fa65e81d640 1 -- 172.21.15.12:0/3166504545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa65813a200 msgr2=0x7fa6580a31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:11.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.325+0000 7fa65e81d640 1 --2- 172.21.15.12:0/3166504545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa65813a200 0x7fa6580a31b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa64800c450 tx=0x7fa64800c910 comp rx=0 tx=0).stop 2024-09-11T23:03:11.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.325+0000 7fa65e81d640 1 -- 172.21.15.12:0/3166504545 shutdown_connections 2024-09-11T23:03:11.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.325+0000 7fa65e81d640 1 --2- 172.21.15.12:0/3166504545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa65813a200 0x7fa6580a31b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:11.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.325+0000 7fa65e81d640 1 -- 172.21.15.12:0/3166504545 >> 172.21.15.12:0/3166504545 conn(0x7fa65806da30 msgr2=0x7fa65809c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:11.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.325+0000 7fa65e81d640 1 -- 172.21.15.12:0/3166504545 shutdown_connections 2024-09-11T23:03:11.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.325+0000 7fa65e81d640 1 -- 172.21.15.12:0/3166504545 wait complete. 2024-09-11T23:03:11.344 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --cluster ceph osd new 826dae4d-8888-4ec5-8f00-425b3be93814 2 2024-09-11T23:03:11.408 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:03:11.405+0000 7f28e25d7180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T23:03:11.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.457+0000 7fe3d24cd640 1 Processor -- start 2024-09-11T23:03:11.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.457+0000 7fe3d24cd640 1 -- start start 2024-09-11T23:03:11.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.461+0000 7fe3d24cd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe3cc070120 0x7fe3cc070500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:11.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.461+0000 7fe3d24cd640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3cc09c0f0 con 0x7fe3cc070a40 2024-09-11T23:03:11.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.461+0000 7fe3d24cd640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fe3cc073200 con 0x7fe3cc070120 2024-09-11T23:03:11.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.461+0000 7fe3cbfff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe3cc070120 0x7fe3cc070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:11.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.461+0000 7fe3cb7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe3cc070a40 0x7fe3cc13a0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43572/0 (socket says 172.21.15.12:43572) 2024-09-11T23:03:11.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.461+0000 7fe3cb7fe640 1 -- 172.21.15.12:0/3558864653 learned_addr learned my addr 172.21.15.12:0/3558864653 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:03:11.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.461+0000 7fe3caffd640 1 -- 172.21.15.12:0/3558864653 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1980034234 0 0) 0x7fe3cc09c0f0 con 0x7fe3cc070a40 2024-09-11T23:03:11.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.461+0000 7fe3caffd640 1 -- 172.21.15.12:0/3558864653 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3b4003530 con 0x7fe3cc070a40 2024-09-11T23:03:11.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.461+0000 7fe3cbfff640 1 -- 172.21.15.12:0/3558864653 >> v1:172.21.15.12:6789/0 conn(0x7fe3cc070a40 legacy=0x7fe3cc13a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:11.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.461+0000 7fe3cbfff640 1 -- 172.21.15.12:0/3558864653 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3cc09be50 con 0x7fe3cc070120 2024-09-11T23:03:11.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.461+0000 7fe3cbfff640 1 --2- 172.21.15.12:0/3558864653 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3cc070120 0x7fe3cc070500 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc009740 tx=0x7fe3bc01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d0b33b720b6462d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:11.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.461+0000 7fe3caffd640 1 -- 172.21.15.12:0/3558864653 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3bc0b0070 con 0x7fe3cc070120 2024-09-11T23:03:11.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.461+0000 7fe3caffd640 1 -- 172.21.15.12:0/3558864653 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3bc0ab400 con 0x7fe3cc070120 2024-09-11T23:03:11.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.461+0000 7fe3caffd640 1 -- 172.21.15.12:0/3558864653 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3bc0ab6e0 con 0x7fe3cc070120 2024-09-11T23:03:11.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.465+0000 7fe3d24cd640 1 -- 172.21.15.12:0/3558864653 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3cc070120 msgr2=0x7fe3cc070500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:11.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.465+0000 7fe3d24cd640 1 --2- 172.21.15.12:0/3558864653 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3cc070120 0x7fe3cc070500 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc009740 tx=0x7fe3bc01c390 comp rx=0 tx=0).stop 2024-09-11T23:03:11.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.465+0000 7fe3d24cd640 1 -- 172.21.15.12:0/3558864653 shutdown_connections 2024-09-11T23:03:11.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.465+0000 7fe3d24cd640 1 --2- 172.21.15.12:0/3558864653 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3cc070120 0x7fe3cc070500 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:11.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.465+0000 7fe3d24cd640 1 -- 172.21.15.12:0/3558864653 >> 172.21.15.12:0/3558864653 conn(0x7fe3cc09aba0 msgr2=0x7fe3cc09afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:11.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.465+0000 7fe3d24cd640 1 -- 172.21.15.12:0/3558864653 shutdown_connections 2024-09-11T23:03:11.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.465+0000 7fe3d24cd640 1 -- 172.21.15.12:0/3558864653 wait complete. 2024-09-11T23:03:11.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.465+0000 7fe3d24cd640 1 Processor -- start 2024-09-11T23:03:11.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.465+0000 7fe3d24cd640 1 -- start start 2024-09-11T23:03:11.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.465+0000 7fe3d24cd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3cc070120 0x7fe3cc11f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:11.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.465+0000 7fe3d24cd640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe3cc067c60 con 0x7fe3cc070120 2024-09-11T23:03:11.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.465+0000 7fe3cbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3cc070120 0x7fe3cc11f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:11.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.465+0000 7fe3cbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3cc070120 0x7fe3cc11f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39606/0 (socket says 172.21.15.12:39606) 2024-09-11T23:03:11.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.465+0000 7fe3cbfff640 1 -- 172.21.15.12:0/3246488818 learned_addr learned my addr 172.21.15.12:0/3246488818 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:11.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.465+0000 7fe3cbfff640 1 -- 172.21.15.12:0/3246488818 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3cc0a75a0 con 0x7fe3cc070120 2024-09-11T23:03:11.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.465+0000 7fe3cbfff640 1 --2- 172.21.15.12:0/3246488818 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3cc070120 0x7fe3cc11f170 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc0ae040 tx=0x7fe3cc0710c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:11.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.465+0000 7fe3c8ff9640 1 -- 172.21.15.12:0/3246488818 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3bc0b8070 con 0x7fe3cc070120 2024-09-11T23:03:11.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.465+0000 7fe3c8ff9640 1 -- 172.21.15.12:0/3246488818 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3bc0abc60 con 0x7fe3cc070120 2024-09-11T23:03:11.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.465+0000 7fe3d24cd640 1 -- 172.21.15.12:0/3246488818 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3cc13fa60 con 0x7fe3cc070120 2024-09-11T23:03:11.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.465+0000 7fe3c8ff9640 1 -- 172.21.15.12:0/3246488818 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3bc0b0040 con 0x7fe3cc070120 2024-09-11T23:03:11.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.465+0000 7fe3d24cd640 1 -- 172.21.15.12:0/3246488818 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3cc0a6d00 con 0x7fe3cc070120 2024-09-11T23:03:11.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.465+0000 7fe3c8ff9640 1 -- 172.21.15.12:0/3246488818 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe3bc0bb070 con 0x7fe3cc070120 2024-09-11T23:03:11.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.465+0000 7fe3c8ff9640 1 -- 172.21.15.12:0/3246488818 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fe3bc0b4830 con 0x7fe3cc070120 2024-09-11T23:03:11.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.465+0000 7fe3d24cd640 1 -- 172.21.15.12:0/3246488818 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3cc071660 con 0x7fe3cc070120 2024-09-11T23:03:11.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.469+0000 7fe3c8ff9640 1 -- 172.21.15.12:0/3246488818 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fe3bc016010 con 0x7fe3cc070120 2024-09-11T23:03:11.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.541+0000 7fe3d24cd640 1 -- 172.21.15.12:0/3246488818 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd new", "uuid": "826dae4d-8888-4ec5-8f00-425b3be93814", "id": 2} v 0) -- 0x7fe3cc072c40 con 0x7fe3cc070120 2024-09-11T23:03:11.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.541+0000 7fe3c8ff9640 1 -- 172.21.15.12:0/3246488818 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "826dae4d-8888-4ec5-8f00-425b3be93814", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fe3bc0b4410 con 0x7fe3cc070120 2024-09-11T23:03:11.545 INFO:teuthology.orchestra.run.smithi012.stdout:2 2024-09-11T23:03:11.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.541+0000 7fe3d24cd640 1 -- 172.21.15.12:0/3246488818 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3cc070120 msgr2=0x7fe3cc11f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:11.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.541+0000 7fe3d24cd640 1 --2- 172.21.15.12:0/3246488818 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3cc070120 0x7fe3cc11f170 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc0ae040 tx=0x7fe3cc0710c0 comp rx=0 tx=0).stop 2024-09-11T23:03:11.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.541+0000 7fe3d24cd640 1 -- 172.21.15.12:0/3246488818 shutdown_connections 2024-09-11T23:03:11.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.541+0000 7fe3d24cd640 1 --2- 172.21.15.12:0/3246488818 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3cc070120 0x7fe3cc11f170 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:11.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.541+0000 7fe3d24cd640 1 -- 172.21.15.12:0/3246488818 >> 172.21.15.12:0/3246488818 conn(0x7fe3cc09aba0 msgr2=0x7fe3cc1398a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:11.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.541+0000 7fe3d24cd640 1 -- 172.21.15.12:0/3246488818 shutdown_connections 2024-09-11T23:03:11.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.541+0000 7fe3d24cd640 1 -- 172.21.15.12:0/3246488818 wait complete. 2024-09-11T23:03:11.563 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-11T23:03:11.563 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-11T23:03:11.566 INFO:tasks.ceph.osd.0:Started 2024-09-11T23:03:11.566 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-11T23:03:11.566 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-11T23:03:11.568 INFO:tasks.ceph.osd.1:Started 2024-09-11T23:03:11.568 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-11T23:03:11.568 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-11T23:03:11.570 INFO:tasks.ceph.osd.2:Started 2024-09-11T23:03:11.570 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:03:11.604 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:03:11.601+0000 7f28e25d7180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T23:03:11.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.681+0000 7f840d5dd640 1 Processor -- start 2024-09-11T23:03:11.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.681+0000 7f840d5dd640 1 -- start start 2024-09-11T23:03:11.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.681+0000 7f840d5dd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f84081378d0 0x7f8408137cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:11.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.681+0000 7f840d5dd640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84080a4cb0 con 0x7f84081381f0 2024-09-11T23:03:11.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.681+0000 7f840d5dd640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f8408073a00 con 0x7f84081378d0 2024-09-11T23:03:11.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.681+0000 7f8406ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f84081378d0 0x7f8408137cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:11.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.681+0000 7f84067fc640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f84081381f0 0x7f84081346c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43610/0 (socket says 172.21.15.12:43610) 2024-09-11T23:03:11.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.681+0000 7f84067fc640 1 -- 172.21.15.12:0/608621995 learned_addr learned my addr 172.21.15.12:0/608621995 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:03:11.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.681+0000 7f8406ffd640 1 -- 172.21.15.12:0/608621995 >> v1:172.21.15.12:6789/0 conn(0x7f84081381f0 legacy=0x7f84081346c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:11.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.681+0000 7f8406ffd640 1 -- 172.21.15.12:0/608621995 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84080709a0 con 0x7f84081378d0 2024-09-11T23:03:11.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.681+0000 7f8406ffd640 1 --2- 172.21.15.12:0/608621995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84081378d0 0x7f8408137cb0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8400009d90 tx=0x7f840001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0497eee11364368 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:11.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.681+0000 7f8405ffb640 1 -- 172.21.15.12:0/608621995 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84000b2070 con 0x7f84081378d0 2024-09-11T23:03:11.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.681+0000 7f8405ffb640 1 -- 172.21.15.12:0/608621995 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84000a57c0 con 0x7f84081378d0 2024-09-11T23:03:11.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.681+0000 7f8405ffb640 1 -- 172.21.15.12:0/608621995 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84000a5ac0 con 0x7f84081378d0 2024-09-11T23:03:11.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.685+0000 7f840d5dd640 1 -- 172.21.15.12:0/608621995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84081378d0 msgr2=0x7f8408137cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:11.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.685+0000 7f840d5dd640 1 --2- 172.21.15.12:0/608621995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84081378d0 0x7f8408137cb0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8400009d90 tx=0x7f840001c910 comp rx=0 tx=0).stop 2024-09-11T23:03:11.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.685+0000 7f840d5dd640 1 -- 172.21.15.12:0/608621995 shutdown_connections 2024-09-11T23:03:11.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.685+0000 7f840d5dd640 1 --2- 172.21.15.12:0/608621995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84081378d0 0x7f8408137cb0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:11.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.685+0000 7f840d5dd640 1 -- 172.21.15.12:0/608621995 >> 172.21.15.12:0/608621995 conn(0x7f8408067e00 msgr2=0x7f8408068210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:11.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.685+0000 7f840d5dd640 1 -- 172.21.15.12:0/608621995 shutdown_connections 2024-09-11T23:03:11.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.685+0000 7f840d5dd640 1 -- 172.21.15.12:0/608621995 wait complete. 2024-09-11T23:03:11.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.685+0000 7f840d5dd640 1 Processor -- start 2024-09-11T23:03:11.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.685+0000 7f840d5dd640 1 -- start start 2024-09-11T23:03:11.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.685+0000 7f840d5dd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84081378d0 0x7f840809ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:11.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.685+0000 7f840d5dd640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f84080a0e80 con 0x7f84081378d0 2024-09-11T23:03:11.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.685+0000 7f8406ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84081378d0 0x7f840809ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:11.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.685+0000 7f8406ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84081378d0 0x7f840809ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39656/0 (socket says 172.21.15.12:39656) 2024-09-11T23:03:11.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.685+0000 7f8406ffd640 1 -- 172.21.15.12:0/677102372 learned_addr learned my addr 172.21.15.12:0/677102372 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:11.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.685+0000 7f8406ffd640 1 -- 172.21.15.12:0/677102372 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84080a98c0 con 0x7f84081378d0 2024-09-11T23:03:11.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.685+0000 7f8406ffd640 1 --2- 172.21.15.12:0/677102372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84081378d0 0x7f840809ede0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f840001a5a0 tx=0x7f8400019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:11.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.685+0000 7f83ff7fe640 1 -- 172.21.15.12:0/677102372 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84000b2050 con 0x7f84081378d0 2024-09-11T23:03:11.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.685+0000 7f83ff7fe640 1 -- 172.21.15.12:0/677102372 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84000b3040 con 0x7f84081378d0 2024-09-11T23:03:11.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.685+0000 7f83ff7fe640 1 -- 172.21.15.12:0/677102372 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84000ad8b0 con 0x7f84081378d0 2024-09-11T23:03:11.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.685+0000 7f840d5dd640 1 -- 172.21.15.12:0/677102372 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84080a9370 con 0x7f84081378d0 2024-09-11T23:03:11.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.685+0000 7f840d5dd640 1 -- 172.21.15.12:0/677102372 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f840806e7f0 con 0x7f84081378d0 2024-09-11T23:03:11.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.685+0000 7f83ff7fe640 1 -- 172.21.15.12:0/677102372 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f84000c0020 con 0x7f84081378d0 2024-09-11T23:03:11.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.685+0000 7f83ff7fe640 1 -- 172.21.15.12:0/677102372 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f84000be020 con 0x7f84081378d0 2024-09-11T23:03:11.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.685+0000 7f840d5dd640 1 -- 172.21.15.12:0/677102372 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8408071570 con 0x7f84081378d0 2024-09-11T23:03:11.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.689+0000 7f83ff7fe640 1 -- 172.21.15.12:0/677102372 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f8400016560 con 0x7f84081378d0 2024-09-11T23:03:11.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.749+0000 7f840d5dd640 1 -- 172.21.15.12:0/677102372 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f840806bc60 con 0x7f84081378d0 2024-09-11T23:03:11.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.749+0000 7f83ff7fe640 1 -- 172.21.15.12:0/677102372 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v5) ==== 74+0+3427 (secure 0 0 0) 0x7f84000b9450 con 0x7f84081378d0 2024-09-11T23:03:11.754 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:03:11.754 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":5,"fsid":"8be14356-3340-4500-91a2-4cbc6b511f65","created":"2024-09-11T23:03:10.620234+0000","modified":"2024-09-11T23:03:11.545817+0000","last_up_change":"0.000000","last_in_change":"2024-09-11T23:03:11.545817+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"153b72a1-40b1-400d-93ea-333e733f9bc1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"94669e49-ee4f-4acf-9e25-e94374dda8a0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"826dae4d-8888-4ec5-8f00-425b3be93814","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:03:11.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.749+0000 7f840d5dd640 1 -- 172.21.15.12:0/677102372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84081378d0 msgr2=0x7f840809ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:11.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.749+0000 7f840d5dd640 1 --2- 172.21.15.12:0/677102372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84081378d0 0x7f840809ede0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f840001a5a0 tx=0x7f8400019710 comp rx=0 tx=0).stop 2024-09-11T23:03:11.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.749+0000 7f840d5dd640 1 -- 172.21.15.12:0/677102372 shutdown_connections 2024-09-11T23:03:11.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.749+0000 7f840d5dd640 1 --2- 172.21.15.12:0/677102372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84081378d0 0x7f840809ede0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:11.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.749+0000 7f840d5dd640 1 -- 172.21.15.12:0/677102372 >> 172.21.15.12:0/677102372 conn(0x7f8408067e00 msgr2=0x7f84080a7d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:11.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.749+0000 7f840d5dd640 1 -- 172.21.15.12:0/677102372 shutdown_connections 2024-09-11T23:03:11.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:11.749+0000 7f840d5dd640 1 -- 172.21.15.12:0/677102372 wait complete. 2024-09-11T23:03:11.770 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-11T23:03:11.770 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-11T23:03:12.072 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-11T23:03:12.182 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:12.177+0000 7fdf93ca3640 1 Processor -- start 2024-09-11T23:03:12.182 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:12.177+0000 7fdf93ca3640 1 -- start start 2024-09-11T23:03:12.183 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:12.177+0000 7fdf93ca3640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdf8c0a18a0 0x7fdf8c13a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:12.183 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:12.177+0000 7fdf93ca3640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf8c09f3d0 con 0x7fdf8c13a580 2024-09-11T23:03:12.183 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:12.177+0000 7fdf93ca3640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fdf8c0a10c0 con 0x7fdf8c0a18a0 2024-09-11T23:03:12.184 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:12.177+0000 7fdf91a3f640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdf8c0a18a0 0x7fdf8c13a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:12.184 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:12.181+0000 7fdf91a3f640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdf8c0a18a0 0x7fdf8c13a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39668/0 (socket says 172.21.15.12:39668) 2024-09-11T23:03:12.184 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:12.181+0000 7fdf9123e640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fdf8c13a580 0x7fdf8c1365f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43616/0 (socket says 172.21.15.12:43616) 2024-09-11T23:03:12.184 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:12.181+0000 7fdf91a3f640 1 -- 172.21.15.12:0/2898961041 learned_addr learned my addr 172.21.15.12:0/2898961041 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:12.184 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:12.181+0000 7fdf91a3f640 1 -- 172.21.15.12:0/2898961041 >> v1:172.21.15.12:6789/0 conn(0x7fdf8c13a580 legacy=0x7fdf8c1365f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:12.184 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:12.181+0000 7fdf91a3f640 1 -- 172.21.15.12:0/2898961041 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf8c0a03d0 con 0x7fdf8c0a18a0 2024-09-11T23:03:12.185 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:12.181+0000 7fdf91a3f640 1 --2- 172.21.15.12:0/2898961041 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf8c0a18a0 0x7fdf8c13a040 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fdf880097f0 tx=0x7fdf8801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc968b244cbb58cf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:12.186 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:12.181+0000 7fdf90a3d640 1 -- 172.21.15.12:0/2898961041 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf880b0070 con 0x7fdf8c0a18a0 2024-09-11T23:03:12.186 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:12.181+0000 7fdf90a3d640 1 -- 172.21.15.12:0/2898961041 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf880ab530 con 0x7fdf8c0a18a0 2024-09-11T23:03:12.186 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:12.181+0000 7fdf90a3d640 1 -- 172.21.15.12:0/2898961041 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf880ab830 con 0x7fdf8c0a18a0 2024-09-11T23:03:12.187 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:12.181+0000 7fdf93ca3640 1 -- 172.21.15.12:0/2898961041 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf8c0a18a0 msgr2=0x7fdf8c13a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:12.188 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:12.181+0000 7fdf93ca3640 1 --2- 172.21.15.12:0/2898961041 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf8c0a18a0 0x7fdf8c13a040 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fdf880097f0 tx=0x7fdf8801c450 comp rx=0 tx=0).stop 2024-09-11T23:03:12.188 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:12.181+0000 7fdf93ca3640 1 -- 172.21.15.12:0/2898961041 shutdown_connections 2024-09-11T23:03:12.188 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:12.181+0000 7fdf93ca3640 1 --2- 172.21.15.12:0/2898961041 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf8c0a18a0 0x7fdf8c13a040 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:12.188 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:12.181+0000 7fdf93ca3640 1 -- 172.21.15.12:0/2898961041 >> 172.21.15.12:0/2898961041 conn(0x7fdf8c06daf0 msgr2=0x7fdf8c06df00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:12.188 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:12.181+0000 7fdf93ca3640 1 -- 172.21.15.12:0/2898961041 shutdown_connections 2024-09-11T23:03:12.188 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:12.181+0000 7fdf93ca3640 1 -- 172.21.15.12:0/2898961041 wait complete. 2024-09-11T23:03:12.189 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:12.185+0000 7fdf93ca3640 1 Processor -- start 2024-09-11T23:03:12.189 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:12.185+0000 7fdf93ca3640 1 -- start start 2024-09-11T23:03:12.191 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:12.185+0000 7fdf93ca3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf8c0a18a0 0x7fdf8c0a3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:12.191 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:12.185+0000 7fdf93ca3640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fdf8c09fe80 con 0x7fdf8c0a18a0 2024-09-11T23:03:12.191 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:12.185+0000 7fdf91a3f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf8c0a18a0 0x7fdf8c0a3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:12.192 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:12.185+0000 7fdf91a3f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf8c0a18a0 0x7fdf8c0a3f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39672/0 (socket says 172.21.15.12:39672) 2024-09-11T23:03:12.192 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:12.185+0000 7fdf91a3f640 1 -- 172.21.15.12:0/2322662688 learned_addr learned my addr 172.21.15.12:0/2322662688 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:12.192 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:12.185+0000 7fdf91a3f640 1 -- 172.21.15.12:0/2322662688 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf8c0a34d0 con 0x7fdf8c0a18a0 2024-09-11T23:03:12.192 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:12.185+0000 7fdf91a3f640 1 --2- 172.21.15.12:0/2322662688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf8c0a18a0 0x7fdf8c0a3f10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdf88019060 tx=0x7fdf8801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:12.193 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:12.185+0000 7fdf827fc640 1 -- 172.21.15.12:0/2322662688 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf880ba020 con 0x7fdf8c0a18a0 2024-09-11T23:03:12.193 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:12.185+0000 7fdf827fc640 1 -- 172.21.15.12:0/2322662688 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf880abe20 con 0x7fdf8c0a18a0 2024-09-11T23:03:12.193 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:12.185+0000 7fdf93ca3640 1 -- 172.21.15.12:0/2322662688 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf8c13efd0 con 0x7fdf8c0a18a0 2024-09-11T23:03:12.193 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:12.185+0000 7fdf93ca3640 1 -- 172.21.15.12:0/2322662688 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf8c13e990 con 0x7fdf8c0a18a0 2024-09-11T23:03:12.193 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:12.185+0000 7fdf827fc640 1 -- 172.21.15.12:0/2322662688 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf880b0040 con 0x7fdf8c0a18a0 2024-09-11T23:03:12.193 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:12.185+0000 7fdf827fc640 1 -- 172.21.15.12:0/2322662688 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdf880bd020 con 0x7fdf8c0a18a0 2024-09-11T23:03:12.193 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:12.185+0000 7fdf827fc640 1 -- 172.21.15.12:0/2322662688 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fdf880bfd40 con 0x7fdf8c0a18a0 2024-09-11T23:03:12.193 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:12.185+0000 7fdf93ca3640 1 -- 172.21.15.12:0/2322662688 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf740052a0 con 0x7fdf8c0a18a0 2024-09-11T23:03:12.194 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:12.189+0000 7fdf827fc640 1 -- 172.21.15.12:0/2322662688 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fdf880c4030 con 0x7fdf8c0a18a0 2024-09-11T23:03:12.212 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:03:12.209+0000 7f28e25d7180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T23:03:12.250 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:12.245+0000 7fdf93ca3640 1 -- 172.21.15.12:0/2322662688 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdf74005860 con 0x7fdf8c0a18a0 2024-09-11T23:03:12.251 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:12.245+0000 7fdf827fc640 1 -- 172.21.15.12:0/2322662688 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v5) ==== 74+0+3427 (secure 0 0 0) 0x7fdf880160d0 con 0x7fdf8c0a18a0 2024-09-11T23:03:12.252 INFO:teuthology.misc.health.smithi012.stdout: 2024-09-11T23:03:12.252 INFO:teuthology.misc.health.smithi012.stdout:{"epoch":5,"fsid":"8be14356-3340-4500-91a2-4cbc6b511f65","created":"2024-09-11T23:03:10.620234+0000","modified":"2024-09-11T23:03:11.545817+0000","last_up_change":"0.000000","last_in_change":"2024-09-11T23:03:11.545817+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"153b72a1-40b1-400d-93ea-333e733f9bc1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"94669e49-ee4f-4acf-9e25-e94374dda8a0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"826dae4d-8888-4ec5-8f00-425b3be93814","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:03:12.253 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:12.249+0000 7fdf93ca3640 1 -- 172.21.15.12:0/2322662688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf8c0a18a0 msgr2=0x7fdf8c0a3f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:12.254 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:12.249+0000 7fdf93ca3640 1 --2- 172.21.15.12:0/2322662688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf8c0a18a0 0x7fdf8c0a3f10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdf88019060 tx=0x7fdf8801ac90 comp rx=0 tx=0).stop 2024-09-11T23:03:12.254 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:12.249+0000 7fdf93ca3640 1 -- 172.21.15.12:0/2322662688 shutdown_connections 2024-09-11T23:03:12.254 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:12.249+0000 7fdf93ca3640 1 --2- 172.21.15.12:0/2322662688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf8c0a18a0 0x7fdf8c0a3f10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:12.254 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:12.249+0000 7fdf93ca3640 1 -- 172.21.15.12:0/2322662688 >> 172.21.15.12:0/2322662688 conn(0x7fdf8c06daf0 msgr2=0x7fdf8c1335b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:12.254 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:12.249+0000 7fdf93ca3640 1 -- 172.21.15.12:0/2322662688 shutdown_connections 2024-09-11T23:03:12.254 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:12.249+0000 7fdf93ca3640 1 -- 172.21.15.12:0/2322662688 wait complete. 2024-09-11T23:03:12.266 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-09-11T23:03:12.270 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:03:12.265+0000 7f28e25d7180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T23:03:12.326 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:03:12.321+0000 7f28e25d7180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T23:03:12.407 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:03:12.405+0000 7f28e25d7180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T23:03:12.462 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:03:12.457+0000 7f28e25d7180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T23:03:12.543 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:03:12.537+0000 7f28e25d7180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T23:03:12.598 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:03:12.593+0000 7f28e25d7180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T23:03:12.758 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:03:12.753+0000 7f28e25d7180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T23:03:12.822 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:03:12.817+0000 7f28e25d7180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T23:03:13.197 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T23:03:13.193+0000 7fafea0b17c0 -1 Falling back to public interface 2024-09-11T23:03:13.433 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T23:03:13.429+0000 7f29d84d47c0 -1 Falling back to public interface 2024-09-11T23:03:13.495 INFO:tasks.ceph.mgr.x.smithi012.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-11T23:03:13.592 INFO:tasks.ceph.mgr.x.smithi012.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-11T23:03:13.593 INFO:tasks.ceph.mgr.x.smithi012.stderr: from numpy import show_config as show_numpy_config 2024-09-11T23:03:13.593 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:03:13.545+0000 7f28e25d7180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T23:03:13.652 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T23:03:13.649+0000 7f99e1aa27c0 -1 Falling back to public interface 2024-09-11T23:03:13.718 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:03:13.713+0000 7f28e25d7180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:03:13.887 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:03:13.885+0000 7f28e25d7180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T23:03:13.960 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:03:13.957+0000 7f28e25d7180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T23:03:14.112 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:03:14.109+0000 7f28e25d7180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:03:14.762 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:03:14.757+0000 7f28e25d7180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T23:03:14.841 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:03:14.837+0000 7f28e25d7180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T23:03:15.034 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:03:15.029+0000 7f28e25d7180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T23:03:15.112 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:03:15.109+0000 7f28e25d7180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T23:03:15.421 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:03:15.417+0000 7f28e25d7180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T23:03:15.486 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:03:15.481+0000 7f28e25d7180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T23:03:16.518 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:03:16.513+0000 7f2889210640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-11T23:03:17.711 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T23:03:17.709+0000 7fafea0b17c0 -1 osd.1 0 log_to_monitors true 2024-09-11T23:03:17.928 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T23:03:17.925+0000 7f29d84d47c0 -1 osd.2 0 log_to_monitors true 2024-09-11T23:03:18.384 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T23:03:18.381+0000 7f99e1aa27c0 -1 osd.0 0 log_to_monitors true 2024-09-11T23:03:18.569 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-11T23:03:18.694 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.689+0000 7f3499678640 1 Processor -- start 2024-09-11T23:03:18.695 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.689+0000 7f3499678640 1 -- start start 2024-09-11T23:03:18.696 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.693+0000 7f3499678640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f349406faf0 0x7f349406fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:18.696 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.693+0000 7f3499678640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3494071220 con 0x7f34940a08d0 2024-09-11T23:03:18.696 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.693+0000 7f3499678640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f34940a0180 con 0x7f349406faf0 2024-09-11T23:03:18.696 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.693+0000 7f3492ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f349406faf0 0x7f349406fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:18.696 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.693+0000 7f34927fc640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f34940a08d0 0x7f3494136aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:59820/0 (socket says 172.21.15.12:59820) 2024-09-11T23:03:18.696 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.693+0000 7f34927fc640 1 -- 172.21.15.12:0/803068181 learned_addr learned my addr 172.21.15.12:0/803068181 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:03:18.696 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.693+0000 7f3492ffd640 1 -- 172.21.15.12:0/803068181 >> v1:172.21.15.12:6789/0 conn(0x7f34940a08d0 legacy=0x7f3494136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:18.696 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.693+0000 7f3491ffb640 1 -- 172.21.15.12:0/803068181 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3291202416 0 0) 0x7f3494071220 con 0x7f34940a08d0 2024-09-11T23:03:18.696 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.693+0000 7f3492ffd640 1 -- 172.21.15.12:0/803068181 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f349409fee0 con 0x7f349406faf0 2024-09-11T23:03:18.699 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.697+0000 7f3492ffd640 1 --2- 172.21.15.12:0/803068181 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f349406faf0 0x7f349406fed0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3484009740 tx=0x7f348401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7a320d80efb1ee server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:18.700 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.697+0000 7f3491ffb640 1 -- 172.21.15.12:0/803068181 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34840b0070 con 0x7f349406faf0 2024-09-11T23:03:18.700 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.697+0000 7f3491ffb640 1 -- 172.21.15.12:0/803068181 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34840ab530 con 0x7f349406faf0 2024-09-11T23:03:18.700 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.697+0000 7f3491ffb640 1 -- 172.21.15.12:0/803068181 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34840ab830 con 0x7f349406faf0 2024-09-11T23:03:18.701 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.697+0000 7f3499678640 1 -- 172.21.15.12:0/803068181 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f349406faf0 msgr2=0x7f349406fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:18.701 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.697+0000 7f3499678640 1 --2- 172.21.15.12:0/803068181 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f349406faf0 0x7f349406fed0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3484009740 tx=0x7f348401c390 comp rx=0 tx=0).stop 2024-09-11T23:03:18.701 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.697+0000 7f3499678640 1 -- 172.21.15.12:0/803068181 shutdown_connections 2024-09-11T23:03:18.701 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.697+0000 7f3499678640 1 --2- 172.21.15.12:0/803068181 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f349406faf0 0x7f349406fed0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:18.701 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.697+0000 7f3499678640 1 -- 172.21.15.12:0/803068181 >> 172.21.15.12:0/803068181 conn(0x7f349409ae50 msgr2=0x7f349409d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:18.701 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.697+0000 7f3499678640 1 -- 172.21.15.12:0/803068181 shutdown_connections 2024-09-11T23:03:18.701 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.697+0000 7f3499678640 1 -- 172.21.15.12:0/803068181 wait complete. 2024-09-11T23:03:18.702 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.697+0000 7f3499678640 1 Processor -- start 2024-09-11T23:03:18.702 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.697+0000 7f3499678640 1 -- start start 2024-09-11T23:03:18.702 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.697+0000 7f3499678640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f349406faf0 0x7f349411e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:18.702 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.697+0000 7f3499678640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f34941400e0 con 0x7f349406faf0 2024-09-11T23:03:18.702 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.697+0000 7f3492ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f349406faf0 0x7f349411e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:18.702 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.697+0000 7f3492ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f349406faf0 0x7f349411e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42168/0 (socket says 172.21.15.12:42168) 2024-09-11T23:03:18.703 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.697+0000 7f3492ffd640 1 -- 172.21.15.12:0/1969915774 learned_addr learned my addr 172.21.15.12:0/1969915774 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:18.703 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.697+0000 7f3492ffd640 1 -- 172.21.15.12:0/1969915774 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3494120360 con 0x7f349406faf0 2024-09-11T23:03:18.704 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.697+0000 7f3492ffd640 1 --2- 172.21.15.12:0/1969915774 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f349406faf0 0x7f349411e920 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3484018fa0 tx=0x7f348401abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:18.704 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.697+0000 7f347b7fe640 1 -- 172.21.15.12:0/1969915774 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34840b0050 con 0x7f349406faf0 2024-09-11T23:03:18.704 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.697+0000 7f347b7fe640 1 -- 172.21.15.12:0/1969915774 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34840b1040 con 0x7f349406faf0 2024-09-11T23:03:18.704 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.697+0000 7f3499678640 1 -- 172.21.15.12:0/1969915774 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3494122260 con 0x7f349406faf0 2024-09-11T23:03:18.704 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.701+0000 7f347b7fe640 1 -- 172.21.15.12:0/1969915774 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3484004280 con 0x7f349406faf0 2024-09-11T23:03:18.704 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.701+0000 7f3499678640 1 -- 172.21.15.12:0/1969915774 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3494120c40 con 0x7f349406faf0 2024-09-11T23:03:18.704 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.701+0000 7f347b7fe640 1 -- 172.21.15.12:0/1969915774 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 4) ==== 43997+0+0 (secure 0 0 0) 0x7f34840be060 con 0x7f349406faf0 2024-09-11T23:03:18.704 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.701+0000 7f34797fa640 1 -- 172.21.15.12:0/1969915774 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f346c0052a0 con 0x7f349406faf0 2024-09-11T23:03:18.705 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.701+0000 7f347b7fe640 1 --2- 172.21.15.12:0/1969915774 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f3480035d20 0x7f34800381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:18.705 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.701+0000 7f347b7fe640 1 -- 172.21.15.12:0/1969915774 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1203+0+0 (secure 0 0 0) 0x7f34840e1c00 con 0x7f349406faf0 2024-09-11T23:03:18.705 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.701+0000 7f34927fc640 1 --2- 172.21.15.12:0/1969915774 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f3480035d20 0x7f34800381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:18.705 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.701+0000 7f34927fc640 1 --2- 172.21.15.12:0/1969915774 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f3480035d20 0x7f34800381e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3488007fd0 tx=0x7f3488007920 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:18.709 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.705+0000 7f347b7fe640 1 -- 172.21.15.12:0/1969915774 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f34840a4e20 con 0x7f349406faf0 2024-09-11T23:03:18.872 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.869+0000 7f34797fa640 1 -- 172.21.15.12:0/1969915774 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f346c005590 con 0x7f349406faf0 2024-09-11T23:03:18.873 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.869+0000 7f347b7fe640 1 -- 172.21.15.12:0/1969915774 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+3427 (secure 0 0 0) 0x7f3484016010 con 0x7f349406faf0 2024-09-11T23:03:18.873 INFO:teuthology.misc.health.smithi012.stdout: 2024-09-11T23:03:18.873 INFO:teuthology.misc.health.smithi012.stdout:{"epoch":6,"fsid":"8be14356-3340-4500-91a2-4cbc6b511f65","created":"2024-09-11T23:03:10.620234+0000","modified":"2024-09-11T23:03:18.562380+0000","last_up_change":"0.000000","last_in_change":"2024-09-11T23:03:11.545817+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"153b72a1-40b1-400d-93ea-333e733f9bc1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"94669e49-ee4f-4acf-9e25-e94374dda8a0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"826dae4d-8888-4ec5-8f00-425b3be93814","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:03:18.875 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.873+0000 7f34797fa640 1 -- 172.21.15.12:0/1969915774 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f3480035d20 msgr2=0x7f34800381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:18.876 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.873+0000 7f34797fa640 1 --2- 172.21.15.12:0/1969915774 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f3480035d20 0x7f34800381e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3488007fd0 tx=0x7f3488007920 comp rx=0 tx=0).stop 2024-09-11T23:03:18.876 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.873+0000 7f34797fa640 1 -- 172.21.15.12:0/1969915774 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f349406faf0 msgr2=0x7f349411e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:18.876 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.873+0000 7f34797fa640 1 --2- 172.21.15.12:0/1969915774 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f349406faf0 0x7f349411e920 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3484018fa0 tx=0x7f348401abd0 comp rx=0 tx=0).stop 2024-09-11T23:03:18.876 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.873+0000 7f34797fa640 1 -- 172.21.15.12:0/1969915774 shutdown_connections 2024-09-11T23:03:18.876 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.873+0000 7f34797fa640 1 --2- 172.21.15.12:0/1969915774 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f3480035d20 0x7f34800381e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:18.876 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.873+0000 7f34797fa640 1 --2- 172.21.15.12:0/1969915774 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f349406faf0 0x7f349411e920 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:18.876 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.873+0000 7f34797fa640 1 -- 172.21.15.12:0/1969915774 >> 172.21.15.12:0/1969915774 conn(0x7f349409ae50 msgr2=0x7f3494071490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:18.876 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.873+0000 7f34797fa640 1 -- 172.21.15.12:0/1969915774 shutdown_connections 2024-09-11T23:03:18.876 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:18.873+0000 7f34797fa640 1 -- 172.21.15.12:0/1969915774 wait complete. 2024-09-11T23:03:18.891 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-09-11T23:03:21.332 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T23:03:21.329+0000 7f29d3c5a640 -1 osd.2 0 waiting for initial osdmap 2024-09-11T23:03:21.352 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-09-11T23:03:21.349+0000 7f29cc2a1640 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:03:21.354 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T23:03:21.349+0000 7fafe686c640 -1 osd.1 0 waiting for initial osdmap 2024-09-11T23:03:21.383 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-09-11T23:03:21.381+0000 7fafdde7e640 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:03:21.389 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T23:03:21.385+0000 7f99dd228640 -1 osd.0 0 waiting for initial osdmap 2024-09-11T23:03:21.412 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-11T23:03:21.409+0000 7f99d586f640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:03:24.460 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:03:25.193 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-11T23:03:25.319 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.313+0000 7f57d0cb5640 1 Processor -- start 2024-09-11T23:03:25.319 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.313+0000 7f57d0cb5640 1 -- start start 2024-09-11T23:03:25.321 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.317+0000 7f57d0cb5640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f57cc0a08d0 0x7f57cc13d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:25.321 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.317+0000 7f57d0cb5640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57cc071220 con 0x7f57cc06faf0 2024-09-11T23:03:25.321 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.317+0000 7f57d0cb5640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f57cc0a0180 con 0x7f57cc0a08d0 2024-09-11T23:03:25.321 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.317+0000 7f57ca59c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f57cc06faf0 0x7f57cc06fed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:37928/0 (socket says 172.21.15.12:37928) 2024-09-11T23:03:25.321 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.317+0000 7f57ca59c640 1 -- 172.21.15.12:0/3528081724 learned_addr learned my addr 172.21.15.12:0/3528081724 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:03:25.321 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.317+0000 7f57c9d9b640 1 --2- 172.21.15.12:0/3528081724 >> v2:172.21.15.12:3300/0 conn(0x7f57cc0a08d0 0x7f57cc13d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:25.321 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.317+0000 7f57c959a640 1 -- 172.21.15.12:0/3528081724 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2070034463 0 0) 0x7f57cc071220 con 0x7f57cc06faf0 2024-09-11T23:03:25.321 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.317+0000 7f57c959a640 1 -- 172.21.15.12:0/3528081724 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57b8003530 con 0x7f57cc06faf0 2024-09-11T23:03:25.321 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.317+0000 7f57c959a640 1 -- 172.21.15.12:0/3528081724 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1544979247 0 0) 0x7f57b8003530 con 0x7f57cc06faf0 2024-09-11T23:03:25.321 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.317+0000 7f57c959a640 1 -- 172.21.15.12:0/3528081724 >> v2:172.21.15.12:3300/0 conn(0x7f57cc0a08d0 msgr2=0x7f57cc13d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:03:25.322 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.317+0000 7f57c959a640 1 --2- 172.21.15.12:0/3528081724 >> v2:172.21.15.12:3300/0 conn(0x7f57cc0a08d0 0x7f57cc13d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:25.322 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.317+0000 7f57c959a640 1 -- 172.21.15.12:0/3528081724 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57cc09fee0 con 0x7f57cc06faf0 2024-09-11T23:03:25.322 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.317+0000 7f57c959a640 1 -- 172.21.15.12:0/3528081724 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 2106515244 0 0) 0x7f57bc0015b0 con 0x7f57cc06faf0 2024-09-11T23:03:25.322 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.317+0000 7f57c959a640 1 -- 172.21.15.12:0/3528081724 >> v1:172.21.15.12:6789/0 conn(0x7f57cc06faf0 legacy=0x7f57cc06fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:25.322 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.317+0000 7f57c959a640 1 --2- 172.21.15.12:0/3528081724 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57b80039f0 0x7f57b8003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:25.322 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.317+0000 7f57c959a640 1 -- 172.21.15.12:0/3528081724 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f57cc0a0180 con 0x7f57b80039f0 2024-09-11T23:03:25.322 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.317+0000 7f57ca59c640 1 --2- 172.21.15.12:0/3528081724 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57b80039f0 0x7f57b8003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:25.322 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.317+0000 7f57ca59c640 1 -- 172.21.15.12:0/3528081724 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57b8003530 con 0x7f57b80039f0 2024-09-11T23:03:25.323 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.317+0000 7f57ca59c640 1 --2- 172.21.15.12:0/3528081724 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57b80039f0 0x7f57b8003df0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f57bc007fb0 tx=0x7f57bc01cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e4ee48501bf745e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:25.323 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.321+0000 7f57c959a640 1 -- 172.21.15.12:0/3528081724 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57bc007c50 con 0x7f57b80039f0 2024-09-11T23:03:25.323 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.321+0000 7f57c959a640 1 -- 172.21.15.12:0/3528081724 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57bc0a9070 con 0x7f57b80039f0 2024-09-11T23:03:25.323 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.321+0000 7f57c959a640 1 -- 172.21.15.12:0/3528081724 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57bc005ba0 con 0x7f57b80039f0 2024-09-11T23:03:25.324 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.321+0000 7f57d0cb5640 1 -- 172.21.15.12:0/3528081724 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57b80039f0 msgr2=0x7f57b8003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:25.324 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.321+0000 7f57d0cb5640 1 --2- 172.21.15.12:0/3528081724 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57b80039f0 0x7f57b8003df0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f57bc007fb0 tx=0x7f57bc01cc80 comp rx=0 tx=0).stop 2024-09-11T23:03:25.324 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.321+0000 7f57d0cb5640 1 -- 172.21.15.12:0/3528081724 shutdown_connections 2024-09-11T23:03:25.324 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.321+0000 7f57d0cb5640 1 --2- 172.21.15.12:0/3528081724 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57b80039f0 0x7f57b8003df0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:25.324 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.321+0000 7f57d0cb5640 1 --2- 172.21.15.12:0/3528081724 >> v2:172.21.15.12:3300/0 conn(0x7f57cc0a08d0 0x7f57cc13d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:25.324 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.321+0000 7f57d0cb5640 1 -- 172.21.15.12:0/3528081724 >> 172.21.15.12:0/3528081724 conn(0x7f57cc09ae50 msgr2=0x7f57cc09d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:25.324 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.321+0000 7f57d0cb5640 1 -- 172.21.15.12:0/3528081724 shutdown_connections 2024-09-11T23:03:25.324 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.321+0000 7f57d0cb5640 1 -- 172.21.15.12:0/3528081724 wait complete. 2024-09-11T23:03:25.325 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.321+0000 7f57d0cb5640 1 Processor -- start 2024-09-11T23:03:25.325 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.321+0000 7f57d0cb5640 1 -- start start 2024-09-11T23:03:25.326 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.321+0000 7f57d0cb5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57b80039f0 0x7f57cc0a3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:25.326 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.321+0000 7f57d0cb5640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f57cc0a0df0 con 0x7f57b80039f0 2024-09-11T23:03:25.326 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.321+0000 7f57ca59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57b80039f0 0x7f57cc0a3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:25.326 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.321+0000 7f57ca59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57b80039f0 0x7f57cc0a3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41800/0 (socket says 172.21.15.12:41800) 2024-09-11T23:03:25.326 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.321+0000 7f57ca59c640 1 -- 172.21.15.12:0/461609733 learned_addr learned my addr 172.21.15.12:0/461609733 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:25.326 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.321+0000 7f57ca59c640 1 -- 172.21.15.12:0/461609733 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57cc135ee0 con 0x7f57b80039f0 2024-09-11T23:03:25.326 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.321+0000 7f57ca59c640 1 --2- 172.21.15.12:0/461609733 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57b80039f0 0x7f57cc0a3cc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f57bc007fb0 tx=0x7f57b8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:25.327 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.321+0000 7f57c2ffd640 1 -- 172.21.15.12:0/461609733 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57bc0bd070 con 0x7f57b80039f0 2024-09-11T23:03:25.327 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.321+0000 7f57c2ffd640 1 -- 172.21.15.12:0/461609733 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57bc001010 con 0x7f57b80039f0 2024-09-11T23:03:25.327 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.321+0000 7f57c2ffd640 1 -- 172.21.15.12:0/461609733 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57bc001b90 con 0x7f57b80039f0 2024-09-11T23:03:25.327 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.321+0000 7f57d0cb5640 1 -- 172.21.15.12:0/461609733 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57cc0a4b50 con 0x7f57b80039f0 2024-09-11T23:03:25.327 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.321+0000 7f57d0cb5640 1 -- 172.21.15.12:0/461609733 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57cc0a5cd0 con 0x7f57b80039f0 2024-09-11T23:03:25.327 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.321+0000 7f57c2ffd640 1 -- 172.21.15.12:0/461609733 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 4) ==== 43997+0+0 (secure 0 0 0) 0x7f57bc0c0070 con 0x7f57b80039f0 2024-09-11T23:03:25.328 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.321+0000 7f57d0cb5640 1 -- 172.21.15.12:0/461609733 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57cc0a3020 con 0x7f57b80039f0 2024-09-11T23:03:25.328 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.325+0000 7f57c2ffd640 1 --2- 172.21.15.12:0/461609733 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f57ac035d20 0x7f57ac0381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:25.328 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.325+0000 7f57c2ffd640 1 -- 172.21.15.12:0/461609733 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 2576+0+0 (secure 0 0 0) 0x7f57bc0b4030 con 0x7f57b80039f0 2024-09-11T23:03:25.328 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.325+0000 7f57c9d9b640 1 --2- 172.21.15.12:0/461609733 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f57ac035d20 0x7f57ac0381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:25.328 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.325+0000 7f57c9d9b640 1 --2- 172.21.15.12:0/461609733 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f57ac035d20 0x7f57ac0381e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f57b4009f80 tx=0x7f57b400b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:25.332 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.329+0000 7f57c2ffd640 1 -- 172.21.15.12:0/461609733 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f57bc016870 con 0x7f57b80039f0 2024-09-11T23:03:25.495 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.489+0000 7f57d0cb5640 1 -- 172.21.15.12:0/461609733 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f57cc06bf70 con 0x7f57b80039f0 2024-09-11T23:03:25.496 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.493+0000 7f57c2ffd640 1 -- 172.21.15.12:0/461609733 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) ==== 74+0+6804 (secure 0 0 0) 0x7f57bc0ae860 con 0x7f57b80039f0 2024-09-11T23:03:25.497 INFO:teuthology.misc.health.smithi012.stdout: 2024-09-11T23:03:25.497 INFO:teuthology.misc.health.smithi012.stdout:{"epoch":11,"fsid":"8be14356-3340-4500-91a2-4cbc6b511f65","created":"2024-09-11T23:03:10.620234+0000","modified":"2024-09-11T23:03:25.365816+0000","last_up_change":"2024-09-11T23:03:22.359028+0000","last_in_change":"2024-09-11T23:03:11.545817+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:03:23.587068+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"153b72a1-40b1-400d-93ea-333e733f9bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6817","nonce":3680911937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6819","nonce":3680911937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6823","nonce":3680911937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6821","nonce":3680911937}]},"public_addr":"172.21.15.12:6817/3680911937","cluster_addr":"172.21.15.12:6819/3680911937","heartbeat_back_addr":"172.21.15.12:6823/3680911937","heartbeat_front_addr":"172.21.15.12:6821/3680911937","state":["exists","up"]},{"osd":1,"uuid":"94669e49-ee4f-4acf-9e25-e94374dda8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6801","nonce":236825163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6803","nonce":236825163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6807","nonce":236825163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6805","nonce":236825163}]},"public_addr":"172.21.15.12:6801/236825163","cluster_addr":"172.21.15.12:6803/236825163","heartbeat_back_addr":"172.21.15.12:6807/236825163","heartbeat_front_addr":"172.21.15.12:6805/236825163","state":["exists","up"]},{"osd":2,"uuid":"826dae4d-8888-4ec5-8f00-425b3be93814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6809","nonce":3263521655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6811","nonce":3263521655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6815","nonce":3263521655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6813","nonce":3263521655}]},"public_addr":"172.21.15.12:6809/3263521655","cluster_addr":"172.21.15.12:6811/3263521655","heartbeat_back_addr":"172.21.15.12:6815/3263521655","heartbeat_front_addr":"172.21.15.12:6813/3263521655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:19.398518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.761524+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.904997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:03:25.498 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.493+0000 7f57d0cb5640 1 -- 172.21.15.12:0/461609733 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f57ac035d20 msgr2=0x7f57ac0381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:25.498 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.493+0000 7f57d0cb5640 1 --2- 172.21.15.12:0/461609733 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f57ac035d20 0x7f57ac0381e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f57b4009f80 tx=0x7f57b400b040 comp rx=0 tx=0).stop 2024-09-11T23:03:25.499 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.493+0000 7f57d0cb5640 1 -- 172.21.15.12:0/461609733 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57b80039f0 msgr2=0x7f57cc0a3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:25.499 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.493+0000 7f57d0cb5640 1 --2- 172.21.15.12:0/461609733 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57b80039f0 0x7f57cc0a3cc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f57bc007fb0 tx=0x7f57b8005840 comp rx=0 tx=0).stop 2024-09-11T23:03:25.499 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.493+0000 7f57d0cb5640 1 -- 172.21.15.12:0/461609733 shutdown_connections 2024-09-11T23:03:25.499 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.493+0000 7f57d0cb5640 1 --2- 172.21.15.12:0/461609733 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f57ac035d20 0x7f57ac0381e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:25.499 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.493+0000 7f57d0cb5640 1 --2- 172.21.15.12:0/461609733 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57b80039f0 0x7f57cc0a3cc0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:25.499 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.493+0000 7f57d0cb5640 1 -- 172.21.15.12:0/461609733 >> 172.21.15.12:0/461609733 conn(0x7f57cc09ae50 msgr2=0x7f57cc09b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:25.499 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.493+0000 7f57d0cb5640 1 -- 172.21.15.12:0/461609733 shutdown_connections 2024-09-11T23:03:25.499 INFO:teuthology.misc.health.smithi012.stderr:2024-09-11T23:03:25.493+0000 7f57d0cb5640 1 -- 172.21.15.12:0/461609733 wait complete. 2024-09-11T23:03:25.513 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-09-11T23:03:25.513 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-11T23:03:25.514 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-11T23:03:25.514 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-11T23:03:25.517 INFO:tasks.ceph.mds.a:Started 2024-09-11T23:03:25.517 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-11T23:03:25.517 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-11T23:03:25.519 INFO:tasks.ceph.mds.b:Started 2024-09-11T23:03:25.519 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-11T23:03:25.520 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:03:25.584 INFO:tasks.ceph.mds.b.smithi012.stdout:starting mds.b at 2024-09-11T23:03:25.584 INFO:tasks.ceph.mds.a.smithi012.stdout:starting mds.a at 2024-09-11T23:03:25.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.621+0000 7ffb5c681640 1 Processor -- start 2024-09-11T23:03:25.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.621+0000 7ffb5c681640 1 -- start start 2024-09-11T23:03:25.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.625+0000 7ffb5c681640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ffb540a0380 0x7ffb5409f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:25.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.625+0000 7ffb5c681640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb5406ed80 con 0x7ffb540a0760 2024-09-11T23:03:25.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.625+0000 7ffb5c681640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7ffb5406e890 con 0x7ffb540a0380 2024-09-11T23:03:25.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.625+0000 7ffb5a41d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ffb540a0380 0x7ffb5409f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:25.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.625+0000 7ffb59c1c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ffb540a0760 0x7ffb54139b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:37946/0 (socket says 172.21.15.12:37946) 2024-09-11T23:03:25.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.625+0000 7ffb59c1c640 1 -- 172.21.15.12:0/1561509390 learned_addr learned my addr 172.21.15.12:0/1561509390 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:03:25.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.625+0000 7ffb5a41d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ffb540a0380 0x7ffb5409f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41836/0 (socket says 172.21.15.12:41836) 2024-09-11T23:03:25.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.625+0000 7ffb5a41d640 1 -- 172.21.15.12:0/1561509390 >> v1:172.21.15.12:6789/0 conn(0x7ffb540a0760 legacy=0x7ffb54139b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:25.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.625+0000 7ffb5a41d640 1 -- 172.21.15.12:0/1561509390 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb5406eac0 con 0x7ffb540a0380 2024-09-11T23:03:25.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.625+0000 7ffb5a41d640 1 --2- 172.21.15.12:0/1561509390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb540a0380 0x7ffb5409f3b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c009740 tx=0x7ffb4c01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7f41f7618ad43fd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:25.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.625+0000 7ffb5941b640 1 -- 172.21.15.12:0/1561509390 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb4c0b0070 con 0x7ffb540a0380 2024-09-11T23:03:25.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.625+0000 7ffb5941b640 1 -- 172.21.15.12:0/1561509390 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb4c0ab530 con 0x7ffb540a0380 2024-09-11T23:03:25.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.625+0000 7ffb5941b640 1 -- 172.21.15.12:0/1561509390 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb4c0ab830 con 0x7ffb540a0380 2024-09-11T23:03:25.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.625+0000 7ffb5c681640 1 -- 172.21.15.12:0/1561509390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb540a0380 msgr2=0x7ffb5409f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:25.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.625+0000 7ffb5c681640 1 --2- 172.21.15.12:0/1561509390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb540a0380 0x7ffb5409f3b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c009740 tx=0x7ffb4c01c390 comp rx=0 tx=0).stop 2024-09-11T23:03:25.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.625+0000 7ffb5c681640 1 -- 172.21.15.12:0/1561509390 shutdown_connections 2024-09-11T23:03:25.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.625+0000 7ffb5c681640 1 --2- 172.21.15.12:0/1561509390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb540a0380 0x7ffb5409f3b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:25.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.625+0000 7ffb5c681640 1 -- 172.21.15.12:0/1561509390 >> 172.21.15.12:0/1561509390 conn(0x7ffb540aa2c0 msgr2=0x7ffb540aa6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:25.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.625+0000 7ffb5c681640 1 -- 172.21.15.12:0/1561509390 shutdown_connections 2024-09-11T23:03:25.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.625+0000 7ffb5c681640 1 -- 172.21.15.12:0/1561509390 wait complete. 2024-09-11T23:03:25.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.629+0000 7ffb5c681640 1 Processor -- start 2024-09-11T23:03:25.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.629+0000 7ffb5c681640 1 -- start start 2024-09-11T23:03:25.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.629+0000 7ffb5c681640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb540a0380 0x7ffb5413c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:25.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.629+0000 7ffb5c681640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ffb541420c0 con 0x7ffb540a0380 2024-09-11T23:03:25.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.629+0000 7ffb5a41d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb540a0380 0x7ffb5413c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:25.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.629+0000 7ffb5a41d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb540a0380 0x7ffb5413c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41844/0 (socket says 172.21.15.12:41844) 2024-09-11T23:03:25.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.629+0000 7ffb5a41d640 1 -- 172.21.15.12:0/4264718867 learned_addr learned my addr 172.21.15.12:0/4264718867 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:25.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.629+0000 7ffb5a41d640 1 -- 172.21.15.12:0/4264718867 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb5413dec0 con 0x7ffb540a0380 2024-09-11T23:03:25.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.629+0000 7ffb5a41d640 1 --2- 172.21.15.12:0/4264718867 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb540a0380 0x7ffb5413c380 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c019fc0 tx=0x7ffb4c01abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:25.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.629+0000 7ffb52ffd640 1 -- 172.21.15.12:0/4264718867 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb4c0b0050 con 0x7ffb540a0380 2024-09-11T23:03:25.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.629+0000 7ffb52ffd640 1 -- 172.21.15.12:0/4264718867 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb4c0b1040 con 0x7ffb540a0380 2024-09-11T23:03:25.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.629+0000 7ffb5c681640 1 -- 172.21.15.12:0/4264718867 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb5413e1a0 con 0x7ffb540a0380 2024-09-11T23:03:25.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.629+0000 7ffb52ffd640 1 -- 172.21.15.12:0/4264718867 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb4c0b5930 con 0x7ffb540a0380 2024-09-11T23:03:25.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.629+0000 7ffb5c681640 1 -- 172.21.15.12:0/4264718867 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb5413f9f0 con 0x7ffb540a0380 2024-09-11T23:03:25.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.629+0000 7ffb5c681640 1 -- 172.21.15.12:0/4264718867 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb5409f3b0 con 0x7ffb540a0380 2024-09-11T23:03:25.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.629+0000 7ffb52ffd640 1 -- 172.21.15.12:0/4264718867 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 4) ==== 43997+0+0 (secure 0 0 0) 0x7ffb4c0be030 con 0x7ffb540a0380 2024-09-11T23:03:25.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.629+0000 7ffb52ffd640 1 --2- 172.21.15.12:0/4264718867 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7ffb40035d20 0x7ffb400381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:25.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.629+0000 7ffb52ffd640 1 -- 172.21.15.12:0/4264718867 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 2587+0+0 (secure 0 0 0) 0x7ffb4c0bc070 con 0x7ffb540a0380 2024-09-11T23:03:25.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.629+0000 7ffb59c1c640 1 --2- 172.21.15.12:0/4264718867 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7ffb40035d20 0x7ffb400381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:25.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.629+0000 7ffb59c1c640 1 --2- 172.21.15.12:0/4264718867 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7ffb40035d20 0x7ffb400381e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ffb48001600 tx=0x7ffb48007a70 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:25.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.633+0000 7ffb52ffd640 1 -- 172.21.15.12:0/4264718867 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ffb4c0c5020 con 0x7ffb540a0380 2024-09-11T23:03:25.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.833+0000 7ffb5c681640 1 -- 172.21.15.12:0/4264718867 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffb540739f0 con 0x7ffb540a0380 2024-09-11T23:03:25.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.833+0000 7ffb52ffd640 1 -- 172.21.15.12:0/4264718867 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1434 (secure 0 0 0) 0x7ffb4c0a4e20 con 0x7ffb540a0380 2024-09-11T23:03:25.839 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:03:25.839 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":2,"btime":"2024-09-11T23:03:25:589162+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4139,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6828/4176387551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":4176387551},{"type":"v1","addr":"172.21.15.12:6828","nonce":4176387551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-11T23:03:25.839 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 2 2024-09-11T23:03:25.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.837+0000 7ffb5c681640 1 -- 172.21.15.12:0/4264718867 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7ffb40035d20 msgr2=0x7ffb400381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:25.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.837+0000 7ffb5c681640 1 --2- 172.21.15.12:0/4264718867 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7ffb40035d20 0x7ffb400381e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ffb48001600 tx=0x7ffb48007a70 comp rx=0 tx=0).stop 2024-09-11T23:03:25.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.837+0000 7ffb5c681640 1 -- 172.21.15.12:0/4264718867 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb540a0380 msgr2=0x7ffb5413c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:25.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.837+0000 7ffb5c681640 1 --2- 172.21.15.12:0/4264718867 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb540a0380 0x7ffb5413c380 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c019fc0 tx=0x7ffb4c01abd0 comp rx=0 tx=0).stop 2024-09-11T23:03:25.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.837+0000 7ffb5c681640 1 -- 172.21.15.12:0/4264718867 shutdown_connections 2024-09-11T23:03:25.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.837+0000 7ffb5c681640 1 --2- 172.21.15.12:0/4264718867 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7ffb40035d20 0x7ffb400381e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:25.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.837+0000 7ffb5c681640 1 --2- 172.21.15.12:0/4264718867 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb540a0380 0x7ffb5413c380 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:25.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.837+0000 7ffb5c681640 1 -- 172.21.15.12:0/4264718867 >> 172.21.15.12:0/4264718867 conn(0x7ffb540aa2c0 msgr2=0x7ffb540732a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:25.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.837+0000 7ffb5c681640 1 -- 172.21.15.12:0/4264718867 shutdown_connections 2024-09-11T23:03:25.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:25.837+0000 7ffb5c681640 1 -- 172.21.15.12:0/4264718867 wait complete. 2024-09-11T23:03:27.859 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:03:27.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:27.989+0000 7f89cf5d9640 1 Processor -- start 2024-09-11T23:03:27.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:27.989+0000 7f89cf5d9640 1 -- start start 2024-09-11T23:03:27.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:27.989+0000 7f89cf5d9640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f89c80a0380 0x7f89c809f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:27.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:27.989+0000 7f89cf5d9640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89c806ed80 con 0x7f89c80a0760 2024-09-11T23:03:27.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:27.989+0000 7f89cf5d9640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f89c806e890 con 0x7f89c80a0380 2024-09-11T23:03:27.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:27.989+0000 7f89ccb74640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f89c80a0760 0x7f89c8139b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:37954/0 (socket says 172.21.15.12:37954) 2024-09-11T23:03:27.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:27.989+0000 7f89ccb74640 1 -- 172.21.15.12:0/3595727063 learned_addr learned my addr 172.21.15.12:0/3595727063 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:03:27.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:27.989+0000 7f89cd375640 1 --2- 172.21.15.12:0/3595727063 >> v2:172.21.15.12:3300/0 conn(0x7f89c80a0380 0x7f89c809f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:27.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:27.989+0000 7f89cd375640 1 -- 172.21.15.12:0/3595727063 >> v1:172.21.15.12:6789/0 conn(0x7f89c80a0760 legacy=0x7f89c8139b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:27.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:27.989+0000 7f89cd375640 1 -- 172.21.15.12:0/3595727063 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89c806eac0 con 0x7f89c80a0380 2024-09-11T23:03:27.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:27.993+0000 7f89cd375640 1 --2- 172.21.15.12:0/3595727063 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89c80a0380 0x7f89c809f3b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f89bc009740 tx=0x7f89bc01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8493b658690410f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:27.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:27.993+0000 7f89bbfff640 1 -- 172.21.15.12:0/3595727063 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89bc0b0070 con 0x7f89c80a0380 2024-09-11T23:03:27.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:27.993+0000 7f89bbfff640 1 -- 172.21.15.12:0/3595727063 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89bc0ab530 con 0x7f89c80a0380 2024-09-11T23:03:27.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:27.993+0000 7f89bbfff640 1 -- 172.21.15.12:0/3595727063 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89bc0ab830 con 0x7f89c80a0380 2024-09-11T23:03:27.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:27.993+0000 7f89cf5d9640 1 -- 172.21.15.12:0/3595727063 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89c80a0380 msgr2=0x7f89c809f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:27.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:27.993+0000 7f89cf5d9640 1 --2- 172.21.15.12:0/3595727063 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89c80a0380 0x7f89c809f3b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f89bc009740 tx=0x7f89bc01c390 comp rx=0 tx=0).stop 2024-09-11T23:03:27.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:27.993+0000 7f89cf5d9640 1 -- 172.21.15.12:0/3595727063 shutdown_connections 2024-09-11T23:03:27.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:27.993+0000 7f89cf5d9640 1 --2- 172.21.15.12:0/3595727063 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89c80a0380 0x7f89c809f3b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:27.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:27.993+0000 7f89cf5d9640 1 -- 172.21.15.12:0/3595727063 >> 172.21.15.12:0/3595727063 conn(0x7f89c80aa2c0 msgr2=0x7f89c80aa6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:27.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:27.993+0000 7f89cf5d9640 1 -- 172.21.15.12:0/3595727063 shutdown_connections 2024-09-11T23:03:27.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:27.993+0000 7f89cf5d9640 1 -- 172.21.15.12:0/3595727063 wait complete. 2024-09-11T23:03:27.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:27.993+0000 7f89cf5d9640 1 Processor -- start 2024-09-11T23:03:27.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:27.993+0000 7f89cf5d9640 1 -- start start 2024-09-11T23:03:27.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:27.993+0000 7f89cf5d9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89c80a0380 0x7f89c813c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:27.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:27.993+0000 7f89cf5d9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f89c81420c0 con 0x7f89c80a0380 2024-09-11T23:03:27.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:27.993+0000 7f89cd375640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89c80a0380 0x7f89c813c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:27.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:27.993+0000 7f89cd375640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89c80a0380 0x7f89c813c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41906/0 (socket says 172.21.15.12:41906) 2024-09-11T23:03:27.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:27.993+0000 7f89cd375640 1 -- 172.21.15.12:0/1876536470 learned_addr learned my addr 172.21.15.12:0/1876536470 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:27.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:27.993+0000 7f89cd375640 1 -- 172.21.15.12:0/1876536470 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89c813dec0 con 0x7f89c80a0380 2024-09-11T23:03:27.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:27.993+0000 7f89cd375640 1 --2- 172.21.15.12:0/1876536470 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89c80a0380 0x7f89c813c380 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f89bc019fc0 tx=0x7f89bc01abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:27.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:27.993+0000 7f89b9ffb640 1 -- 172.21.15.12:0/1876536470 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89bc0b0050 con 0x7f89c80a0380 2024-09-11T23:03:27.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:27.993+0000 7f89b9ffb640 1 -- 172.21.15.12:0/1876536470 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89bc0b1040 con 0x7f89c80a0380 2024-09-11T23:03:27.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:27.993+0000 7f89cf5d9640 1 -- 172.21.15.12:0/1876536470 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89c813e1a0 con 0x7f89c80a0380 2024-09-11T23:03:27.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:27.993+0000 7f89b9ffb640 1 -- 172.21.15.12:0/1876536470 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89bc0b5930 con 0x7f89c80a0380 2024-09-11T23:03:27.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:27.993+0000 7f89cf5d9640 1 -- 172.21.15.12:0/1876536470 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89c813f9f0 con 0x7f89c80a0380 2024-09-11T23:03:28.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:27.997+0000 7f89b9ffb640 1 -- 172.21.15.12:0/1876536470 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 4) ==== 43997+0+0 (secure 0 0 0) 0x7f89bc0be030 con 0x7f89c80a0380 2024-09-11T23:03:28.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:27.997+0000 7f89cf5d9640 1 -- 172.21.15.12:0/1876536470 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89c809f3b0 con 0x7f89c80a0380 2024-09-11T23:03:28.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:27.997+0000 7f89b9ffb640 1 --2- 172.21.15.12:0/1876536470 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f89ac035d70 0x7f89ac038230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:28.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:27.997+0000 7f89b9ffb640 1 -- 172.21.15.12:0/1876536470 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2587+0+0 (secure 0 0 0) 0x7f89bc0bc070 con 0x7f89c80a0380 2024-09-11T23:03:28.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:27.997+0000 7f89ccb74640 1 --2- 172.21.15.12:0/1876536470 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f89ac035d70 0x7f89ac038230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:28.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:27.997+0000 7f89ccb74640 1 --2- 172.21.15.12:0/1876536470 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f89ac035d70 0x7f89ac038230 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f89c4002080 tx=0x7f89c4001670 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:28.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.001+0000 7f89b9ffb640 1 -- 172.21.15.12:0/1876536470 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f89bc0c5020 con 0x7f89c80a0380 2024-09-11T23:03:28.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.197+0000 7f89cf5d9640 1 -- 172.21.15.12:0/1876536470 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f89c80739f0 con 0x7f89c80a0380 2024-09-11T23:03:28.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.197+0000 7f89b9ffb640 1 -- 172.21.15.12:0/1876536470 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2258 (secure 0 0 0) 0x7f89bc0a4e20 con 0x7f89c80a0380 2024-09-11T23:03:28.202 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:03:28.203 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":3,"btime":"2024-09-11T23:03:26:589689+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4139,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6828/4176387551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":4176387551},{"type":"v1","addr":"172.21.15.12:6828","nonce":4176387551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4140,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6829/2850198678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6827","nonce":2850198678},{"type":"v1","addr":"172.21.15.12:6829","nonce":2850198678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-11T23:03:28.203 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 3 2024-09-11T23:03:28.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.201+0000 7f89cf5d9640 1 -- 172.21.15.12:0/1876536470 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f89ac035d70 msgr2=0x7f89ac038230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:28.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.201+0000 7f89cf5d9640 1 --2- 172.21.15.12:0/1876536470 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f89ac035d70 0x7f89ac038230 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f89c4002080 tx=0x7f89c4001670 comp rx=0 tx=0).stop 2024-09-11T23:03:28.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.201+0000 7f89cf5d9640 1 -- 172.21.15.12:0/1876536470 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89c80a0380 msgr2=0x7f89c813c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:28.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.201+0000 7f89cf5d9640 1 --2- 172.21.15.12:0/1876536470 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89c80a0380 0x7f89c813c380 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f89bc019fc0 tx=0x7f89bc01abd0 comp rx=0 tx=0).stop 2024-09-11T23:03:28.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.201+0000 7f89cf5d9640 1 -- 172.21.15.12:0/1876536470 shutdown_connections 2024-09-11T23:03:28.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.201+0000 7f89cf5d9640 1 --2- 172.21.15.12:0/1876536470 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f89ac035d70 0x7f89ac038230 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:28.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.201+0000 7f89cf5d9640 1 --2- 172.21.15.12:0/1876536470 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89c80a0380 0x7f89c813c380 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:28.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.201+0000 7f89cf5d9640 1 -- 172.21.15.12:0/1876536470 >> 172.21.15.12:0/1876536470 conn(0x7f89c80aa2c0 msgr2=0x7f89c80732a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:28.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.201+0000 7f89cf5d9640 1 -- 172.21.15.12:0/1876536470 shutdown_connections 2024-09-11T23:03:28.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.201+0000 7f89cf5d9640 1 -- 172.21.15.12:0/1876536470 wait complete. 2024-09-11T23:03:28.222 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-11T23:03:28.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.341+0000 7fdb32d6e640 1 Processor -- start 2024-09-11T23:03:28.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.341+0000 7fdb32d6e640 1 -- start start 2024-09-11T23:03:28.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.341+0000 7fdb32d6e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdb2c13a410 0x7fdb2c0a6af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:28.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.341+0000 7fdb32d6e640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb2c0a82a0 con 0x7fdb2c0a4b80 2024-09-11T23:03:28.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.341+0000 7fdb32d6e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fdb2c0a3cb0 con 0x7fdb2c13a410 2024-09-11T23:03:28.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.341+0000 7fdb30b0a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdb2c13a410 0x7fdb2c0a6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:28.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.341+0000 7fdb2bfff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fdb2c0a4b80 0x7fdb2c0a7030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:37964/0 (socket says 172.21.15.12:37964) 2024-09-11T23:03:28.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.341+0000 7fdb2bfff640 1 -- 172.21.15.12:0/1205763409 learned_addr learned my addr 172.21.15.12:0/1205763409 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:03:28.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.341+0000 7fdb30b0a640 1 -- 172.21.15.12:0/1205763409 >> v1:172.21.15.12:6789/0 conn(0x7fdb2c0a4b80 legacy=0x7fdb2c0a7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:28.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.341+0000 7fdb30b0a640 1 -- 172.21.15.12:0/1205763409 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb2c139fe0 con 0x7fdb2c13a410 2024-09-11T23:03:28.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.345+0000 7fdb30b0a640 1 --2- 172.21.15.12:0/1205763409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb2c13a410 0x7fdb2c0a6af0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdb18009740 tx=0x7fdb1801c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e3b91ef98e81b2b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:28.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.345+0000 7fdb2b7fe640 1 -- 172.21.15.12:0/1205763409 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb180b0070 con 0x7fdb2c13a410 2024-09-11T23:03:28.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.345+0000 7fdb2b7fe640 1 -- 172.21.15.12:0/1205763409 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb180ab530 con 0x7fdb2c13a410 2024-09-11T23:03:28.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.345+0000 7fdb2b7fe640 1 -- 172.21.15.12:0/1205763409 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb180ab830 con 0x7fdb2c13a410 2024-09-11T23:03:28.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.345+0000 7fdb32d6e640 1 -- 172.21.15.12:0/1205763409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb2c13a410 msgr2=0x7fdb2c0a6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:28.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.345+0000 7fdb32d6e640 1 --2- 172.21.15.12:0/1205763409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb2c13a410 0x7fdb2c0a6af0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdb18009740 tx=0x7fdb1801c390 comp rx=0 tx=0).stop 2024-09-11T23:03:28.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.345+0000 7fdb32d6e640 1 -- 172.21.15.12:0/1205763409 shutdown_connections 2024-09-11T23:03:28.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.345+0000 7fdb32d6e640 1 --2- 172.21.15.12:0/1205763409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb2c13a410 0x7fdb2c0a6af0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:28.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.345+0000 7fdb32d6e640 1 -- 172.21.15.12:0/1205763409 >> 172.21.15.12:0/1205763409 conn(0x7fdb2c0ac2c0 msgr2=0x7fdb2c0ac6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:28.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.345+0000 7fdb32d6e640 1 -- 172.21.15.12:0/1205763409 shutdown_connections 2024-09-11T23:03:28.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.345+0000 7fdb32d6e640 1 -- 172.21.15.12:0/1205763409 wait complete. 2024-09-11T23:03:28.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.345+0000 7fdb32d6e640 1 Processor -- start 2024-09-11T23:03:28.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.345+0000 7fdb32d6e640 1 -- start start 2024-09-11T23:03:28.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.349+0000 7fdb32d6e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb2c0a4b80 0x7fdb2c0a1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:28.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.349+0000 7fdb32d6e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fdb2c0a7740 con 0x7fdb2c0a4b80 2024-09-11T23:03:28.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.349+0000 7fdb30b0a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb2c0a4b80 0x7fdb2c0a1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:28.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.349+0000 7fdb30b0a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb2c0a4b80 0x7fdb2c0a1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41930/0 (socket says 172.21.15.12:41930) 2024-09-11T23:03:28.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.349+0000 7fdb30b0a640 1 -- 172.21.15.12:0/1893244483 learned_addr learned my addr 172.21.15.12:0/1893244483 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:28.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.349+0000 7fdb30b0a640 1 -- 172.21.15.12:0/1893244483 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb2c0a0700 con 0x7fdb2c0a4b80 2024-09-11T23:03:28.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.349+0000 7fdb30b0a640 1 --2- 172.21.15.12:0/1893244483 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb2c0a4b80 0x7fdb2c0a1140 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdb18019fc0 tx=0x7fdb1801abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:28.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.349+0000 7fdb297fa640 1 -- 172.21.15.12:0/1893244483 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb180b0050 con 0x7fdb2c0a4b80 2024-09-11T23:03:28.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.349+0000 7fdb297fa640 1 -- 172.21.15.12:0/1893244483 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb180b1040 con 0x7fdb2c0a4b80 2024-09-11T23:03:28.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.349+0000 7fdb32d6e640 1 -- 172.21.15.12:0/1893244483 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb2c13f070 con 0x7fdb2c0a4b80 2024-09-11T23:03:28.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.349+0000 7fdb297fa640 1 -- 172.21.15.12:0/1893244483 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb180b5740 con 0x7fdb2c0a4b80 2024-09-11T23:03:28.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.349+0000 7fdb32d6e640 1 -- 172.21.15.12:0/1893244483 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb2c0a09c0 con 0x7fdb2c0a4b80 2024-09-11T23:03:28.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.349+0000 7fdb297fa640 1 -- 172.21.15.12:0/1893244483 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 4) ==== 43997+0+0 (secure 0 0 0) 0x7fdb180be030 con 0x7fdb2c0a4b80 2024-09-11T23:03:28.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.349+0000 7fdb32d6e640 1 -- 172.21.15.12:0/1893244483 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb2c0a6af0 con 0x7fdb2c0a4b80 2024-09-11T23:03:28.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.349+0000 7fdb297fa640 1 --2- 172.21.15.12:0/1893244483 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fdb10035d20 0x7fdb100381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:28.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.349+0000 7fdb297fa640 1 -- 172.21.15.12:0/1893244483 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2587+0+0 (secure 0 0 0) 0x7fdb180bc070 con 0x7fdb2c0a4b80 2024-09-11T23:03:28.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.349+0000 7fdb2bfff640 1 --2- 172.21.15.12:0/1893244483 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fdb10035d20 0x7fdb100381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:28.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.349+0000 7fdb2bfff640 1 --2- 172.21.15.12:0/1893244483 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fdb10035d20 0x7fdb100381e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fdb20001610 tx=0x7fdb20007ad0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:28.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.353+0000 7fdb297fa640 1 -- 172.21.15.12:0/1893244483 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fdb180c5020 con 0x7fdb2c0a4b80 2024-09-11T23:03:28.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.525+0000 7fdb32d6e640 1 -- 172.21.15.12:0/1893244483 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fdb2c0a2eb0 con 0x7fdb2c0a4b80 2024-09-11T23:03:28.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.525+0000 7fdb297fa640 1 -- 172.21.15.12:0/1893244483 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v12) ==== 84+0+65 (secure 0 0 0) 0x7fdb18016010 con 0x7fdb2c0a4b80 2024-09-11T23:03:28.528 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:03:28.528 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2024-09-11T23:03:28.528 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:03:28.528 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 1, 2024-09-11T23:03:28.528 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": ".mgr" 2024-09-11T23:03:28.528 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:03:28.528 INFO:teuthology.orchestra.run.smithi012.stdout:] 2024-09-11T23:03:28.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.525+0000 7fdb32d6e640 1 -- 172.21.15.12:0/1893244483 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fdb10035d20 msgr2=0x7fdb100381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:28.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.525+0000 7fdb32d6e640 1 --2- 172.21.15.12:0/1893244483 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fdb10035d20 0x7fdb100381e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fdb20001610 tx=0x7fdb20007ad0 comp rx=0 tx=0).stop 2024-09-11T23:03:28.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.525+0000 7fdb32d6e640 1 -- 172.21.15.12:0/1893244483 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb2c0a4b80 msgr2=0x7fdb2c0a1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:28.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.525+0000 7fdb32d6e640 1 --2- 172.21.15.12:0/1893244483 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb2c0a4b80 0x7fdb2c0a1140 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdb18019fc0 tx=0x7fdb1801abd0 comp rx=0 tx=0).stop 2024-09-11T23:03:28.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.525+0000 7fdb32d6e640 1 -- 172.21.15.12:0/1893244483 shutdown_connections 2024-09-11T23:03:28.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.525+0000 7fdb32d6e640 1 --2- 172.21.15.12:0/1893244483 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fdb10035d20 0x7fdb100381e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:28.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.525+0000 7fdb32d6e640 1 --2- 172.21.15.12:0/1893244483 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb2c0a4b80 0x7fdb2c0a1140 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:28.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.525+0000 7fdb32d6e640 1 -- 172.21.15.12:0/1893244483 >> 172.21.15.12:0/1893244483 conn(0x7fdb2c0ac2c0 msgr2=0x7fdb2c0ab750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:28.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.525+0000 7fdb32d6e640 1 -- 172.21.15.12:0/1893244483 shutdown_connections 2024-09-11T23:03:28.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.525+0000 7fdb32d6e640 1 -- 172.21.15.12:0/1893244483 wait complete. 2024-09-11T23:03:28.547 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T23:03:28.547 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T23:03:28.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.673+0000 7f9682652640 1 Processor -- start 2024-09-11T23:03:28.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.673+0000 7f9682652640 1 -- start start 2024-09-11T23:03:28.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.673+0000 7f9682652640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f967c13a090 0x7f967c0a17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:28.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.673+0000 7f9682652640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f967c0a1e30 con 0x7f967c13a470 2024-09-11T23:03:28.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.673+0000 7f9682652640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f967c0a10a0 con 0x7f967c13a090 2024-09-11T23:03:28.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.673+0000 7f967bfff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f967c13a090 0x7f967c0a17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:28.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.673+0000 7f967bfff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f967c13a090 0x7f967c0a17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41942/0 (socket says 172.21.15.12:41942) 2024-09-11T23:03:28.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.673+0000 7f967bfff640 1 -- 172.21.15.12:0/1794165145 learned_addr learned my addr 172.21.15.12:0/1794165145 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:28.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.673+0000 7f96737fe640 1 --1- 172.21.15.12:0/1794165145 >> v1:172.21.15.12:6789/0 conn(0x7f967c13a470 0x7f967c09d9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:37972/0 (socket says 172.21.15.12:37972) 2024-09-11T23:03:28.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.673+0000 7f967b7fe640 1 -- 172.21.15.12:0/1794165145 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2100526043 0 0) 0x7f967c0a1e30 con 0x7f967c13a470 2024-09-11T23:03:28.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.673+0000 7f967b7fe640 1 -- 172.21.15.12:0/1794165145 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9668003530 con 0x7f967c13a470 2024-09-11T23:03:28.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.673+0000 7f967bfff640 1 -- 172.21.15.12:0/1794165145 >> v1:172.21.15.12:6789/0 conn(0x7f967c13a470 legacy=0x7f967c09d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:28.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.673+0000 7f967bfff640 1 -- 172.21.15.12:0/1794165145 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f967c09f380 con 0x7f967c13a090 2024-09-11T23:03:28.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.673+0000 7f967bfff640 1 --2- 172.21.15.12:0/1794165145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f967c13a090 0x7f967c0a17f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f966c0097f0 tx=0x7f966c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb9dccab7b5bb9b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:28.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.673+0000 7f967b7fe640 1 -- 172.21.15.12:0/1794165145 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f966c0b0070 con 0x7f967c13a090 2024-09-11T23:03:28.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.677+0000 7f967b7fe640 1 -- 172.21.15.12:0/1794165145 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f966c0ab530 con 0x7f967c13a090 2024-09-11T23:03:28.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.677+0000 7f967b7fe640 1 -- 172.21.15.12:0/1794165145 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f966c0ab810 con 0x7f967c13a090 2024-09-11T23:03:28.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.677+0000 7f9682652640 1 -- 172.21.15.12:0/1794165145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f967c13a090 msgr2=0x7f967c0a17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:28.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.677+0000 7f9682652640 1 --2- 172.21.15.12:0/1794165145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f967c13a090 0x7f967c0a17f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f966c0097f0 tx=0x7f966c01c450 comp rx=0 tx=0).stop 2024-09-11T23:03:28.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.677+0000 7f9682652640 1 -- 172.21.15.12:0/1794165145 shutdown_connections 2024-09-11T23:03:28.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.677+0000 7f9682652640 1 --2- 172.21.15.12:0/1794165145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f967c13a090 0x7f967c0a17f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:28.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.677+0000 7f9682652640 1 -- 172.21.15.12:0/1794165145 >> 172.21.15.12:0/1794165145 conn(0x7f967c06da30 msgr2=0x7f967c06de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:28.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.677+0000 7f9682652640 1 -- 172.21.15.12:0/1794165145 shutdown_connections 2024-09-11T23:03:28.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.677+0000 7f9682652640 1 -- 172.21.15.12:0/1794165145 wait complete. 2024-09-11T23:03:28.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.677+0000 7f9682652640 1 Processor -- start 2024-09-11T23:03:28.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.677+0000 7f9682652640 1 -- start start 2024-09-11T23:03:28.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.677+0000 7f9682652640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f967c13a090 0x7f967c0a8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:28.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.677+0000 7f9682652640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f967c1420b0 con 0x7f967c13a090 2024-09-11T23:03:28.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.677+0000 7f967bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f967c13a090 0x7f967c0a8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:28.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.677+0000 7f967bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f967c13a090 0x7f967c0a8c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41954/0 (socket says 172.21.15.12:41954) 2024-09-11T23:03:28.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.677+0000 7f967bfff640 1 -- 172.21.15.12:0/1656451750 learned_addr learned my addr 172.21.15.12:0/1656451750 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:28.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.677+0000 7f967bfff640 1 -- 172.21.15.12:0/1656451750 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f967c0ab040 con 0x7f967c13a090 2024-09-11T23:03:28.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.677+0000 7f967bfff640 1 --2- 172.21.15.12:0/1656451750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f967c13a090 0x7f967c0a8c30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f966c019060 tx=0x7f966c0191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:28.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.677+0000 7f96797fa640 1 -- 172.21.15.12:0/1656451750 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f966c0ba030 con 0x7f967c13a090 2024-09-11T23:03:28.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.677+0000 7f96797fa640 1 -- 172.21.15.12:0/1656451750 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f966c0ab6e0 con 0x7f967c13a090 2024-09-11T23:03:28.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.677+0000 7f9682652640 1 -- 172.21.15.12:0/1656451750 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f967c123560 con 0x7f967c13a090 2024-09-11T23:03:28.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.677+0000 7f96797fa640 1 -- 172.21.15.12:0/1656451750 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f966c0b0040 con 0x7f967c13a090 2024-09-11T23:03:28.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.677+0000 7f9682652640 1 -- 172.21.15.12:0/1656451750 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f967c13f560 con 0x7f967c13a090 2024-09-11T23:03:28.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.677+0000 7f9682652640 1 -- 172.21.15.12:0/1656451750 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f967c13f110 con 0x7f967c13a090 2024-09-11T23:03:28.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.681+0000 7f96797fa640 1 -- 172.21.15.12:0/1656451750 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f966c0bd070 con 0x7f967c13a090 2024-09-11T23:03:28.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.681+0000 7f96797fa640 1 --2- 172.21.15.12:0/1656451750 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f965c035d60 0x7f965c038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:28.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.681+0000 7f96797fa640 1 -- 172.21.15.12:0/1656451750 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2587+0+0 (secure 0 0 0) 0x7f966c0bb070 con 0x7f967c13a090 2024-09-11T23:03:28.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.681+0000 7f96737fe640 1 --2- 172.21.15.12:0/1656451750 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f965c035d60 0x7f965c038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:28.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.681+0000 7f96737fe640 1 --2- 172.21.15.12:0/1656451750 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f965c035d60 0x7f965c038220 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9664007fd0 tx=0x7f9664007900 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:28.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.685+0000 7f96797fa640 1 -- 172.21.15.12:0/1656451750 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f966c0160d0 con 0x7f967c13a090 2024-09-11T23:03:28.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:28.849+0000 7f9682652640 1 -- 172.21.15.12:0/1656451750 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f967c0a17f0 con 0x7f967c13a090 2024-09-11T23:03:29.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.605+0000 7f96797fa640 1 -- 172.21.15.12:0/1656451750 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v13) ==== 138+0+0 (secure 0 0 0) 0x7f966c0b43f0 con 0x7f967c13a090 2024-09-11T23:03:29.608 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' created 2024-09-11T23:03:29.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.609+0000 7f9682652640 1 -- 172.21.15.12:0/1656451750 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f965c035d60 msgr2=0x7f965c038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:29.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.609+0000 7f9682652640 1 --2- 172.21.15.12:0/1656451750 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f965c035d60 0x7f965c038220 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9664007fd0 tx=0x7f9664007900 comp rx=0 tx=0).stop 2024-09-11T23:03:29.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.609+0000 7f9682652640 1 -- 172.21.15.12:0/1656451750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f967c13a090 msgr2=0x7f967c0a8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:29.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.609+0000 7f9682652640 1 --2- 172.21.15.12:0/1656451750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f967c13a090 0x7f967c0a8c30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f966c019060 tx=0x7f966c0191f0 comp rx=0 tx=0).stop 2024-09-11T23:03:29.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.609+0000 7f9682652640 1 -- 172.21.15.12:0/1656451750 shutdown_connections 2024-09-11T23:03:29.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.609+0000 7f9682652640 1 --2- 172.21.15.12:0/1656451750 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f965c035d60 0x7f965c038220 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:29.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.609+0000 7f9682652640 1 --2- 172.21.15.12:0/1656451750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f967c13a090 0x7f967c0a8c30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:29.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.609+0000 7f9682652640 1 -- 172.21.15.12:0/1656451750 >> 172.21.15.12:0/1656451750 conn(0x7f967c06da30 msgr2=0x7f967c13ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:29.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.609+0000 7f9682652640 1 -- 172.21.15.12:0/1656451750 shutdown_connections 2024-09-11T23:03:29.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.609+0000 7f9682652640 1 -- 172.21.15.12:0/1656451750 wait complete. 2024-09-11T23:03:29.644 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T23:03:29.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.773+0000 7fd116f4d640 1 Processor -- start 2024-09-11T23:03:29.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.773+0000 7fd116f4d640 1 -- start start 2024-09-11T23:03:29.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.773+0000 7fd116f4d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd110134720 0x7fd110134b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:29.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.773+0000 7fd116f4d640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd110134500 con 0x7fd11009f060 2024-09-11T23:03:29.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.773+0000 7fd116f4d640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fd1101341f0 con 0x7fd110134720 2024-09-11T23:03:29.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.773+0000 7fd114ce9640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd110134720 0x7fd110134b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:29.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.773+0000 7fd114ce9640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd110134720 0x7fd110134b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41966/0 (socket says 172.21.15.12:41966) 2024-09-11T23:03:29.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.773+0000 7fd114ce9640 1 -- 172.21.15.12:0/1576652633 learned_addr learned my addr 172.21.15.12:0/1576652633 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:29.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.773+0000 7fd114ce9640 1 -- 172.21.15.12:0/1576652633 >> v1:172.21.15.12:6789/0 conn(0x7fd11009f060 legacy=0x7fd1101377e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:29.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.773+0000 7fd114ce9640 1 -- 172.21.15.12:0/1576652633 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd11009fbe0 con 0x7fd110134720 2024-09-11T23:03:29.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.777+0000 7fd114ce9640 1 --2- 172.21.15.12:0/1576652633 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd110134720 0x7fd110134b00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd1040097f0 tx=0x7fd10401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e73a9f10d65b2b96 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:29.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.777+0000 7fd10f7fe640 1 -- 172.21.15.12:0/1576652633 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1040b0070 con 0x7fd110134720 2024-09-11T23:03:29.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.777+0000 7fd10f7fe640 1 -- 172.21.15.12:0/1576652633 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1040ab530 con 0x7fd110134720 2024-09-11T23:03:29.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.777+0000 7fd10f7fe640 1 -- 172.21.15.12:0/1576652633 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1040a4e60 con 0x7fd110134720 2024-09-11T23:03:29.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.777+0000 7fd116f4d640 1 -- 172.21.15.12:0/1576652633 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd110134720 msgr2=0x7fd110134b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:29.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.777+0000 7fd116f4d640 1 --2- 172.21.15.12:0/1576652633 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd110134720 0x7fd110134b00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd1040097f0 tx=0x7fd10401c4e0 comp rx=0 tx=0).stop 2024-09-11T23:03:29.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.777+0000 7fd116f4d640 1 -- 172.21.15.12:0/1576652633 shutdown_connections 2024-09-11T23:03:29.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.777+0000 7fd116f4d640 1 --2- 172.21.15.12:0/1576652633 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd110134720 0x7fd110134b00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:29.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.777+0000 7fd116f4d640 1 -- 172.21.15.12:0/1576652633 >> 172.21.15.12:0/1576652633 conn(0x7fd11009a9d0 msgr2=0x7fd11009cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:29.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.777+0000 7fd116f4d640 1 -- 172.21.15.12:0/1576652633 shutdown_connections 2024-09-11T23:03:29.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.777+0000 7fd116f4d640 1 -- 172.21.15.12:0/1576652633 wait complete. 2024-09-11T23:03:29.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.777+0000 7fd116f4d640 1 Processor -- start 2024-09-11T23:03:29.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.777+0000 7fd116f4d640 1 -- start start 2024-09-11T23:03:29.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.777+0000 7fd116f4d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd11009f060 0x7fd1100a1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:29.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.781+0000 7fd116f4d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd11013fb80 con 0x7fd11009f060 2024-09-11T23:03:29.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.781+0000 7fd114ce9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd11009f060 0x7fd1100a1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:29.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.781+0000 7fd114ce9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd11009f060 0x7fd1100a1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41972/0 (socket says 172.21.15.12:41972) 2024-09-11T23:03:29.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.781+0000 7fd114ce9640 1 -- 172.21.15.12:0/2655152728 learned_addr learned my addr 172.21.15.12:0/2655152728 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:29.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.781+0000 7fd114ce9640 1 -- 172.21.15.12:0/2655152728 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1100a3f20 con 0x7fd11009f060 2024-09-11T23:03:29.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.781+0000 7fd114ce9640 1 --2- 172.21.15.12:0/2655152728 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd11009f060 0x7fd1100a1b10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd1040ae040 tx=0x7fd104019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:29.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.781+0000 7fd10d7fa640 1 -- 172.21.15.12:0/2655152728 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1040b8070 con 0x7fd11009f060 2024-09-11T23:03:29.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.781+0000 7fd10d7fa640 1 -- 172.21.15.12:0/2655152728 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1040b4410 con 0x7fd11009f060 2024-09-11T23:03:29.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.781+0000 7fd116f4d640 1 -- 172.21.15.12:0/2655152728 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1100a61b0 con 0x7fd11009f060 2024-09-11T23:03:29.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.781+0000 7fd10d7fa640 1 -- 172.21.15.12:0/2655152728 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1040b0040 con 0x7fd11009f060 2024-09-11T23:03:29.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.781+0000 7fd116f4d640 1 -- 172.21.15.12:0/2655152728 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd11009adb0 con 0x7fd11009f060 2024-09-11T23:03:29.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.781+0000 7fd10d7fa640 1 -- 172.21.15.12:0/2655152728 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd1040bb070 con 0x7fd11009f060 2024-09-11T23:03:29.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.781+0000 7fd116f4d640 1 -- 172.21.15.12:0/2655152728 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd110137a20 con 0x7fd11009f060 2024-09-11T23:03:29.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.781+0000 7fd10d7fa640 1 --2- 172.21.15.12:0/2655152728 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fd0f4035e00 0x7fd0f40382c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:29.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.781+0000 7fd10d7fa640 1 -- 172.21.15.12:0/2655152728 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2957+0+0 (secure 0 0 0) 0x7fd1040e22a0 con 0x7fd11009f060 2024-09-11T23:03:29.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.781+0000 7fd10ffff640 1 --2- 172.21.15.12:0/2655152728 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fd0f4035e00 0x7fd0f40382c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:29.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.781+0000 7fd10ffff640 1 --2- 172.21.15.12:0/2655152728 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fd0f4035e00 0x7fd0f40382c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc001590 tx=0x7fd0fc007a60 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:29.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.785+0000 7fd10d7fa640 1 -- 172.21.15.12:0/2655152728 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd1040160d0 con 0x7fd11009f060 2024-09-11T23:03:29.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:29.949+0000 7fd116f4d640 1 -- 172.21.15.12:0/2655152728 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fd11009d2e0 con 0x7fd11009f060 2024-09-11T23:03:30.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.605+0000 7fd10d7fa640 1 -- 172.21.15.12:0/2655152728 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v14) ==== 170+0+0 (secure 0 0 0) 0x7fd1040b3d60 con 0x7fd11009f060 2024-09-11T23:03:30.611 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' created 2024-09-11T23:03:30.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.609+0000 7fd116f4d640 1 -- 172.21.15.12:0/2655152728 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fd0f4035e00 msgr2=0x7fd0f40382c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:30.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.609+0000 7fd116f4d640 1 --2- 172.21.15.12:0/2655152728 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fd0f4035e00 0x7fd0f40382c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc001590 tx=0x7fd0fc007a60 comp rx=0 tx=0).stop 2024-09-11T23:03:30.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.609+0000 7fd116f4d640 1 -- 172.21.15.12:0/2655152728 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd11009f060 msgr2=0x7fd1100a1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:30.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.609+0000 7fd116f4d640 1 --2- 172.21.15.12:0/2655152728 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd11009f060 0x7fd1100a1b10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd1040ae040 tx=0x7fd104019280 comp rx=0 tx=0).stop 2024-09-11T23:03:30.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.609+0000 7fd116f4d640 1 -- 172.21.15.12:0/2655152728 shutdown_connections 2024-09-11T23:03:30.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.609+0000 7fd116f4d640 1 --2- 172.21.15.12:0/2655152728 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fd0f4035e00 0x7fd0f40382c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:30.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.609+0000 7fd116f4d640 1 --2- 172.21.15.12:0/2655152728 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd11009f060 0x7fd1100a1b10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:30.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.609+0000 7fd116f4d640 1 -- 172.21.15.12:0/2655152728 >> 172.21.15.12:0/2655152728 conn(0x7fd11009a9d0 msgr2=0x7fd11009b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:30.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.609+0000 7fd116f4d640 1 -- 172.21.15.12:0/2655152728 shutdown_connections 2024-09-11T23:03:30.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.609+0000 7fd116f4d640 1 -- 172.21.15.12:0/2655152728 wait complete. 2024-09-11T23:03:30.650 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T23:03:30.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.769+0000 7f8bd2e89640 1 Processor -- start 2024-09-11T23:03:30.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.769+0000 7f8bd2e89640 1 -- start start 2024-09-11T23:03:30.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.769+0000 7f8bd2e89640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8bcc137de0 0x7f8bcc09f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:30.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.769+0000 7f8bd2e89640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bcc09d690 con 0x7f8bcc1381c0 2024-09-11T23:03:30.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.769+0000 7f8bd2e89640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f8bcc09ea90 con 0x7f8bcc137de0 2024-09-11T23:03:30.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.769+0000 7f8bd0c25640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8bcc137de0 0x7f8bcc09f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:30.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.769+0000 7f8bd0c25640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8bcc137de0 0x7f8bcc09f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41976/0 (socket says 172.21.15.12:41976) 2024-09-11T23:03:30.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.769+0000 7f8bcbfff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f8bcc1381c0 0x7f8bcc0a36a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:37996/0 (socket says 172.21.15.12:37996) 2024-09-11T23:03:30.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.769+0000 7f8bd0c25640 1 -- 172.21.15.12:0/1998299931 learned_addr learned my addr 172.21.15.12:0/1998299931 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:30.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.769+0000 7f8bd0c25640 1 -- 172.21.15.12:0/1998299931 >> v1:172.21.15.12:6789/0 conn(0x7f8bcc1381c0 legacy=0x7f8bcc0a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:30.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.769+0000 7f8bd0c25640 1 -- 172.21.15.12:0/1998299931 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bcc09f6d0 con 0x7f8bcc137de0 2024-09-11T23:03:30.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.769+0000 7f8bcb7fe640 1 -- 172.21.15.12:0/1998299931 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1120083429 0 0) 0x7f8bcc09d690 con 0x7f8bcc1381c0 2024-09-11T23:03:30.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.773+0000 7f8bd0c25640 1 --2- 172.21.15.12:0/1998299931 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bcc137de0 0x7f8bcc09f190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8bc00097f0 tx=0x7f8bc001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5aaa32534d2d569 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:30.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.773+0000 7f8bcb7fe640 1 -- 172.21.15.12:0/1998299931 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8bc00b0070 con 0x7f8bcc137de0 2024-09-11T23:03:30.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.773+0000 7f8bcb7fe640 1 -- 172.21.15.12:0/1998299931 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bc00ab530 con 0x7f8bcc137de0 2024-09-11T23:03:30.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.773+0000 7f8bcb7fe640 1 -- 172.21.15.12:0/1998299931 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8bc00ab830 con 0x7f8bcc137de0 2024-09-11T23:03:30.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.773+0000 7f8bd2e89640 1 -- 172.21.15.12:0/1998299931 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bcc137de0 msgr2=0x7f8bcc09f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:30.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.773+0000 7f8bd2e89640 1 --2- 172.21.15.12:0/1998299931 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bcc137de0 0x7f8bcc09f190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8bc00097f0 tx=0x7f8bc001c450 comp rx=0 tx=0).stop 2024-09-11T23:03:30.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.773+0000 7f8bd2e89640 1 -- 172.21.15.12:0/1998299931 shutdown_connections 2024-09-11T23:03:30.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.773+0000 7f8bd2e89640 1 --2- 172.21.15.12:0/1998299931 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bcc137de0 0x7f8bcc09f190 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:30.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.773+0000 7f8bd2e89640 1 -- 172.21.15.12:0/1998299931 >> 172.21.15.12:0/1998299931 conn(0x7f8bcc0a82f0 msgr2=0x7f8bcc0a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:30.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.773+0000 7f8bd2e89640 1 -- 172.21.15.12:0/1998299931 shutdown_connections 2024-09-11T23:03:30.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.773+0000 7f8bd2e89640 1 -- 172.21.15.12:0/1998299931 wait complete. 2024-09-11T23:03:30.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.773+0000 7f8bd2e89640 1 Processor -- start 2024-09-11T23:03:30.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.773+0000 7f8bd2e89640 1 -- start start 2024-09-11T23:03:30.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.773+0000 7f8bd2e89640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bcc137de0 0x7f8bcc072390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:30.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.777+0000 7f8bd2e89640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8bcc09e7d0 con 0x7f8bcc137de0 2024-09-11T23:03:30.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.777+0000 7f8bd0c25640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bcc137de0 0x7f8bcc072390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:30.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.777+0000 7f8bd0c25640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bcc137de0 0x7f8bcc072390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41980/0 (socket says 172.21.15.12:41980) 2024-09-11T23:03:30.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.777+0000 7f8bd0c25640 1 -- 172.21.15.12:0/1919655225 learned_addr learned my addr 172.21.15.12:0/1919655225 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:30.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.777+0000 7f8bd0c25640 1 -- 172.21.15.12:0/1919655225 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bcc071e80 con 0x7f8bcc137de0 2024-09-11T23:03:30.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.777+0000 7f8bd0c25640 1 --2- 172.21.15.12:0/1919655225 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bcc137de0 0x7f8bcc072390 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0019060 tx=0x7f8bc001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:30.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.777+0000 7f8bc97fa640 1 -- 172.21.15.12:0/1919655225 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8bc00b0040 con 0x7f8bcc137de0 2024-09-11T23:03:30.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.777+0000 7f8bc97fa640 1 -- 172.21.15.12:0/1919655225 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bc00abe40 con 0x7f8bcc137de0 2024-09-11T23:03:30.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.777+0000 7f8bc97fa640 1 -- 172.21.15.12:0/1919655225 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8bc0004150 con 0x7f8bcc137de0 2024-09-11T23:03:30.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.777+0000 7f8bd2e89640 1 -- 172.21.15.12:0/1919655225 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bcc0711e0 con 0x7f8bcc137de0 2024-09-11T23:03:30.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.777+0000 7f8bd2e89640 1 -- 172.21.15.12:0/1919655225 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bcc13cfa0 con 0x7f8bcc137de0 2024-09-11T23:03:30.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.777+0000 7f8bc97fa640 1 -- 172.21.15.12:0/1919655225 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8bc00b3070 con 0x7f8bcc137de0 2024-09-11T23:03:30.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.777+0000 7f8bc97fa640 1 --2- 172.21.15.12:0/1919655225 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f8bb8035e00 0x7f8bb80382c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:30.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.777+0000 7f8bd2e89640 1 -- 172.21.15.12:0/1919655225 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bcc09f190 con 0x7f8bcc137de0 2024-09-11T23:03:30.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.777+0000 7f8bc97fa640 1 -- 172.21.15.12:0/1919655225 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3339+0+0 (secure 0 0 0) 0x7f8bc00e2980 con 0x7f8bcc137de0 2024-09-11T23:03:30.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.777+0000 7f8bcbfff640 1 --2- 172.21.15.12:0/1919655225 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f8bb8035e00 0x7f8bb80382c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:30.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.777+0000 7f8bcbfff640 1 --2- 172.21.15.12:0/1919655225 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f8bb8035e00 0x7f8bb80382c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc007fd0 tx=0x7f8bbc007940 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:30.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.781+0000 7f8bc97fa640 1 -- 172.21.15.12:0/1919655225 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8bc00c3030 con 0x7f8bcc137de0 2024-09-11T23:03:30.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:30.981+0000 7f8bd2e89640 1 -- 172.21.15.12:0/1919655225 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f8bcc070fb0 con 0x7f8bcc137de0 2024-09-11T23:03:31.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.617+0000 7f8bc97fa640 1 -- 172.21.15.12:0/1919655225 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f8bcc071e80 con 0x7f8bcc137de0 2024-09-11T23:03:31.621 INFO:teuthology.orchestra.run.smithi012.stderr:new fs with metadata pool 2 and data pool 3 2024-09-11T23:03:31.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.629+0000 7f8bd2e89640 1 -- 172.21.15.12:0/1919655225 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f8bb8035e00 msgr2=0x7f8bb80382c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:31.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.629+0000 7f8bd2e89640 1 --2- 172.21.15.12:0/1919655225 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f8bb8035e00 0x7f8bb80382c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc007fd0 tx=0x7f8bbc007940 comp rx=0 tx=0).stop 2024-09-11T23:03:31.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.629+0000 7f8bd2e89640 1 -- 172.21.15.12:0/1919655225 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bcc137de0 msgr2=0x7f8bcc072390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:31.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.629+0000 7f8bd2e89640 1 --2- 172.21.15.12:0/1919655225 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bcc137de0 0x7f8bcc072390 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0019060 tx=0x7f8bc001ac90 comp rx=0 tx=0).stop 2024-09-11T23:03:31.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.629+0000 7f8bd2e89640 1 -- 172.21.15.12:0/1919655225 shutdown_connections 2024-09-11T23:03:31.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.633+0000 7f8bd2e89640 1 --2- 172.21.15.12:0/1919655225 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f8bb8035e00 0x7f8bb80382c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:31.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.633+0000 7f8bd2e89640 1 --2- 172.21.15.12:0/1919655225 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bcc137de0 0x7f8bcc072390 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:31.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.633+0000 7f8bd2e89640 1 -- 172.21.15.12:0/1919655225 >> 172.21.15.12:0/1919655225 conn(0x7f8bcc0a82f0 msgr2=0x7f8bcc13d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:31.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.633+0000 7f8bd2e89640 1 -- 172.21.15.12:0/1919655225 shutdown_connections 2024-09-11T23:03:31.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.633+0000 7f8bd2e89640 1 -- 172.21.15.12:0/1919655225 wait complete. 2024-09-11T23:03:31.671 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:03:31.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.785+0000 7fd4c1c3a640 1 Processor -- start 2024-09-11T23:03:31.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.785+0000 7fd4c1c3a640 1 -- start start 2024-09-11T23:03:31.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.789+0000 7fd4c1c3a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd4bc09f6e0 0x7fd4bc13cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:31.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.789+0000 7fd4c1c3a640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4bc09e930 con 0x7fd4bc137e60 2024-09-11T23:03:31.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.789+0000 7fd4c1c3a640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fd4bc1379e0 con 0x7fd4bc09f6e0 2024-09-11T23:03:31.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.789+0000 7fd4baffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd4bc09f6e0 0x7fd4bc13cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:31.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.789+0000 7fd4bb7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd4bc137e60 0x7fd4bc138240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38000/0 (socket says 172.21.15.12:38000) 2024-09-11T23:03:31.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.789+0000 7fd4bb7fe640 1 -- 172.21.15.12:0/1687124838 learned_addr learned my addr 172.21.15.12:0/1687124838 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:03:31.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.789+0000 7fd4baffd640 1 -- 172.21.15.12:0/1687124838 >> v1:172.21.15.12:6789/0 conn(0x7fd4bc137e60 legacy=0x7fd4bc138240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:31.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.789+0000 7fd4baffd640 1 -- 172.21.15.12:0/1687124838 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4bc09d910 con 0x7fd4bc09f6e0 2024-09-11T23:03:31.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.789+0000 7fd4baffd640 1 --2- 172.21.15.12:0/1687124838 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4bc09f6e0 0x7fd4bc13cc60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0009740 tx=0x7fd4b001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16820fc98fad057c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:31.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.789+0000 7fd4ba7fc640 1 -- 172.21.15.12:0/1687124838 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4b00ab570 con 0x7fd4bc09f6e0 2024-09-11T23:03:31.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.789+0000 7fd4ba7fc640 1 -- 172.21.15.12:0/1687124838 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4b00b0070 con 0x7fd4bc09f6e0 2024-09-11T23:03:31.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.789+0000 7fd4ba7fc640 1 -- 172.21.15.12:0/1687124838 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4b00ab860 con 0x7fd4bc09f6e0 2024-09-11T23:03:31.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.793+0000 7fd4c1c3a640 1 -- 172.21.15.12:0/1687124838 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4bc09f6e0 msgr2=0x7fd4bc13cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:31.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.793+0000 7fd4c1c3a640 1 --2- 172.21.15.12:0/1687124838 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4bc09f6e0 0x7fd4bc13cc60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0009740 tx=0x7fd4b001c420 comp rx=0 tx=0).stop 2024-09-11T23:03:31.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.793+0000 7fd4c1c3a640 1 -- 172.21.15.12:0/1687124838 shutdown_connections 2024-09-11T23:03:31.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.793+0000 7fd4c1c3a640 1 --2- 172.21.15.12:0/1687124838 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4bc09f6e0 0x7fd4bc13cc60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:31.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.793+0000 7fd4c1c3a640 1 -- 172.21.15.12:0/1687124838 >> 172.21.15.12:0/1687124838 conn(0x7fd4bc0a8450 msgr2=0x7fd4bc0a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:31.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.793+0000 7fd4c1c3a640 1 -- 172.21.15.12:0/1687124838 shutdown_connections 2024-09-11T23:03:31.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.793+0000 7fd4c1c3a640 1 -- 172.21.15.12:0/1687124838 wait complete. 2024-09-11T23:03:31.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.793+0000 7fd4c1c3a640 1 Processor -- start 2024-09-11T23:03:31.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.793+0000 7fd4c1c3a640 1 -- start start 2024-09-11T23:03:31.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.793+0000 7fd4c1c3a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4bc137e60 0x7fd4bc070340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:31.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.793+0000 7fd4c1c3a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd4bc13fd50 con 0x7fd4bc137e60 2024-09-11T23:03:31.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.793+0000 7fd4bb7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4bc137e60 0x7fd4bc070340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:31.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.793+0000 7fd4bb7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4bc137e60 0x7fd4bc070340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41988/0 (socket says 172.21.15.12:41988) 2024-09-11T23:03:31.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.793+0000 7fd4bb7fe640 1 -- 172.21.15.12:0/3388613878 learned_addr learned my addr 172.21.15.12:0/3388613878 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:31.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.793+0000 7fd4bb7fe640 1 -- 172.21.15.12:0/3388613878 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4bc071090 con 0x7fd4bc137e60 2024-09-11T23:03:31.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.793+0000 7fd4bb7fe640 1 --2- 172.21.15.12:0/3388613878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4bc137e60 0x7fd4bc070340 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd4b400cb20 tx=0x7fd4b400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:31.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.793+0000 7fd4a3fff640 1 -- 172.21.15.12:0/3388613878 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4b4017070 con 0x7fd4bc137e60 2024-09-11T23:03:31.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.793+0000 7fd4a3fff640 1 -- 172.21.15.12:0/3388613878 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4b400abf0 con 0x7fd4bc137e60 2024-09-11T23:03:31.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.793+0000 7fd4c1c3a640 1 -- 172.21.15.12:0/3388613878 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4bc0713a0 con 0x7fd4bc137e60 2024-09-11T23:03:31.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.793+0000 7fd4a3fff640 1 -- 172.21.15.12:0/3388613878 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4b4012400 con 0x7fd4bc137e60 2024-09-11T23:03:31.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.793+0000 7fd4c1c3a640 1 -- 172.21.15.12:0/3388613878 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4bc0716d0 con 0x7fd4bc137e60 2024-09-11T23:03:31.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.793+0000 7fd4a3fff640 1 -- 172.21.15.12:0/3388613878 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd4b401a070 con 0x7fd4bc137e60 2024-09-11T23:03:31.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.793+0000 7fd4a3fff640 1 --2- 172.21.15.12:0/3388613878 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fd4a8035db0 0x7fd4a8038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:31.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.793+0000 7fd4a3fff640 1 -- 172.21.15.12:0/3388613878 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3439+0+0 (secure 0 0 0) 0x7fd4b40483d0 con 0x7fd4bc137e60 2024-09-11T23:03:31.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.793+0000 7fd4c1c3a640 1 -- 172.21.15.12:0/3388613878 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4bc09c870 con 0x7fd4bc137e60 2024-09-11T23:03:31.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.793+0000 7fd4baffd640 1 --2- 172.21.15.12:0/3388613878 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fd4a8035db0 0x7fd4a8038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:31.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.797+0000 7fd4baffd640 1 --2- 172.21.15.12:0/3388613878 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fd4a8035db0 0x7fd4a8038270 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd4b00af000 tx=0x7fd4b00a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:31.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.801+0000 7fd4a3fff640 1 -- 172.21.15.12:0/3388613878 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd4b40113a0 con 0x7fd4bc137e60 2024-09-11T23:03:31.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.965+0000 7fd4c1c3a640 1 -- 172.21.15.12:0/3388613878 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd4bc138240 con 0x7fd4bc137e60 2024-09-11T23:03:31.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.969+0000 7fd4a3fff640 1 -- 172.21.15.12:0/3388613878 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) ==== 74+0+10688 (secure 0 0 0) 0x7fd4b401aa90 con 0x7fd4bc137e60 2024-09-11T23:03:31.971 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:03:31.971 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":15,"fsid":"8be14356-3340-4500-91a2-4cbc6b511f65","created":"2024-09-11T23:03:10.620234+0000","modified":"2024-09-11T23:03:30.988815+0000","last_up_change":"2024-09-11T23:03:22.359028+0000","last_in_change":"2024-09-11T23:03:11.545817+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:03:23.587068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:03:28.893298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:03:29.993656+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"153b72a1-40b1-400d-93ea-333e733f9bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6817","nonce":3680911937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6819","nonce":3680911937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6823","nonce":3680911937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6821","nonce":3680911937}]},"public_addr":"172.21.15.12:6817/3680911937","cluster_addr":"172.21.15.12:6819/3680911937","heartbeat_back_addr":"172.21.15.12:6823/3680911937","heartbeat_front_addr":"172.21.15.12:6821/3680911937","state":["exists","up"]},{"osd":1,"uuid":"94669e49-ee4f-4acf-9e25-e94374dda8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6801","nonce":236825163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6803","nonce":236825163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6807","nonce":236825163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6805","nonce":236825163}]},"public_addr":"172.21.15.12:6801/236825163","cluster_addr":"172.21.15.12:6803/236825163","heartbeat_back_addr":"172.21.15.12:6807/236825163","heartbeat_front_addr":"172.21.15.12:6805/236825163","state":["exists","up"]},{"osd":2,"uuid":"826dae4d-8888-4ec5-8f00-425b3be93814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6809","nonce":3263521655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6811","nonce":3263521655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6815","nonce":3263521655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6813","nonce":3263521655}]},"public_addr":"172.21.15.12:6809/3263521655","cluster_addr":"172.21.15.12:6811/3263521655","heartbeat_back_addr":"172.21.15.12:6815/3263521655","heartbeat_front_addr":"172.21.15.12:6813/3263521655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:19.398518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.761524+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.904997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:03:31.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.973+0000 7fd4c1c3a640 1 -- 172.21.15.12:0/3388613878 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fd4a8035db0 msgr2=0x7fd4a8038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:31.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.973+0000 7fd4c1c3a640 1 --2- 172.21.15.12:0/3388613878 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fd4a8035db0 0x7fd4a8038270 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd4b00af000 tx=0x7fd4b00a7000 comp rx=0 tx=0).stop 2024-09-11T23:03:31.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.973+0000 7fd4c1c3a640 1 -- 172.21.15.12:0/3388613878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4bc137e60 msgr2=0x7fd4bc070340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:31.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.973+0000 7fd4c1c3a640 1 --2- 172.21.15.12:0/3388613878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4bc137e60 0x7fd4bc070340 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd4b400cb20 tx=0x7fd4b400a060 comp rx=0 tx=0).stop 2024-09-11T23:03:31.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.973+0000 7fd4c1c3a640 1 -- 172.21.15.12:0/3388613878 shutdown_connections 2024-09-11T23:03:31.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.973+0000 7fd4c1c3a640 1 --2- 172.21.15.12:0/3388613878 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fd4a8035db0 0x7fd4a8038270 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:31.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.973+0000 7fd4c1c3a640 1 --2- 172.21.15.12:0/3388613878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4bc137e60 0x7fd4bc070340 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:31.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.973+0000 7fd4c1c3a640 1 -- 172.21.15.12:0/3388613878 >> 172.21.15.12:0/3388613878 conn(0x7fd4bc0a8450 msgr2=0x7fd4bc09fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:31.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.973+0000 7fd4c1c3a640 1 -- 172.21.15.12:0/3388613878 shutdown_connections 2024-09-11T23:03:31.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:31.973+0000 7fd4c1c3a640 1 -- 172.21.15.12:0/3388613878 wait complete. 2024-09-11T23:03:31.992 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:03:32.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.109+0000 7faf13650640 1 Processor -- start 2024-09-11T23:03:32.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.109+0000 7faf13650640 1 -- start start 2024-09-11T23:03:32.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.109+0000 7faf13650640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7faf0c09f6e0 0x7faf0c13cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:32.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.109+0000 7faf13650640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf0c09e930 con 0x7faf0c137e60 2024-09-11T23:03:32.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.109+0000 7faf13650640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7faf0c1379e0 con 0x7faf0c09f6e0 2024-09-11T23:03:32.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.109+0000 7faf10beb640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7faf0c09f6e0 0x7faf0c13cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:32.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.109+0000 7faf113ec640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7faf0c137e60 0x7faf0c138240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38016/0 (socket says 172.21.15.12:38016) 2024-09-11T23:03:32.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.109+0000 7faf10beb640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7faf0c09f6e0 0x7faf0c13cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41994/0 (socket says 172.21.15.12:41994) 2024-09-11T23:03:32.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.109+0000 7faf113ec640 1 -- 172.21.15.12:0/3470918051 learned_addr learned my addr 172.21.15.12:0/3470918051 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:03:32.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.109+0000 7faf10beb640 1 -- 172.21.15.12:0/3470918051 >> v1:172.21.15.12:6789/0 conn(0x7faf0c137e60 legacy=0x7faf0c138240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:32.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.109+0000 7faf03fff640 1 -- 172.21.15.12:0/3470918051 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3235004442 0 0) 0x7faf0c09e930 con 0x7faf0c137e60 2024-09-11T23:03:32.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.109+0000 7faf10beb640 1 -- 172.21.15.12:0/3470918051 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf0c09d910 con 0x7faf0c09f6e0 2024-09-11T23:03:32.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.113+0000 7faf10beb640 1 --2- 172.21.15.12:0/3470918051 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf0c09f6e0 0x7faf0c13cc60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7faefc009740 tx=0x7faefc01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fd453619a0c051a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:32.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.113+0000 7faf03fff640 1 -- 172.21.15.12:0/3470918051 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faefc0ab570 con 0x7faf0c09f6e0 2024-09-11T23:03:32.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.113+0000 7faf03fff640 1 -- 172.21.15.12:0/3470918051 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faefc0b0070 con 0x7faf0c09f6e0 2024-09-11T23:03:32.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.113+0000 7faf03fff640 1 -- 172.21.15.12:0/3470918051 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faefc0ab860 con 0x7faf0c09f6e0 2024-09-11T23:03:32.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.113+0000 7faf13650640 1 -- 172.21.15.12:0/3470918051 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf0c09f6e0 msgr2=0x7faf0c13cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:32.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.113+0000 7faf13650640 1 --2- 172.21.15.12:0/3470918051 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf0c09f6e0 0x7faf0c13cc60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7faefc009740 tx=0x7faefc01c420 comp rx=0 tx=0).stop 2024-09-11T23:03:32.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.113+0000 7faf13650640 1 -- 172.21.15.12:0/3470918051 shutdown_connections 2024-09-11T23:03:32.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.113+0000 7faf13650640 1 --2- 172.21.15.12:0/3470918051 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf0c09f6e0 0x7faf0c13cc60 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:32.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.113+0000 7faf13650640 1 -- 172.21.15.12:0/3470918051 >> 172.21.15.12:0/3470918051 conn(0x7faf0c0a8450 msgr2=0x7faf0c0a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:32.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.113+0000 7faf13650640 1 -- 172.21.15.12:0/3470918051 shutdown_connections 2024-09-11T23:03:32.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.113+0000 7faf13650640 1 -- 172.21.15.12:0/3470918051 wait complete. 2024-09-11T23:03:32.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.117+0000 7faf13650640 1 Processor -- start 2024-09-11T23:03:32.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.117+0000 7faf13650640 1 -- start start 2024-09-11T23:03:32.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.117+0000 7faf13650640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf0c09f6e0 0x7faf0c11e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:32.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.117+0000 7faf13650640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7faf0c13fd50 con 0x7faf0c09f6e0 2024-09-11T23:03:32.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.117+0000 7faf113ec640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf0c09f6e0 0x7faf0c11e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:32.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.117+0000 7faf113ec640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf0c09f6e0 0x7faf0c11e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42004/0 (socket says 172.21.15.12:42004) 2024-09-11T23:03:32.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.117+0000 7faf113ec640 1 -- 172.21.15.12:0/3405758775 learned_addr learned my addr 172.21.15.12:0/3405758775 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:32.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.117+0000 7faf113ec640 1 -- 172.21.15.12:0/3405758775 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf0c0714d0 con 0x7faf0c09f6e0 2024-09-11T23:03:32.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.117+0000 7faf113ec640 1 --2- 172.21.15.12:0/3405758775 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf0c09f6e0 0x7faf0c11e490 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7faf0800c450 tx=0x7faf0800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:32.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.117+0000 7faf01ffb640 1 -- 172.21.15.12:0/3405758775 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf08005c20 con 0x7faf0c09f6e0 2024-09-11T23:03:32.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.117+0000 7faf01ffb640 1 -- 172.21.15.12:0/3405758775 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf08005dc0 con 0x7faf0c09f6e0 2024-09-11T23:03:32.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.117+0000 7faf13650640 1 -- 172.21.15.12:0/3405758775 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf0c071740 con 0x7faf0c09f6e0 2024-09-11T23:03:32.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.117+0000 7faf01ffb640 1 -- 172.21.15.12:0/3405758775 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf080071a0 con 0x7faf0c09f6e0 2024-09-11T23:03:32.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.117+0000 7faf13650640 1 -- 172.21.15.12:0/3405758775 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf0c072390 con 0x7faf0c09f6e0 2024-09-11T23:03:32.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.117+0000 7faf01ffb640 1 -- 172.21.15.12:0/3405758775 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7faf08007400 con 0x7faf0c09f6e0 2024-09-11T23:03:32.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.117+0000 7faf13650640 1 -- 172.21.15.12:0/3405758775 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf0c073200 con 0x7faf0c09f6e0 2024-09-11T23:03:32.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.117+0000 7faf01ffb640 1 --2- 172.21.15.12:0/3405758775 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7faef0035d60 0x7faef0038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:32.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.117+0000 7faf01ffb640 1 -- 172.21.15.12:0/3405758775 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3439+0+0 (secure 0 0 0) 0x7faf08048350 con 0x7faf0c09f6e0 2024-09-11T23:03:32.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.117+0000 7faf10beb640 1 --2- 172.21.15.12:0/3405758775 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7faef0035d60 0x7faef0038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:32.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.117+0000 7faf10beb640 1 --2- 172.21.15.12:0/3405758775 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7faef0035d60 0x7faef0038220 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7faefc0af000 tx=0x7faefc0a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:32.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.121+0000 7faf01ffb640 1 -- 172.21.15.12:0/3405758775 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7faf080182b0 con 0x7faf0c09f6e0 2024-09-11T23:03:32.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.281+0000 7faf13650640 1 -- 172.21.15.12:0/3405758775 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faf0c06bc60 con 0x7faf0c09f6e0 2024-09-11T23:03:32.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.285+0000 7faf01ffb640 1 -- 172.21.15.12:0/3405758775 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) ==== 74+0+10688 (secure 0 0 0) 0x7faf0801bca0 con 0x7faf0c09f6e0 2024-09-11T23:03:32.287 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:03:32.288 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":15,"fsid":"8be14356-3340-4500-91a2-4cbc6b511f65","created":"2024-09-11T23:03:10.620234+0000","modified":"2024-09-11T23:03:30.988815+0000","last_up_change":"2024-09-11T23:03:22.359028+0000","last_in_change":"2024-09-11T23:03:11.545817+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:03:23.587068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:03:28.893298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:03:29.993656+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"153b72a1-40b1-400d-93ea-333e733f9bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6817","nonce":3680911937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6819","nonce":3680911937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6823","nonce":3680911937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6821","nonce":3680911937}]},"public_addr":"172.21.15.12:6817/3680911937","cluster_addr":"172.21.15.12:6819/3680911937","heartbeat_back_addr":"172.21.15.12:6823/3680911937","heartbeat_front_addr":"172.21.15.12:6821/3680911937","state":["exists","up"]},{"osd":1,"uuid":"94669e49-ee4f-4acf-9e25-e94374dda8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6801","nonce":236825163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6803","nonce":236825163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6807","nonce":236825163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6805","nonce":236825163}]},"public_addr":"172.21.15.12:6801/236825163","cluster_addr":"172.21.15.12:6803/236825163","heartbeat_back_addr":"172.21.15.12:6807/236825163","heartbeat_front_addr":"172.21.15.12:6805/236825163","state":["exists","up"]},{"osd":2,"uuid":"826dae4d-8888-4ec5-8f00-425b3be93814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6809","nonce":3263521655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6811","nonce":3263521655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6815","nonce":3263521655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6813","nonce":3263521655}]},"public_addr":"172.21.15.12:6809/3263521655","cluster_addr":"172.21.15.12:6811/3263521655","heartbeat_back_addr":"172.21.15.12:6815/3263521655","heartbeat_front_addr":"172.21.15.12:6813/3263521655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:19.398518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.761524+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.904997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:03:32.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.285+0000 7faf13650640 1 -- 172.21.15.12:0/3405758775 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7faef0035d60 msgr2=0x7faef0038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:32.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.285+0000 7faf13650640 1 --2- 172.21.15.12:0/3405758775 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7faef0035d60 0x7faef0038220 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7faefc0af000 tx=0x7faefc0a7000 comp rx=0 tx=0).stop 2024-09-11T23:03:32.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.285+0000 7faf13650640 1 -- 172.21.15.12:0/3405758775 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf0c09f6e0 msgr2=0x7faf0c11e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:32.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.285+0000 7faf13650640 1 --2- 172.21.15.12:0/3405758775 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf0c09f6e0 0x7faf0c11e490 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7faf0800c450 tx=0x7faf0800c910 comp rx=0 tx=0).stop 2024-09-11T23:03:32.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.285+0000 7faf13650640 1 -- 172.21.15.12:0/3405758775 shutdown_connections 2024-09-11T23:03:32.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.285+0000 7faf13650640 1 --2- 172.21.15.12:0/3405758775 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7faef0035d60 0x7faef0038220 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:32.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.285+0000 7faf13650640 1 --2- 172.21.15.12:0/3405758775 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf0c09f6e0 0x7faf0c11e490 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:32.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.285+0000 7faf13650640 1 -- 172.21.15.12:0/3405758775 >> 172.21.15.12:0/3405758775 conn(0x7faf0c0a8450 msgr2=0x7faf0c0a14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:32.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.285+0000 7faf13650640 1 -- 172.21.15.12:0/3405758775 shutdown_connections 2024-09-11T23:03:32.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.285+0000 7faf13650640 1 -- 172.21.15.12:0/3405758775 wait complete. 2024-09-11T23:03:32.305 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-11T23:03:32.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.413+0000 7fae5c4e3640 1 Processor -- start 2024-09-11T23:03:32.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.413+0000 7fae5c4e3640 1 -- start start 2024-09-11T23:03:32.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.417+0000 7fae5c4e3640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fae540a8110 0x7fae5413ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:32.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.417+0000 7fae5c4e3640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae540a4e40 con 0x7fae540a71c0 2024-09-11T23:03:32.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.417+0000 7fae5c4e3640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fae540a6af0 con 0x7fae540a8110 2024-09-11T23:03:32.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.417+0000 7fae59a7e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fae540a8110 0x7fae5413ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:32.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.417+0000 7fae5a27f640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fae540a71c0 0x7fae540a75a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38028/0 (socket says 172.21.15.12:38028) 2024-09-11T23:03:32.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.417+0000 7fae59a7e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fae540a8110 0x7fae5413ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42008/0 (socket says 172.21.15.12:42008) 2024-09-11T23:03:32.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.417+0000 7fae5a27f640 1 -- 172.21.15.12:0/890450366 learned_addr learned my addr 172.21.15.12:0/890450366 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:03:32.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.417+0000 7fae59a7e640 1 -- 172.21.15.12:0/890450366 >> v1:172.21.15.12:6789/0 conn(0x7fae540a71c0 legacy=0x7fae540a75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:32.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.417+0000 7fae5927d640 1 -- 172.21.15.12:0/890450366 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2853057085 0 0) 0x7fae540a4e40 con 0x7fae540a71c0 2024-09-11T23:03:32.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.417+0000 7fae59a7e640 1 -- 172.21.15.12:0/890450366 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae540a3f50 con 0x7fae540a8110 2024-09-11T23:03:32.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.417+0000 7fae59a7e640 1 --2- 172.21.15.12:0/890450366 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae540a8110 0x7fae5413ef50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fae48009740 tx=0x7fae4801c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0306a09b4444529 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:32.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.417+0000 7fae5927d640 1 -- 172.21.15.12:0/890450366 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae480b0070 con 0x7fae540a8110 2024-09-11T23:03:32.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.417+0000 7fae5927d640 1 -- 172.21.15.12:0/890450366 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae480ab530 con 0x7fae540a8110 2024-09-11T23:03:32.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.417+0000 7fae5927d640 1 -- 172.21.15.12:0/890450366 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae480ab830 con 0x7fae540a8110 2024-09-11T23:03:32.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.417+0000 7fae5c4e3640 1 -- 172.21.15.12:0/890450366 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae540a8110 msgr2=0x7fae5413ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:32.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.417+0000 7fae5c4e3640 1 --2- 172.21.15.12:0/890450366 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae540a8110 0x7fae5413ef50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fae48009740 tx=0x7fae4801c390 comp rx=0 tx=0).stop 2024-09-11T23:03:32.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.417+0000 7fae5c4e3640 1 -- 172.21.15.12:0/890450366 shutdown_connections 2024-09-11T23:03:32.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.417+0000 7fae5c4e3640 1 --2- 172.21.15.12:0/890450366 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae540a8110 0x7fae5413ef50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:32.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.417+0000 7fae5c4e3640 1 -- 172.21.15.12:0/890450366 >> 172.21.15.12:0/890450366 conn(0x7fae540ac4f0 msgr2=0x7fae540ac900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:32.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.417+0000 7fae5c4e3640 1 -- 172.21.15.12:0/890450366 shutdown_connections 2024-09-11T23:03:32.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.417+0000 7fae5c4e3640 1 -- 172.21.15.12:0/890450366 wait complete. 2024-09-11T23:03:32.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.421+0000 7fae5c4e3640 1 Processor -- start 2024-09-11T23:03:32.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.421+0000 7fae5c4e3640 1 -- start start 2024-09-11T23:03:32.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.421+0000 7fae5c4e3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae540a71c0 0x7fae5409f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:32.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.421+0000 7fae5c4e3640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fae5406dd50 con 0x7fae540a71c0 2024-09-11T23:03:32.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.421+0000 7fae5a27f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae540a71c0 0x7fae5409f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:32.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.421+0000 7fae5a27f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae540a71c0 0x7fae5409f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42024/0 (socket says 172.21.15.12:42024) 2024-09-11T23:03:32.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.421+0000 7fae5a27f640 1 -- 172.21.15.12:0/357520234 learned_addr learned my addr 172.21.15.12:0/357520234 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:32.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.421+0000 7fae5a27f640 1 -- 172.21.15.12:0/357520234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae5409ea60 con 0x7fae540a71c0 2024-09-11T23:03:32.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.421+0000 7fae5a27f640 1 --2- 172.21.15.12:0/357520234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae540a71c0 0x7fae5409f420 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fae5000c420 tx=0x7fae5000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:32.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.421+0000 7fae46ffd640 1 -- 172.21.15.12:0/357520234 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae50018070 con 0x7fae540a71c0 2024-09-11T23:03:32.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.421+0000 7fae46ffd640 1 -- 172.21.15.12:0/357520234 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae500074d0 con 0x7fae540a71c0 2024-09-11T23:03:32.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.421+0000 7fae5c4e3640 1 -- 172.21.15.12:0/357520234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae541cde50 con 0x7fae540a71c0 2024-09-11T23:03:32.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.421+0000 7fae46ffd640 1 -- 172.21.15.12:0/357520234 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae50004960 con 0x7fae540a71c0 2024-09-11T23:03:32.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.421+0000 7fae5c4e3640 1 -- 172.21.15.12:0/357520234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae540a1280 con 0x7fae540a71c0 2024-09-11T23:03:32.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.421+0000 7fae46ffd640 1 -- 172.21.15.12:0/357520234 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fae5001b070 con 0x7fae540a71c0 2024-09-11T23:03:32.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.421+0000 7fae46ffd640 1 --2- 172.21.15.12:0/357520234 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fae38035e00 0x7fae380382c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:32.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.421+0000 7fae5c4e3640 1 -- 172.21.15.12:0/357520234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae540a75a0 con 0x7fae540a71c0 2024-09-11T23:03:32.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.421+0000 7fae46ffd640 1 -- 172.21.15.12:0/357520234 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3439+0+0 (secure 0 0 0) 0x7fae50047a90 con 0x7fae540a71c0 2024-09-11T23:03:32.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.421+0000 7fae59a7e640 1 --2- 172.21.15.12:0/357520234 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fae38035e00 0x7fae380382c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:32.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.421+0000 7fae59a7e640 1 --2- 172.21.15.12:0/357520234 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fae38035e00 0x7fae380382c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fae480ad000 tx=0x7fae48008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:32.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.425+0000 7fae46ffd640 1 -- 172.21.15.12:0/357520234 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fae500119b0 con 0x7fae540a71c0 2024-09-11T23:03:32.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:32.625+0000 7fae5c4e3640 1 -- 172.21.15.12:0/357520234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fae54073390 con 0x7fae540a71c0 2024-09-11T23:03:33.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.625+0000 7fae46ffd640 1 -- 172.21.15.12:0/357520234 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) ==== 118+0+0 (secure 0 0 0) 0x7fae50011c10 con 0x7fae540a71c0 2024-09-11T23:03:33.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.629+0000 7fae5c4e3640 1 -- 172.21.15.12:0/357520234 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fae38035e00 msgr2=0x7fae380382c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:33.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.629+0000 7fae5c4e3640 1 --2- 172.21.15.12:0/357520234 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fae38035e00 0x7fae380382c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fae480ad000 tx=0x7fae48008040 comp rx=0 tx=0).stop 2024-09-11T23:03:33.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.629+0000 7fae5c4e3640 1 -- 172.21.15.12:0/357520234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae540a71c0 msgr2=0x7fae5409f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:33.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.629+0000 7fae5c4e3640 1 --2- 172.21.15.12:0/357520234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae540a71c0 0x7fae5409f420 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fae5000c420 tx=0x7fae5000c8e0 comp rx=0 tx=0).stop 2024-09-11T23:03:33.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.629+0000 7fae5c4e3640 1 -- 172.21.15.12:0/357520234 shutdown_connections 2024-09-11T23:03:33.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.629+0000 7fae5c4e3640 1 --2- 172.21.15.12:0/357520234 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fae38035e00 0x7fae380382c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:33.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.629+0000 7fae5c4e3640 1 --2- 172.21.15.12:0/357520234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae540a71c0 0x7fae5409f420 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:33.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.629+0000 7fae5c4e3640 1 -- 172.21.15.12:0/357520234 >> 172.21.15.12:0/357520234 conn(0x7fae540ac4f0 msgr2=0x7fae54139620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:33.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.629+0000 7fae5c4e3640 1 -- 172.21.15.12:0/357520234 shutdown_connections 2024-09-11T23:03:33.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.629+0000 7fae5c4e3640 1 -- 172.21.15.12:0/357520234 wait complete. 2024-09-11T23:03:33.654 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-11T23:03:33.654 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-11T23:03:33.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.781+0000 7f98ea841640 1 Processor -- start 2024-09-11T23:03:33.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.785+0000 7f98ea841640 1 -- start start 2024-09-11T23:03:33.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.785+0000 7f98ea841640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f98e40a1af0 0x7f98e413edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:33.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.785+0000 7f98ea841640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98e4136670 con 0x7f98e4136aa0 2024-09-11T23:03:33.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.785+0000 7f98ea841640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f98e40a03c0 con 0x7f98e40a1af0 2024-09-11T23:03:33.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.785+0000 7f98e37fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f98e40a1af0 0x7f98e413edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:33.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.785+0000 7f98e3fff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f98e4136aa0 0x7f98e4136e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38036/0 (socket says 172.21.15.12:38036) 2024-09-11T23:03:33.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.785+0000 7f98e3fff640 1 -- 172.21.15.12:0/4151317750 learned_addr learned my addr 172.21.15.12:0/4151317750 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:03:33.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.785+0000 7f98e37fe640 1 -- 172.21.15.12:0/4151317750 >> v1:172.21.15.12:6789/0 conn(0x7f98e4136aa0 legacy=0x7f98e4136e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:33.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.785+0000 7f98e37fe640 1 -- 172.21.15.12:0/4151317750 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98e40a50d0 con 0x7f98e40a1af0 2024-09-11T23:03:33.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.785+0000 7f98e2ffd640 1 -- 172.21.15.12:0/4151317750 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1275677781 0 0) 0x7f98e4136670 con 0x7f98e4136aa0 2024-09-11T23:03:33.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.785+0000 7f98e37fe640 1 --2- 172.21.15.12:0/4151317750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98e40a1af0 0x7f98e413edf0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f98d8009740 tx=0x7f98d801c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8643dc8d897c7eab server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:33.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.785+0000 7f98e2ffd640 1 -- 172.21.15.12:0/4151317750 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98d80b0070 con 0x7f98e40a1af0 2024-09-11T23:03:33.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.785+0000 7f98e2ffd640 1 -- 172.21.15.12:0/4151317750 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98d80ab530 con 0x7f98e40a1af0 2024-09-11T23:03:33.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.785+0000 7f98e2ffd640 1 -- 172.21.15.12:0/4151317750 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98d80ab830 con 0x7f98e40a1af0 2024-09-11T23:03:33.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.789+0000 7f98ea841640 1 -- 172.21.15.12:0/4151317750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98e40a1af0 msgr2=0x7f98e413edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:33.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.789+0000 7f98ea841640 1 --2- 172.21.15.12:0/4151317750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98e40a1af0 0x7f98e413edf0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f98d8009740 tx=0x7f98d801c390 comp rx=0 tx=0).stop 2024-09-11T23:03:33.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.789+0000 7f98ea841640 1 -- 172.21.15.12:0/4151317750 shutdown_connections 2024-09-11T23:03:33.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.789+0000 7f98ea841640 1 --2- 172.21.15.12:0/4151317750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98e40a1af0 0x7f98e413edf0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:33.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.789+0000 7f98ea841640 1 -- 172.21.15.12:0/4151317750 >> 172.21.15.12:0/4151317750 conn(0x7f98e40a91a0 msgr2=0x7f98e40a95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:33.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.789+0000 7f98ea841640 1 -- 172.21.15.12:0/4151317750 shutdown_connections 2024-09-11T23:03:33.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.789+0000 7f98ea841640 1 -- 172.21.15.12:0/4151317750 wait complete. 2024-09-11T23:03:33.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.789+0000 7f98ea841640 1 Processor -- start 2024-09-11T23:03:33.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.789+0000 7f98ea841640 1 -- start start 2024-09-11T23:03:33.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.789+0000 7f98ea841640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98e40a1af0 0x7f98e411f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:33.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.789+0000 7f98ea841640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f98e406c040 con 0x7f98e40a1af0 2024-09-11T23:03:33.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.789+0000 7f98e3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98e40a1af0 0x7f98e411f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:33.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.789+0000 7f98e3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98e40a1af0 0x7f98e411f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42046/0 (socket says 172.21.15.12:42046) 2024-09-11T23:03:33.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.789+0000 7f98e3fff640 1 -- 172.21.15.12:0/2099955156 learned_addr learned my addr 172.21.15.12:0/2099955156 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:33.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.789+0000 7f98e3fff640 1 -- 172.21.15.12:0/2099955156 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98e409e710 con 0x7f98e40a1af0 2024-09-11T23:03:33.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.789+0000 7f98e3fff640 1 --2- 172.21.15.12:0/2099955156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98e40a1af0 0x7f98e411f5a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f98d400c840 tx=0x7f98d400cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:33.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.789+0000 7f98e0ff9640 1 -- 172.21.15.12:0/2099955156 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98d4018070 con 0x7f98e40a1af0 2024-09-11T23:03:33.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.789+0000 7f98e0ff9640 1 -- 172.21.15.12:0/2099955156 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98d400a660 con 0x7f98e40a1af0 2024-09-11T23:03:33.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.789+0000 7f98ea841640 1 -- 172.21.15.12:0/2099955156 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98e409eb60 con 0x7f98e40a1af0 2024-09-11T23:03:33.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.789+0000 7f98e0ff9640 1 -- 172.21.15.12:0/2099955156 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98d400a850 con 0x7f98e40a1af0 2024-09-11T23:03:33.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.789+0000 7f98ea841640 1 -- 172.21.15.12:0/2099955156 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98e409d680 con 0x7f98e40a1af0 2024-09-11T23:03:33.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.789+0000 7f98ea841640 1 -- 172.21.15.12:0/2099955156 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98e409cef0 con 0x7f98e40a1af0 2024-09-11T23:03:33.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.789+0000 7f98e0ff9640 1 -- 172.21.15.12:0/2099955156 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f98d401b070 con 0x7f98e40a1af0 2024-09-11T23:03:33.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.789+0000 7f98e0ff9640 1 --2- 172.21.15.12:0/2099955156 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f98d0035db0 0x7f98d0038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:33.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.793+0000 7f98e0ff9640 1 -- 172.21.15.12:0/2099955156 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3439+0+0 (secure 0 0 0) 0x7f98d4047da0 con 0x7f98e40a1af0 2024-09-11T23:03:33.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.793+0000 7f98e37fe640 1 --2- 172.21.15.12:0/2099955156 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f98d0035db0 0x7f98d0038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:33.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.793+0000 7f98e37fe640 1 --2- 172.21.15.12:0/2099955156 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f98d0035db0 0x7f98d0038270 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f98d80ad000 tx=0x7f98d8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:33.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.797+0000 7f98e0ff9640 1 -- 172.21.15.12:0/2099955156 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f98d4011360 con 0x7f98e40a1af0 2024-09-11T23:03:34.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:33.997+0000 7f98ea841640 1 -- 172.21.15.12:0/2099955156 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f98e406cd70 con 0x7f98e40a1af0 2024-09-11T23:03:34.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.637+0000 7f98e0ff9640 1 -- 172.21.15.12:0/2099955156 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) ==== 122+0+0 (secure 0 0 0) 0x7f98d401cda0 con 0x7f98e40a1af0 2024-09-11T23:03:34.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.637+0000 7f98ea841640 1 -- 172.21.15.12:0/2099955156 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f98d0035db0 msgr2=0x7f98d0038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:34.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.637+0000 7f98ea841640 1 --2- 172.21.15.12:0/2099955156 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f98d0035db0 0x7f98d0038270 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f98d80ad000 tx=0x7f98d8008040 comp rx=0 tx=0).stop 2024-09-11T23:03:34.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.637+0000 7f98ea841640 1 -- 172.21.15.12:0/2099955156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98e40a1af0 msgr2=0x7f98e411f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:34.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.637+0000 7f98ea841640 1 --2- 172.21.15.12:0/2099955156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98e40a1af0 0x7f98e411f5a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f98d400c840 tx=0x7f98d400cd00 comp rx=0 tx=0).stop 2024-09-11T23:03:34.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.637+0000 7f98ea841640 1 -- 172.21.15.12:0/2099955156 shutdown_connections 2024-09-11T23:03:34.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.637+0000 7f98ea841640 1 --2- 172.21.15.12:0/2099955156 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f98d0035db0 0x7f98d0038270 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:34.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.637+0000 7f98ea841640 1 --2- 172.21.15.12:0/2099955156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98e40a1af0 0x7f98e411f5a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:34.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.637+0000 7f98ea841640 1 -- 172.21.15.12:0/2099955156 >> 172.21.15.12:0/2099955156 conn(0x7f98e40a91a0 msgr2=0x7f98e40a2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:34.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.637+0000 7f98ea841640 1 -- 172.21.15.12:0/2099955156 shutdown_connections 2024-09-11T23:03:34.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.637+0000 7f98ea841640 1 -- 172.21.15.12:0/2099955156 wait complete. 2024-09-11T23:03:34.662 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-11T23:03:34.662 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:03:34.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.785+0000 7f0eea13e640 1 Processor -- start 2024-09-11T23:03:34.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.785+0000 7f0eea13e640 1 -- start start 2024-09-11T23:03:34.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.785+0000 7f0eea13e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0ee40a4b80 0x7f0ee40a7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:34.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.785+0000 7f0eea13e640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ee40a82a0 con 0x7f0ee413a410 2024-09-11T23:03:34.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.785+0000 7f0eea13e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f0ee40a3cb0 con 0x7f0ee40a4b80 2024-09-11T23:03:34.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.785+0000 7f0ee2ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0ee40a4b80 0x7f0ee40a7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:34.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.785+0000 7f0ee2ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0ee40a4b80 0x7f0ee40a7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35000/0 (socket says 172.21.15.12:35000) 2024-09-11T23:03:34.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.785+0000 7f0ee2ffd640 1 -- 172.21.15.12:0/3244599267 learned_addr learned my addr 172.21.15.12:0/3244599267 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:34.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.789+0000 7f0ee2ffd640 1 -- 172.21.15.12:0/3244599267 >> v1:172.21.15.12:6789/0 conn(0x7f0ee413a410 legacy=0x7f0ee40a6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:34.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.789+0000 7f0ee2ffd640 1 -- 172.21.15.12:0/3244599267 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ee4139fe0 con 0x7f0ee40a4b80 2024-09-11T23:03:34.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.789+0000 7f0ee27fc640 1 -- 172.21.15.12:0/3244599267 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2132672596 0 0) 0x7f0ee40a82a0 con 0x7f0ee413a410 2024-09-11T23:03:34.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.789+0000 7f0ee2ffd640 1 --2- 172.21.15.12:0/3244599267 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ee40a4b80 0x7f0ee40a7200 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0ed80097f0 tx=0x7f0ed801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7689afd8b8caa190 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:34.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.789+0000 7f0ee27fc640 1 -- 172.21.15.12:0/3244599267 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ed80b2070 con 0x7f0ee40a4b80 2024-09-11T23:03:34.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.789+0000 7f0ee27fc640 1 -- 172.21.15.12:0/3244599267 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ed80a9070 con 0x7f0ee40a4b80 2024-09-11T23:03:34.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.789+0000 7f0ee27fc640 1 -- 172.21.15.12:0/3244599267 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ed80ad5b0 con 0x7f0ee40a4b80 2024-09-11T23:03:34.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.789+0000 7f0eea13e640 1 -- 172.21.15.12:0/3244599267 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ee40a4b80 msgr2=0x7f0ee40a7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:34.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.789+0000 7f0eea13e640 1 --2- 172.21.15.12:0/3244599267 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ee40a4b80 0x7f0ee40a7200 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0ed80097f0 tx=0x7f0ed801c450 comp rx=0 tx=0).stop 2024-09-11T23:03:34.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.789+0000 7f0eea13e640 1 -- 172.21.15.12:0/3244599267 shutdown_connections 2024-09-11T23:03:34.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.789+0000 7f0eea13e640 1 --2- 172.21.15.12:0/3244599267 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ee40a4b80 0x7f0ee40a7200 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:34.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.789+0000 7f0eea13e640 1 -- 172.21.15.12:0/3244599267 >> 172.21.15.12:0/3244599267 conn(0x7f0ee40ac2c0 msgr2=0x7f0ee40ac6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:34.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.789+0000 7f0eea13e640 1 -- 172.21.15.12:0/3244599267 shutdown_connections 2024-09-11T23:03:34.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.789+0000 7f0eea13e640 1 -- 172.21.15.12:0/3244599267 wait complete. 2024-09-11T23:03:34.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.793+0000 7f0eea13e640 1 Processor -- start 2024-09-11T23:03:34.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.793+0000 7f0eea13e640 1 -- start start 2024-09-11T23:03:34.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.793+0000 7f0eea13e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ee40a4b80 0x7f0ee409efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:34.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.793+0000 7f0eea13e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee40a7740 con 0x7f0ee40a4b80 2024-09-11T23:03:34.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.793+0000 7f0ee37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ee40a4b80 0x7f0ee409efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:34.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.793+0000 7f0ee37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ee40a4b80 0x7f0ee409efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35002/0 (socket says 172.21.15.12:35002) 2024-09-11T23:03:34.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.793+0000 7f0ee37fe640 1 -- 172.21.15.12:0/576572890 learned_addr learned my addr 172.21.15.12:0/576572890 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:34.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.793+0000 7f0ee37fe640 1 -- 172.21.15.12:0/576572890 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ee409c9e0 con 0x7f0ee40a4b80 2024-09-11T23:03:34.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.793+0000 7f0ee37fe640 1 --2- 172.21.15.12:0/576572890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ee40a4b80 0x7f0ee409efd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0ed400c420 tx=0x7f0ed400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:34.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.793+0000 7f0ecbfff640 1 -- 172.21.15.12:0/576572890 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ed4016020 con 0x7f0ee40a4b80 2024-09-11T23:03:34.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.793+0000 7f0ecbfff640 1 -- 172.21.15.12:0/576572890 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ed4012820 con 0x7f0ee40a4b80 2024-09-11T23:03:34.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.793+0000 7f0eea13e640 1 -- 172.21.15.12:0/576572890 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ee409b260 con 0x7f0ee40a4b80 2024-09-11T23:03:34.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.793+0000 7f0ecbfff640 1 -- 172.21.15.12:0/576572890 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ed4012bc0 con 0x7f0ee40a4b80 2024-09-11T23:03:34.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.793+0000 7f0eea13e640 1 -- 172.21.15.12:0/576572890 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ee409e850 con 0x7f0ee40a4b80 2024-09-11T23:03:34.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.793+0000 7f0ecbfff640 1 -- 172.21.15.12:0/576572890 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0ed4019020 con 0x7f0ee40a4b80 2024-09-11T23:03:34.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.793+0000 7f0eea13e640 1 -- 172.21.15.12:0/576572890 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ee40a6af0 con 0x7f0ee40a4b80 2024-09-11T23:03:34.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.793+0000 7f0ecbfff640 1 --2- 172.21.15.12:0/576572890 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f0ed0035db0 0x7f0ed0038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:34.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.793+0000 7f0ecbfff640 1 -- 172.21.15.12:0/576572890 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3439+0+0 (secure 0 0 0) 0x7f0ed4048320 con 0x7f0ee40a4b80 2024-09-11T23:03:34.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.793+0000 7f0ee2ffd640 1 --2- 172.21.15.12:0/576572890 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f0ed0035db0 0x7f0ed0038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:34.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.793+0000 7f0ee2ffd640 1 --2- 172.21.15.12:0/576572890 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f0ed0035db0 0x7f0ed0038270 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0ed80af000 tx=0x7f0ed8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:34.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.797+0000 7f0ecbfff640 1 -- 172.21.15.12:0/576572890 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0ed4020030 con 0x7f0ee40a4b80 2024-09-11T23:03:34.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.993+0000 7f0eea13e640 1 -- 172.21.15.12:0/576572890 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0ee409f510 con 0x7f0ee40a4b80 2024-09-11T23:03:34.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.997+0000 7f0ecbfff640 1 -- 172.21.15.12:0/576572890 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+3569 (secure 0 0 0) 0x7f0ed40102e0 con 0x7f0ee40a4b80 2024-09-11T23:03:35.000 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:03:35.000 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":7,"btime":"2024-09-11T23:03:34:638819+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4139,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6828/4176387551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":4176387551},{"type":"v1","addr":"172.21.15.12:6828","nonce":4176387551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:03:30.989250+0000","modified":"2024-09-11T23:03:34.002181+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4140":{"gid":4140,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6829/2850198678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6827","nonce":2850198678},{"type":"v1","addr":"172.21.15.12:6829","nonce":2850198678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4140,"qdb_cluster":[4140]},"id":1}]} 2024-09-11T23:03:35.000 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 7 2024-09-11T23:03:35.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.997+0000 7f0eea13e640 1 -- 172.21.15.12:0/576572890 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f0ed0035db0 msgr2=0x7f0ed0038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:35.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.997+0000 7f0eea13e640 1 --2- 172.21.15.12:0/576572890 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f0ed0035db0 0x7f0ed0038270 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0ed80af000 tx=0x7f0ed8008040 comp rx=0 tx=0).stop 2024-09-11T23:03:35.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.997+0000 7f0eea13e640 1 -- 172.21.15.12:0/576572890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ee40a4b80 msgr2=0x7f0ee409efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:35.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.997+0000 7f0eea13e640 1 --2- 172.21.15.12:0/576572890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ee40a4b80 0x7f0ee409efd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0ed400c420 tx=0x7f0ed400c8e0 comp rx=0 tx=0).stop 2024-09-11T23:03:35.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.997+0000 7f0eea13e640 1 -- 172.21.15.12:0/576572890 shutdown_connections 2024-09-11T23:03:35.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.997+0000 7f0eea13e640 1 --2- 172.21.15.12:0/576572890 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f0ed0035db0 0x7f0ed0038270 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:35.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.997+0000 7f0eea13e640 1 --2- 172.21.15.12:0/576572890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ee40a4b80 0x7f0ee409efd0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:35.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.997+0000 7f0eea13e640 1 -- 172.21.15.12:0/576572890 >> 172.21.15.12:0/576572890 conn(0x7f0ee40ac2c0 msgr2=0x7f0ee413f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:35.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.997+0000 7f0eea13e640 1 -- 172.21.15.12:0/576572890 shutdown_connections 2024-09-11T23:03:35.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:34.997+0000 7f0eea13e640 1 -- 172.21.15.12:0/576572890 wait complete. 2024-09-11T23:03:35.016 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:03:35.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.137+0000 7f32b7269640 1 Processor -- start 2024-09-11T23:03:35.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.137+0000 7f32b7269640 1 -- start start 2024-09-11T23:03:35.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.137+0000 7f32b7269640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f32b0137080 0x7f32b013bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:35.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.137+0000 7f32b7269640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32b00a1ff0 con 0x7f32b0136ca0 2024-09-11T23:03:35.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.137+0000 7f32b7269640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f32b009b4a0 con 0x7f32b0137080 2024-09-11T23:03:35.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.137+0000 7f32b5005640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f32b0136ca0 0x7f32b009ad90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:49550/0 (socket says 172.21.15.12:49550) 2024-09-11T23:03:35.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.137+0000 7f32b5005640 1 -- 172.21.15.12:0/1370137990 learned_addr learned my addr 172.21.15.12:0/1370137990 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:03:35.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.137+0000 7f32b4804640 1 --2- 172.21.15.12:0/1370137990 >> v2:172.21.15.12:3300/0 conn(0x7f32b0137080 0x7f32b013bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:35.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.137+0000 7f32a3fff640 1 -- 172.21.15.12:0/1370137990 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2847936740 0 0) 0x7f32b00a1ff0 con 0x7f32b0136ca0 2024-09-11T23:03:35.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.137+0000 7f32a3fff640 1 -- 172.21.15.12:0/1370137990 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f329c003530 con 0x7f32b0136ca0 2024-09-11T23:03:35.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.137+0000 7f32b4804640 1 -- 172.21.15.12:0/1370137990 >> v1:172.21.15.12:6789/0 conn(0x7f32b0136ca0 legacy=0x7f32b009ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:35.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.137+0000 7f32b4804640 1 -- 172.21.15.12:0/1370137990 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b00a0eb0 con 0x7f32b0137080 2024-09-11T23:03:35.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.141+0000 7f32b4804640 1 --2- 172.21.15.12:0/1370137990 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32b0137080 0x7f32b013bb70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f32a4009d90 tx=0x7f32a401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f74d7ab3a2332231 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:35.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.141+0000 7f32a3fff640 1 -- 172.21.15.12:0/1370137990 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32a40b2070 con 0x7f32b0137080 2024-09-11T23:03:35.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.141+0000 7f32a3fff640 1 -- 172.21.15.12:0/1370137990 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32a40a56e0 con 0x7f32b0137080 2024-09-11T23:03:35.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.141+0000 7f32a3fff640 1 -- 172.21.15.12:0/1370137990 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32a40a59e0 con 0x7f32b0137080 2024-09-11T23:03:35.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.141+0000 7f32b7269640 1 -- 172.21.15.12:0/1370137990 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32b0137080 msgr2=0x7f32b013bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:35.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.141+0000 7f32b7269640 1 --2- 172.21.15.12:0/1370137990 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32b0137080 0x7f32b013bb70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f32a4009d90 tx=0x7f32a401c970 comp rx=0 tx=0).stop 2024-09-11T23:03:35.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.141+0000 7f32b7269640 1 -- 172.21.15.12:0/1370137990 shutdown_connections 2024-09-11T23:03:35.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.141+0000 7f32b7269640 1 --2- 172.21.15.12:0/1370137990 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32b0137080 0x7f32b013bb70 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:35.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.141+0000 7f32b7269640 1 -- 172.21.15.12:0/1370137990 >> 172.21.15.12:0/1370137990 conn(0x7f32b00a8450 msgr2=0x7f32b00a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:35.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.141+0000 7f32b7269640 1 -- 172.21.15.12:0/1370137990 shutdown_connections 2024-09-11T23:03:35.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.141+0000 7f32b7269640 1 -- 172.21.15.12:0/1370137990 wait complete. 2024-09-11T23:03:35.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.141+0000 7f32b7269640 1 Processor -- start 2024-09-11T23:03:35.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.141+0000 7f32b7269640 1 -- start start 2024-09-11T23:03:35.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.145+0000 7f32b7269640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32b0136ca0 0x7f32b00732e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:35.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.145+0000 7f32b7269640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f32b013cc50 con 0x7f32b0136ca0 2024-09-11T23:03:35.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.145+0000 7f32b5005640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32b0136ca0 0x7f32b00732e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:35.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.145+0000 7f32b5005640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32b0136ca0 0x7f32b00732e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35018/0 (socket says 172.21.15.12:35018) 2024-09-11T23:03:35.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.145+0000 7f32b5005640 1 -- 172.21.15.12:0/4025231690 learned_addr learned my addr 172.21.15.12:0/4025231690 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:35.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.145+0000 7f32b5005640 1 -- 172.21.15.12:0/4025231690 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b0072540 con 0x7f32b0136ca0 2024-09-11T23:03:35.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.145+0000 7f32b5005640 1 --2- 172.21.15.12:0/4025231690 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32b0136ca0 0x7f32b00732e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f32ac00c3a0 tx=0x7f32ac00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:35.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.145+0000 7f32a1ffb640 1 -- 172.21.15.12:0/4025231690 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32ac017070 con 0x7f32b0136ca0 2024-09-11T23:03:35.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.145+0000 7f32a1ffb640 1 -- 172.21.15.12:0/4025231690 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32ac005c20 con 0x7f32b0136ca0 2024-09-11T23:03:35.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.145+0000 7f32b7269640 1 -- 172.21.15.12:0/4025231690 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32b006f800 con 0x7f32b0136ca0 2024-09-11T23:03:35.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.145+0000 7f32a1ffb640 1 -- 172.21.15.12:0/4025231690 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32ac0070d0 con 0x7f32b0136ca0 2024-09-11T23:03:35.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.145+0000 7f32b7269640 1 -- 172.21.15.12:0/4025231690 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32b0071620 con 0x7f32b0136ca0 2024-09-11T23:03:35.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.145+0000 7f32b7269640 1 -- 172.21.15.12:0/4025231690 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32b009ad90 con 0x7f32b0136ca0 2024-09-11T23:03:35.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.145+0000 7f32a1ffb640 1 -- 172.21.15.12:0/4025231690 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f32ac01a070 con 0x7f32b0136ca0 2024-09-11T23:03:35.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.145+0000 7f32a1ffb640 1 --2- 172.21.15.12:0/4025231690 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f3294035db0 0x7f3294038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:35.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.145+0000 7f32a1ffb640 1 -- 172.21.15.12:0/4025231690 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3439+0+0 (secure 0 0 0) 0x7f32ac047aa0 con 0x7f32b0136ca0 2024-09-11T23:03:35.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.145+0000 7f32b4804640 1 --2- 172.21.15.12:0/4025231690 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f3294035db0 0x7f3294038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:35.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.145+0000 7f32b4804640 1 --2- 172.21.15.12:0/4025231690 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f3294035db0 0x7f3294038270 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f32a40af000 tx=0x7f32a40a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:35.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.149+0000 7f32a1ffb640 1 -- 172.21.15.12:0/4025231690 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f32ac019e10 con 0x7f32b0136ca0 2024-09-11T23:03:35.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.313+0000 7f32b7269640 1 -- 172.21.15.12:0/4025231690 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f32b00703a0 con 0x7f32b0136ca0 2024-09-11T23:03:35.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.313+0000 7f32a1ffb640 1 -- 172.21.15.12:0/4025231690 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+10675 (secure 0 0 0) 0x7f32ac03a9d0 con 0x7f32b0136ca0 2024-09-11T23:03:35.318 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:03:35.318 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":16,"fsid":"8be14356-3340-4500-91a2-4cbc6b511f65","created":"2024-09-11T23:03:10.620234+0000","modified":"2024-09-11T23:03:32.629844+0000","last_up_change":"2024-09-11T23:03:22.359028+0000","last_in_change":"2024-09-11T23:03:11.545817+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:03:23.587068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:03:28.893298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:03:29.993656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"153b72a1-40b1-400d-93ea-333e733f9bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6817","nonce":3680911937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6819","nonce":3680911937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6823","nonce":3680911937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6821","nonce":3680911937}]},"public_addr":"172.21.15.12:6817/3680911937","cluster_addr":"172.21.15.12:6819/3680911937","heartbeat_back_addr":"172.21.15.12:6823/3680911937","heartbeat_front_addr":"172.21.15.12:6821/3680911937","state":["exists","up"]},{"osd":1,"uuid":"94669e49-ee4f-4acf-9e25-e94374dda8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6801","nonce":236825163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6803","nonce":236825163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6807","nonce":236825163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6805","nonce":236825163}]},"public_addr":"172.21.15.12:6801/236825163","cluster_addr":"172.21.15.12:6803/236825163","heartbeat_back_addr":"172.21.15.12:6807/236825163","heartbeat_front_addr":"172.21.15.12:6805/236825163","state":["exists","up"]},{"osd":2,"uuid":"826dae4d-8888-4ec5-8f00-425b3be93814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6809","nonce":3263521655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6811","nonce":3263521655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6815","nonce":3263521655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6813","nonce":3263521655}]},"public_addr":"172.21.15.12:6809/3263521655","cluster_addr":"172.21.15.12:6811/3263521655","heartbeat_back_addr":"172.21.15.12:6815/3263521655","heartbeat_front_addr":"172.21.15.12:6813/3263521655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:19.398518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.761524+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.904997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:03:35.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.317+0000 7f32b7269640 1 -- 172.21.15.12:0/4025231690 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f3294035db0 msgr2=0x7f3294038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:35.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.317+0000 7f32b7269640 1 --2- 172.21.15.12:0/4025231690 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f3294035db0 0x7f3294038270 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f32a40af000 tx=0x7f32a40a7070 comp rx=0 tx=0).stop 2024-09-11T23:03:35.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.317+0000 7f32b7269640 1 -- 172.21.15.12:0/4025231690 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32b0136ca0 msgr2=0x7f32b00732e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:35.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.317+0000 7f32b7269640 1 --2- 172.21.15.12:0/4025231690 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32b0136ca0 0x7f32b00732e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f32ac00c3a0 tx=0x7f32ac00c860 comp rx=0 tx=0).stop 2024-09-11T23:03:35.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.317+0000 7f32b7269640 1 -- 172.21.15.12:0/4025231690 shutdown_connections 2024-09-11T23:03:35.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.317+0000 7f32b7269640 1 --2- 172.21.15.12:0/4025231690 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f3294035db0 0x7f3294038270 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:35.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.317+0000 7f32b7269640 1 --2- 172.21.15.12:0/4025231690 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32b0136ca0 0x7f32b00732e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:35.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.317+0000 7f32b7269640 1 -- 172.21.15.12:0/4025231690 >> 172.21.15.12:0/4025231690 conn(0x7f32b00a8450 msgr2=0x7f32b00a5fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:35.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.317+0000 7f32b7269640 1 -- 172.21.15.12:0/4025231690 shutdown_connections 2024-09-11T23:03:35.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.317+0000 7f32b7269640 1 -- 172.21.15.12:0/4025231690 wait complete. 2024-09-11T23:03:35.337 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T23:03:35.338 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:03:35.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.453+0000 7f2f6b1d5640 1 Processor -- start 2024-09-11T23:03:35.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.453+0000 7f2f6b1d5640 1 -- start start 2024-09-11T23:03:35.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.453+0000 7f2f6b1d5640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2f6409f6e0 0x7f2f6413cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:35.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.453+0000 7f2f6b1d5640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f6409e930 con 0x7f2f64137e60 2024-09-11T23:03:35.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.453+0000 7f2f6b1d5640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f2f641379e0 con 0x7f2f6409f6e0 2024-09-11T23:03:35.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.453+0000 7f2f63fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2f6409f6e0 0x7f2f6413cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:35.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.453+0000 7f2f63fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2f6409f6e0 0x7f2f6413cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35034/0 (socket says 172.21.15.12:35034) 2024-09-11T23:03:35.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.453+0000 7f2f63fff640 1 -- 172.21.15.12:0/3799617541 learned_addr learned my addr 172.21.15.12:0/3799617541 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:35.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.453+0000 7f2f68f71640 1 --1- 172.21.15.12:0/3799617541 >> v1:172.21.15.12:6789/0 conn(0x7f2f64137e60 0x7f2f64138240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:49566/0 (socket says 172.21.15.12:49566) 2024-09-11T23:03:35.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.453+0000 7f2f63fff640 1 -- 172.21.15.12:0/3799617541 >> v1:172.21.15.12:6789/0 conn(0x7f2f64137e60 legacy=0x7f2f64138240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:35.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.453+0000 7f2f63fff640 1 -- 172.21.15.12:0/3799617541 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f6409d910 con 0x7f2f6409f6e0 2024-09-11T23:03:35.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.457+0000 7f2f63fff640 1 --2- 172.21.15.12:0/3799617541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2f6409f6e0 0x7f2f6413cc60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2f540097f0 tx=0x7f2f5401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6f6f71c03da2f15 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:35.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.457+0000 7f2f637fe640 1 -- 172.21.15.12:0/3799617541 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f540aa590 con 0x7f2f6409f6e0 2024-09-11T23:03:35.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.457+0000 7f2f637fe640 1 -- 172.21.15.12:0/3799617541 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f540af070 con 0x7f2f6409f6e0 2024-09-11T23:03:35.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.457+0000 7f2f637fe640 1 -- 172.21.15.12:0/3799617541 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f540aa880 con 0x7f2f6409f6e0 2024-09-11T23:03:35.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.457+0000 7f2f6b1d5640 1 -- 172.21.15.12:0/3799617541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2f6409f6e0 msgr2=0x7f2f6413cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:35.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.457+0000 7f2f6b1d5640 1 --2- 172.21.15.12:0/3799617541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2f6409f6e0 0x7f2f6413cc60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2f540097f0 tx=0x7f2f5401c4e0 comp rx=0 tx=0).stop 2024-09-11T23:03:35.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.457+0000 7f2f6b1d5640 1 -- 172.21.15.12:0/3799617541 shutdown_connections 2024-09-11T23:03:35.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.457+0000 7f2f6b1d5640 1 --2- 172.21.15.12:0/3799617541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2f6409f6e0 0x7f2f6413cc60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:35.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.457+0000 7f2f6b1d5640 1 -- 172.21.15.12:0/3799617541 >> 172.21.15.12:0/3799617541 conn(0x7f2f640a8450 msgr2=0x7f2f640a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:35.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.457+0000 7f2f6b1d5640 1 -- 172.21.15.12:0/3799617541 shutdown_connections 2024-09-11T23:03:35.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.457+0000 7f2f6b1d5640 1 -- 172.21.15.12:0/3799617541 wait complete. 2024-09-11T23:03:35.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.457+0000 7f2f6b1d5640 1 Processor -- start 2024-09-11T23:03:35.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.457+0000 7f2f6b1d5640 1 -- start start 2024-09-11T23:03:35.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.457+0000 7f2f6b1d5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2f6409f6e0 0x7f2f6406fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:35.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.457+0000 7f2f6b1d5640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2f6413fd50 con 0x7f2f6409f6e0 2024-09-11T23:03:35.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.457+0000 7f2f68f71640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2f6409f6e0 0x7f2f6406fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:35.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.457+0000 7f2f68f71640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2f6409f6e0 0x7f2f6406fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35050/0 (socket says 172.21.15.12:35050) 2024-09-11T23:03:35.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.457+0000 7f2f68f71640 1 -- 172.21.15.12:0/2090674824 learned_addr learned my addr 172.21.15.12:0/2090674824 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:35.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.457+0000 7f2f68f71640 1 -- 172.21.15.12:0/2090674824 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f641350d0 con 0x7f2f6409f6e0 2024-09-11T23:03:35.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.457+0000 7f2f68f71640 1 --2- 172.21.15.12:0/2090674824 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2f6409f6e0 0x7f2f6406fc40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c00c3a0 tx=0x7f2f4c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:35.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.457+0000 7f2f617fa640 1 -- 172.21.15.12:0/2090674824 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f4c007410 con 0x7f2f6409f6e0 2024-09-11T23:03:35.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.457+0000 7f2f617fa640 1 -- 172.21.15.12:0/2090674824 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f4c0075b0 con 0x7f2f6409f6e0 2024-09-11T23:03:35.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.457+0000 7f2f6b1d5640 1 -- 172.21.15.12:0/2090674824 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f6411e2e0 con 0x7f2f6409f6e0 2024-09-11T23:03:35.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.457+0000 7f2f617fa640 1 -- 172.21.15.12:0/2090674824 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f4c004920 con 0x7f2f6409f6e0 2024-09-11T23:03:35.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.457+0000 7f2f6b1d5640 1 -- 172.21.15.12:0/2090674824 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f64073560 con 0x7f2f6409f6e0 2024-09-11T23:03:35.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.461+0000 7f2f6b1d5640 1 -- 172.21.15.12:0/2090674824 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f6411efb0 con 0x7f2f6409f6e0 2024-09-11T23:03:35.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.461+0000 7f2f617fa640 1 -- 172.21.15.12:0/2090674824 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2f4c01a020 con 0x7f2f6409f6e0 2024-09-11T23:03:35.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.461+0000 7f2f617fa640 1 --2- 172.21.15.12:0/2090674824 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f2f44035db0 0x7f2f44038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:35.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.461+0000 7f2f617fa640 1 -- 172.21.15.12:0/2090674824 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3439+0+0 (secure 0 0 0) 0x7f2f4c047e20 con 0x7f2f6409f6e0 2024-09-11T23:03:35.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.461+0000 7f2f63fff640 1 --2- 172.21.15.12:0/2090674824 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f2f44035db0 0x7f2f44038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:35.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.461+0000 7f2f63fff640 1 --2- 172.21.15.12:0/2090674824 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f2f44035db0 0x7f2f44038270 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2f540ae000 tx=0x7f2f540a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:35.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.465+0000 7f2f617fa640 1 -- 172.21.15.12:0/2090674824 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2f4c01bc30 con 0x7f2f6409f6e0 2024-09-11T23:03:35.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.625+0000 7f2f6b1d5640 1 -- 172.21.15.12:0/2090674824 --> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2f64071a00 con 0x7f2f44035db0 2024-09-11T23:03:35.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.645+0000 7f2f617fa640 1 -- 172.21.15.12:0/2090674824 <== mgr.4099 v2:172.21.15.12:6824/2765460338 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245902 (secure 0 0 0) 0x7f2f64071a00 con 0x7f2f44035db0 2024-09-11T23:03:35.649 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:03:35.653 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-11T23:03:35.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.649+0000 7f2f6b1d5640 1 -- 172.21.15.12:0/2090674824 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f2f44035db0 msgr2=0x7f2f44038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:35.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.649+0000 7f2f6b1d5640 1 --2- 172.21.15.12:0/2090674824 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f2f44035db0 0x7f2f44038270 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2f540ae000 tx=0x7f2f540a7000 comp rx=0 tx=0).stop 2024-09-11T23:03:35.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.649+0000 7f2f6b1d5640 1 -- 172.21.15.12:0/2090674824 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2f6409f6e0 msgr2=0x7f2f6406fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:35.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.649+0000 7f2f6b1d5640 1 --2- 172.21.15.12:0/2090674824 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2f6409f6e0 0x7f2f6406fc40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c00c3a0 tx=0x7f2f4c00c860 comp rx=0 tx=0).stop 2024-09-11T23:03:35.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.649+0000 7f2f6b1d5640 1 -- 172.21.15.12:0/2090674824 shutdown_connections 2024-09-11T23:03:35.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.649+0000 7f2f6b1d5640 1 --2- 172.21.15.12:0/2090674824 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f2f44035db0 0x7f2f44038270 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:35.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.649+0000 7f2f6b1d5640 1 --2- 172.21.15.12:0/2090674824 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2f6409f6e0 0x7f2f6406fc40 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:35.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.649+0000 7f2f6b1d5640 1 -- 172.21.15.12:0/2090674824 >> 172.21.15.12:0/2090674824 conn(0x7f2f640a8450 msgr2=0x7f2f640a7260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:35.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.649+0000 7f2f6b1d5640 1 -- 172.21.15.12:0/2090674824 shutdown_connections 2024-09-11T23:03:35.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.649+0000 7f2f6b1d5640 1 -- 172.21.15.12:0/2090674824 wait complete. 2024-09-11T23:03:35.668 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-11T23:03:35.516087+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":181,"num_write_kb":1908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":133,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":82704,"kb_used_data":1608,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283032816,"statfs":{"total":289910292480,"available":289825603584,"internally_reserved":0,"allocated":1646592,"data_stored":1301776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":82963791},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.904122"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.660839+0000","last_change":"2024-09-11T23:03:31.644980+0000","last_active":"2024-09-11T23:03:31.660839+0000","last_peered":"2024-09-11T23:03:31.660839+0000","last_clean":"2024-09-11T23:03:31.660839+0000","last_became_active":"2024-09-11T23:03:31.643322+0000","last_became_peered":"2024-09-11T23:03:31.643322+0000","last_unstale":"2024-09-11T23:03:31.660839+0000","last_undegraded":"2024-09-11T23:03:31.660839+0000","last_fullsized":"2024-09-11T23:03:31.660839+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:51.805947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.653811+0000","last_change":"2024-09-11T23:03:31.650677+0000","last_active":"2024-09-11T23:03:31.653811+0000","last_peered":"2024-09-11T23:03:31.653811+0000","last_clean":"2024-09-11T23:03:31.653811+0000","last_became_active":"2024-09-11T23:03:31.650405+0000","last_became_peered":"2024-09-11T23:03:31.650405+0000","last_unstale":"2024-09-11T23:03:31.653811+0000","last_undegraded":"2024-09-11T23:03:31.653811+0000","last_fullsized":"2024-09-11T23:03:31.653811+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:03.349545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.667298+0000","last_change":"2024-09-11T23:03:31.658194+0000","last_active":"2024-09-11T23:03:31.667298+0000","last_peered":"2024-09-11T23:03:31.667298+0000","last_clean":"2024-09-11T23:03:31.667298+0000","last_became_active":"2024-09-11T23:03:31.657911+0000","last_became_peered":"2024-09-11T23:03:31.657911+0000","last_unstale":"2024-09-11T23:03:31.667298+0000","last_undegraded":"2024-09-11T23:03:31.667298+0000","last_fullsized":"2024-09-11T23:03:31.667298+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:13.638867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.680452+0000","last_change":"2024-09-11T23:03:31.676906+0000","last_active":"2024-09-11T23:03:31.680452+0000","last_peered":"2024-09-11T23:03:31.680452+0000","last_clean":"2024-09-11T23:03:31.680452+0000","last_became_active":"2024-09-11T23:03:31.676592+0000","last_became_peered":"2024-09-11T23:03:31.676592+0000","last_unstale":"2024-09-11T23:03:31.680452+0000","last_undegraded":"2024-09-11T23:03:31.680452+0000","last_fullsized":"2024-09-11T23:03:31.680452+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:21.383496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.667949+0000","last_change":"2024-09-11T23:03:31.657824+0000","last_active":"2024-09-11T23:03:31.667949+0000","last_peered":"2024-09-11T23:03:31.667949+0000","last_clean":"2024-09-11T23:03:31.667949+0000","last_became_active":"2024-09-11T23:03:31.657535+0000","last_became_peered":"2024-09-11T23:03:31.657535+0000","last_unstale":"2024-09-11T23:03:31.667949+0000","last_undegraded":"2024-09-11T23:03:31.667949+0000","last_fullsized":"2024-09-11T23:03:31.667949+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:59.854206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.680288+0000","last_change":"2024-09-11T23:03:31.673561+0000","last_active":"2024-09-11T23:03:31.680288+0000","last_peered":"2024-09-11T23:03:31.680288+0000","last_clean":"2024-09-11T23:03:31.680288+0000","last_became_active":"2024-09-11T23:03:31.672515+0000","last_became_peered":"2024-09-11T23:03:31.672515+0000","last_unstale":"2024-09-11T23:03:31.680288+0000","last_undegraded":"2024-09-11T23:03:31.680288+0000","last_fullsized":"2024-09-11T23:03:31.680288+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:43.609686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.654737+0000","last_change":"2024-09-11T23:03:31.640733+0000","last_active":"2024-09-11T23:03:31.654737+0000","last_peered":"2024-09-11T23:03:31.654737+0000","last_clean":"2024-09-11T23:03:31.654737+0000","last_became_active":"2024-09-11T23:03:31.640419+0000","last_became_peered":"2024-09-11T23:03:31.640419+0000","last_unstale":"2024-09-11T23:03:31.654737+0000","last_undegraded":"2024-09-11T23:03:31.654737+0000","last_fullsized":"2024-09-11T23:03:31.654737+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:01.531894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.680933+0000","last_change":"2024-09-11T23:03:31.677179+0000","last_active":"2024-09-11T23:03:31.680933+0000","last_peered":"2024-09-11T23:03:31.680933+0000","last_clean":"2024-09-11T23:03:31.680933+0000","last_became_active":"2024-09-11T23:03:31.670449+0000","last_became_peered":"2024-09-11T23:03:31.670449+0000","last_unstale":"2024-09-11T23:03:31.680933+0000","last_undegraded":"2024-09-11T23:03:31.680933+0000","last_fullsized":"2024-09-11T23:03:31.680933+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:45.747386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.655441+0000","last_change":"2024-09-11T23:03:31.652750+0000","last_active":"2024-09-11T23:03:31.655441+0000","last_peered":"2024-09-11T23:03:31.655441+0000","last_clean":"2024-09-11T23:03:31.655441+0000","last_became_active":"2024-09-11T23:03:31.651659+0000","last_became_peered":"2024-09-11T23:03:31.651659+0000","last_unstale":"2024-09-11T23:03:31.655441+0000","last_undegraded":"2024-09-11T23:03:31.655441+0000","last_fullsized":"2024-09-11T23:03:31.655441+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:17.323384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.667128+0000","last_change":"2024-09-11T23:03:31.658062+0000","last_active":"2024-09-11T23:03:31.667128+0000","last_peered":"2024-09-11T23:03:31.667128+0000","last_clean":"2024-09-11T23:03:31.667128+0000","last_became_active":"2024-09-11T23:03:31.657713+0000","last_became_peered":"2024-09-11T23:03:31.657713+0000","last_unstale":"2024-09-11T23:03:31.667128+0000","last_undegraded":"2024-09-11T23:03:31.667128+0000","last_fullsized":"2024-09-11T23:03:31.667128+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:41.847795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.661635+0000","last_change":"2024-09-11T23:03:31.644330+0000","last_active":"2024-09-11T23:03:31.661635+0000","last_peered":"2024-09-11T23:03:31.661635+0000","last_clean":"2024-09-11T23:03:31.661635+0000","last_became_active":"2024-09-11T23:03:31.644082+0000","last_became_peered":"2024-09-11T23:03:31.644082+0000","last_unstale":"2024-09-11T23:03:31.661635+0000","last_undegraded":"2024-09-11T23:03:31.661635+0000","last_fullsized":"2024-09-11T23:03:31.661635+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:01.814867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.654778+0000","last_change":"2024-09-11T23:03:31.642201+0000","last_active":"2024-09-11T23:03:31.654778+0000","last_peered":"2024-09-11T23:03:31.654778+0000","last_clean":"2024-09-11T23:03:31.654778+0000","last_became_active":"2024-09-11T23:03:31.641846+0000","last_became_peered":"2024-09-11T23:03:31.641846+0000","last_unstale":"2024-09-11T23:03:31.654778+0000","last_undegraded":"2024-09-11T23:03:31.654778+0000","last_fullsized":"2024-09-11T23:03:31.654778+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:07.511329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.667970+0000","last_change":"2024-09-11T23:03:31.656241+0000","last_active":"2024-09-11T23:03:31.667970+0000","last_peered":"2024-09-11T23:03:31.667970+0000","last_clean":"2024-09-11T23:03:31.667970+0000","last_became_active":"2024-09-11T23:03:31.655038+0000","last_became_peered":"2024-09-11T23:03:31.655038+0000","last_unstale":"2024-09-11T23:03:31.667970+0000","last_undegraded":"2024-09-11T23:03:31.667970+0000","last_fullsized":"2024-09-11T23:03:31.667970+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:08.195338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.655011+0000","last_change":"2024-09-11T23:03:31.642497+0000","last_active":"2024-09-11T23:03:31.655011+0000","last_peered":"2024-09-11T23:03:31.655011+0000","last_clean":"2024-09-11T23:03:31.655011+0000","last_became_active":"2024-09-11T23:03:31.642002+0000","last_became_peered":"2024-09-11T23:03:31.642002+0000","last_unstale":"2024-09-11T23:03:31.655011+0000","last_undegraded":"2024-09-11T23:03:31.655011+0000","last_fullsized":"2024-09-11T23:03:31.655011+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:45.747386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.653100+0000","last_change":"2024-09-11T23:03:31.645457+0000","last_active":"2024-09-11T23:03:31.653100+0000","last_peered":"2024-09-11T23:03:31.653100+0000","last_clean":"2024-09-11T23:03:31.653100+0000","last_became_active":"2024-09-11T23:03:31.643894+0000","last_became_peered":"2024-09-11T23:03:31.643894+0000","last_unstale":"2024-09-11T23:03:31.653100+0000","last_undegraded":"2024-09-11T23:03:31.653100+0000","last_fullsized":"2024-09-11T23:03:31.653100+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:01.531894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.681004+0000","last_change":"2024-09-11T23:03:31.678032+0000","last_active":"2024-09-11T23:03:31.681004+0000","last_peered":"2024-09-11T23:03:31.681004+0000","last_clean":"2024-09-11T23:03:31.681004+0000","last_became_active":"2024-09-11T23:03:31.672976+0000","last_became_peered":"2024-09-11T23:03:31.672976+0000","last_unstale":"2024-09-11T23:03:31.681004+0000","last_undegraded":"2024-09-11T23:03:31.681004+0000","last_fullsized":"2024-09-11T23:03:31.681004+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:43.598787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.655415+0000","last_change":"2024-09-11T23:03:31.652625+0000","last_active":"2024-09-11T23:03:31.655415+0000","last_peered":"2024-09-11T23:03:31.655415+0000","last_clean":"2024-09-11T23:03:31.655415+0000","last_became_active":"2024-09-11T23:03:31.651397+0000","last_became_peered":"2024-09-11T23:03:31.651397+0000","last_unstale":"2024-09-11T23:03:31.655415+0000","last_undegraded":"2024-09-11T23:03:31.655415+0000","last_fullsized":"2024-09-11T23:03:31.655415+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:45.747386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.680332+0000","last_change":"2024-09-11T23:03:31.673847+0000","last_active":"2024-09-11T23:03:31.680332+0000","last_peered":"2024-09-11T23:03:31.680332+0000","last_clean":"2024-09-11T23:03:31.680332+0000","last_became_active":"2024-09-11T23:03:31.673484+0000","last_became_peered":"2024-09-11T23:03:31.673484+0000","last_unstale":"2024-09-11T23:03:31.680332+0000","last_undegraded":"2024-09-11T23:03:31.680332+0000","last_fullsized":"2024-09-11T23:03:31.680332+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:07.511329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.667277+0000","last_change":"2024-09-11T23:03:31.658165+0000","last_active":"2024-09-11T23:03:31.667277+0000","last_peered":"2024-09-11T23:03:31.667277+0000","last_clean":"2024-09-11T23:03:31.667277+0000","last_became_active":"2024-09-11T23:03:31.657520+0000","last_became_peered":"2024-09-11T23:03:31.657520+0000","last_unstale":"2024-09-11T23:03:31.667277+0000","last_undegraded":"2024-09-11T23:03:31.667277+0000","last_fullsized":"2024-09-11T23:03:31.667277+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:50:10.314960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.654703+0000","last_change":"2024-09-11T23:03:31.641111+0000","last_active":"2024-09-11T23:03:31.654703+0000","last_peered":"2024-09-11T23:03:31.654703+0000","last_clean":"2024-09-11T23:03:31.654703+0000","last_became_active":"2024-09-11T23:03:31.640663+0000","last_became_peered":"2024-09-11T23:03:31.640663+0000","last_unstale":"2024-09-11T23:03:31.654703+0000","last_undegraded":"2024-09-11T23:03:31.654703+0000","last_fullsized":"2024-09-11T23:03:31.654703+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:43.609686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.666212+0000","last_change":"2024-09-11T23:03:31.657160+0000","last_active":"2024-09-11T23:03:31.666212+0000","last_peered":"2024-09-11T23:03:31.666212+0000","last_clean":"2024-09-11T23:03:31.666212+0000","last_became_active":"2024-09-11T23:03:31.655894+0000","last_became_peered":"2024-09-11T23:03:31.655894+0000","last_unstale":"2024-09-11T23:03:31.666212+0000","last_undegraded":"2024-09-11T23:03:31.666212+0000","last_fullsized":"2024-09-11T23:03:31.666212+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:17.931079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.653880+0000","last_change":"2024-09-11T23:03:31.651347+0000","last_active":"2024-09-11T23:03:31.653880+0000","last_peered":"2024-09-11T23:03:31.653880+0000","last_clean":"2024-09-11T23:03:31.653880+0000","last_became_active":"2024-09-11T23:03:31.650762+0000","last_became_peered":"2024-09-11T23:03:31.650762+0000","last_unstale":"2024-09-11T23:03:31.653880+0000","last_undegraded":"2024-09-11T23:03:31.653880+0000","last_fullsized":"2024-09-11T23:03:31.653880+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:21.383496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.663652+0000","last_change":"2024-09-11T23:03:31.649698+0000","last_active":"2024-09-11T23:03:31.663652+0000","last_peered":"2024-09-11T23:03:31.663652+0000","last_clean":"2024-09-11T23:03:31.663652+0000","last_became_active":"2024-09-11T23:03:31.649443+0000","last_became_peered":"2024-09-11T23:03:31.649443+0000","last_unstale":"2024-09-11T23:03:31.663652+0000","last_undegraded":"2024-09-11T23:03:31.663652+0000","last_fullsized":"2024-09-11T23:03:31.663652+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:39.031797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.676397+0000","last_change":"2024-09-11T23:03:31.674478+0000","last_active":"2024-09-11T23:03:31.676397+0000","last_peered":"2024-09-11T23:03:31.676397+0000","last_clean":"2024-09-11T23:03:31.676397+0000","last_became_active":"2024-09-11T23:03:31.674069+0000","last_became_peered":"2024-09-11T23:03:31.674069+0000","last_unstale":"2024-09-11T23:03:31.676397+0000","last_undegraded":"2024-09-11T23:03:31.676397+0000","last_fullsized":"2024-09-11T23:03:31.676397+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:10.683627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.680181+0000","last_change":"2024-09-11T23:03:31.673244+0000","last_active":"2024-09-11T23:03:31.680181+0000","last_peered":"2024-09-11T23:03:31.680181+0000","last_clean":"2024-09-11T23:03:31.680181+0000","last_became_active":"2024-09-11T23:03:31.672958+0000","last_became_peered":"2024-09-11T23:03:31.672958+0000","last_unstale":"2024-09-11T23:03:31.680181+0000","last_undegraded":"2024-09-11T23:03:31.680181+0000","last_fullsized":"2024-09-11T23:03:31.680181+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:21.272618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.680525+0000","last_change":"2024-09-11T23:03:31.677762+0000","last_active":"2024-09-11T23:03:31.680525+0000","last_peered":"2024-09-11T23:03:31.680525+0000","last_clean":"2024-09-11T23:03:31.680525+0000","last_became_active":"2024-09-11T23:03:31.677183+0000","last_became_peered":"2024-09-11T23:03:31.677183+0000","last_unstale":"2024-09-11T23:03:31.680525+0000","last_undegraded":"2024-09-11T23:03:31.680525+0000","last_fullsized":"2024-09-11T23:03:31.680525+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:17.323384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.659791+0000","last_change":"2024-09-11T23:03:31.659006+0000","last_active":"2024-09-11T23:03:31.659791+0000","last_peered":"2024-09-11T23:03:31.659791+0000","last_clean":"2024-09-11T23:03:31.659791+0000","last_became_active":"2024-09-11T23:03:31.658753+0000","last_became_peered":"2024-09-11T23:03:31.658753+0000","last_unstale":"2024-09-11T23:03:31.659791+0000","last_undegraded":"2024-09-11T23:03:31.659791+0000","last_fullsized":"2024-09-11T23:03:31.659791+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:08.160568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.667341+0000","last_change":"2024-09-11T23:03:31.663269+0000","last_active":"2024-09-11T23:03:31.667341+0000","last_peered":"2024-09-11T23:03:31.667341+0000","last_clean":"2024-09-11T23:03:31.667341+0000","last_became_active":"2024-09-11T23:03:31.661949+0000","last_became_peered":"2024-09-11T23:03:31.661949+0000","last_unstale":"2024-09-11T23:03:31.667341+0000","last_undegraded":"2024-09-11T23:03:31.667341+0000","last_fullsized":"2024-09-11T23:03:31.667341+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:49.970021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.669249+0000","last_change":"2024-09-11T23:03:31.663932+0000","last_active":"2024-09-11T23:03:31.669249+0000","last_peered":"2024-09-11T23:03:31.669249+0000","last_clean":"2024-09-11T23:03:31.669249+0000","last_became_active":"2024-09-11T23:03:31.663346+0000","last_became_peered":"2024-09-11T23:03:31.663346+0000","last_unstale":"2024-09-11T23:03:31.669249+0000","last_undegraded":"2024-09-11T23:03:31.669249+0000","last_fullsized":"2024-09-11T23:03:31.669249+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:52.318572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.669402+0000","last_change":"2024-09-11T23:03:31.663998+0000","last_active":"2024-09-11T23:03:31.669402+0000","last_peered":"2024-09-11T23:03:31.669402+0000","last_clean":"2024-09-11T23:03:31.669402+0000","last_became_active":"2024-09-11T23:03:31.663608+0000","last_became_peered":"2024-09-11T23:03:31.663608+0000","last_unstale":"2024-09-11T23:03:31.669402+0000","last_undegraded":"2024-09-11T23:03:31.669402+0000","last_fullsized":"2024-09-11T23:03:31.669402+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:23.103838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.677057+0000","last_change":"2024-09-11T23:03:31.668324+0000","last_active":"2024-09-11T23:03:31.677057+0000","last_peered":"2024-09-11T23:03:31.677057+0000","last_clean":"2024-09-11T23:03:31.677057+0000","last_became_active":"2024-09-11T23:03:31.667670+0000","last_became_peered":"2024-09-11T23:03:31.667670+0000","last_unstale":"2024-09-11T23:03:31.677057+0000","last_undegraded":"2024-09-11T23:03:31.677057+0000","last_fullsized":"2024-09-11T23:03:31.677057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:12.618645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.681026+0000","last_change":"2024-09-11T23:03:31.678992+0000","last_active":"2024-09-11T23:03:31.681026+0000","last_peered":"2024-09-11T23:03:31.681026+0000","last_clean":"2024-09-11T23:03:31.681026+0000","last_became_active":"2024-09-11T23:03:31.676531+0000","last_became_peered":"2024-09-11T23:03:31.676531+0000","last_unstale":"2024-09-11T23:03:31.681026+0000","last_undegraded":"2024-09-11T23:03:31.681026+0000","last_fullsized":"2024-09-11T23:03:31.681026+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:48.004677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.659296+0000","last_change":"2024-09-11T23:03:31.657027+0000","last_active":"2024-09-11T23:03:31.659296+0000","last_peered":"2024-09-11T23:03:31.659296+0000","last_clean":"2024-09-11T23:03:31.659296+0000","last_became_active":"2024-09-11T23:03:31.656728+0000","last_became_peered":"2024-09-11T23:03:31.656728+0000","last_unstale":"2024-09-11T23:03:31.659296+0000","last_undegraded":"2024-09-11T23:03:31.659296+0000","last_fullsized":"2024-09-11T23:03:31.659296+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:01.814867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"15'1","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.669517+0000","last_change":"2024-09-11T23:03:30.660455+0000","last_active":"2024-09-11T23:03:31.669517+0000","last_peered":"2024-09-11T23:03:31.669517+0000","last_clean":"2024-09-11T23:03:31.669517+0000","last_became_active":"2024-09-11T23:03:30.660052+0000","last_became_peered":"2024-09-11T23:03:30.660052+0000","last_unstale":"2024-09-11T23:03:31.669517+0000","last_undegraded":"2024-09-11T23:03:31.669517+0000","last_fullsized":"2024-09-11T23:03:31.669517+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:11.604671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.661018+0000","last_change":"2024-09-11T23:03:31.644592+0000","last_active":"2024-09-11T23:03:31.661018+0000","last_peered":"2024-09-11T23:03:31.661018+0000","last_clean":"2024-09-11T23:03:31.661018+0000","last_became_active":"2024-09-11T23:03:31.644297+0000","last_became_peered":"2024-09-11T23:03:31.644297+0000","last_unstale":"2024-09-11T23:03:31.661018+0000","last_undegraded":"2024-09-11T23:03:31.661018+0000","last_fullsized":"2024-09-11T23:03:31.661018+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:08.160568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"15'1","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.670939+0000","last_change":"2024-09-11T23:03:30.653792+0000","last_active":"2024-09-11T23:03:31.670939+0000","last_peered":"2024-09-11T23:03:31.670939+0000","last_clean":"2024-09-11T23:03:31.670939+0000","last_became_active":"2024-09-11T23:03:30.653493+0000","last_became_peered":"2024-09-11T23:03:30.653493+0000","last_unstale":"2024-09-11T23:03:31.670939+0000","last_undegraded":"2024-09-11T23:03:31.670939+0000","last_fullsized":"2024-09-11T23:03:31.670939+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:37.723285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.626342+0000","last_change":"2024-09-11T23:03:30.653094+0000","last_active":"2024-09-11T23:03:31.626342+0000","last_peered":"2024-09-11T23:03:31.626342+0000","last_clean":"2024-09-11T23:03:31.626342+0000","last_became_active":"2024-09-11T23:03:30.652770+0000","last_became_peered":"2024-09-11T23:03:30.652770+0000","last_unstale":"2024-09-11T23:03:31.626342+0000","last_undegraded":"2024-09-11T23:03:31.626342+0000","last_fullsized":"2024-09-11T23:03:31.626342+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:43.385721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.681055+0000","last_change":"2024-09-11T23:03:31.679465+0000","last_active":"2024-09-11T23:03:31.681055+0000","last_peered":"2024-09-11T23:03:31.681055+0000","last_clean":"2024-09-11T23:03:31.681055+0000","last_became_active":"2024-09-11T23:03:31.677617+0000","last_became_peered":"2024-09-11T23:03:31.677617+0000","last_unstale":"2024-09-11T23:03:31.681055+0000","last_undegraded":"2024-09-11T23:03:31.681055+0000","last_fullsized":"2024-09-11T23:03:31.681055+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:51.805947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.625851+0000","last_change":"2024-09-11T23:03:30.663136+0000","last_active":"2024-09-11T23:03:31.625851+0000","last_peered":"2024-09-11T23:03:31.625851+0000","last_clean":"2024-09-11T23:03:31.625851+0000","last_became_active":"2024-09-11T23:03:30.662724+0000","last_became_peered":"2024-09-11T23:03:30.662724+0000","last_unstale":"2024-09-11T23:03:31.625851+0000","last_undegraded":"2024-09-11T23:03:31.625851+0000","last_fullsized":"2024-09-11T23:03:31.625851+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:03.253537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.659817+0000","last_change":"2024-09-11T23:03:31.657767+0000","last_active":"2024-09-11T23:03:31.659817+0000","last_peered":"2024-09-11T23:03:31.659817+0000","last_clean":"2024-09-11T23:03:31.659817+0000","last_became_active":"2024-09-11T23:03:31.656481+0000","last_became_peered":"2024-09-11T23:03:31.656481+0000","last_unstale":"2024-09-11T23:03:31.659817+0000","last_undegraded":"2024-09-11T23:03:31.659817+0000","last_fullsized":"2024-09-11T23:03:31.659817+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:41.215134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.634356+0000","last_change":"2024-09-11T23:03:30.658131+0000","last_active":"2024-09-11T23:03:31.634356+0000","last_peered":"2024-09-11T23:03:31.634356+0000","last_clean":"2024-09-11T23:03:31.634356+0000","last_became_active":"2024-09-11T23:03:30.655737+0000","last_became_peered":"2024-09-11T23:03:30.655737+0000","last_unstale":"2024-09-11T23:03:31.634356+0000","last_undegraded":"2024-09-11T23:03:31.634356+0000","last_fullsized":"2024-09-11T23:03:31.634356+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:43.385721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.680590+0000","last_change":"2024-09-11T23:03:31.678439+0000","last_active":"2024-09-11T23:03:31.680590+0000","last_peered":"2024-09-11T23:03:31.680590+0000","last_clean":"2024-09-11T23:03:31.680590+0000","last_became_active":"2024-09-11T23:03:31.677947+0000","last_became_peered":"2024-09-11T23:03:31.677947+0000","last_unstale":"2024-09-11T23:03:31.680590+0000","last_undegraded":"2024-09-11T23:03:31.680590+0000","last_fullsized":"2024-09-11T23:03:31.680590+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:41.215134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.630887+0000","last_change":"2024-09-11T23:03:30.664333+0000","last_active":"2024-09-11T23:03:31.630887+0000","last_peered":"2024-09-11T23:03:31.630887+0000","last_clean":"2024-09-11T23:03:31.630887+0000","last_became_active":"2024-09-11T23:03:30.664058+0000","last_became_peered":"2024-09-11T23:03:30.664058+0000","last_unstale":"2024-09-11T23:03:31.630887+0000","last_undegraded":"2024-09-11T23:03:31.630887+0000","last_fullsized":"2024-09-11T23:03:31.630887+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:39.066030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.660799+0000","last_change":"2024-09-11T23:03:31.644698+0000","last_active":"2024-09-11T23:03:31.660799+0000","last_peered":"2024-09-11T23:03:31.660799+0000","last_clean":"2024-09-11T23:03:31.660799+0000","last_became_active":"2024-09-11T23:03:31.642741+0000","last_became_peered":"2024-09-11T23:03:31.642741+0000","last_unstale":"2024-09-11T23:03:31.660799+0000","last_undegraded":"2024-09-11T23:03:31.660799+0000","last_fullsized":"2024-09-11T23:03:31.660799+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:48.004677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"15'3","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.670160+0000","last_change":"2024-09-11T23:03:30.661999+0000","last_active":"2024-09-11T23:03:31.670160+0000","last_peered":"2024-09-11T23:03:31.670160+0000","last_clean":"2024-09-11T23:03:31.670160+0000","last_became_active":"2024-09-11T23:03:30.661483+0000","last_became_peered":"2024-09-11T23:03:30.661483+0000","last_unstale":"2024-09-11T23:03:31.670160+0000","last_undegraded":"2024-09-11T23:03:31.670160+0000","last_fullsized":"2024-09-11T23:03:31.670160+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:11.610671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.665313+0000","last_change":"2024-09-11T23:03:31.663054+0000","last_active":"2024-09-11T23:03:31.665313+0000","last_peered":"2024-09-11T23:03:31.665313+0000","last_clean":"2024-09-11T23:03:31.665313+0000","last_became_active":"2024-09-11T23:03:31.662588+0000","last_became_peered":"2024-09-11T23:03:31.662588+0000","last_unstale":"2024-09-11T23:03:31.665313+0000","last_undegraded":"2024-09-11T23:03:31.665313+0000","last_fullsized":"2024-09-11T23:03:31.665313+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:51.805947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"15'6","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.683669+0000","last_change":"2024-09-11T23:03:30.664300+0000","last_active":"2024-09-11T23:03:31.683669+0000","last_peered":"2024-09-11T23:03:31.683669+0000","last_clean":"2024-09-11T23:03:31.683669+0000","last_became_active":"2024-09-11T23:03:30.663600+0000","last_became_peered":"2024-09-11T23:03:30.663600+0000","last_unstale":"2024-09-11T23:03:31.683669+0000","last_undegraded":"2024-09-11T23:03:31.683669+0000","last_fullsized":"2024-09-11T23:03:31.683669+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:16:21.984941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.661656+0000","last_change":"2024-09-11T23:03:31.643144+0000","last_active":"2024-09-11T23:03:31.661656+0000","last_peered":"2024-09-11T23:03:31.661656+0000","last_clean":"2024-09-11T23:03:31.661656+0000","last_became_active":"2024-09-11T23:03:31.642819+0000","last_became_peered":"2024-09-11T23:03:31.642819+0000","last_unstale":"2024-09-11T23:03:31.661656+0000","last_undegraded":"2024-09-11T23:03:31.661656+0000","last_fullsized":"2024-09-11T23:03:31.661656+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:30.571044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"15'2","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.674452+0000","last_change":"2024-09-11T23:03:30.652612+0000","last_active":"2024-09-11T23:03:31.674452+0000","last_peered":"2024-09-11T23:03:31.674452+0000","last_clean":"2024-09-11T23:03:31.674452+0000","last_became_active":"2024-09-11T23:03:30.652343+0000","last_became_peered":"2024-09-11T23:03:30.652343+0000","last_unstale":"2024-09-11T23:03:31.674452+0000","last_undegraded":"2024-09-11T23:03:31.674452+0000","last_fullsized":"2024-09-11T23:03:31.674452+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:11.610671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.654992+0000","last_change":"2024-09-11T23:03:31.642382+0000","last_active":"2024-09-11T23:03:31.654992+0000","last_peered":"2024-09-11T23:03:31.654992+0000","last_clean":"2024-09-11T23:03:31.654992+0000","last_became_active":"2024-09-11T23:03:31.641739+0000","last_became_peered":"2024-09-11T23:03:31.641739+0000","last_unstale":"2024-09-11T23:03:31.654992+0000","last_undegraded":"2024-09-11T23:03:31.654992+0000","last_fullsized":"2024-09-11T23:03:31.654992+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:21.383496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.661407+0000","last_change":"2024-09-11T23:03:30.662995+0000","last_active":"2024-09-11T23:03:31.661407+0000","last_peered":"2024-09-11T23:03:31.661407+0000","last_clean":"2024-09-11T23:03:31.661407+0000","last_became_active":"2024-09-11T23:03:30.662463+0000","last_became_peered":"2024-09-11T23:03:30.662463+0000","last_unstale":"2024-09-11T23:03:31.661407+0000","last_undegraded":"2024-09-11T23:03:31.661407+0000","last_fullsized":"2024-09-11T23:03:31.661407+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:11.604671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.653850+0000","last_change":"2024-09-11T23:03:31.650998+0000","last_active":"2024-09-11T23:03:31.653850+0000","last_peered":"2024-09-11T23:03:31.653850+0000","last_clean":"2024-09-11T23:03:31.653850+0000","last_became_active":"2024-09-11T23:03:31.650439+0000","last_became_peered":"2024-09-11T23:03:31.650439+0000","last_unstale":"2024-09-11T23:03:31.653850+0000","last_undegraded":"2024-09-11T23:03:31.653850+0000","last_fullsized":"2024-09-11T23:03:31.653850+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:07.511329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.626619+0000","last_change":"2024-09-11T23:03:30.662321+0000","last_active":"2024-09-11T23:03:31.626619+0000","last_peered":"2024-09-11T23:03:31.626619+0000","last_clean":"2024-09-11T23:03:31.626619+0000","last_became_active":"2024-09-11T23:03:30.661916+0000","last_became_peered":"2024-09-11T23:03:30.661916+0000","last_unstale":"2024-09-11T23:03:31.626619+0000","last_undegraded":"2024-09-11T23:03:31.626619+0000","last_fullsized":"2024-09-11T23:03:31.626619+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:37.723285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.645191+0000","last_change":"2024-09-11T23:03:31.643564+0000","last_active":"2024-09-11T23:03:31.645191+0000","last_peered":"2024-09-11T23:03:31.645191+0000","last_clean":"2024-09-11T23:03:31.645191+0000","last_became_active":"2024-09-11T23:03:31.643289+0000","last_became_peered":"2024-09-11T23:03:31.643289+0000","last_unstale":"2024-09-11T23:03:31.645191+0000","last_undegraded":"2024-09-11T23:03:31.645191+0000","last_fullsized":"2024-09-11T23:03:31.645191+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:21.272618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"15'8","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.682845+0000","last_change":"2024-09-11T23:03:30.659134+0000","last_active":"2024-09-11T23:03:31.682845+0000","last_peered":"2024-09-11T23:03:31.682845+0000","last_clean":"2024-09-11T23:03:31.682845+0000","last_became_active":"2024-09-11T23:03:30.658788+0000","last_became_peered":"2024-09-11T23:03:30.658788+0000","last_unstale":"2024-09-11T23:03:31.682845+0000","last_undegraded":"2024-09-11T23:03:31.682845+0000","last_fullsized":"2024-09-11T23:03:31.682845+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:05.436819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.677085+0000","last_change":"2024-09-11T23:03:31.668569+0000","last_active":"2024-09-11T23:03:31.677085+0000","last_peered":"2024-09-11T23:03:31.677085+0000","last_clean":"2024-09-11T23:03:31.677085+0000","last_became_active":"2024-09-11T23:03:31.668015+0000","last_became_peered":"2024-09-11T23:03:31.668015+0000","last_unstale":"2024-09-11T23:03:31.677085+0000","last_undegraded":"2024-09-11T23:03:31.677085+0000","last_fullsized":"2024-09-11T23:03:31.677085+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:57.289306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"15'1","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.666530+0000","last_change":"2024-09-11T23:03:30.668018+0000","last_active":"2024-09-11T23:03:31.666530+0000","last_peered":"2024-09-11T23:03:31.666530+0000","last_clean":"2024-09-11T23:03:31.666530+0000","last_became_active":"2024-09-11T23:03:30.667416+0000","last_became_peered":"2024-09-11T23:03:30.667416+0000","last_unstale":"2024-09-11T23:03:31.666530+0000","last_undegraded":"2024-09-11T23:03:31.666530+0000","last_fullsized":"2024-09-11T23:03:31.666530+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:20.264643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.680609+0000","last_change":"2024-09-11T23:03:31.678504+0000","last_active":"2024-09-11T23:03:31.680609+0000","last_peered":"2024-09-11T23:03:31.680609+0000","last_clean":"2024-09-11T23:03:31.680609+0000","last_became_active":"2024-09-11T23:03:31.678027+0000","last_became_peered":"2024-09-11T23:03:31.678027+0000","last_unstale":"2024-09-11T23:03:31.680609+0000","last_undegraded":"2024-09-11T23:03:31.680609+0000","last_fullsized":"2024-09-11T23:03:31.680609+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:08.160568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"15'2","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.679883+0000","last_change":"2024-09-11T23:03:30.655788+0000","last_active":"2024-09-11T23:03:31.679883+0000","last_peered":"2024-09-11T23:03:31.679883+0000","last_clean":"2024-09-11T23:03:31.679883+0000","last_became_active":"2024-09-11T23:03:30.655370+0000","last_became_peered":"2024-09-11T23:03:30.655370+0000","last_unstale":"2024-09-11T23:03:31.679883+0000","last_undegraded":"2024-09-11T23:03:31.679883+0000","last_fullsized":"2024-09-11T23:03:31.679883+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:23.634393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.660776+0000","last_change":"2024-09-11T23:03:31.644215+0000","last_active":"2024-09-11T23:03:31.660776+0000","last_peered":"2024-09-11T23:03:31.660776+0000","last_clean":"2024-09-11T23:03:31.660776+0000","last_became_active":"2024-09-11T23:03:31.642396+0000","last_became_peered":"2024-09-11T23:03:31.642396+0000","last_unstale":"2024-09-11T23:03:31.660776+0000","last_undegraded":"2024-09-11T23:03:31.660776+0000","last_fullsized":"2024-09-11T23:03:31.660776+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:41.215134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"15'1","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.671985+0000","last_change":"2024-09-11T23:03:30.654962+0000","last_active":"2024-09-11T23:03:31.671985+0000","last_peered":"2024-09-11T23:03:31.671985+0000","last_clean":"2024-09-11T23:03:31.671985+0000","last_became_active":"2024-09-11T23:03:30.650356+0000","last_became_peered":"2024-09-11T23:03:30.650356+0000","last_unstale":"2024-09-11T23:03:31.671985+0000","last_undegraded":"2024-09-11T23:03:31.671985+0000","last_fullsized":"2024-09-11T23:03:31.671985+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:56.281332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.661833+0000","last_change":"2024-09-11T23:03:31.643251+0000","last_active":"2024-09-11T23:03:31.661833+0000","last_peered":"2024-09-11T23:03:31.661833+0000","last_clean":"2024-09-11T23:03:31.661833+0000","last_became_active":"2024-09-11T23:03:31.642954+0000","last_became_peered":"2024-09-11T23:03:31.642954+0000","last_unstale":"2024-09-11T23:03:31.661833+0000","last_undegraded":"2024-09-11T23:03:31.661833+0000","last_fullsized":"2024-09-11T23:03:31.661833+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:42.095319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.660995+0000","last_change":"2024-09-11T23:03:30.653720+0000","last_active":"2024-09-11T23:03:31.660995+0000","last_peered":"2024-09-11T23:03:31.660995+0000","last_clean":"2024-09-11T23:03:31.660995+0000","last_became_active":"2024-09-11T23:03:30.653076+0000","last_became_peered":"2024-09-11T23:03:30.653076+0000","last_unstale":"2024-09-11T23:03:31.660995+0000","last_undegraded":"2024-09-11T23:03:31.660995+0000","last_fullsized":"2024-09-11T23:03:31.660995+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:43.385721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.669996+0000","last_change":"2024-09-11T23:03:31.667091+0000","last_active":"2024-09-11T23:03:31.669996+0000","last_peered":"2024-09-11T23:03:31.669996+0000","last_clean":"2024-09-11T23:03:31.669996+0000","last_became_active":"2024-09-11T23:03:31.666762+0000","last_became_peered":"2024-09-11T23:03:31.666762+0000","last_unstale":"2024-09-11T23:03:31.669996+0000","last_undegraded":"2024-09-11T23:03:31.669996+0000","last_fullsized":"2024-09-11T23:03:31.669996+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:30.571044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":145,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.633018+0000","last_change":"2024-09-11T23:03:26.382905+0000","last_active":"2024-09-11T23:03:31.633018+0000","last_peered":"2024-09-11T23:03:31.633018+0000","last_clean":"2024-09-11T23:03:31.633018+0000","last_became_active":"2024-09-11T23:03:26.380590+0000","last_became_peered":"2024-09-11T23:03:26.380590+0000","last_unstale":"2024-09-11T23:03:31.633018+0000","last_undegraded":"2024-09-11T23:03:31.633018+0000","last_fullsized":"2024-09-11T23:03:31.633018+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:24.361793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:24.361793+0000","last_clean_scrub_stamp":"2024-09-11T23:03:24.361793+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:46.577063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.635461+0000","last_change":"2024-09-11T23:03:30.650947+0000","last_active":"2024-09-11T23:03:31.635461+0000","last_peered":"2024-09-11T23:03:31.635461+0000","last_clean":"2024-09-11T23:03:31.635461+0000","last_became_active":"2024-09-11T23:03:30.640787+0000","last_became_peered":"2024-09-11T23:03:30.640787+0000","last_unstale":"2024-09-11T23:03:31.635461+0000","last_undegraded":"2024-09-11T23:03:31.635461+0000","last_fullsized":"2024-09-11T23:03:31.635461+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:39.066030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.665719+0000","last_change":"2024-09-11T23:03:31.662781+0000","last_active":"2024-09-11T23:03:31.665719+0000","last_peered":"2024-09-11T23:03:31.665719+0000","last_clean":"2024-09-11T23:03:31.665719+0000","last_became_active":"2024-09-11T23:03:31.662481+0000","last_became_peered":"2024-09-11T23:03:31.662481+0000","last_unstale":"2024-09-11T23:03:31.665719+0000","last_undegraded":"2024-09-11T23:03:31.665719+0000","last_fullsized":"2024-09-11T23:03:31.665719+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:48.004677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.653592+0000","last_change":"2024-09-11T23:03:30.665053+0000","last_active":"2024-09-11T23:03:31.653592+0000","last_peered":"2024-09-11T23:03:31.653592+0000","last_clean":"2024-09-11T23:03:31.653592+0000","last_became_active":"2024-09-11T23:03:30.664393+0000","last_became_peered":"2024-09-11T23:03:30.664393+0000","last_unstale":"2024-09-11T23:03:31.653592+0000","last_undegraded":"2024-09-11T23:03:31.653592+0000","last_fullsized":"2024-09-11T23:03:31.653592+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:34:50.423468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.674947+0000","last_change":"2024-09-11T23:03:31.673415+0000","last_active":"2024-09-11T23:03:31.674947+0000","last_peered":"2024-09-11T23:03:31.674947+0000","last_clean":"2024-09-11T23:03:31.674947+0000","last_became_active":"2024-09-11T23:03:31.673160+0000","last_became_peered":"2024-09-11T23:03:31.673160+0000","last_unstale":"2024-09-11T23:03:31.674947+0000","last_undegraded":"2024-09-11T23:03:31.674947+0000","last_fullsized":"2024-09-11T23:03:31.674947+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:05.113429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.655846+0000","last_change":"2024-09-11T23:03:30.663975+0000","last_active":"2024-09-11T23:03:31.655846+0000","last_peered":"2024-09-11T23:03:31.655846+0000","last_clean":"2024-09-11T23:03:31.655846+0000","last_became_active":"2024-09-11T23:03:30.663612+0000","last_became_peered":"2024-09-11T23:03:30.663612+0000","last_unstale":"2024-09-11T23:03:31.655846+0000","last_undegraded":"2024-09-11T23:03:31.655846+0000","last_fullsized":"2024-09-11T23:03:31.655846+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:03.253537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.675467+0000","last_change":"2024-09-11T23:03:31.672101+0000","last_active":"2024-09-11T23:03:31.675467+0000","last_peered":"2024-09-11T23:03:31.675467+0000","last_clean":"2024-09-11T23:03:31.675467+0000","last_became_active":"2024-09-11T23:03:31.671541+0000","last_became_peered":"2024-09-11T23:03:31.671541+0000","last_unstale":"2024-09-11T23:03:31.675467+0000","last_undegraded":"2024-09-11T23:03:31.675467+0000","last_fullsized":"2024-09-11T23:03:31.675467+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:39.031797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.627768+0000","last_change":"2024-09-11T23:03:30.665266+0000","last_active":"2024-09-11T23:03:31.627768+0000","last_peered":"2024-09-11T23:03:31.627768+0000","last_clean":"2024-09-11T23:03:31.627768+0000","last_became_active":"2024-09-11T23:03:30.664313+0000","last_became_peered":"2024-09-11T23:03:30.664313+0000","last_unstale":"2024-09-11T23:03:31.627768+0000","last_undegraded":"2024-09-11T23:03:31.627768+0000","last_fullsized":"2024-09-11T23:03:31.627768+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:11.604671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.669315+0000","last_change":"2024-09-11T23:03:31.663884+0000","last_active":"2024-09-11T23:03:31.669315+0000","last_peered":"2024-09-11T23:03:31.669315+0000","last_clean":"2024-09-11T23:03:31.669315+0000","last_became_active":"2024-09-11T23:03:31.662007+0000","last_became_peered":"2024-09-11T23:03:31.662007+0000","last_unstale":"2024-09-11T23:03:31.669315+0000","last_undegraded":"2024-09-11T23:03:31.669315+0000","last_fullsized":"2024-09-11T23:03:31.669315+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:44.003355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.634355+0000","last_change":"2024-09-11T23:03:30.662279+0000","last_active":"2024-09-11T23:03:31.634355+0000","last_peered":"2024-09-11T23:03:31.634355+0000","last_clean":"2024-09-11T23:03:31.634355+0000","last_became_active":"2024-09-11T23:03:30.661872+0000","last_became_peered":"2024-09-11T23:03:30.661872+0000","last_unstale":"2024-09-11T23:03:31.634355+0000","last_undegraded":"2024-09-11T23:03:31.634355+0000","last_fullsized":"2024-09-11T23:03:31.634355+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:16:21.984941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.680256+0000","last_change":"2024-09-11T23:03:31.673516+0000","last_active":"2024-09-11T23:03:31.680256+0000","last_peered":"2024-09-11T23:03:31.680256+0000","last_clean":"2024-09-11T23:03:31.680256+0000","last_became_active":"2024-09-11T23:03:31.672911+0000","last_became_peered":"2024-09-11T23:03:31.672911+0000","last_unstale":"2024-09-11T23:03:31.680256+0000","last_undegraded":"2024-09-11T23:03:31.680256+0000","last_fullsized":"2024-09-11T23:03:31.680256+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:01.531894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.636942+0000","last_change":"2024-09-11T23:03:30.661744+0000","last_active":"2024-09-11T23:03:31.636942+0000","last_peered":"2024-09-11T23:03:31.636942+0000","last_clean":"2024-09-11T23:03:31.636942+0000","last_became_active":"2024-09-11T23:03:30.661193+0000","last_became_peered":"2024-09-11T23:03:30.661193+0000","last_unstale":"2024-09-11T23:03:31.636942+0000","last_undegraded":"2024-09-11T23:03:31.636942+0000","last_fullsized":"2024-09-11T23:03:31.636942+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:33:15.409459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.659234+0000","last_change":"2024-09-11T23:03:31.656724+0000","last_active":"2024-09-11T23:03:31.659234+0000","last_peered":"2024-09-11T23:03:31.659234+0000","last_clean":"2024-09-11T23:03:31.659234+0000","last_became_active":"2024-09-11T23:03:31.654951+0000","last_became_peered":"2024-09-11T23:03:31.654951+0000","last_unstale":"2024-09-11T23:03:31.659234+0000","last_undegraded":"2024-09-11T23:03:31.659234+0000","last_fullsized":"2024-09-11T23:03:31.659234+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:43.598787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.633893+0000","last_change":"2024-09-11T23:03:30.662133+0000","last_active":"2024-09-11T23:03:31.633893+0000","last_peered":"2024-09-11T23:03:31.633893+0000","last_clean":"2024-09-11T23:03:31.633893+0000","last_became_active":"2024-09-11T23:03:30.661549+0000","last_became_peered":"2024-09-11T23:03:30.661549+0000","last_unstale":"2024-09-11T23:03:31.633893+0000","last_undegraded":"2024-09-11T23:03:31.633893+0000","last_fullsized":"2024-09-11T23:03:31.633893+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:03.253537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.679735+0000","last_change":"2024-09-11T23:03:31.672813+0000","last_active":"2024-09-11T23:03:31.679735+0000","last_peered":"2024-09-11T23:03:31.679735+0000","last_clean":"2024-09-11T23:03:31.679735+0000","last_became_active":"2024-09-11T23:03:31.672523+0000","last_became_peered":"2024-09-11T23:03:31.672523+0000","last_unstale":"2024-09-11T23:03:31.679735+0000","last_undegraded":"2024-09-11T23:03:31.679735+0000","last_fullsized":"2024-09-11T23:03:31.679735+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:33:16.417433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"15'2","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.670278+0000","last_change":"2024-09-11T23:03:30.662637+0000","last_active":"2024-09-11T23:03:31.670278+0000","last_peered":"2024-09-11T23:03:31.670278+0000","last_clean":"2024-09-11T23:03:31.670278+0000","last_became_active":"2024-09-11T23:03:30.661392+0000","last_became_peered":"2024-09-11T23:03:30.661392+0000","last_unstale":"2024-09-11T23:03:31.670278+0000","last_undegraded":"2024-09-11T23:03:31.670278+0000","last_fullsized":"2024-09-11T23:03:31.670278+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:23.634393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.655249+0000","last_change":"2024-09-11T23:03:31.642675+0000","last_active":"2024-09-11T23:03:31.655249+0000","last_peered":"2024-09-11T23:03:31.655249+0000","last_clean":"2024-09-11T23:03:31.655249+0000","last_became_active":"2024-09-11T23:03:31.641871+0000","last_became_peered":"2024-09-11T23:03:31.641871+0000","last_unstale":"2024-09-11T23:03:31.655249+0000","last_undegraded":"2024-09-11T23:03:31.655249+0000","last_fullsized":"2024-09-11T23:03:31.655249+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:17.323384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.626081+0000","last_change":"2024-09-11T23:03:30.652950+0000","last_active":"2024-09-11T23:03:31.626081+0000","last_peered":"2024-09-11T23:03:31.626081+0000","last_clean":"2024-09-11T23:03:31.626081+0000","last_became_active":"2024-09-11T23:03:30.652537+0000","last_became_peered":"2024-09-11T23:03:30.652537+0000","last_unstale":"2024-09-11T23:03:31.626081+0000","last_undegraded":"2024-09-11T23:03:31.626081+0000","last_fullsized":"2024-09-11T23:03:31.626081+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:16:21.984941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.674415+0000","last_change":"2024-09-11T23:03:31.672747+0000","last_active":"2024-09-11T23:03:31.674415+0000","last_peered":"2024-09-11T23:03:31.674415+0000","last_clean":"2024-09-11T23:03:31.674415+0000","last_became_active":"2024-09-11T23:03:31.672498+0000","last_became_peered":"2024-09-11T23:03:31.672498+0000","last_unstale":"2024-09-11T23:03:31.674415+0000","last_undegraded":"2024-09-11T23:03:31.674415+0000","last_fullsized":"2024-09-11T23:03:31.674415+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:47.643082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.634537+0000","last_change":"2024-09-11T23:03:30.660463+0000","last_active":"2024-09-11T23:03:31.634537+0000","last_peered":"2024-09-11T23:03:31.634537+0000","last_clean":"2024-09-11T23:03:31.634537+0000","last_became_active":"2024-09-11T23:03:30.660103+0000","last_became_peered":"2024-09-11T23:03:30.660103+0000","last_unstale":"2024-09-11T23:03:31.634537+0000","last_undegraded":"2024-09-11T23:03:31.634537+0000","last_fullsized":"2024-09-11T23:03:31.634537+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:37.723285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.678429+0000","last_change":"2024-09-11T23:03:31.668311+0000","last_active":"2024-09-11T23:03:31.678429+0000","last_peered":"2024-09-11T23:03:31.678429+0000","last_clean":"2024-09-11T23:03:31.678429+0000","last_became_active":"2024-09-11T23:03:31.668035+0000","last_became_peered":"2024-09-11T23:03:31.668035+0000","last_unstale":"2024-09-11T23:03:31.678429+0000","last_undegraded":"2024-09-11T23:03:31.678429+0000","last_fullsized":"2024-09-11T23:03:31.678429+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:25.933565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.636186+0000","last_change":"2024-09-11T23:03:30.660477+0000","last_active":"2024-09-11T23:03:31.636186+0000","last_peered":"2024-09-11T23:03:31.636186+0000","last_clean":"2024-09-11T23:03:31.636186+0000","last_became_active":"2024-09-11T23:03:30.660094+0000","last_became_peered":"2024-09-11T23:03:30.660094+0000","last_unstale":"2024-09-11T23:03:31.636186+0000","last_undegraded":"2024-09-11T23:03:31.636186+0000","last_fullsized":"2024-09-11T23:03:31.636186+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:24.925590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.670071+0000","last_change":"2024-09-11T23:03:31.668020+0000","last_active":"2024-09-11T23:03:31.670071+0000","last_peered":"2024-09-11T23:03:31.670071+0000","last_clean":"2024-09-11T23:03:31.670071+0000","last_became_active":"2024-09-11T23:03:31.667719+0000","last_became_peered":"2024-09-11T23:03:31.667719+0000","last_unstale":"2024-09-11T23:03:31.670071+0000","last_undegraded":"2024-09-11T23:03:31.670071+0000","last_fullsized":"2024-09-11T23:03:31.670071+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:42.095319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"15'2","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.674557+0000","last_change":"2024-09-11T23:03:30.651711+0000","last_active":"2024-09-11T23:03:31.674557+0000","last_peered":"2024-09-11T23:03:31.674557+0000","last_clean":"2024-09-11T23:03:31.674557+0000","last_became_active":"2024-09-11T23:03:30.651348+0000","last_became_peered":"2024-09-11T23:03:30.651348+0000","last_unstale":"2024-09-11T23:03:31.674557+0000","last_undegraded":"2024-09-11T23:03:31.674557+0000","last_fullsized":"2024-09-11T23:03:31.674557+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:56.281332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.654969+0000","last_change":"2024-09-11T23:03:31.642102+0000","last_active":"2024-09-11T23:03:31.654969+0000","last_peered":"2024-09-11T23:03:31.654969+0000","last_clean":"2024-09-11T23:03:31.654969+0000","last_became_active":"2024-09-11T23:03:31.641618+0000","last_became_peered":"2024-09-11T23:03:31.641618+0000","last_unstale":"2024-09-11T23:03:31.654969+0000","last_undegraded":"2024-09-11T23:03:31.654969+0000","last_fullsized":"2024-09-11T23:03:31.654969+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:03.349545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.680302+0000","last_change":"2024-09-11T23:03:31.673693+0000","last_active":"2024-09-11T23:03:31.680302+0000","last_peered":"2024-09-11T23:03:31.680302+0000","last_clean":"2024-09-11T23:03:31.680302+0000","last_became_active":"2024-09-11T23:03:31.673405+0000","last_became_peered":"2024-09-11T23:03:31.673405+0000","last_unstale":"2024-09-11T23:03:31.680302+0000","last_undegraded":"2024-09-11T23:03:31.680302+0000","last_fullsized":"2024-09-11T23:03:31.680302+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:03.349545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"15'2","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.666065+0000","last_change":"2024-09-11T23:03:30.665363+0000","last_active":"2024-09-11T23:03:31.666065+0000","last_peered":"2024-09-11T23:03:31.666065+0000","last_clean":"2024-09-11T23:03:31.666065+0000","last_became_active":"2024-09-11T23:03:30.665036+0000","last_became_peered":"2024-09-11T23:03:30.665036+0000","last_unstale":"2024-09-11T23:03:31.666065+0000","last_undegraded":"2024-09-11T23:03:31.666065+0000","last_fullsized":"2024-09-11T23:03:31.666065+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:24.925590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.653643+0000","last_change":"2024-09-11T23:03:31.645731+0000","last_active":"2024-09-11T23:03:31.653643+0000","last_peered":"2024-09-11T23:03:31.653643+0000","last_clean":"2024-09-11T23:03:31.653643+0000","last_became_active":"2024-09-11T23:03:31.645437+0000","last_became_peered":"2024-09-11T23:03:31.645437+0000","last_unstale":"2024-09-11T23:03:31.653643+0000","last_undegraded":"2024-09-11T23:03:31.653643+0000","last_fullsized":"2024-09-11T23:03:31.653643+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:43.609686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"15'2","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.666219+0000","last_change":"2024-09-11T23:03:30.665521+0000","last_active":"2024-09-11T23:03:31.666219+0000","last_peered":"2024-09-11T23:03:31.666219+0000","last_clean":"2024-09-11T23:03:31.666219+0000","last_became_active":"2024-09-11T23:03:30.664488+0000","last_became_peered":"2024-09-11T23:03:30.664488+0000","last_unstale":"2024-09-11T23:03:31.666219+0000","last_undegraded":"2024-09-11T23:03:31.666219+0000","last_fullsized":"2024-09-11T23:03:31.666219+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:23.634393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.660818+0000","last_change":"2024-09-11T23:03:31.643030+0000","last_active":"2024-09-11T23:03:31.660818+0000","last_peered":"2024-09-11T23:03:31.660818+0000","last_clean":"2024-09-11T23:03:31.660818+0000","last_became_active":"2024-09-11T23:03:31.642037+0000","last_became_peered":"2024-09-11T23:03:31.642037+0000","last_unstale":"2024-09-11T23:03:31.660818+0000","last_undegraded":"2024-09-11T23:03:31.660818+0000","last_fullsized":"2024-09-11T23:03:31.660818+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:43.598787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"15'1","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.677495+0000","last_change":"2024-09-11T23:03:30.653547+0000","last_active":"2024-09-11T23:03:31.677495+0000","last_peered":"2024-09-11T23:03:31.677495+0000","last_clean":"2024-09-11T23:03:31.677495+0000","last_became_active":"2024-09-11T23:03:30.652566+0000","last_became_peered":"2024-09-11T23:03:30.652566+0000","last_unstale":"2024-09-11T23:03:31.677495+0000","last_undegraded":"2024-09-11T23:03:31.677495+0000","last_fullsized":"2024-09-11T23:03:31.677495+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:39.066030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.680568+0000","last_change":"2024-09-11T23:03:31.678214+0000","last_active":"2024-09-11T23:03:31.680568+0000","last_peered":"2024-09-11T23:03:31.680568+0000","last_clean":"2024-09-11T23:03:31.680568+0000","last_became_active":"2024-09-11T23:03:31.677646+0000","last_became_peered":"2024-09-11T23:03:31.677646+0000","last_unstale":"2024-09-11T23:03:31.680568+0000","last_undegraded":"2024-09-11T23:03:31.680568+0000","last_fullsized":"2024-09-11T23:03:31.680568+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:01.814867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"15'4","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.666870+0000","last_change":"2024-09-11T23:03:30.667990+0000","last_active":"2024-09-11T23:03:31.666870+0000","last_peered":"2024-09-11T23:03:31.666870+0000","last_clean":"2024-09-11T23:03:31.666870+0000","last_became_active":"2024-09-11T23:03:30.667696+0000","last_became_peered":"2024-09-11T23:03:30.667696+0000","last_unstale":"2024-09-11T23:03:31.666870+0000","last_undegraded":"2024-09-11T23:03:31.666870+0000","last_fullsized":"2024-09-11T23:03:31.666870+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:33:15.409459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":151552,"data_stored":40456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":753664,"data_stored":631484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27756,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":741376,"data_stored":629836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:03:35.672 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:03:35.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.825+0000 7f4e6bbba640 1 Processor -- start 2024-09-11T23:03:35.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.825+0000 7f4e6bbba640 1 -- start start 2024-09-11T23:03:35.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.829+0000 7f4e6bbba640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4e6413a410 0x7f4e640a6af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:35.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.829+0000 7f4e6bbba640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e640a82a0 con 0x7f4e640a4b80 2024-09-11T23:03:35.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.829+0000 7f4e6bbba640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f4e640a3cb0 con 0x7f4e6413a410 2024-09-11T23:03:35.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.829+0000 7f4e69155640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f4e640a4b80 0x7f4e640a7030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:49574/0 (socket says 172.21.15.12:49574) 2024-09-11T23:03:35.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.829+0000 7f4e69155640 1 -- 172.21.15.12:0/1183286017 learned_addr learned my addr 172.21.15.12:0/1183286017 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:03:35.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.829+0000 7f4e69956640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4e6413a410 0x7f4e640a6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:35.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.829+0000 7f4e68954640 1 -- 172.21.15.12:0/1183286017 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 186428505 0 0) 0x7f4e640a82a0 con 0x7f4e640a4b80 2024-09-11T23:03:35.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.829+0000 7f4e68954640 1 -- 172.21.15.12:0/1183286017 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e50003530 con 0x7f4e640a4b80 2024-09-11T23:03:35.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.829+0000 7f4e69956640 1 -- 172.21.15.12:0/1183286017 >> v1:172.21.15.12:6789/0 conn(0x7f4e640a4b80 legacy=0x7f4e640a7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:35.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.829+0000 7f4e69956640 1 -- 172.21.15.12:0/1183286017 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e64139fe0 con 0x7f4e6413a410 2024-09-11T23:03:35.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.829+0000 7f4e69956640 1 --2- 172.21.15.12:0/1183286017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e6413a410 0x7f4e640a6af0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4e60009740 tx=0x7f4e6001c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=807126c3878d8e4e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:35.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.829+0000 7f4e68954640 1 -- 172.21.15.12:0/1183286017 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e600b0070 con 0x7f4e6413a410 2024-09-11T23:03:35.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.829+0000 7f4e68954640 1 -- 172.21.15.12:0/1183286017 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e600ab530 con 0x7f4e6413a410 2024-09-11T23:03:35.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.829+0000 7f4e68954640 1 -- 172.21.15.12:0/1183286017 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e600ab810 con 0x7f4e6413a410 2024-09-11T23:03:35.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.833+0000 7f4e6bbba640 1 -- 172.21.15.12:0/1183286017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e6413a410 msgr2=0x7f4e640a6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:35.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.833+0000 7f4e6bbba640 1 --2- 172.21.15.12:0/1183286017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e6413a410 0x7f4e640a6af0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4e60009740 tx=0x7f4e6001c390 comp rx=0 tx=0).stop 2024-09-11T23:03:35.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.833+0000 7f4e6bbba640 1 -- 172.21.15.12:0/1183286017 shutdown_connections 2024-09-11T23:03:35.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.833+0000 7f4e6bbba640 1 --2- 172.21.15.12:0/1183286017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e6413a410 0x7f4e640a6af0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:35.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.833+0000 7f4e6bbba640 1 -- 172.21.15.12:0/1183286017 >> 172.21.15.12:0/1183286017 conn(0x7f4e640ac2c0 msgr2=0x7f4e640ac6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:35.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.833+0000 7f4e6bbba640 1 -- 172.21.15.12:0/1183286017 shutdown_connections 2024-09-11T23:03:35.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.833+0000 7f4e6bbba640 1 -- 172.21.15.12:0/1183286017 wait complete. 2024-09-11T23:03:35.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.833+0000 7f4e6bbba640 1 Processor -- start 2024-09-11T23:03:35.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.833+0000 7f4e6bbba640 1 -- start start 2024-09-11T23:03:35.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.833+0000 7f4e6bbba640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e640a4b80 0x7f4e6409d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:35.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.833+0000 7f4e6bbba640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4e640a7740 con 0x7f4e640a4b80 2024-09-11T23:03:35.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.833+0000 7f4e69956640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e640a4b80 0x7f4e6409d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:35.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.833+0000 7f4e69956640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e640a4b80 0x7f4e6409d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35072/0 (socket says 172.21.15.12:35072) 2024-09-11T23:03:35.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.833+0000 7f4e69956640 1 -- 172.21.15.12:0/2890804951 learned_addr learned my addr 172.21.15.12:0/2890804951 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:35.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.833+0000 7f4e69956640 1 -- 172.21.15.12:0/2890804951 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e6409bdb0 con 0x7f4e640a4b80 2024-09-11T23:03:35.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.833+0000 7f4e69956640 1 --2- 172.21.15.12:0/2890804951 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e640a4b80 0x7f4e6409d170 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4e60018fa0 tx=0x7f4e60019130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:35.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.833+0000 7f4e5a7fc640 1 -- 172.21.15.12:0/2890804951 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e600b9020 con 0x7f4e640a4b80 2024-09-11T23:03:35.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.833+0000 7f4e5a7fc640 1 -- 172.21.15.12:0/2890804951 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e600ab810 con 0x7f4e640a4b80 2024-09-11T23:03:35.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.833+0000 7f4e6bbba640 1 -- 172.21.15.12:0/2890804951 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e6409c730 con 0x7f4e640a4b80 2024-09-11T23:03:35.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.833+0000 7f4e5a7fc640 1 -- 172.21.15.12:0/2890804951 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e600b0040 con 0x7f4e640a4b80 2024-09-11T23:03:35.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.833+0000 7f4e6bbba640 1 -- 172.21.15.12:0/2890804951 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e6409abd0 con 0x7f4e640a4b80 2024-09-11T23:03:35.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.833+0000 7f4e5a7fc640 1 -- 172.21.15.12:0/2890804951 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4e600bc020 con 0x7f4e640a4b80 2024-09-11T23:03:35.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.833+0000 7f4e6bbba640 1 -- 172.21.15.12:0/2890804951 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e640a6af0 con 0x7f4e640a4b80 2024-09-11T23:03:35.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.833+0000 7f4e5a7fc640 1 --2- 172.21.15.12:0/2890804951 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f4e48035db0 0x7f4e48038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:35.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.833+0000 7f4e5a7fc640 1 -- 172.21.15.12:0/2890804951 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3439+0+0 (secure 0 0 0) 0x7f4e600e24e0 con 0x7f4e640a4b80 2024-09-11T23:03:35.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.833+0000 7f4e69155640 1 --2- 172.21.15.12:0/2890804951 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f4e48035db0 0x7f4e48038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:35.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.837+0000 7f4e69155640 1 --2- 172.21.15.12:0/2890804951 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f4e48035db0 0x7f4e48038270 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4e54000f70 tx=0x7f4e540010b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:35.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.841+0000 7f4e5a7fc640 1 -- 172.21.15.12:0/2890804951 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4e600c3030 con 0x7f4e640a4b80 2024-09-11T23:03:36.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:35.997+0000 7f4e6bbba640 1 -- 172.21.15.12:0/2890804951 --> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4e6409b9f0 con 0x7f4e48035db0 2024-09-11T23:03:36.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.005+0000 7f4e5a7fc640 1 -- 172.21.15.12:0/2890804951 <== mgr.4099 v2:172.21.15.12:6824/2765460338 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245902 (secure 0 0 0) 0x7f4e6409b9f0 con 0x7f4e48035db0 2024-09-11T23:03:36.012 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:03:36.014 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-11T23:03:36.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.009+0000 7f4e6bbba640 1 -- 172.21.15.12:0/2890804951 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f4e48035db0 msgr2=0x7f4e48038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:36.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.009+0000 7f4e6bbba640 1 --2- 172.21.15.12:0/2890804951 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f4e48035db0 0x7f4e48038270 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4e54000f70 tx=0x7f4e540010b0 comp rx=0 tx=0).stop 2024-09-11T23:03:36.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.009+0000 7f4e6bbba640 1 -- 172.21.15.12:0/2890804951 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e640a4b80 msgr2=0x7f4e6409d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:36.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.009+0000 7f4e6bbba640 1 --2- 172.21.15.12:0/2890804951 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e640a4b80 0x7f4e6409d170 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4e60018fa0 tx=0x7f4e60019130 comp rx=0 tx=0).stop 2024-09-11T23:03:36.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.009+0000 7f4e6bbba640 1 -- 172.21.15.12:0/2890804951 shutdown_connections 2024-09-11T23:03:36.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.009+0000 7f4e6bbba640 1 --2- 172.21.15.12:0/2890804951 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f4e48035db0 0x7f4e48038270 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:36.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.009+0000 7f4e6bbba640 1 --2- 172.21.15.12:0/2890804951 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e640a4b80 0x7f4e6409d170 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:36.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.009+0000 7f4e6bbba640 1 -- 172.21.15.12:0/2890804951 >> 172.21.15.12:0/2890804951 conn(0x7f4e640ac2c0 msgr2=0x7f4e6413f480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:36.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.009+0000 7f4e6bbba640 1 -- 172.21.15.12:0/2890804951 shutdown_connections 2024-09-11T23:03:36.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.009+0000 7f4e6bbba640 1 -- 172.21.15.12:0/2890804951 wait complete. 2024-09-11T23:03:36.032 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-11T23:03:35.516087+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":181,"num_write_kb":1908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":133,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":82704,"kb_used_data":1608,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283032816,"statfs":{"total":289910292480,"available":289825603584,"internally_reserved":0,"allocated":1646592,"data_stored":1301776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":82963791},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.904122"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.660839+0000","last_change":"2024-09-11T23:03:31.644980+0000","last_active":"2024-09-11T23:03:31.660839+0000","last_peered":"2024-09-11T23:03:31.660839+0000","last_clean":"2024-09-11T23:03:31.660839+0000","last_became_active":"2024-09-11T23:03:31.643322+0000","last_became_peered":"2024-09-11T23:03:31.643322+0000","last_unstale":"2024-09-11T23:03:31.660839+0000","last_undegraded":"2024-09-11T23:03:31.660839+0000","last_fullsized":"2024-09-11T23:03:31.660839+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:51.805947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.653811+0000","last_change":"2024-09-11T23:03:31.650677+0000","last_active":"2024-09-11T23:03:31.653811+0000","last_peered":"2024-09-11T23:03:31.653811+0000","last_clean":"2024-09-11T23:03:31.653811+0000","last_became_active":"2024-09-11T23:03:31.650405+0000","last_became_peered":"2024-09-11T23:03:31.650405+0000","last_unstale":"2024-09-11T23:03:31.653811+0000","last_undegraded":"2024-09-11T23:03:31.653811+0000","last_fullsized":"2024-09-11T23:03:31.653811+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:03.349545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.667298+0000","last_change":"2024-09-11T23:03:31.658194+0000","last_active":"2024-09-11T23:03:31.667298+0000","last_peered":"2024-09-11T23:03:31.667298+0000","last_clean":"2024-09-11T23:03:31.667298+0000","last_became_active":"2024-09-11T23:03:31.657911+0000","last_became_peered":"2024-09-11T23:03:31.657911+0000","last_unstale":"2024-09-11T23:03:31.667298+0000","last_undegraded":"2024-09-11T23:03:31.667298+0000","last_fullsized":"2024-09-11T23:03:31.667298+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:13.638867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.680452+0000","last_change":"2024-09-11T23:03:31.676906+0000","last_active":"2024-09-11T23:03:31.680452+0000","last_peered":"2024-09-11T23:03:31.680452+0000","last_clean":"2024-09-11T23:03:31.680452+0000","last_became_active":"2024-09-11T23:03:31.676592+0000","last_became_peered":"2024-09-11T23:03:31.676592+0000","last_unstale":"2024-09-11T23:03:31.680452+0000","last_undegraded":"2024-09-11T23:03:31.680452+0000","last_fullsized":"2024-09-11T23:03:31.680452+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:21.383496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.667949+0000","last_change":"2024-09-11T23:03:31.657824+0000","last_active":"2024-09-11T23:03:31.667949+0000","last_peered":"2024-09-11T23:03:31.667949+0000","last_clean":"2024-09-11T23:03:31.667949+0000","last_became_active":"2024-09-11T23:03:31.657535+0000","last_became_peered":"2024-09-11T23:03:31.657535+0000","last_unstale":"2024-09-11T23:03:31.667949+0000","last_undegraded":"2024-09-11T23:03:31.667949+0000","last_fullsized":"2024-09-11T23:03:31.667949+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:59.854206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.680288+0000","last_change":"2024-09-11T23:03:31.673561+0000","last_active":"2024-09-11T23:03:31.680288+0000","last_peered":"2024-09-11T23:03:31.680288+0000","last_clean":"2024-09-11T23:03:31.680288+0000","last_became_active":"2024-09-11T23:03:31.672515+0000","last_became_peered":"2024-09-11T23:03:31.672515+0000","last_unstale":"2024-09-11T23:03:31.680288+0000","last_undegraded":"2024-09-11T23:03:31.680288+0000","last_fullsized":"2024-09-11T23:03:31.680288+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:43.609686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.654737+0000","last_change":"2024-09-11T23:03:31.640733+0000","last_active":"2024-09-11T23:03:31.654737+0000","last_peered":"2024-09-11T23:03:31.654737+0000","last_clean":"2024-09-11T23:03:31.654737+0000","last_became_active":"2024-09-11T23:03:31.640419+0000","last_became_peered":"2024-09-11T23:03:31.640419+0000","last_unstale":"2024-09-11T23:03:31.654737+0000","last_undegraded":"2024-09-11T23:03:31.654737+0000","last_fullsized":"2024-09-11T23:03:31.654737+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:01.531894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.680933+0000","last_change":"2024-09-11T23:03:31.677179+0000","last_active":"2024-09-11T23:03:31.680933+0000","last_peered":"2024-09-11T23:03:31.680933+0000","last_clean":"2024-09-11T23:03:31.680933+0000","last_became_active":"2024-09-11T23:03:31.670449+0000","last_became_peered":"2024-09-11T23:03:31.670449+0000","last_unstale":"2024-09-11T23:03:31.680933+0000","last_undegraded":"2024-09-11T23:03:31.680933+0000","last_fullsized":"2024-09-11T23:03:31.680933+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:45.747386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.655441+0000","last_change":"2024-09-11T23:03:31.652750+0000","last_active":"2024-09-11T23:03:31.655441+0000","last_peered":"2024-09-11T23:03:31.655441+0000","last_clean":"2024-09-11T23:03:31.655441+0000","last_became_active":"2024-09-11T23:03:31.651659+0000","last_became_peered":"2024-09-11T23:03:31.651659+0000","last_unstale":"2024-09-11T23:03:31.655441+0000","last_undegraded":"2024-09-11T23:03:31.655441+0000","last_fullsized":"2024-09-11T23:03:31.655441+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:17.323384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.667128+0000","last_change":"2024-09-11T23:03:31.658062+0000","last_active":"2024-09-11T23:03:31.667128+0000","last_peered":"2024-09-11T23:03:31.667128+0000","last_clean":"2024-09-11T23:03:31.667128+0000","last_became_active":"2024-09-11T23:03:31.657713+0000","last_became_peered":"2024-09-11T23:03:31.657713+0000","last_unstale":"2024-09-11T23:03:31.667128+0000","last_undegraded":"2024-09-11T23:03:31.667128+0000","last_fullsized":"2024-09-11T23:03:31.667128+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:41.847795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.661635+0000","last_change":"2024-09-11T23:03:31.644330+0000","last_active":"2024-09-11T23:03:31.661635+0000","last_peered":"2024-09-11T23:03:31.661635+0000","last_clean":"2024-09-11T23:03:31.661635+0000","last_became_active":"2024-09-11T23:03:31.644082+0000","last_became_peered":"2024-09-11T23:03:31.644082+0000","last_unstale":"2024-09-11T23:03:31.661635+0000","last_undegraded":"2024-09-11T23:03:31.661635+0000","last_fullsized":"2024-09-11T23:03:31.661635+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:01.814867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.654778+0000","last_change":"2024-09-11T23:03:31.642201+0000","last_active":"2024-09-11T23:03:31.654778+0000","last_peered":"2024-09-11T23:03:31.654778+0000","last_clean":"2024-09-11T23:03:31.654778+0000","last_became_active":"2024-09-11T23:03:31.641846+0000","last_became_peered":"2024-09-11T23:03:31.641846+0000","last_unstale":"2024-09-11T23:03:31.654778+0000","last_undegraded":"2024-09-11T23:03:31.654778+0000","last_fullsized":"2024-09-11T23:03:31.654778+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:07.511329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.667970+0000","last_change":"2024-09-11T23:03:31.656241+0000","last_active":"2024-09-11T23:03:31.667970+0000","last_peered":"2024-09-11T23:03:31.667970+0000","last_clean":"2024-09-11T23:03:31.667970+0000","last_became_active":"2024-09-11T23:03:31.655038+0000","last_became_peered":"2024-09-11T23:03:31.655038+0000","last_unstale":"2024-09-11T23:03:31.667970+0000","last_undegraded":"2024-09-11T23:03:31.667970+0000","last_fullsized":"2024-09-11T23:03:31.667970+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:08.195338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.655011+0000","last_change":"2024-09-11T23:03:31.642497+0000","last_active":"2024-09-11T23:03:31.655011+0000","last_peered":"2024-09-11T23:03:31.655011+0000","last_clean":"2024-09-11T23:03:31.655011+0000","last_became_active":"2024-09-11T23:03:31.642002+0000","last_became_peered":"2024-09-11T23:03:31.642002+0000","last_unstale":"2024-09-11T23:03:31.655011+0000","last_undegraded":"2024-09-11T23:03:31.655011+0000","last_fullsized":"2024-09-11T23:03:31.655011+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:45.747386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.653100+0000","last_change":"2024-09-11T23:03:31.645457+0000","last_active":"2024-09-11T23:03:31.653100+0000","last_peered":"2024-09-11T23:03:31.653100+0000","last_clean":"2024-09-11T23:03:31.653100+0000","last_became_active":"2024-09-11T23:03:31.643894+0000","last_became_peered":"2024-09-11T23:03:31.643894+0000","last_unstale":"2024-09-11T23:03:31.653100+0000","last_undegraded":"2024-09-11T23:03:31.653100+0000","last_fullsized":"2024-09-11T23:03:31.653100+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:01.531894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.681004+0000","last_change":"2024-09-11T23:03:31.678032+0000","last_active":"2024-09-11T23:03:31.681004+0000","last_peered":"2024-09-11T23:03:31.681004+0000","last_clean":"2024-09-11T23:03:31.681004+0000","last_became_active":"2024-09-11T23:03:31.672976+0000","last_became_peered":"2024-09-11T23:03:31.672976+0000","last_unstale":"2024-09-11T23:03:31.681004+0000","last_undegraded":"2024-09-11T23:03:31.681004+0000","last_fullsized":"2024-09-11T23:03:31.681004+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:43.598787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.655415+0000","last_change":"2024-09-11T23:03:31.652625+0000","last_active":"2024-09-11T23:03:31.655415+0000","last_peered":"2024-09-11T23:03:31.655415+0000","last_clean":"2024-09-11T23:03:31.655415+0000","last_became_active":"2024-09-11T23:03:31.651397+0000","last_became_peered":"2024-09-11T23:03:31.651397+0000","last_unstale":"2024-09-11T23:03:31.655415+0000","last_undegraded":"2024-09-11T23:03:31.655415+0000","last_fullsized":"2024-09-11T23:03:31.655415+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:45.747386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.680332+0000","last_change":"2024-09-11T23:03:31.673847+0000","last_active":"2024-09-11T23:03:31.680332+0000","last_peered":"2024-09-11T23:03:31.680332+0000","last_clean":"2024-09-11T23:03:31.680332+0000","last_became_active":"2024-09-11T23:03:31.673484+0000","last_became_peered":"2024-09-11T23:03:31.673484+0000","last_unstale":"2024-09-11T23:03:31.680332+0000","last_undegraded":"2024-09-11T23:03:31.680332+0000","last_fullsized":"2024-09-11T23:03:31.680332+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:07.511329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.667277+0000","last_change":"2024-09-11T23:03:31.658165+0000","last_active":"2024-09-11T23:03:31.667277+0000","last_peered":"2024-09-11T23:03:31.667277+0000","last_clean":"2024-09-11T23:03:31.667277+0000","last_became_active":"2024-09-11T23:03:31.657520+0000","last_became_peered":"2024-09-11T23:03:31.657520+0000","last_unstale":"2024-09-11T23:03:31.667277+0000","last_undegraded":"2024-09-11T23:03:31.667277+0000","last_fullsized":"2024-09-11T23:03:31.667277+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:50:10.314960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.654703+0000","last_change":"2024-09-11T23:03:31.641111+0000","last_active":"2024-09-11T23:03:31.654703+0000","last_peered":"2024-09-11T23:03:31.654703+0000","last_clean":"2024-09-11T23:03:31.654703+0000","last_became_active":"2024-09-11T23:03:31.640663+0000","last_became_peered":"2024-09-11T23:03:31.640663+0000","last_unstale":"2024-09-11T23:03:31.654703+0000","last_undegraded":"2024-09-11T23:03:31.654703+0000","last_fullsized":"2024-09-11T23:03:31.654703+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:43.609686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.666212+0000","last_change":"2024-09-11T23:03:31.657160+0000","last_active":"2024-09-11T23:03:31.666212+0000","last_peered":"2024-09-11T23:03:31.666212+0000","last_clean":"2024-09-11T23:03:31.666212+0000","last_became_active":"2024-09-11T23:03:31.655894+0000","last_became_peered":"2024-09-11T23:03:31.655894+0000","last_unstale":"2024-09-11T23:03:31.666212+0000","last_undegraded":"2024-09-11T23:03:31.666212+0000","last_fullsized":"2024-09-11T23:03:31.666212+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:17.931079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.653880+0000","last_change":"2024-09-11T23:03:31.651347+0000","last_active":"2024-09-11T23:03:31.653880+0000","last_peered":"2024-09-11T23:03:31.653880+0000","last_clean":"2024-09-11T23:03:31.653880+0000","last_became_active":"2024-09-11T23:03:31.650762+0000","last_became_peered":"2024-09-11T23:03:31.650762+0000","last_unstale":"2024-09-11T23:03:31.653880+0000","last_undegraded":"2024-09-11T23:03:31.653880+0000","last_fullsized":"2024-09-11T23:03:31.653880+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:21.383496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.663652+0000","last_change":"2024-09-11T23:03:31.649698+0000","last_active":"2024-09-11T23:03:31.663652+0000","last_peered":"2024-09-11T23:03:31.663652+0000","last_clean":"2024-09-11T23:03:31.663652+0000","last_became_active":"2024-09-11T23:03:31.649443+0000","last_became_peered":"2024-09-11T23:03:31.649443+0000","last_unstale":"2024-09-11T23:03:31.663652+0000","last_undegraded":"2024-09-11T23:03:31.663652+0000","last_fullsized":"2024-09-11T23:03:31.663652+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:39.031797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.676397+0000","last_change":"2024-09-11T23:03:31.674478+0000","last_active":"2024-09-11T23:03:31.676397+0000","last_peered":"2024-09-11T23:03:31.676397+0000","last_clean":"2024-09-11T23:03:31.676397+0000","last_became_active":"2024-09-11T23:03:31.674069+0000","last_became_peered":"2024-09-11T23:03:31.674069+0000","last_unstale":"2024-09-11T23:03:31.676397+0000","last_undegraded":"2024-09-11T23:03:31.676397+0000","last_fullsized":"2024-09-11T23:03:31.676397+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:10.683627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.680181+0000","last_change":"2024-09-11T23:03:31.673244+0000","last_active":"2024-09-11T23:03:31.680181+0000","last_peered":"2024-09-11T23:03:31.680181+0000","last_clean":"2024-09-11T23:03:31.680181+0000","last_became_active":"2024-09-11T23:03:31.672958+0000","last_became_peered":"2024-09-11T23:03:31.672958+0000","last_unstale":"2024-09-11T23:03:31.680181+0000","last_undegraded":"2024-09-11T23:03:31.680181+0000","last_fullsized":"2024-09-11T23:03:31.680181+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:21.272618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.680525+0000","last_change":"2024-09-11T23:03:31.677762+0000","last_active":"2024-09-11T23:03:31.680525+0000","last_peered":"2024-09-11T23:03:31.680525+0000","last_clean":"2024-09-11T23:03:31.680525+0000","last_became_active":"2024-09-11T23:03:31.677183+0000","last_became_peered":"2024-09-11T23:03:31.677183+0000","last_unstale":"2024-09-11T23:03:31.680525+0000","last_undegraded":"2024-09-11T23:03:31.680525+0000","last_fullsized":"2024-09-11T23:03:31.680525+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:17.323384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.659791+0000","last_change":"2024-09-11T23:03:31.659006+0000","last_active":"2024-09-11T23:03:31.659791+0000","last_peered":"2024-09-11T23:03:31.659791+0000","last_clean":"2024-09-11T23:03:31.659791+0000","last_became_active":"2024-09-11T23:03:31.658753+0000","last_became_peered":"2024-09-11T23:03:31.658753+0000","last_unstale":"2024-09-11T23:03:31.659791+0000","last_undegraded":"2024-09-11T23:03:31.659791+0000","last_fullsized":"2024-09-11T23:03:31.659791+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:08.160568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.667341+0000","last_change":"2024-09-11T23:03:31.663269+0000","last_active":"2024-09-11T23:03:31.667341+0000","last_peered":"2024-09-11T23:03:31.667341+0000","last_clean":"2024-09-11T23:03:31.667341+0000","last_became_active":"2024-09-11T23:03:31.661949+0000","last_became_peered":"2024-09-11T23:03:31.661949+0000","last_unstale":"2024-09-11T23:03:31.667341+0000","last_undegraded":"2024-09-11T23:03:31.667341+0000","last_fullsized":"2024-09-11T23:03:31.667341+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:49.970021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.669249+0000","last_change":"2024-09-11T23:03:31.663932+0000","last_active":"2024-09-11T23:03:31.669249+0000","last_peered":"2024-09-11T23:03:31.669249+0000","last_clean":"2024-09-11T23:03:31.669249+0000","last_became_active":"2024-09-11T23:03:31.663346+0000","last_became_peered":"2024-09-11T23:03:31.663346+0000","last_unstale":"2024-09-11T23:03:31.669249+0000","last_undegraded":"2024-09-11T23:03:31.669249+0000","last_fullsized":"2024-09-11T23:03:31.669249+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:52.318572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.669402+0000","last_change":"2024-09-11T23:03:31.663998+0000","last_active":"2024-09-11T23:03:31.669402+0000","last_peered":"2024-09-11T23:03:31.669402+0000","last_clean":"2024-09-11T23:03:31.669402+0000","last_became_active":"2024-09-11T23:03:31.663608+0000","last_became_peered":"2024-09-11T23:03:31.663608+0000","last_unstale":"2024-09-11T23:03:31.669402+0000","last_undegraded":"2024-09-11T23:03:31.669402+0000","last_fullsized":"2024-09-11T23:03:31.669402+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:23.103838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.677057+0000","last_change":"2024-09-11T23:03:31.668324+0000","last_active":"2024-09-11T23:03:31.677057+0000","last_peered":"2024-09-11T23:03:31.677057+0000","last_clean":"2024-09-11T23:03:31.677057+0000","last_became_active":"2024-09-11T23:03:31.667670+0000","last_became_peered":"2024-09-11T23:03:31.667670+0000","last_unstale":"2024-09-11T23:03:31.677057+0000","last_undegraded":"2024-09-11T23:03:31.677057+0000","last_fullsized":"2024-09-11T23:03:31.677057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:12.618645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.681026+0000","last_change":"2024-09-11T23:03:31.678992+0000","last_active":"2024-09-11T23:03:31.681026+0000","last_peered":"2024-09-11T23:03:31.681026+0000","last_clean":"2024-09-11T23:03:31.681026+0000","last_became_active":"2024-09-11T23:03:31.676531+0000","last_became_peered":"2024-09-11T23:03:31.676531+0000","last_unstale":"2024-09-11T23:03:31.681026+0000","last_undegraded":"2024-09-11T23:03:31.681026+0000","last_fullsized":"2024-09-11T23:03:31.681026+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:48.004677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.659296+0000","last_change":"2024-09-11T23:03:31.657027+0000","last_active":"2024-09-11T23:03:31.659296+0000","last_peered":"2024-09-11T23:03:31.659296+0000","last_clean":"2024-09-11T23:03:31.659296+0000","last_became_active":"2024-09-11T23:03:31.656728+0000","last_became_peered":"2024-09-11T23:03:31.656728+0000","last_unstale":"2024-09-11T23:03:31.659296+0000","last_undegraded":"2024-09-11T23:03:31.659296+0000","last_fullsized":"2024-09-11T23:03:31.659296+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:01.814867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"15'1","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.669517+0000","last_change":"2024-09-11T23:03:30.660455+0000","last_active":"2024-09-11T23:03:31.669517+0000","last_peered":"2024-09-11T23:03:31.669517+0000","last_clean":"2024-09-11T23:03:31.669517+0000","last_became_active":"2024-09-11T23:03:30.660052+0000","last_became_peered":"2024-09-11T23:03:30.660052+0000","last_unstale":"2024-09-11T23:03:31.669517+0000","last_undegraded":"2024-09-11T23:03:31.669517+0000","last_fullsized":"2024-09-11T23:03:31.669517+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:11.604671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.661018+0000","last_change":"2024-09-11T23:03:31.644592+0000","last_active":"2024-09-11T23:03:31.661018+0000","last_peered":"2024-09-11T23:03:31.661018+0000","last_clean":"2024-09-11T23:03:31.661018+0000","last_became_active":"2024-09-11T23:03:31.644297+0000","last_became_peered":"2024-09-11T23:03:31.644297+0000","last_unstale":"2024-09-11T23:03:31.661018+0000","last_undegraded":"2024-09-11T23:03:31.661018+0000","last_fullsized":"2024-09-11T23:03:31.661018+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:08.160568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"15'1","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.670939+0000","last_change":"2024-09-11T23:03:30.653792+0000","last_active":"2024-09-11T23:03:31.670939+0000","last_peered":"2024-09-11T23:03:31.670939+0000","last_clean":"2024-09-11T23:03:31.670939+0000","last_became_active":"2024-09-11T23:03:30.653493+0000","last_became_peered":"2024-09-11T23:03:30.653493+0000","last_unstale":"2024-09-11T23:03:31.670939+0000","last_undegraded":"2024-09-11T23:03:31.670939+0000","last_fullsized":"2024-09-11T23:03:31.670939+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:37.723285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.626342+0000","last_change":"2024-09-11T23:03:30.653094+0000","last_active":"2024-09-11T23:03:31.626342+0000","last_peered":"2024-09-11T23:03:31.626342+0000","last_clean":"2024-09-11T23:03:31.626342+0000","last_became_active":"2024-09-11T23:03:30.652770+0000","last_became_peered":"2024-09-11T23:03:30.652770+0000","last_unstale":"2024-09-11T23:03:31.626342+0000","last_undegraded":"2024-09-11T23:03:31.626342+0000","last_fullsized":"2024-09-11T23:03:31.626342+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:43.385721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.681055+0000","last_change":"2024-09-11T23:03:31.679465+0000","last_active":"2024-09-11T23:03:31.681055+0000","last_peered":"2024-09-11T23:03:31.681055+0000","last_clean":"2024-09-11T23:03:31.681055+0000","last_became_active":"2024-09-11T23:03:31.677617+0000","last_became_peered":"2024-09-11T23:03:31.677617+0000","last_unstale":"2024-09-11T23:03:31.681055+0000","last_undegraded":"2024-09-11T23:03:31.681055+0000","last_fullsized":"2024-09-11T23:03:31.681055+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:51.805947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.625851+0000","last_change":"2024-09-11T23:03:30.663136+0000","last_active":"2024-09-11T23:03:31.625851+0000","last_peered":"2024-09-11T23:03:31.625851+0000","last_clean":"2024-09-11T23:03:31.625851+0000","last_became_active":"2024-09-11T23:03:30.662724+0000","last_became_peered":"2024-09-11T23:03:30.662724+0000","last_unstale":"2024-09-11T23:03:31.625851+0000","last_undegraded":"2024-09-11T23:03:31.625851+0000","last_fullsized":"2024-09-11T23:03:31.625851+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:03.253537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.659817+0000","last_change":"2024-09-11T23:03:31.657767+0000","last_active":"2024-09-11T23:03:31.659817+0000","last_peered":"2024-09-11T23:03:31.659817+0000","last_clean":"2024-09-11T23:03:31.659817+0000","last_became_active":"2024-09-11T23:03:31.656481+0000","last_became_peered":"2024-09-11T23:03:31.656481+0000","last_unstale":"2024-09-11T23:03:31.659817+0000","last_undegraded":"2024-09-11T23:03:31.659817+0000","last_fullsized":"2024-09-11T23:03:31.659817+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:41.215134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.634356+0000","last_change":"2024-09-11T23:03:30.658131+0000","last_active":"2024-09-11T23:03:31.634356+0000","last_peered":"2024-09-11T23:03:31.634356+0000","last_clean":"2024-09-11T23:03:31.634356+0000","last_became_active":"2024-09-11T23:03:30.655737+0000","last_became_peered":"2024-09-11T23:03:30.655737+0000","last_unstale":"2024-09-11T23:03:31.634356+0000","last_undegraded":"2024-09-11T23:03:31.634356+0000","last_fullsized":"2024-09-11T23:03:31.634356+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:43.385721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.680590+0000","last_change":"2024-09-11T23:03:31.678439+0000","last_active":"2024-09-11T23:03:31.680590+0000","last_peered":"2024-09-11T23:03:31.680590+0000","last_clean":"2024-09-11T23:03:31.680590+0000","last_became_active":"2024-09-11T23:03:31.677947+0000","last_became_peered":"2024-09-11T23:03:31.677947+0000","last_unstale":"2024-09-11T23:03:31.680590+0000","last_undegraded":"2024-09-11T23:03:31.680590+0000","last_fullsized":"2024-09-11T23:03:31.680590+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:41.215134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.630887+0000","last_change":"2024-09-11T23:03:30.664333+0000","last_active":"2024-09-11T23:03:31.630887+0000","last_peered":"2024-09-11T23:03:31.630887+0000","last_clean":"2024-09-11T23:03:31.630887+0000","last_became_active":"2024-09-11T23:03:30.664058+0000","last_became_peered":"2024-09-11T23:03:30.664058+0000","last_unstale":"2024-09-11T23:03:31.630887+0000","last_undegraded":"2024-09-11T23:03:31.630887+0000","last_fullsized":"2024-09-11T23:03:31.630887+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:39.066030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.660799+0000","last_change":"2024-09-11T23:03:31.644698+0000","last_active":"2024-09-11T23:03:31.660799+0000","last_peered":"2024-09-11T23:03:31.660799+0000","last_clean":"2024-09-11T23:03:31.660799+0000","last_became_active":"2024-09-11T23:03:31.642741+0000","last_became_peered":"2024-09-11T23:03:31.642741+0000","last_unstale":"2024-09-11T23:03:31.660799+0000","last_undegraded":"2024-09-11T23:03:31.660799+0000","last_fullsized":"2024-09-11T23:03:31.660799+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:48.004677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"15'3","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.670160+0000","last_change":"2024-09-11T23:03:30.661999+0000","last_active":"2024-09-11T23:03:31.670160+0000","last_peered":"2024-09-11T23:03:31.670160+0000","last_clean":"2024-09-11T23:03:31.670160+0000","last_became_active":"2024-09-11T23:03:30.661483+0000","last_became_peered":"2024-09-11T23:03:30.661483+0000","last_unstale":"2024-09-11T23:03:31.670160+0000","last_undegraded":"2024-09-11T23:03:31.670160+0000","last_fullsized":"2024-09-11T23:03:31.670160+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:11.610671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.665313+0000","last_change":"2024-09-11T23:03:31.663054+0000","last_active":"2024-09-11T23:03:31.665313+0000","last_peered":"2024-09-11T23:03:31.665313+0000","last_clean":"2024-09-11T23:03:31.665313+0000","last_became_active":"2024-09-11T23:03:31.662588+0000","last_became_peered":"2024-09-11T23:03:31.662588+0000","last_unstale":"2024-09-11T23:03:31.665313+0000","last_undegraded":"2024-09-11T23:03:31.665313+0000","last_fullsized":"2024-09-11T23:03:31.665313+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:51.805947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"15'6","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.683669+0000","last_change":"2024-09-11T23:03:30.664300+0000","last_active":"2024-09-11T23:03:31.683669+0000","last_peered":"2024-09-11T23:03:31.683669+0000","last_clean":"2024-09-11T23:03:31.683669+0000","last_became_active":"2024-09-11T23:03:30.663600+0000","last_became_peered":"2024-09-11T23:03:30.663600+0000","last_unstale":"2024-09-11T23:03:31.683669+0000","last_undegraded":"2024-09-11T23:03:31.683669+0000","last_fullsized":"2024-09-11T23:03:31.683669+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:16:21.984941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.661656+0000","last_change":"2024-09-11T23:03:31.643144+0000","last_active":"2024-09-11T23:03:31.661656+0000","last_peered":"2024-09-11T23:03:31.661656+0000","last_clean":"2024-09-11T23:03:31.661656+0000","last_became_active":"2024-09-11T23:03:31.642819+0000","last_became_peered":"2024-09-11T23:03:31.642819+0000","last_unstale":"2024-09-11T23:03:31.661656+0000","last_undegraded":"2024-09-11T23:03:31.661656+0000","last_fullsized":"2024-09-11T23:03:31.661656+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:30.571044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"15'2","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.674452+0000","last_change":"2024-09-11T23:03:30.652612+0000","last_active":"2024-09-11T23:03:31.674452+0000","last_peered":"2024-09-11T23:03:31.674452+0000","last_clean":"2024-09-11T23:03:31.674452+0000","last_became_active":"2024-09-11T23:03:30.652343+0000","last_became_peered":"2024-09-11T23:03:30.652343+0000","last_unstale":"2024-09-11T23:03:31.674452+0000","last_undegraded":"2024-09-11T23:03:31.674452+0000","last_fullsized":"2024-09-11T23:03:31.674452+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:11.610671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.654992+0000","last_change":"2024-09-11T23:03:31.642382+0000","last_active":"2024-09-11T23:03:31.654992+0000","last_peered":"2024-09-11T23:03:31.654992+0000","last_clean":"2024-09-11T23:03:31.654992+0000","last_became_active":"2024-09-11T23:03:31.641739+0000","last_became_peered":"2024-09-11T23:03:31.641739+0000","last_unstale":"2024-09-11T23:03:31.654992+0000","last_undegraded":"2024-09-11T23:03:31.654992+0000","last_fullsized":"2024-09-11T23:03:31.654992+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:21.383496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.661407+0000","last_change":"2024-09-11T23:03:30.662995+0000","last_active":"2024-09-11T23:03:31.661407+0000","last_peered":"2024-09-11T23:03:31.661407+0000","last_clean":"2024-09-11T23:03:31.661407+0000","last_became_active":"2024-09-11T23:03:30.662463+0000","last_became_peered":"2024-09-11T23:03:30.662463+0000","last_unstale":"2024-09-11T23:03:31.661407+0000","last_undegraded":"2024-09-11T23:03:31.661407+0000","last_fullsized":"2024-09-11T23:03:31.661407+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:11.604671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.653850+0000","last_change":"2024-09-11T23:03:31.650998+0000","last_active":"2024-09-11T23:03:31.653850+0000","last_peered":"2024-09-11T23:03:31.653850+0000","last_clean":"2024-09-11T23:03:31.653850+0000","last_became_active":"2024-09-11T23:03:31.650439+0000","last_became_peered":"2024-09-11T23:03:31.650439+0000","last_unstale":"2024-09-11T23:03:31.653850+0000","last_undegraded":"2024-09-11T23:03:31.653850+0000","last_fullsized":"2024-09-11T23:03:31.653850+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:07.511329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.626619+0000","last_change":"2024-09-11T23:03:30.662321+0000","last_active":"2024-09-11T23:03:31.626619+0000","last_peered":"2024-09-11T23:03:31.626619+0000","last_clean":"2024-09-11T23:03:31.626619+0000","last_became_active":"2024-09-11T23:03:30.661916+0000","last_became_peered":"2024-09-11T23:03:30.661916+0000","last_unstale":"2024-09-11T23:03:31.626619+0000","last_undegraded":"2024-09-11T23:03:31.626619+0000","last_fullsized":"2024-09-11T23:03:31.626619+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:37.723285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.645191+0000","last_change":"2024-09-11T23:03:31.643564+0000","last_active":"2024-09-11T23:03:31.645191+0000","last_peered":"2024-09-11T23:03:31.645191+0000","last_clean":"2024-09-11T23:03:31.645191+0000","last_became_active":"2024-09-11T23:03:31.643289+0000","last_became_peered":"2024-09-11T23:03:31.643289+0000","last_unstale":"2024-09-11T23:03:31.645191+0000","last_undegraded":"2024-09-11T23:03:31.645191+0000","last_fullsized":"2024-09-11T23:03:31.645191+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:21.272618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"15'8","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.682845+0000","last_change":"2024-09-11T23:03:30.659134+0000","last_active":"2024-09-11T23:03:31.682845+0000","last_peered":"2024-09-11T23:03:31.682845+0000","last_clean":"2024-09-11T23:03:31.682845+0000","last_became_active":"2024-09-11T23:03:30.658788+0000","last_became_peered":"2024-09-11T23:03:30.658788+0000","last_unstale":"2024-09-11T23:03:31.682845+0000","last_undegraded":"2024-09-11T23:03:31.682845+0000","last_fullsized":"2024-09-11T23:03:31.682845+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:05.436819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.677085+0000","last_change":"2024-09-11T23:03:31.668569+0000","last_active":"2024-09-11T23:03:31.677085+0000","last_peered":"2024-09-11T23:03:31.677085+0000","last_clean":"2024-09-11T23:03:31.677085+0000","last_became_active":"2024-09-11T23:03:31.668015+0000","last_became_peered":"2024-09-11T23:03:31.668015+0000","last_unstale":"2024-09-11T23:03:31.677085+0000","last_undegraded":"2024-09-11T23:03:31.677085+0000","last_fullsized":"2024-09-11T23:03:31.677085+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:57.289306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"15'1","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.666530+0000","last_change":"2024-09-11T23:03:30.668018+0000","last_active":"2024-09-11T23:03:31.666530+0000","last_peered":"2024-09-11T23:03:31.666530+0000","last_clean":"2024-09-11T23:03:31.666530+0000","last_became_active":"2024-09-11T23:03:30.667416+0000","last_became_peered":"2024-09-11T23:03:30.667416+0000","last_unstale":"2024-09-11T23:03:31.666530+0000","last_undegraded":"2024-09-11T23:03:31.666530+0000","last_fullsized":"2024-09-11T23:03:31.666530+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:20.264643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.680609+0000","last_change":"2024-09-11T23:03:31.678504+0000","last_active":"2024-09-11T23:03:31.680609+0000","last_peered":"2024-09-11T23:03:31.680609+0000","last_clean":"2024-09-11T23:03:31.680609+0000","last_became_active":"2024-09-11T23:03:31.678027+0000","last_became_peered":"2024-09-11T23:03:31.678027+0000","last_unstale":"2024-09-11T23:03:31.680609+0000","last_undegraded":"2024-09-11T23:03:31.680609+0000","last_fullsized":"2024-09-11T23:03:31.680609+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:08.160568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"15'2","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.679883+0000","last_change":"2024-09-11T23:03:30.655788+0000","last_active":"2024-09-11T23:03:31.679883+0000","last_peered":"2024-09-11T23:03:31.679883+0000","last_clean":"2024-09-11T23:03:31.679883+0000","last_became_active":"2024-09-11T23:03:30.655370+0000","last_became_peered":"2024-09-11T23:03:30.655370+0000","last_unstale":"2024-09-11T23:03:31.679883+0000","last_undegraded":"2024-09-11T23:03:31.679883+0000","last_fullsized":"2024-09-11T23:03:31.679883+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:23.634393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.660776+0000","last_change":"2024-09-11T23:03:31.644215+0000","last_active":"2024-09-11T23:03:31.660776+0000","last_peered":"2024-09-11T23:03:31.660776+0000","last_clean":"2024-09-11T23:03:31.660776+0000","last_became_active":"2024-09-11T23:03:31.642396+0000","last_became_peered":"2024-09-11T23:03:31.642396+0000","last_unstale":"2024-09-11T23:03:31.660776+0000","last_undegraded":"2024-09-11T23:03:31.660776+0000","last_fullsized":"2024-09-11T23:03:31.660776+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:41.215134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"15'1","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.671985+0000","last_change":"2024-09-11T23:03:30.654962+0000","last_active":"2024-09-11T23:03:31.671985+0000","last_peered":"2024-09-11T23:03:31.671985+0000","last_clean":"2024-09-11T23:03:31.671985+0000","last_became_active":"2024-09-11T23:03:30.650356+0000","last_became_peered":"2024-09-11T23:03:30.650356+0000","last_unstale":"2024-09-11T23:03:31.671985+0000","last_undegraded":"2024-09-11T23:03:31.671985+0000","last_fullsized":"2024-09-11T23:03:31.671985+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:56.281332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.661833+0000","last_change":"2024-09-11T23:03:31.643251+0000","last_active":"2024-09-11T23:03:31.661833+0000","last_peered":"2024-09-11T23:03:31.661833+0000","last_clean":"2024-09-11T23:03:31.661833+0000","last_became_active":"2024-09-11T23:03:31.642954+0000","last_became_peered":"2024-09-11T23:03:31.642954+0000","last_unstale":"2024-09-11T23:03:31.661833+0000","last_undegraded":"2024-09-11T23:03:31.661833+0000","last_fullsized":"2024-09-11T23:03:31.661833+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:42.095319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.660995+0000","last_change":"2024-09-11T23:03:30.653720+0000","last_active":"2024-09-11T23:03:31.660995+0000","last_peered":"2024-09-11T23:03:31.660995+0000","last_clean":"2024-09-11T23:03:31.660995+0000","last_became_active":"2024-09-11T23:03:30.653076+0000","last_became_peered":"2024-09-11T23:03:30.653076+0000","last_unstale":"2024-09-11T23:03:31.660995+0000","last_undegraded":"2024-09-11T23:03:31.660995+0000","last_fullsized":"2024-09-11T23:03:31.660995+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:43.385721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.669996+0000","last_change":"2024-09-11T23:03:31.667091+0000","last_active":"2024-09-11T23:03:31.669996+0000","last_peered":"2024-09-11T23:03:31.669996+0000","last_clean":"2024-09-11T23:03:31.669996+0000","last_became_active":"2024-09-11T23:03:31.666762+0000","last_became_peered":"2024-09-11T23:03:31.666762+0000","last_unstale":"2024-09-11T23:03:31.669996+0000","last_undegraded":"2024-09-11T23:03:31.669996+0000","last_fullsized":"2024-09-11T23:03:31.669996+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:30.571044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":145,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.633018+0000","last_change":"2024-09-11T23:03:26.382905+0000","last_active":"2024-09-11T23:03:31.633018+0000","last_peered":"2024-09-11T23:03:31.633018+0000","last_clean":"2024-09-11T23:03:31.633018+0000","last_became_active":"2024-09-11T23:03:26.380590+0000","last_became_peered":"2024-09-11T23:03:26.380590+0000","last_unstale":"2024-09-11T23:03:31.633018+0000","last_undegraded":"2024-09-11T23:03:31.633018+0000","last_fullsized":"2024-09-11T23:03:31.633018+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:24.361793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:24.361793+0000","last_clean_scrub_stamp":"2024-09-11T23:03:24.361793+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:46.577063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.635461+0000","last_change":"2024-09-11T23:03:30.650947+0000","last_active":"2024-09-11T23:03:31.635461+0000","last_peered":"2024-09-11T23:03:31.635461+0000","last_clean":"2024-09-11T23:03:31.635461+0000","last_became_active":"2024-09-11T23:03:30.640787+0000","last_became_peered":"2024-09-11T23:03:30.640787+0000","last_unstale":"2024-09-11T23:03:31.635461+0000","last_undegraded":"2024-09-11T23:03:31.635461+0000","last_fullsized":"2024-09-11T23:03:31.635461+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:39.066030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.665719+0000","last_change":"2024-09-11T23:03:31.662781+0000","last_active":"2024-09-11T23:03:31.665719+0000","last_peered":"2024-09-11T23:03:31.665719+0000","last_clean":"2024-09-11T23:03:31.665719+0000","last_became_active":"2024-09-11T23:03:31.662481+0000","last_became_peered":"2024-09-11T23:03:31.662481+0000","last_unstale":"2024-09-11T23:03:31.665719+0000","last_undegraded":"2024-09-11T23:03:31.665719+0000","last_fullsized":"2024-09-11T23:03:31.665719+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:48.004677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.653592+0000","last_change":"2024-09-11T23:03:30.665053+0000","last_active":"2024-09-11T23:03:31.653592+0000","last_peered":"2024-09-11T23:03:31.653592+0000","last_clean":"2024-09-11T23:03:31.653592+0000","last_became_active":"2024-09-11T23:03:30.664393+0000","last_became_peered":"2024-09-11T23:03:30.664393+0000","last_unstale":"2024-09-11T23:03:31.653592+0000","last_undegraded":"2024-09-11T23:03:31.653592+0000","last_fullsized":"2024-09-11T23:03:31.653592+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:34:50.423468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.674947+0000","last_change":"2024-09-11T23:03:31.673415+0000","last_active":"2024-09-11T23:03:31.674947+0000","last_peered":"2024-09-11T23:03:31.674947+0000","last_clean":"2024-09-11T23:03:31.674947+0000","last_became_active":"2024-09-11T23:03:31.673160+0000","last_became_peered":"2024-09-11T23:03:31.673160+0000","last_unstale":"2024-09-11T23:03:31.674947+0000","last_undegraded":"2024-09-11T23:03:31.674947+0000","last_fullsized":"2024-09-11T23:03:31.674947+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:05.113429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.655846+0000","last_change":"2024-09-11T23:03:30.663975+0000","last_active":"2024-09-11T23:03:31.655846+0000","last_peered":"2024-09-11T23:03:31.655846+0000","last_clean":"2024-09-11T23:03:31.655846+0000","last_became_active":"2024-09-11T23:03:30.663612+0000","last_became_peered":"2024-09-11T23:03:30.663612+0000","last_unstale":"2024-09-11T23:03:31.655846+0000","last_undegraded":"2024-09-11T23:03:31.655846+0000","last_fullsized":"2024-09-11T23:03:31.655846+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:03.253537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.675467+0000","last_change":"2024-09-11T23:03:31.672101+0000","last_active":"2024-09-11T23:03:31.675467+0000","last_peered":"2024-09-11T23:03:31.675467+0000","last_clean":"2024-09-11T23:03:31.675467+0000","last_became_active":"2024-09-11T23:03:31.671541+0000","last_became_peered":"2024-09-11T23:03:31.671541+0000","last_unstale":"2024-09-11T23:03:31.675467+0000","last_undegraded":"2024-09-11T23:03:31.675467+0000","last_fullsized":"2024-09-11T23:03:31.675467+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:39.031797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.627768+0000","last_change":"2024-09-11T23:03:30.665266+0000","last_active":"2024-09-11T23:03:31.627768+0000","last_peered":"2024-09-11T23:03:31.627768+0000","last_clean":"2024-09-11T23:03:31.627768+0000","last_became_active":"2024-09-11T23:03:30.664313+0000","last_became_peered":"2024-09-11T23:03:30.664313+0000","last_unstale":"2024-09-11T23:03:31.627768+0000","last_undegraded":"2024-09-11T23:03:31.627768+0000","last_fullsized":"2024-09-11T23:03:31.627768+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:11.604671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.669315+0000","last_change":"2024-09-11T23:03:31.663884+0000","last_active":"2024-09-11T23:03:31.669315+0000","last_peered":"2024-09-11T23:03:31.669315+0000","last_clean":"2024-09-11T23:03:31.669315+0000","last_became_active":"2024-09-11T23:03:31.662007+0000","last_became_peered":"2024-09-11T23:03:31.662007+0000","last_unstale":"2024-09-11T23:03:31.669315+0000","last_undegraded":"2024-09-11T23:03:31.669315+0000","last_fullsized":"2024-09-11T23:03:31.669315+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:44.003355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.634355+0000","last_change":"2024-09-11T23:03:30.662279+0000","last_active":"2024-09-11T23:03:31.634355+0000","last_peered":"2024-09-11T23:03:31.634355+0000","last_clean":"2024-09-11T23:03:31.634355+0000","last_became_active":"2024-09-11T23:03:30.661872+0000","last_became_peered":"2024-09-11T23:03:30.661872+0000","last_unstale":"2024-09-11T23:03:31.634355+0000","last_undegraded":"2024-09-11T23:03:31.634355+0000","last_fullsized":"2024-09-11T23:03:31.634355+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:16:21.984941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.680256+0000","last_change":"2024-09-11T23:03:31.673516+0000","last_active":"2024-09-11T23:03:31.680256+0000","last_peered":"2024-09-11T23:03:31.680256+0000","last_clean":"2024-09-11T23:03:31.680256+0000","last_became_active":"2024-09-11T23:03:31.672911+0000","last_became_peered":"2024-09-11T23:03:31.672911+0000","last_unstale":"2024-09-11T23:03:31.680256+0000","last_undegraded":"2024-09-11T23:03:31.680256+0000","last_fullsized":"2024-09-11T23:03:31.680256+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:01.531894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.636942+0000","last_change":"2024-09-11T23:03:30.661744+0000","last_active":"2024-09-11T23:03:31.636942+0000","last_peered":"2024-09-11T23:03:31.636942+0000","last_clean":"2024-09-11T23:03:31.636942+0000","last_became_active":"2024-09-11T23:03:30.661193+0000","last_became_peered":"2024-09-11T23:03:30.661193+0000","last_unstale":"2024-09-11T23:03:31.636942+0000","last_undegraded":"2024-09-11T23:03:31.636942+0000","last_fullsized":"2024-09-11T23:03:31.636942+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:33:15.409459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.659234+0000","last_change":"2024-09-11T23:03:31.656724+0000","last_active":"2024-09-11T23:03:31.659234+0000","last_peered":"2024-09-11T23:03:31.659234+0000","last_clean":"2024-09-11T23:03:31.659234+0000","last_became_active":"2024-09-11T23:03:31.654951+0000","last_became_peered":"2024-09-11T23:03:31.654951+0000","last_unstale":"2024-09-11T23:03:31.659234+0000","last_undegraded":"2024-09-11T23:03:31.659234+0000","last_fullsized":"2024-09-11T23:03:31.659234+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:43.598787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.633893+0000","last_change":"2024-09-11T23:03:30.662133+0000","last_active":"2024-09-11T23:03:31.633893+0000","last_peered":"2024-09-11T23:03:31.633893+0000","last_clean":"2024-09-11T23:03:31.633893+0000","last_became_active":"2024-09-11T23:03:30.661549+0000","last_became_peered":"2024-09-11T23:03:30.661549+0000","last_unstale":"2024-09-11T23:03:31.633893+0000","last_undegraded":"2024-09-11T23:03:31.633893+0000","last_fullsized":"2024-09-11T23:03:31.633893+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:03.253537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.679735+0000","last_change":"2024-09-11T23:03:31.672813+0000","last_active":"2024-09-11T23:03:31.679735+0000","last_peered":"2024-09-11T23:03:31.679735+0000","last_clean":"2024-09-11T23:03:31.679735+0000","last_became_active":"2024-09-11T23:03:31.672523+0000","last_became_peered":"2024-09-11T23:03:31.672523+0000","last_unstale":"2024-09-11T23:03:31.679735+0000","last_undegraded":"2024-09-11T23:03:31.679735+0000","last_fullsized":"2024-09-11T23:03:31.679735+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:33:16.417433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"15'2","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.670278+0000","last_change":"2024-09-11T23:03:30.662637+0000","last_active":"2024-09-11T23:03:31.670278+0000","last_peered":"2024-09-11T23:03:31.670278+0000","last_clean":"2024-09-11T23:03:31.670278+0000","last_became_active":"2024-09-11T23:03:30.661392+0000","last_became_peered":"2024-09-11T23:03:30.661392+0000","last_unstale":"2024-09-11T23:03:31.670278+0000","last_undegraded":"2024-09-11T23:03:31.670278+0000","last_fullsized":"2024-09-11T23:03:31.670278+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:23.634393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.655249+0000","last_change":"2024-09-11T23:03:31.642675+0000","last_active":"2024-09-11T23:03:31.655249+0000","last_peered":"2024-09-11T23:03:31.655249+0000","last_clean":"2024-09-11T23:03:31.655249+0000","last_became_active":"2024-09-11T23:03:31.641871+0000","last_became_peered":"2024-09-11T23:03:31.641871+0000","last_unstale":"2024-09-11T23:03:31.655249+0000","last_undegraded":"2024-09-11T23:03:31.655249+0000","last_fullsized":"2024-09-11T23:03:31.655249+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:17.323384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.626081+0000","last_change":"2024-09-11T23:03:30.652950+0000","last_active":"2024-09-11T23:03:31.626081+0000","last_peered":"2024-09-11T23:03:31.626081+0000","last_clean":"2024-09-11T23:03:31.626081+0000","last_became_active":"2024-09-11T23:03:30.652537+0000","last_became_peered":"2024-09-11T23:03:30.652537+0000","last_unstale":"2024-09-11T23:03:31.626081+0000","last_undegraded":"2024-09-11T23:03:31.626081+0000","last_fullsized":"2024-09-11T23:03:31.626081+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:16:21.984941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.674415+0000","last_change":"2024-09-11T23:03:31.672747+0000","last_active":"2024-09-11T23:03:31.674415+0000","last_peered":"2024-09-11T23:03:31.674415+0000","last_clean":"2024-09-11T23:03:31.674415+0000","last_became_active":"2024-09-11T23:03:31.672498+0000","last_became_peered":"2024-09-11T23:03:31.672498+0000","last_unstale":"2024-09-11T23:03:31.674415+0000","last_undegraded":"2024-09-11T23:03:31.674415+0000","last_fullsized":"2024-09-11T23:03:31.674415+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:47.643082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.634537+0000","last_change":"2024-09-11T23:03:30.660463+0000","last_active":"2024-09-11T23:03:31.634537+0000","last_peered":"2024-09-11T23:03:31.634537+0000","last_clean":"2024-09-11T23:03:31.634537+0000","last_became_active":"2024-09-11T23:03:30.660103+0000","last_became_peered":"2024-09-11T23:03:30.660103+0000","last_unstale":"2024-09-11T23:03:31.634537+0000","last_undegraded":"2024-09-11T23:03:31.634537+0000","last_fullsized":"2024-09-11T23:03:31.634537+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:37.723285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.678429+0000","last_change":"2024-09-11T23:03:31.668311+0000","last_active":"2024-09-11T23:03:31.678429+0000","last_peered":"2024-09-11T23:03:31.678429+0000","last_clean":"2024-09-11T23:03:31.678429+0000","last_became_active":"2024-09-11T23:03:31.668035+0000","last_became_peered":"2024-09-11T23:03:31.668035+0000","last_unstale":"2024-09-11T23:03:31.678429+0000","last_undegraded":"2024-09-11T23:03:31.678429+0000","last_fullsized":"2024-09-11T23:03:31.678429+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:25.933565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.636186+0000","last_change":"2024-09-11T23:03:30.660477+0000","last_active":"2024-09-11T23:03:31.636186+0000","last_peered":"2024-09-11T23:03:31.636186+0000","last_clean":"2024-09-11T23:03:31.636186+0000","last_became_active":"2024-09-11T23:03:30.660094+0000","last_became_peered":"2024-09-11T23:03:30.660094+0000","last_unstale":"2024-09-11T23:03:31.636186+0000","last_undegraded":"2024-09-11T23:03:31.636186+0000","last_fullsized":"2024-09-11T23:03:31.636186+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:24.925590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.670071+0000","last_change":"2024-09-11T23:03:31.668020+0000","last_active":"2024-09-11T23:03:31.670071+0000","last_peered":"2024-09-11T23:03:31.670071+0000","last_clean":"2024-09-11T23:03:31.670071+0000","last_became_active":"2024-09-11T23:03:31.667719+0000","last_became_peered":"2024-09-11T23:03:31.667719+0000","last_unstale":"2024-09-11T23:03:31.670071+0000","last_undegraded":"2024-09-11T23:03:31.670071+0000","last_fullsized":"2024-09-11T23:03:31.670071+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:42.095319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"15'2","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.674557+0000","last_change":"2024-09-11T23:03:30.651711+0000","last_active":"2024-09-11T23:03:31.674557+0000","last_peered":"2024-09-11T23:03:31.674557+0000","last_clean":"2024-09-11T23:03:31.674557+0000","last_became_active":"2024-09-11T23:03:30.651348+0000","last_became_peered":"2024-09-11T23:03:30.651348+0000","last_unstale":"2024-09-11T23:03:31.674557+0000","last_undegraded":"2024-09-11T23:03:31.674557+0000","last_fullsized":"2024-09-11T23:03:31.674557+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:56.281332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.654969+0000","last_change":"2024-09-11T23:03:31.642102+0000","last_active":"2024-09-11T23:03:31.654969+0000","last_peered":"2024-09-11T23:03:31.654969+0000","last_clean":"2024-09-11T23:03:31.654969+0000","last_became_active":"2024-09-11T23:03:31.641618+0000","last_became_peered":"2024-09-11T23:03:31.641618+0000","last_unstale":"2024-09-11T23:03:31.654969+0000","last_undegraded":"2024-09-11T23:03:31.654969+0000","last_fullsized":"2024-09-11T23:03:31.654969+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:03.349545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.680302+0000","last_change":"2024-09-11T23:03:31.673693+0000","last_active":"2024-09-11T23:03:31.680302+0000","last_peered":"2024-09-11T23:03:31.680302+0000","last_clean":"2024-09-11T23:03:31.680302+0000","last_became_active":"2024-09-11T23:03:31.673405+0000","last_became_peered":"2024-09-11T23:03:31.673405+0000","last_unstale":"2024-09-11T23:03:31.680302+0000","last_undegraded":"2024-09-11T23:03:31.680302+0000","last_fullsized":"2024-09-11T23:03:31.680302+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:03.349545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"15'2","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.666065+0000","last_change":"2024-09-11T23:03:30.665363+0000","last_active":"2024-09-11T23:03:31.666065+0000","last_peered":"2024-09-11T23:03:31.666065+0000","last_clean":"2024-09-11T23:03:31.666065+0000","last_became_active":"2024-09-11T23:03:30.665036+0000","last_became_peered":"2024-09-11T23:03:30.665036+0000","last_unstale":"2024-09-11T23:03:31.666065+0000","last_undegraded":"2024-09-11T23:03:31.666065+0000","last_fullsized":"2024-09-11T23:03:31.666065+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:24.925590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.653643+0000","last_change":"2024-09-11T23:03:31.645731+0000","last_active":"2024-09-11T23:03:31.653643+0000","last_peered":"2024-09-11T23:03:31.653643+0000","last_clean":"2024-09-11T23:03:31.653643+0000","last_became_active":"2024-09-11T23:03:31.645437+0000","last_became_peered":"2024-09-11T23:03:31.645437+0000","last_unstale":"2024-09-11T23:03:31.653643+0000","last_undegraded":"2024-09-11T23:03:31.653643+0000","last_fullsized":"2024-09-11T23:03:31.653643+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:43.609686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"15'2","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.666219+0000","last_change":"2024-09-11T23:03:30.665521+0000","last_active":"2024-09-11T23:03:31.666219+0000","last_peered":"2024-09-11T23:03:31.666219+0000","last_clean":"2024-09-11T23:03:31.666219+0000","last_became_active":"2024-09-11T23:03:30.664488+0000","last_became_peered":"2024-09-11T23:03:30.664488+0000","last_unstale":"2024-09-11T23:03:31.666219+0000","last_undegraded":"2024-09-11T23:03:31.666219+0000","last_fullsized":"2024-09-11T23:03:31.666219+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:23.634393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.660818+0000","last_change":"2024-09-11T23:03:31.643030+0000","last_active":"2024-09-11T23:03:31.660818+0000","last_peered":"2024-09-11T23:03:31.660818+0000","last_clean":"2024-09-11T23:03:31.660818+0000","last_became_active":"2024-09-11T23:03:31.642037+0000","last_became_peered":"2024-09-11T23:03:31.642037+0000","last_unstale":"2024-09-11T23:03:31.660818+0000","last_undegraded":"2024-09-11T23:03:31.660818+0000","last_fullsized":"2024-09-11T23:03:31.660818+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:43.598787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"15'1","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.677495+0000","last_change":"2024-09-11T23:03:30.653547+0000","last_active":"2024-09-11T23:03:31.677495+0000","last_peered":"2024-09-11T23:03:31.677495+0000","last_clean":"2024-09-11T23:03:31.677495+0000","last_became_active":"2024-09-11T23:03:30.652566+0000","last_became_peered":"2024-09-11T23:03:30.652566+0000","last_unstale":"2024-09-11T23:03:31.677495+0000","last_undegraded":"2024-09-11T23:03:31.677495+0000","last_fullsized":"2024-09-11T23:03:31.677495+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:39.066030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.680568+0000","last_change":"2024-09-11T23:03:31.678214+0000","last_active":"2024-09-11T23:03:31.680568+0000","last_peered":"2024-09-11T23:03:31.680568+0000","last_clean":"2024-09-11T23:03:31.680568+0000","last_became_active":"2024-09-11T23:03:31.677646+0000","last_became_peered":"2024-09-11T23:03:31.677646+0000","last_unstale":"2024-09-11T23:03:31.680568+0000","last_undegraded":"2024-09-11T23:03:31.680568+0000","last_fullsized":"2024-09-11T23:03:31.680568+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:01.814867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"15'4","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T23:03:31.666870+0000","last_change":"2024-09-11T23:03:30.667990+0000","last_active":"2024-09-11T23:03:31.666870+0000","last_peered":"2024-09-11T23:03:31.666870+0000","last_clean":"2024-09-11T23:03:31.666870+0000","last_became_active":"2024-09-11T23:03:30.667696+0000","last_became_peered":"2024-09-11T23:03:30.667696+0000","last_unstale":"2024-09-11T23:03:31.666870+0000","last_undegraded":"2024-09-11T23:03:31.666870+0000","last_fullsized":"2024-09-11T23:03:31.666870+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:33:15.409459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":151552,"data_stored":40456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":753664,"data_stored":631484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27756,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":741376,"data_stored":629836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:03:36.038 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T23:03:36.038 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-11T23:03:36.038 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-11T23:03:36.039 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-11T23:03:36.039 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-11T23:03:36.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.189+0000 7fb5ddbc4640 1 Processor -- start 2024-09-11T23:03:36.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.189+0000 7fb5ddbc4640 1 -- start start 2024-09-11T23:03:36.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.189+0000 7fb5ddbc4640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb5d813a410 0x7fb5d80a6af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:36.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.189+0000 7fb5ddbc4640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5d80a82a0 con 0x7fb5d80a4b80 2024-09-11T23:03:36.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.189+0000 7fb5ddbc4640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fb5d80a3cb0 con 0x7fb5d813a410 2024-09-11T23:03:36.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.189+0000 7fb5d77fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb5d813a410 0x7fb5d80a6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:36.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.189+0000 7fb5d6ffd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fb5d80a4b80 0x7fb5d80a7030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:49578/0 (socket says 172.21.15.12:49578) 2024-09-11T23:03:36.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.189+0000 7fb5d6ffd640 1 -- 172.21.15.12:0/4289364135 learned_addr learned my addr 172.21.15.12:0/4289364135 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:03:36.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.189+0000 7fb5d67fc640 1 -- 172.21.15.12:0/4289364135 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2678601551 0 0) 0x7fb5d80a82a0 con 0x7fb5d80a4b80 2024-09-11T23:03:36.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.189+0000 7fb5d67fc640 1 -- 172.21.15.12:0/4289364135 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5c0003530 con 0x7fb5d80a4b80 2024-09-11T23:03:36.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.189+0000 7fb5d67fc640 1 -- 172.21.15.12:0/4289364135 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1303852476 0 0) 0x7fb5c0003530 con 0x7fb5d80a4b80 2024-09-11T23:03:36.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.189+0000 7fb5d77fe640 1 -- 172.21.15.12:0/4289364135 >> v1:172.21.15.12:6789/0 conn(0x7fb5d80a4b80 legacy=0x7fb5d80a7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:36.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.189+0000 7fb5d77fe640 1 -- 172.21.15.12:0/4289364135 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5d8139fe0 con 0x7fb5d813a410 2024-09-11T23:03:36.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.193+0000 7fb5d77fe640 1 --2- 172.21.15.12:0/4289364135 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5d813a410 0x7fb5d80a6af0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb5c8009740 tx=0x7fb5c801c2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=702e9d0447d46c1e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:36.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.193+0000 7fb5d67fc640 1 -- 172.21.15.12:0/4289364135 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5c80b0070 con 0x7fb5d813a410 2024-09-11T23:03:36.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.193+0000 7fb5d67fc640 1 -- 172.21.15.12:0/4289364135 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5c80ab400 con 0x7fb5d813a410 2024-09-11T23:03:36.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.193+0000 7fb5d67fc640 1 -- 172.21.15.12:0/4289364135 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5cc0015b0 con 0x7fb5d813a410 2024-09-11T23:03:36.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.193+0000 7fb5ddbc4640 1 -- 172.21.15.12:0/4289364135 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5d813a410 msgr2=0x7fb5d80a6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:36.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.193+0000 7fb5ddbc4640 1 --2- 172.21.15.12:0/4289364135 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5d813a410 0x7fb5d80a6af0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb5c8009740 tx=0x7fb5c801c2b0 comp rx=0 tx=0).stop 2024-09-11T23:03:36.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.193+0000 7fb5ddbc4640 1 -- 172.21.15.12:0/4289364135 shutdown_connections 2024-09-11T23:03:36.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.193+0000 7fb5ddbc4640 1 --2- 172.21.15.12:0/4289364135 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5d813a410 0x7fb5d80a6af0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:36.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.193+0000 7fb5ddbc4640 1 -- 172.21.15.12:0/4289364135 >> 172.21.15.12:0/4289364135 conn(0x7fb5d80ac2c0 msgr2=0x7fb5d80ac6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:36.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.193+0000 7fb5ddbc4640 1 -- 172.21.15.12:0/4289364135 shutdown_connections 2024-09-11T23:03:36.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.193+0000 7fb5ddbc4640 1 -- 172.21.15.12:0/4289364135 wait complete. 2024-09-11T23:03:36.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.193+0000 7fb5ddbc4640 1 Processor -- start 2024-09-11T23:03:36.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.193+0000 7fb5ddbc4640 1 -- start start 2024-09-11T23:03:36.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.193+0000 7fb5ddbc4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5d80a4b80 0x7fb5d809b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:36.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.193+0000 7fb5ddbc4640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb5d80a7740 con 0x7fb5d80a4b80 2024-09-11T23:03:36.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.193+0000 7fb5d77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5d80a4b80 0x7fb5d809b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:36.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.193+0000 7fb5d77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5d80a4b80 0x7fb5d809b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35088/0 (socket says 172.21.15.12:35088) 2024-09-11T23:03:36.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.193+0000 7fb5d77fe640 1 -- 172.21.15.12:0/2467050361 learned_addr learned my addr 172.21.15.12:0/2467050361 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:36.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.193+0000 7fb5d77fe640 1 -- 172.21.15.12:0/2467050361 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5d809c6a0 con 0x7fb5d80a4b80 2024-09-11T23:03:36.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.193+0000 7fb5d77fe640 1 --2- 172.21.15.12:0/2467050361 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5d80a4b80 0x7fb5d809b240 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb5c8019ee0 tx=0x7fb5c8019050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:36.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.193+0000 7fb5bffff640 1 -- 172.21.15.12:0/2467050361 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5c80b9020 con 0x7fb5d80a4b80 2024-09-11T23:03:36.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.193+0000 7fb5bffff640 1 -- 172.21.15.12:0/2467050361 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5c80037d0 con 0x7fb5d80a4b80 2024-09-11T23:03:36.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.193+0000 7fb5ddbc4640 1 -- 172.21.15.12:0/2467050361 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5d81ce600 con 0x7fb5d80a4b80 2024-09-11T23:03:36.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.193+0000 7fb5bffff640 1 -- 172.21.15.12:0/2467050361 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5c80b0040 con 0x7fb5d80a4b80 2024-09-11T23:03:36.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.193+0000 7fb5ddbc4640 1 -- 172.21.15.12:0/2467050361 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5d809d270 con 0x7fb5d80a4b80 2024-09-11T23:03:36.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.197+0000 7fb5bffff640 1 -- 172.21.15.12:0/2467050361 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb5c80bc020 con 0x7fb5d80a4b80 2024-09-11T23:03:36.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.197+0000 7fb5ddbc4640 1 -- 172.21.15.12:0/2467050361 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5d80a6af0 con 0x7fb5d80a4b80 2024-09-11T23:03:36.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.197+0000 7fb5bffff640 1 --2- 172.21.15.12:0/2467050361 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fb5c4035db0 0x7fb5c4038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:36.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.197+0000 7fb5bffff640 1 -- 172.21.15.12:0/2467050361 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3439+0+0 (secure 0 0 0) 0x7fb5c80e24f0 con 0x7fb5d80a4b80 2024-09-11T23:03:36.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.197+0000 7fb5d6ffd640 1 --2- 172.21.15.12:0/2467050361 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fb5c4035db0 0x7fb5c4038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:36.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.197+0000 7fb5d6ffd640 1 --2- 172.21.15.12:0/2467050361 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fb5c4035db0 0x7fb5c4038270 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc000c10 tx=0x7fb5cc001240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:36.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.201+0000 7fb5bffff640 1 -- 172.21.15.12:0/2467050361 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb5c80c3030 con 0x7fb5d80a4b80 2024-09-11T23:03:36.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.405+0000 7fb5ddbc4640 1 -- 172.21.15.12:0/2467050361 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fb5d80a2e90 con 0x7fb5d80a4b80 2024-09-11T23:03:36.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.409+0000 7fb5bffff640 1 -- 172.21.15.12:0/2467050361 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+84173 (secure 0 0 0) 0x7fb5c8015f30 con 0x7fb5d80a4b80 2024-09-11T23:03:36.413 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:03:36.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.409+0000 7fb5ddbc4640 1 -- 172.21.15.12:0/2467050361 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fb5c4035db0 msgr2=0x7fb5c4038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:36.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.409+0000 7fb5ddbc4640 1 --2- 172.21.15.12:0/2467050361 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fb5c4035db0 0x7fb5c4038270 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc000c10 tx=0x7fb5cc001240 comp rx=0 tx=0).stop 2024-09-11T23:03:36.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.409+0000 7fb5ddbc4640 1 -- 172.21.15.12:0/2467050361 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5d80a4b80 msgr2=0x7fb5d809b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:36.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.409+0000 7fb5ddbc4640 1 --2- 172.21.15.12:0/2467050361 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5d80a4b80 0x7fb5d809b240 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb5c8019ee0 tx=0x7fb5c8019050 comp rx=0 tx=0).stop 2024-09-11T23:03:36.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.409+0000 7fb5ddbc4640 1 -- 172.21.15.12:0/2467050361 shutdown_connections 2024-09-11T23:03:36.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.409+0000 7fb5ddbc4640 1 --2- 172.21.15.12:0/2467050361 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fb5c4035db0 0x7fb5c4038270 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:36.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.409+0000 7fb5ddbc4640 1 --2- 172.21.15.12:0/2467050361 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5d80a4b80 0x7fb5d809b240 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:36.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.409+0000 7fb5ddbc4640 1 -- 172.21.15.12:0/2467050361 >> 172.21.15.12:0/2467050361 conn(0x7fb5d80ac2c0 msgr2=0x7fb5d813f510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:36.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.409+0000 7fb5ddbc4640 1 -- 172.21.15.12:0/2467050361 shutdown_connections 2024-09-11T23:03:36.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.409+0000 7fb5ddbc4640 1 -- 172.21.15.12:0/2467050361 wait complete. 2024-09-11T23:03:36.431 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":5,"flags":0,"active_gid":4099,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2765460338},{"type":"v1","addr":"172.21.15.12:6825","nonce":2765460338}]},"active_addr":"172.21.15.12:6825/2765460338","active_change":"2024-09-11T23:03:15.506462+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.12:0","nonce":4120232861}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.12:0","nonce":1241865013}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.12:0","nonce":255391181}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.12:0","nonce":2345769658}]}]} 2024-09-11T23:03:36.433 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-11T23:03:36.433 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-11T23:03:36.433 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:03:36.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.545+0000 7f4bf8d53640 1 Processor -- start 2024-09-11T23:03:36.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.545+0000 7f4bf8d53640 1 -- start start 2024-09-11T23:03:36.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.545+0000 7f4bf8d53640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4bf409f3b0 0x7f4bf413ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:36.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.545+0000 7f4bf8d53640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bf409f820 con 0x7f4bf40a0380 2024-09-11T23:03:36.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.545+0000 7f4bf8d53640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f4bf406e890 con 0x7f4bf409f3b0 2024-09-11T23:03:36.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.545+0000 7f4bf1d9b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4bf409f3b0 0x7f4bf413ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:36.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.545+0000 7f4bf1d9b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4bf409f3b0 0x7f4bf413ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35094/0 (socket says 172.21.15.12:35094) 2024-09-11T23:03:36.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.545+0000 7f4bf1d9b640 1 -- 172.21.15.12:0/1502224998 learned_addr learned my addr 172.21.15.12:0/1502224998 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:36.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.545+0000 7f4bf259c640 1 --1- 172.21.15.12:0/1502224998 >> v1:172.21.15.12:6789/0 conn(0x7f4bf40a0380 0x7f4bf40a0760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:49580/0 (socket says 172.21.15.12:49580) 2024-09-11T23:03:36.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.545+0000 7f4bf1d9b640 1 -- 172.21.15.12:0/1502224998 >> v1:172.21.15.12:6789/0 conn(0x7f4bf40a0380 legacy=0x7f4bf40a0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:36.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.545+0000 7f4bf1d9b640 1 -- 172.21.15.12:0/1502224998 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bf406ed80 con 0x7f4bf409f3b0 2024-09-11T23:03:36.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.549+0000 7f4bf1d9b640 1 --2- 172.21.15.12:0/1502224998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4bf409f3b0 0x7f4bf413ee90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc006fd0 tx=0x7f4bdc01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c43eeaeeec6b4e3a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:36.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.549+0000 7f4bf159a640 1 -- 172.21.15.12:0/1502224998 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bdc0b0070 con 0x7f4bf409f3b0 2024-09-11T23:03:36.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.549+0000 7f4bf159a640 1 -- 172.21.15.12:0/1502224998 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bdc0ab530 con 0x7f4bf409f3b0 2024-09-11T23:03:36.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.549+0000 7f4bf159a640 1 -- 172.21.15.12:0/1502224998 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bdc0ab830 con 0x7f4bf409f3b0 2024-09-11T23:03:36.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.549+0000 7f4bf8d53640 1 -- 172.21.15.12:0/1502224998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4bf409f3b0 msgr2=0x7f4bf413ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:36.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.549+0000 7f4bf8d53640 1 --2- 172.21.15.12:0/1502224998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4bf409f3b0 0x7f4bf413ee90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc006fd0 tx=0x7f4bdc01c430 comp rx=0 tx=0).stop 2024-09-11T23:03:36.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.549+0000 7f4bf8d53640 1 -- 172.21.15.12:0/1502224998 shutdown_connections 2024-09-11T23:03:36.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.549+0000 7f4bf8d53640 1 --2- 172.21.15.12:0/1502224998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4bf409f3b0 0x7f4bf413ee90 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:36.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.549+0000 7f4bf8d53640 1 -- 172.21.15.12:0/1502224998 >> 172.21.15.12:0/1502224998 conn(0x7f4bf40aa2c0 msgr2=0x7f4bf40aa6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:36.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.549+0000 7f4bf8d53640 1 -- 172.21.15.12:0/1502224998 shutdown_connections 2024-09-11T23:03:36.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.549+0000 7f4bf8d53640 1 -- 172.21.15.12:0/1502224998 wait complete. 2024-09-11T23:03:36.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.549+0000 7f4bf8d53640 1 Processor -- start 2024-09-11T23:03:36.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.549+0000 7f4bf8d53640 1 -- start start 2024-09-11T23:03:36.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.553+0000 7f4bf8d53640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4bf409f3b0 0x7f4bf413b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:36.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.553+0000 7f4bf8d53640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf4141f80 con 0x7f4bf409f3b0 2024-09-11T23:03:36.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.553+0000 7f4bf259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4bf409f3b0 0x7f4bf413b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:36.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.553+0000 7f4bf259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4bf409f3b0 0x7f4bf413b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35110/0 (socket says 172.21.15.12:35110) 2024-09-11T23:03:36.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.553+0000 7f4bf259c640 1 -- 172.21.15.12:0/1778737209 learned_addr learned my addr 172.21.15.12:0/1778737209 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:36.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.553+0000 7f4bf259c640 1 -- 172.21.15.12:0/1778737209 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bf413ceb0 con 0x7f4bf409f3b0 2024-09-11T23:03:36.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.553+0000 7f4bf259c640 1 --2- 172.21.15.12:0/1778737209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4bf409f3b0 0x7f4bf413b0a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4bec00c7f0 tx=0x7f4bec00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:36.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.553+0000 7f4beaffd640 1 -- 172.21.15.12:0/1778737209 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bec017070 con 0x7f4bf409f3b0 2024-09-11T23:03:36.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.553+0000 7f4beaffd640 1 -- 172.21.15.12:0/1778737209 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bec00a610 con 0x7f4bf409f3b0 2024-09-11T23:03:36.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.553+0000 7f4bf8d53640 1 -- 172.21.15.12:0/1778737209 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bf41209a0 con 0x7f4bf409f3b0 2024-09-11T23:03:36.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.553+0000 7f4beaffd640 1 -- 172.21.15.12:0/1778737209 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bec00a8f0 con 0x7f4bf409f3b0 2024-09-11T23:03:36.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.553+0000 7f4bf8d53640 1 -- 172.21.15.12:0/1778737209 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bf413cbd0 con 0x7f4bf409f3b0 2024-09-11T23:03:36.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.553+0000 7f4beaffd640 1 -- 172.21.15.12:0/1778737209 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4bec01a070 con 0x7f4bf409f3b0 2024-09-11T23:03:36.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.553+0000 7f4bf8d53640 1 -- 172.21.15.12:0/1778737209 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bf40008e0 con 0x7f4bf409f3b0 2024-09-11T23:03:36.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.553+0000 7f4beaffd640 1 --2- 172.21.15.12:0/1778737209 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f4bd4035db0 0x7f4bd4038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:36.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.553+0000 7f4beaffd640 1 -- 172.21.15.12:0/1778737209 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3439+0+0 (secure 0 0 0) 0x7f4bec047cb0 con 0x7f4bf409f3b0 2024-09-11T23:03:36.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.553+0000 7f4bf1d9b640 1 --2- 172.21.15.12:0/1778737209 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f4bd4035db0 0x7f4bd4038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:36.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.553+0000 7f4bf1d9b640 1 --2- 172.21.15.12:0/1778737209 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f4bd4035db0 0x7f4bd4038270 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc0ad000 tx=0x7f4bdc0a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:36.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.557+0000 7f4beaffd640 1 -- 172.21.15.12:0/1778737209 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4bf409f820 con 0x7f4bf409f3b0 2024-09-11T23:03:36.594 INFO:tasks.ceph.mds.b.smithi012.stderr:2024-09-11T23:03:36.589+0000 7fef6baf9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T23:03:36.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.717+0000 7f4bf8d53640 1 -- 172.21.15.12:0/1778737209 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4bf413e930 con 0x7f4bf409f3b0 2024-09-11T23:03:36.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.717+0000 7f4beaffd640 1 -- 172.21.15.12:0/1778737209 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+10675 (secure 0 0 0) 0x7f4bec011c30 con 0x7f4bf409f3b0 2024-09-11T23:03:36.723 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:03:36.723 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":16,"fsid":"8be14356-3340-4500-91a2-4cbc6b511f65","created":"2024-09-11T23:03:10.620234+0000","modified":"2024-09-11T23:03:32.629844+0000","last_up_change":"2024-09-11T23:03:22.359028+0000","last_in_change":"2024-09-11T23:03:11.545817+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:03:23.587068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:03:28.893298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:03:29.993656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"153b72a1-40b1-400d-93ea-333e733f9bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6817","nonce":3680911937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6819","nonce":3680911937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6823","nonce":3680911937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6821","nonce":3680911937}]},"public_addr":"172.21.15.12:6817/3680911937","cluster_addr":"172.21.15.12:6819/3680911937","heartbeat_back_addr":"172.21.15.12:6823/3680911937","heartbeat_front_addr":"172.21.15.12:6821/3680911937","state":["exists","up"]},{"osd":1,"uuid":"94669e49-ee4f-4acf-9e25-e94374dda8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6801","nonce":236825163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6803","nonce":236825163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6807","nonce":236825163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6805","nonce":236825163}]},"public_addr":"172.21.15.12:6801/236825163","cluster_addr":"172.21.15.12:6803/236825163","heartbeat_back_addr":"172.21.15.12:6807/236825163","heartbeat_front_addr":"172.21.15.12:6805/236825163","state":["exists","up"]},{"osd":2,"uuid":"826dae4d-8888-4ec5-8f00-425b3be93814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6809","nonce":3263521655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6811","nonce":3263521655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6815","nonce":3263521655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6813","nonce":3263521655}]},"public_addr":"172.21.15.12:6809/3263521655","cluster_addr":"172.21.15.12:6811/3263521655","heartbeat_back_addr":"172.21.15.12:6815/3263521655","heartbeat_front_addr":"172.21.15.12:6813/3263521655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:19.398518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.761524+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.904997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:03:36.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.721+0000 7f4bf8d53640 1 -- 172.21.15.12:0/1778737209 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f4bd4035db0 msgr2=0x7f4bd4038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:36.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.721+0000 7f4bf8d53640 1 --2- 172.21.15.12:0/1778737209 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f4bd4035db0 0x7f4bd4038270 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc0ad000 tx=0x7f4bdc0a6000 comp rx=0 tx=0).stop 2024-09-11T23:03:36.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.721+0000 7f4bf8d53640 1 -- 172.21.15.12:0/1778737209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4bf409f3b0 msgr2=0x7f4bf413b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:36.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.721+0000 7f4bf8d53640 1 --2- 172.21.15.12:0/1778737209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4bf409f3b0 0x7f4bf413b0a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4bec00c7f0 tx=0x7f4bec00ccb0 comp rx=0 tx=0).stop 2024-09-11T23:03:36.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.721+0000 7f4bf8d53640 1 -- 172.21.15.12:0/1778737209 shutdown_connections 2024-09-11T23:03:36.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.721+0000 7f4bf8d53640 1 --2- 172.21.15.12:0/1778737209 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f4bd4035db0 0x7f4bd4038270 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:36.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.721+0000 7f4bf8d53640 1 --2- 172.21.15.12:0/1778737209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4bf409f3b0 0x7f4bf413b0a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:36.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.721+0000 7f4bf8d53640 1 -- 172.21.15.12:0/1778737209 >> 172.21.15.12:0/1778737209 conn(0x7f4bf40aa2c0 msgr2=0x7f4bf4072820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:36.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.721+0000 7f4bf8d53640 1 -- 172.21.15.12:0/1778737209 shutdown_connections 2024-09-11T23:03:36.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.721+0000 7f4bf8d53640 1 -- 172.21.15.12:0/1778737209 wait complete. 2024-09-11T23:03:36.741 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-11T23:03:36.741 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:03:36.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.857+0000 7fec357a8640 1 Processor -- start 2024-09-11T23:03:36.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.857+0000 7fec357a8640 1 -- start start 2024-09-11T23:03:36.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.861+0000 7fec357a8640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fec3013a410 0x7fec300a6af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:36.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.861+0000 7fec357a8640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec300a82a0 con 0x7fec300a4b80 2024-09-11T23:03:36.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.861+0000 7fec357a8640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fec300a3cb0 con 0x7fec3013a410 2024-09-11T23:03:36.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.861+0000 7fec2effd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fec3013a410 0x7fec300a6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:36.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.861+0000 7fec2e7fc640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fec300a4b80 0x7fec300a7030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:49596/0 (socket says 172.21.15.12:49596) 2024-09-11T23:03:36.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.861+0000 7fec2e7fc640 1 -- 172.21.15.12:0/11893052 learned_addr learned my addr 172.21.15.12:0/11893052 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:03:36.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.861+0000 7fec2dffb640 1 -- 172.21.15.12:0/11893052 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 37759824 0 0) 0x7fec300a82a0 con 0x7fec300a4b80 2024-09-11T23:03:36.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.861+0000 7fec2dffb640 1 -- 172.21.15.12:0/11893052 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec18003530 con 0x7fec300a4b80 2024-09-11T23:03:36.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.861+0000 7fec2effd640 1 -- 172.21.15.12:0/11893052 >> v1:172.21.15.12:6789/0 conn(0x7fec300a4b80 legacy=0x7fec300a7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:36.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.861+0000 7fec2effd640 1 -- 172.21.15.12:0/11893052 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec30139fe0 con 0x7fec3013a410 2024-09-11T23:03:36.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.861+0000 7fec2effd640 1 --2- 172.21.15.12:0/11893052 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec3013a410 0x7fec300a6af0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fec20009740 tx=0x7fec2001c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7376204b52adb701 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:36.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.861+0000 7fec2dffb640 1 -- 172.21.15.12:0/11893052 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec200b0070 con 0x7fec3013a410 2024-09-11T23:03:36.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.861+0000 7fec2dffb640 1 -- 172.21.15.12:0/11893052 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec200ab530 con 0x7fec3013a410 2024-09-11T23:03:36.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.861+0000 7fec2dffb640 1 -- 172.21.15.12:0/11893052 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec200ab830 con 0x7fec3013a410 2024-09-11T23:03:36.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.861+0000 7fec357a8640 1 -- 172.21.15.12:0/11893052 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec3013a410 msgr2=0x7fec300a6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:36.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.861+0000 7fec357a8640 1 --2- 172.21.15.12:0/11893052 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec3013a410 0x7fec300a6af0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fec20009740 tx=0x7fec2001c390 comp rx=0 tx=0).stop 2024-09-11T23:03:36.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.861+0000 7fec357a8640 1 -- 172.21.15.12:0/11893052 shutdown_connections 2024-09-11T23:03:36.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.861+0000 7fec357a8640 1 --2- 172.21.15.12:0/11893052 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec3013a410 0x7fec300a6af0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:36.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.861+0000 7fec357a8640 1 -- 172.21.15.12:0/11893052 >> 172.21.15.12:0/11893052 conn(0x7fec300ac2c0 msgr2=0x7fec300ac6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:36.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.861+0000 7fec357a8640 1 -- 172.21.15.12:0/11893052 shutdown_connections 2024-09-11T23:03:36.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.861+0000 7fec357a8640 1 -- 172.21.15.12:0/11893052 wait complete. 2024-09-11T23:03:36.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.865+0000 7fec357a8640 1 Processor -- start 2024-09-11T23:03:36.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.865+0000 7fec357a8640 1 -- start start 2024-09-11T23:03:36.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.865+0000 7fec357a8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec300a4b80 0x7fec301ce880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:36.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.865+0000 7fec357a8640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fec300a7740 con 0x7fec300a4b80 2024-09-11T23:03:36.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.865+0000 7fec2effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec300a4b80 0x7fec301ce880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:36.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.865+0000 7fec2effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec300a4b80 0x7fec301ce880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35130/0 (socket says 172.21.15.12:35130) 2024-09-11T23:03:36.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.865+0000 7fec2effd640 1 -- 172.21.15.12:0/1987865567 learned_addr learned my addr 172.21.15.12:0/1987865567 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:36.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.865+0000 7fec2effd640 1 -- 172.21.15.12:0/1987865567 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec3013eba0 con 0x7fec300a4b80 2024-09-11T23:03:36.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.865+0000 7fec2effd640 1 --2- 172.21.15.12:0/1987865567 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec300a4b80 0x7fec301ce880 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fec20019fc0 tx=0x7fec2001abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:36.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.865+0000 7fec177fe640 1 -- 172.21.15.12:0/1987865567 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec200b0050 con 0x7fec300a4b80 2024-09-11T23:03:36.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.865+0000 7fec177fe640 1 -- 172.21.15.12:0/1987865567 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec200b1040 con 0x7fec300a4b80 2024-09-11T23:03:36.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.865+0000 7fec357a8640 1 -- 172.21.15.12:0/1987865567 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec3009c450 con 0x7fec300a4b80 2024-09-11T23:03:36.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.865+0000 7fec177fe640 1 -- 172.21.15.12:0/1987865567 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec200b7580 con 0x7fec300a4b80 2024-09-11T23:03:36.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.865+0000 7fec357a8640 1 -- 172.21.15.12:0/1987865567 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec3013ef70 con 0x7fec300a4b80 2024-09-11T23:03:36.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.865+0000 7fec177fe640 1 -- 172.21.15.12:0/1987865567 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fec200be030 con 0x7fec300a4b80 2024-09-11T23:03:36.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.865+0000 7fec357a8640 1 -- 172.21.15.12:0/1987865567 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec300a6af0 con 0x7fec300a4b80 2024-09-11T23:03:36.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.865+0000 7fec177fe640 1 --2- 172.21.15.12:0/1987865567 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fec1c035e00 0x7fec1c0382c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:36.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.865+0000 7fec177fe640 1 -- 172.21.15.12:0/1987865567 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3439+0+0 (secure 0 0 0) 0x7fec200bc070 con 0x7fec300a4b80 2024-09-11T23:03:36.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.865+0000 7fec2e7fc640 1 --2- 172.21.15.12:0/1987865567 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fec1c035e00 0x7fec1c0382c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:36.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.865+0000 7fec2e7fc640 1 --2- 172.21.15.12:0/1987865567 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fec1c035e00 0x7fec1c0382c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fec24007fd0 tx=0x7fec24007980 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:36.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:36.869+0000 7fec177fe640 1 -- 172.21.15.12:0/1987865567 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fec200c5020 con 0x7fec300a4b80 2024-09-11T23:03:37.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.025+0000 7fec357a8640 1 -- 172.21.15.12:0/1987865567 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fec300a2eb0 con 0x7fec300a4b80 2024-09-11T23:03:37.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.029+0000 7fec177fe640 1 -- 172.21.15.12:0/1987865567 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+10675 (secure 0 0 0) 0x7fec20016010 con 0x7fec300a4b80 2024-09-11T23:03:37.031 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:03:37.031 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":16,"fsid":"8be14356-3340-4500-91a2-4cbc6b511f65","created":"2024-09-11T23:03:10.620234+0000","modified":"2024-09-11T23:03:32.629844+0000","last_up_change":"2024-09-11T23:03:22.359028+0000","last_in_change":"2024-09-11T23:03:11.545817+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:03:23.587068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:03:28.893298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:03:29.993656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"153b72a1-40b1-400d-93ea-333e733f9bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6817","nonce":3680911937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6819","nonce":3680911937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6823","nonce":3680911937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6821","nonce":3680911937}]},"public_addr":"172.21.15.12:6817/3680911937","cluster_addr":"172.21.15.12:6819/3680911937","heartbeat_back_addr":"172.21.15.12:6823/3680911937","heartbeat_front_addr":"172.21.15.12:6821/3680911937","state":["exists","up"]},{"osd":1,"uuid":"94669e49-ee4f-4acf-9e25-e94374dda8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6801","nonce":236825163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6803","nonce":236825163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6807","nonce":236825163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6805","nonce":236825163}]},"public_addr":"172.21.15.12:6801/236825163","cluster_addr":"172.21.15.12:6803/236825163","heartbeat_back_addr":"172.21.15.12:6807/236825163","heartbeat_front_addr":"172.21.15.12:6805/236825163","state":["exists","up"]},{"osd":2,"uuid":"826dae4d-8888-4ec5-8f00-425b3be93814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6809","nonce":3263521655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6811","nonce":3263521655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6815","nonce":3263521655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6813","nonce":3263521655}]},"public_addr":"172.21.15.12:6809/3263521655","cluster_addr":"172.21.15.12:6811/3263521655","heartbeat_back_addr":"172.21.15.12:6815/3263521655","heartbeat_front_addr":"172.21.15.12:6813/3263521655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:19.398518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.761524+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.904997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:03:37.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.029+0000 7fec357a8640 1 -- 172.21.15.12:0/1987865567 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fec1c035e00 msgr2=0x7fec1c0382c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:37.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.029+0000 7fec357a8640 1 --2- 172.21.15.12:0/1987865567 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fec1c035e00 0x7fec1c0382c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fec24007fd0 tx=0x7fec24007980 comp rx=0 tx=0).stop 2024-09-11T23:03:37.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.029+0000 7fec357a8640 1 -- 172.21.15.12:0/1987865567 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec300a4b80 msgr2=0x7fec301ce880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:37.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.029+0000 7fec357a8640 1 --2- 172.21.15.12:0/1987865567 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec300a4b80 0x7fec301ce880 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fec20019fc0 tx=0x7fec2001abd0 comp rx=0 tx=0).stop 2024-09-11T23:03:37.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.029+0000 7fec357a8640 1 -- 172.21.15.12:0/1987865567 shutdown_connections 2024-09-11T23:03:37.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.029+0000 7fec357a8640 1 --2- 172.21.15.12:0/1987865567 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fec1c035e00 0x7fec1c0382c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:37.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.029+0000 7fec357a8640 1 --2- 172.21.15.12:0/1987865567 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec300a4b80 0x7fec301ce880 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:37.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.029+0000 7fec357a8640 1 -- 172.21.15.12:0/1987865567 >> 172.21.15.12:0/1987865567 conn(0x7fec300ac2c0 msgr2=0x7fec3013f660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:37.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.029+0000 7fec357a8640 1 -- 172.21.15.12:0/1987865567 shutdown_connections 2024-09-11T23:03:37.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.029+0000 7fec357a8640 1 -- 172.21.15.12:0/1987865567 wait complete. 2024-09-11T23:03:37.049 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-11T23:03:37.050 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-11T23:03:37.050 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-11T23:03:37.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.153+0000 7f612fdb0640 1 Processor -- start 2024-09-11T23:03:37.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.153+0000 7f612fdb0640 1 -- start start 2024-09-11T23:03:37.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.153+0000 7f52d8c3e640 1 Processor -- start 2024-09-11T23:03:37.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.153+0000 7f52d8c3e640 1 -- start start 2024-09-11T23:03:37.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.153+0000 7f612fdb0640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6128139ae0 0x7f612813bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:37.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.153+0000 7f612fdb0640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f612809c430 con 0x7f612809e890 2024-09-11T23:03:37.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.153+0000 7f612fdb0640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f612809dda0 con 0x7f6128139ae0 2024-09-11T23:03:37.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.153+0000 7f52d8c3e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f52d4136a10 0x7f52d406bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:37.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.153+0000 7f52d8c3e640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52d40a4f40 con 0x7f52d4136df0 2024-09-11T23:03:37.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.153+0000 7f52d8c3e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f52d406c8f0 con 0x7f52d4136a10 2024-09-11T23:03:37.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.153+0000 7f612d34b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6128139ae0 0x7f612813bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:37.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.153+0000 7f52d259c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f52d4136a10 0x7f52d406bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:37.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.153+0000 7f52d259c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f52d4136a10 0x7f52d406bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35138/0 (socket says 172.21.15.12:35138) 2024-09-11T23:03:37.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.153+0000 7f52d259c640 1 -- 172.21.15.12:0/3371380861 learned_addr learned my addr 172.21.15.12:0/3371380861 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:37.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.153+0000 7f52cbfff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f52d4136df0 0x7f52d409ede0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:49608/0 (socket says 172.21.15.12:49608) 2024-09-11T23:03:37.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.153+0000 7f612d34b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6128139ae0 0x7f612813bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35132/0 (socket says 172.21.15.12:35132) 2024-09-11T23:03:37.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.153+0000 7f612d34b640 1 -- 172.21.15.12:0/1331258522 learned_addr learned my addr 172.21.15.12:0/1331258522 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:37.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.153+0000 7f612d34b640 1 -- 172.21.15.12:0/1331258522 >> v1:172.21.15.12:6789/0 conn(0x7f612809e890 legacy=0x7f61281338a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:37.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.153+0000 7f612d34b640 1 -- 172.21.15.12:0/1331258522 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f612809d240 con 0x7f6128139ae0 2024-09-11T23:03:37.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.153+0000 7f52d259c640 1 -- 172.21.15.12:0/3371380861 >> v1:172.21.15.12:6789/0 conn(0x7f52d4136df0 legacy=0x7f52d409ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:37.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.153+0000 7f52d259c640 1 -- 172.21.15.12:0/3371380861 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52d40a5200 con 0x7f52d4136a10 2024-09-11T23:03:37.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.157+0000 7fa8c82b0640 1 Processor -- start 2024-09-11T23:03:37.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.157+0000 7f612d34b640 1 --2- 172.21.15.12:0/1331258522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6128139ae0 0x7f612813bed0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6118006fd0 tx=0x7f611801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed2dfa559667e2a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:37.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.157+0000 7f52d259c640 1 --2- 172.21.15.12:0/3371380861 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52d4136a10 0x7f52d406bc60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f52c40097f0 tx=0x7f52c401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5adbb30cb022cc8e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:37.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.157+0000 7fa8c82b0640 1 -- start start 2024-09-11T23:03:37.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.157+0000 7f612cb4a640 1 -- 172.21.15.12:0/1331258522 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61180b1070 con 0x7f6128139ae0 2024-09-11T23:03:37.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.157+0000 7f612cb4a640 1 -- 172.21.15.12:0/1331258522 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61180ac560 con 0x7f6128139ae0 2024-09-11T23:03:37.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.157+0000 7f52d1d9b640 1 -- 172.21.15.12:0/3371380861 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52c40b0070 con 0x7f52d4136a10 2024-09-11T23:03:37.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.157+0000 7f612cb4a640 1 -- 172.21.15.12:0/1331258522 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61180a8050 con 0x7f6128139ae0 2024-09-11T23:03:37.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.157+0000 7f52d1d9b640 1 -- 172.21.15.12:0/3371380861 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52c40ab530 con 0x7f52d4136a10 2024-09-11T23:03:37.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.157+0000 7f52d1d9b640 1 -- 172.21.15.12:0/3371380861 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52c40ab830 con 0x7f52d4136a10 2024-09-11T23:03:37.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.157+0000 7fa8c82b0640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa8c00a60c0 0x7fa8c0139f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:37.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.157+0000 7fa8c82b0640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8c0139c50 con 0x7fa8c013a4a0 2024-09-11T23:03:37.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.157+0000 7fa8c82b0640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fa8c009efe0 con 0x7fa8c00a60c0 2024-09-11T23:03:37.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.157+0000 7fa8c584b640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa8c013a4a0 0x7fa8c00a48c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:49616/0 (socket says 172.21.15.12:49616) 2024-09-11T23:03:37.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.157+0000 7fa8c604c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa8c00a60c0 0x7fa8c0139f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:37.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.157+0000 7fa8c584b640 1 -- 172.21.15.12:0/4099560953 learned_addr learned my addr 172.21.15.12:0/4099560953 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:03:37.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.157+0000 7f612fdb0640 1 -- 172.21.15.12:0/1331258522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6128139ae0 msgr2=0x7f612813bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:37.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.157+0000 7f612fdb0640 1 --2- 172.21.15.12:0/1331258522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6128139ae0 0x7f612813bed0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6118006fd0 tx=0x7f611801c4c0 comp rx=0 tx=0).stop 2024-09-11T23:03:37.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.157+0000 7f52d8c3e640 1 -- 172.21.15.12:0/3371380861 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52d4136a10 msgr2=0x7f52d406bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:37.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.157+0000 7f52d8c3e640 1 --2- 172.21.15.12:0/3371380861 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52d4136a10 0x7f52d406bc60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f52c40097f0 tx=0x7f52c401c450 comp rx=0 tx=0).stop 2024-09-11T23:03:37.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.157+0000 7fa8c604c640 1 -- 172.21.15.12:0/4099560953 >> v1:172.21.15.12:6789/0 conn(0x7fa8c013a4a0 legacy=0x7fa8c00a48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:37.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.157+0000 7fa8c604c640 1 -- 172.21.15.12:0/4099560953 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8c009f860 con 0x7fa8c00a60c0 2024-09-11T23:03:37.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.157+0000 7f612fdb0640 1 -- 172.21.15.12:0/1331258522 shutdown_connections 2024-09-11T23:03:37.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.157+0000 7f612fdb0640 1 --2- 172.21.15.12:0/1331258522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6128139ae0 0x7f612813bed0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:37.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.157+0000 7f612fdb0640 1 -- 172.21.15.12:0/1331258522 >> 172.21.15.12:0/1331258522 conn(0x7f612806f940 msgr2=0x7f6128071d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:37.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.157+0000 7f52d8c3e640 1 -- 172.21.15.12:0/3371380861 shutdown_connections 2024-09-11T23:03:37.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.157+0000 7f612fdb0640 1 -- 172.21.15.12:0/1331258522 shutdown_connections 2024-09-11T23:03:37.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.157+0000 7f52d8c3e640 1 --2- 172.21.15.12:0/3371380861 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52d4136a10 0x7f52d406bc60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:37.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.157+0000 7f52d8c3e640 1 -- 172.21.15.12:0/3371380861 >> 172.21.15.12:0/3371380861 conn(0x7f52d4067e00 msgr2=0x7f52d4068210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:37.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.157+0000 7f612fdb0640 1 -- 172.21.15.12:0/1331258522 wait complete. 2024-09-11T23:03:37.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.157+0000 7f52d8c3e640 1 -- 172.21.15.12:0/3371380861 shutdown_connections 2024-09-11T23:03:37.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.157+0000 7f52d8c3e640 1 -- 172.21.15.12:0/3371380861 wait complete. 2024-09-11T23:03:37.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.157+0000 7f52d8c3e640 1 Processor -- start 2024-09-11T23:03:37.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.157+0000 7f612fdb0640 1 Processor -- start 2024-09-11T23:03:37.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.157+0000 7f52d8c3e640 1 -- start start 2024-09-11T23:03:37.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.157+0000 7f612fdb0640 1 -- start start 2024-09-11T23:03:37.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7f52d8c3e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52d4136a10 0x7f52d406fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:37.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7f52d8c3e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f52d4142050 con 0x7f52d4136a10 2024-09-11T23:03:37.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7f612fdb0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f612809e890 0x7f61280724b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:37.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7f612fdb0640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f612813ec30 con 0x7f612809e890 2024-09-11T23:03:37.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7f52d259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52d4136a10 0x7f52d406fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:37.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7f612db4c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f612809e890 0x7f61280724b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:37.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7f52d259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52d4136a10 0x7f52d406fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35150/0 (socket says 172.21.15.12:35150) 2024-09-11T23:03:37.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7f52d259c640 1 -- 172.21.15.12:0/444234676 learned_addr learned my addr 172.21.15.12:0/444234676 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:37.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7f612db4c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f612809e890 0x7f61280724b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35154/0 (socket says 172.21.15.12:35154) 2024-09-11T23:03:37.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7f612db4c640 1 -- 172.21.15.12:0/4047234682 learned_addr learned my addr 172.21.15.12:0/4047234682 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:37.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7f52d259c640 1 -- 172.21.15.12:0/444234676 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52d413b470 con 0x7f52d4136a10 2024-09-11T23:03:37.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7f612db4c640 1 -- 172.21.15.12:0/4047234682 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61281359b0 con 0x7f612809e890 2024-09-11T23:03:37.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7f612db4c640 1 --2- 172.21.15.12:0/4047234682 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f612809e890 0x7f61280724b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f612400c340 tx=0x7f612400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:37.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7f52d259c640 1 --2- 172.21.15.12:0/444234676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52d4136a10 0x7f52d406fee0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f52c4019060 tx=0x7f52c40191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:37.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7fa8c604c640 1 --2- 172.21.15.12:0/4099560953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8c00a60c0 0x7fa8c0139f60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8009740 tx=0x7fa8b801c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0eb12cbce944393 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:37.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7f52caffd640 1 -- 172.21.15.12:0/444234676 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52c40b0040 con 0x7f52d4136a10 2024-09-11T23:03:37.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7f52caffd640 1 -- 172.21.15.12:0/444234676 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52c40b4440 con 0x7f52d4136a10 2024-09-11T23:03:37.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7f52caffd640 1 -- 172.21.15.12:0/444234676 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52c40b4760 con 0x7f52d4136a10 2024-09-11T23:03:37.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7f611e7fc640 1 -- 172.21.15.12:0/4047234682 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6124005150 con 0x7f612809e890 2024-09-11T23:03:37.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7fa8c504a640 1 -- 172.21.15.12:0/4099560953 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8b80b0070 con 0x7fa8c00a60c0 2024-09-11T23:03:37.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7f611e7fc640 1 -- 172.21.15.12:0/4047234682 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61240052f0 con 0x7f612809e890 2024-09-11T23:03:37.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7f612fdb0640 1 -- 172.21.15.12:0/4047234682 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61280a0100 con 0x7f612809e890 2024-09-11T23:03:37.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7fa8c504a640 1 -- 172.21.15.12:0/4099560953 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8b80ab530 con 0x7fa8c00a60c0 2024-09-11T23:03:37.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7fa8c504a640 1 -- 172.21.15.12:0/4099560953 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8b80ab830 con 0x7fa8c00a60c0 2024-09-11T23:03:37.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7f611e7fc640 1 -- 172.21.15.12:0/4047234682 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6124007030 con 0x7f612809e890 2024-09-11T23:03:37.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7f612fdb0640 1 -- 172.21.15.12:0/4047234682 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61281356a0 con 0x7f612809e890 2024-09-11T23:03:37.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7f52d8c3e640 1 -- 172.21.15.12:0/444234676 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52d413fb30 con 0x7f52d4136a10 2024-09-11T23:03:37.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7f52d8c3e640 1 -- 172.21.15.12:0/444234676 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52d40726f0 con 0x7f52d4136a10 2024-09-11T23:03:37.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7f612fdb0640 1 -- 172.21.15.12:0/4047234682 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f612813bf10 con 0x7f612809e890 2024-09-11T23:03:37.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7f52caffd640 1 -- 172.21.15.12:0/444234676 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f52c40bb020 con 0x7f52d4136a10 2024-09-11T23:03:37.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7f52d8c3e640 1 -- 172.21.15.12:0/444234676 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f52d40a8880 con 0x7f52d4136a10 2024-09-11T23:03:37.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7f611e7fc640 1 -- 172.21.15.12:0/4047234682 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6124019020 con 0x7f612809e890 2024-09-11T23:03:37.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7f52caffd640 1 --2- 172.21.15.12:0/444234676 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f52b4035d60 0x7f52b4038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:37.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7f52caffd640 1 -- 172.21.15.12:0/444234676 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3439+0+0 (secure 0 0 0) 0x7f52c40b9020 con 0x7f52d4136a10 2024-09-11T23:03:37.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7f52cbfff640 1 --2- 172.21.15.12:0/444234676 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f52b4035d60 0x7f52b4038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:37.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7f611e7fc640 1 --2- 172.21.15.12:0/4047234682 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f610c035e30 0x7f610c0382f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:37.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7f52caffd640 1 --2- 172.21.15.12:0/444234676 >> [v2:172.21.15.12:6808/3263521655,v1:172.21.15.12:6809/3263521655] conn(0x7f52b403cba0 0x7f52b403efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:37.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7f52caffd640 1 -- 172.21.15.12:0/444234676 --> [v2:172.21.15.12:6808/3263521655,v1:172.21.15.12:6809/3263521655] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f52c40afe50 con 0x7f52b403cba0 2024-09-11T23:03:37.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7f52caffd640 1 -- 172.21.15.12:0/444234676 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f52c40e62a0 con 0x7f52d4136a10 2024-09-11T23:03:37.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7f611e7fc640 1 -- 172.21.15.12:0/4047234682 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3439+0+0 (secure 0 0 0) 0x7f61240478b0 con 0x7f612809e890 2024-09-11T23:03:37.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7f612d34b640 1 --2- 172.21.15.12:0/4047234682 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f610c035e30 0x7f610c0382f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:37.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7f52d2d9d640 1 --2- 172.21.15.12:0/444234676 >> [v2:172.21.15.12:6808/3263521655,v1:172.21.15.12:6809/3263521655] conn(0x7f52b403cba0 0x7f52b403efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:37.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7fa8c82b0640 1 -- 172.21.15.12:0/4099560953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8c00a60c0 msgr2=0x7fa8c0139f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:37.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7fa8c82b0640 1 --2- 172.21.15.12:0/4099560953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8c00a60c0 0x7fa8c0139f60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8009740 tx=0x7fa8b801c390 comp rx=0 tx=0).stop 2024-09-11T23:03:37.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7f611e7fc640 1 --2- 172.21.15.12:0/4047234682 >> [v2:172.21.15.12:6800/236825163,v1:172.21.15.12:6801/236825163] conn(0x7f610c03cdd0 0x7f610c03f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:37.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7f611e7fc640 1 -- 172.21.15.12:0/4047234682 --> [v2:172.21.15.12:6800/236825163,v1:172.21.15.12:6801/236825163] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f610c03f8e0 con 0x7f610c03cdd0 2024-09-11T23:03:37.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7f611e7fc640 1 -- 172.21.15.12:0/4047234682 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f612404c220 con 0x7f612809e890 2024-09-11T23:03:37.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7f612e34d640 1 --2- 172.21.15.12:0/4047234682 >> [v2:172.21.15.12:6800/236825163,v1:172.21.15.12:6801/236825163] conn(0x7f610c03cdd0 0x7f610c03f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:37.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7fa8c82b0640 1 -- 172.21.15.12:0/4099560953 shutdown_connections 2024-09-11T23:03:37.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7fa8c82b0640 1 --2- 172.21.15.12:0/4099560953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8c00a60c0 0x7fa8c0139f60 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:37.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7fa8c82b0640 1 -- 172.21.15.12:0/4099560953 >> 172.21.15.12:0/4099560953 conn(0x7fa8c00a94b0 msgr2=0x7fa8c00a59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:37.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7fa8c82b0640 1 -- 172.21.15.12:0/4099560953 shutdown_connections 2024-09-11T23:03:37.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7fa8c82b0640 1 -- 172.21.15.12:0/4099560953 wait complete. 2024-09-11T23:03:37.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7f52cbfff640 1 --2- 172.21.15.12:0/444234676 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f52b4035d60 0x7f52b4038220 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f52bc001600 tx=0x7f52bc007a50 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:37.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7f612d34b640 1 --2- 172.21.15.12:0/4047234682 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f610c035e30 0x7f610c0382f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f61180ae000 tx=0x7f61180a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:37.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7f52d2d9d640 1 --2- 172.21.15.12:0/444234676 >> [v2:172.21.15.12:6808/3263521655,v1:172.21.15.12:6809/3263521655] conn(0x7f52b403cba0 0x7f52b403efe0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:37.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.161+0000 7f612e34d640 1 --2- 172.21.15.12:0/4047234682 >> [v2:172.21.15.12:6800/236825163,v1:172.21.15.12:6801/236825163] conn(0x7f610c03cdd0 0x7f610c03f210 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:37.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.165+0000 7f611e7fc640 1 -- 172.21.15.12:0/4047234682 <== osd.1 v2:172.21.15.12:6800/236825163 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f610c03f8e0 con 0x7f610c03cdd0 2024-09-11T23:03:37.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.165+0000 7fa8c82b0640 1 Processor -- start 2024-09-11T23:03:37.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.165+0000 7f52caffd640 1 -- 172.21.15.12:0/444234676 <== osd.2 v2:172.21.15.12:6808/3263521655 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f52c40afe50 con 0x7f52b403cba0 2024-09-11T23:03:37.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.165+0000 7fa8c82b0640 1 -- start start 2024-09-11T23:03:37.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.165+0000 7fa8c82b0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8c00a60c0 0x7fa8c013c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:37.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.165+0000 7fa8c82b0640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c01421a0 con 0x7fa8c00a60c0 2024-09-11T23:03:37.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.165+0000 7fa8c604c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8c00a60c0 0x7fa8c013c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:37.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.165+0000 7fa8c604c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8c00a60c0 0x7fa8c013c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35158/0 (socket says 172.21.15.12:35158) 2024-09-11T23:03:37.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.165+0000 7fa8c604c640 1 -- 172.21.15.12:0/940778066 learned_addr learned my addr 172.21.15.12:0/940778066 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:37.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.165+0000 7fa8c604c640 1 -- 172.21.15.12:0/940778066 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8c01201e0 con 0x7fa8c00a60c0 2024-09-11T23:03:37.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.165+0000 7fa8c604c640 1 --2- 172.21.15.12:0/940778066 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8c00a60c0 0x7fa8c013c5f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa8b80ae040 tx=0x7fa8b8019130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:37.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.165+0000 7fa8beffd640 1 -- 172.21.15.12:0/940778066 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8b80b8020 con 0x7fa8c00a60c0 2024-09-11T23:03:37.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.165+0000 7fa8beffd640 1 -- 172.21.15.12:0/940778066 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8b80b4410 con 0x7fa8c00a60c0 2024-09-11T23:03:37.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.165+0000 7fa8c82b0640 1 -- 172.21.15.12:0/940778066 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8c011f7a0 con 0x7fa8c00a60c0 2024-09-11T23:03:37.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.165+0000 7fa8beffd640 1 -- 172.21.15.12:0/940778066 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8b80b0040 con 0x7fa8c00a60c0 2024-09-11T23:03:37.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.165+0000 7fa8c82b0640 1 -- 172.21.15.12:0/940778066 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8c0138dd0 con 0x7fa8c00a60c0 2024-09-11T23:03:37.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.165+0000 7fa8c82b0640 1 -- 172.21.15.12:0/940778066 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa8c0139f60 con 0x7fa8c00a60c0 2024-09-11T23:03:37.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.165+0000 7fa8beffd640 1 -- 172.21.15.12:0/940778066 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa8b80bb020 con 0x7fa8c00a60c0 2024-09-11T23:03:37.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.165+0000 7fa8beffd640 1 --2- 172.21.15.12:0/940778066 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fa8ac035db0 0x7fa8ac038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:37.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.165+0000 7fa8beffd640 1 -- 172.21.15.12:0/940778066 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3439+0+0 (secure 0 0 0) 0x7fa8b80e2320 con 0x7fa8c00a60c0 2024-09-11T23:03:37.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.165+0000 7fa8beffd640 1 --2- 172.21.15.12:0/940778066 >> [v2:172.21.15.12:6816/3680911937,v1:172.21.15.12:6817/3680911937] conn(0x7fa8ac03cc70 0x7fa8ac03f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:37.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.165+0000 7fa8beffd640 1 -- 172.21.15.12:0/940778066 --> [v2:172.21.15.12:6816/3680911937,v1:172.21.15.12:6817/3680911937] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa8b80a9ec0 con 0x7fa8ac03cc70 2024-09-11T23:03:37.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.165+0000 7fa8beffd640 1 -- 172.21.15.12:0/940778066 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7fa8b80e9050 con 0x7fa8c00a60c0 2024-09-11T23:03:37.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.165+0000 7fa8c584b640 1 --2- 172.21.15.12:0/940778066 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fa8ac035db0 0x7fa8ac038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:37.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.165+0000 7fa8c684d640 1 --2- 172.21.15.12:0/940778066 >> [v2:172.21.15.12:6816/3680911937,v1:172.21.15.12:6817/3680911937] conn(0x7fa8ac03cc70 0x7fa8ac03f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:37.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.165+0000 7fa8c584b640 1 --2- 172.21.15.12:0/940778066 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fa8ac035db0 0x7fa8ac038270 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa8b4001570 tx=0x7fa8b4007ad0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:37.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.165+0000 7fa8c684d640 1 --2- 172.21.15.12:0/940778066 >> [v2:172.21.15.12:6816/3680911937,v1:172.21.15.12:6817/3680911937] conn(0x7fa8ac03cc70 0x7fa8ac03f0b0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:37.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.169+0000 7fa8beffd640 1 -- 172.21.15.12:0/940778066 <== osd.0 v2:172.21.15.12:6816/3680911937 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa8b80a9ec0 con 0x7fa8ac03cc70 2024-09-11T23:03:37.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.177+0000 7f52d8c3e640 1 -- 172.21.15.12:0/444234676 --> [v2:172.21.15.12:6808/3263521655,v1:172.21.15.12:6809/3263521655] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f52d413ada0 con 0x7f52b403cba0 2024-09-11T23:03:37.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.177+0000 7f612fdb0640 1 -- 172.21.15.12:0/4047234682 --> [v2:172.21.15.12:6800/236825163,v1:172.21.15.12:6801/236825163] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f61281338a0 con 0x7f610c03cdd0 2024-09-11T23:03:37.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.177+0000 7f52caffd640 1 -- 172.21.15.12:0/444234676 <== osd.2 v2:172.21.15.12:6808/3263521655 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f52cc00ad10 con 0x7f52b403cba0 2024-09-11T23:03:37.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.177+0000 7f611e7fc640 1 -- 172.21.15.12:0/4047234682 <== osd.1 v2:172.21.15.12:6800/236825163 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f61281338a0 con 0x7f610c03cdd0 2024-09-11T23:03:37.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.181+0000 7f52d8c3e640 1 -- 172.21.15.12:0/444234676 >> [v2:172.21.15.12:6808/3263521655,v1:172.21.15.12:6809/3263521655] conn(0x7f52b403cba0 msgr2=0x7f52b403efe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:37.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.181+0000 7f52d8c3e640 1 --2- 172.21.15.12:0/444234676 >> [v2:172.21.15.12:6808/3263521655,v1:172.21.15.12:6809/3263521655] conn(0x7f52b403cba0 0x7f52b403efe0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:37.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.181+0000 7f52d8c3e640 1 -- 172.21.15.12:0/444234676 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f52b4035d60 msgr2=0x7f52b4038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:37.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.181+0000 7f52d8c3e640 1 --2- 172.21.15.12:0/444234676 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f52b4035d60 0x7f52b4038220 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f52bc001600 tx=0x7f52bc007a50 comp rx=0 tx=0).stop 2024-09-11T23:03:37.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.181+0000 7f612fdb0640 1 -- 172.21.15.12:0/4047234682 >> [v2:172.21.15.12:6800/236825163,v1:172.21.15.12:6801/236825163] conn(0x7f610c03cdd0 msgr2=0x7f610c03f210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:37.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.181+0000 7f612fdb0640 1 --2- 172.21.15.12:0/4047234682 >> [v2:172.21.15.12:6800/236825163,v1:172.21.15.12:6801/236825163] conn(0x7f610c03cdd0 0x7f610c03f210 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:37.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.181+0000 7f52d8c3e640 1 -- 172.21.15.12:0/444234676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52d4136a10 msgr2=0x7f52d406fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:37.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.181+0000 7f52d8c3e640 1 --2- 172.21.15.12:0/444234676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52d4136a10 0x7f52d406fee0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f52c4019060 tx=0x7f52c40191f0 comp rx=0 tx=0).stop 2024-09-11T23:03:37.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.181+0000 7f612fdb0640 1 -- 172.21.15.12:0/4047234682 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f610c035e30 msgr2=0x7f610c0382f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:37.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.181+0000 7f612fdb0640 1 --2- 172.21.15.12:0/4047234682 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f610c035e30 0x7f610c0382f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f61180ae000 tx=0x7f61180a7000 comp rx=0 tx=0).stop 2024-09-11T23:03:37.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.181+0000 7f612fdb0640 1 -- 172.21.15.12:0/4047234682 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f612809e890 msgr2=0x7f61280724b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:37.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.181+0000 7f612fdb0640 1 --2- 172.21.15.12:0/4047234682 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f612809e890 0x7f61280724b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f612400c340 tx=0x7f612400c800 comp rx=0 tx=0).stop 2024-09-11T23:03:37.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.181+0000 7f52d8c3e640 1 -- 172.21.15.12:0/444234676 shutdown_connections 2024-09-11T23:03:37.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.181+0000 7f52d8c3e640 1 --2- 172.21.15.12:0/444234676 >> [v2:172.21.15.12:6808/3263521655,v1:172.21.15.12:6809/3263521655] conn(0x7f52b403cba0 0x7f52b403efe0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:37.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.181+0000 7f52d8c3e640 1 --2- 172.21.15.12:0/444234676 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f52b4035d60 0x7f52b4038220 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:37.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.181+0000 7f52d8c3e640 1 --2- 172.21.15.12:0/444234676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52d4136a10 0x7f52d406fee0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:37.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.181+0000 7f52d8c3e640 1 -- 172.21.15.12:0/444234676 >> 172.21.15.12:0/444234676 conn(0x7f52d4067e00 msgr2=0x7f52d4135fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:37.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.181+0000 7f612fdb0640 1 -- 172.21.15.12:0/4047234682 shutdown_connections 2024-09-11T23:03:37.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.181+0000 7f612fdb0640 1 --2- 172.21.15.12:0/4047234682 >> [v2:172.21.15.12:6800/236825163,v1:172.21.15.12:6801/236825163] conn(0x7f610c03cdd0 0x7f610c03f210 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:37.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.181+0000 7f612fdb0640 1 --2- 172.21.15.12:0/4047234682 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f610c035e30 0x7f610c0382f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:37.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.181+0000 7f612fdb0640 1 --2- 172.21.15.12:0/4047234682 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f612809e890 0x7f61280724b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:37.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.181+0000 7f612fdb0640 1 -- 172.21.15.12:0/4047234682 >> 172.21.15.12:0/4047234682 conn(0x7f612806f940 msgr2=0x7f612812ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:37.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.181+0000 7f52d8c3e640 1 -- 172.21.15.12:0/444234676 shutdown_connections 2024-09-11T23:03:37.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.181+0000 7f612fdb0640 1 -- 172.21.15.12:0/4047234682 shutdown_connections 2024-09-11T23:03:37.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.181+0000 7f52d8c3e640 1 -- 172.21.15.12:0/444234676 wait complete. 2024-09-11T23:03:37.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.181+0000 7f612fdb0640 1 -- 172.21.15.12:0/4047234682 wait complete. 2024-09-11T23:03:37.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.181+0000 7fa8c82b0640 1 -- 172.21.15.12:0/940778066 --> [v2:172.21.15.12:6816/3680911937,v1:172.21.15.12:6817/3680911937] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa8c013e570 con 0x7fa8ac03cc70 2024-09-11T23:03:37.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.181+0000 7fa8beffd640 1 -- 172.21.15.12:0/940778066 <== osd.0 v2:172.21.15.12:6816/3680911937 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa8c013e570 con 0x7fa8ac03cc70 2024-09-11T23:03:37.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.181+0000 7fa8c82b0640 1 -- 172.21.15.12:0/940778066 >> [v2:172.21.15.12:6816/3680911937,v1:172.21.15.12:6817/3680911937] conn(0x7fa8ac03cc70 msgr2=0x7fa8ac03f0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:37.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.181+0000 7fa8c82b0640 1 --2- 172.21.15.12:0/940778066 >> [v2:172.21.15.12:6816/3680911937,v1:172.21.15.12:6817/3680911937] conn(0x7fa8ac03cc70 0x7fa8ac03f0b0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:37.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.181+0000 7fa8c82b0640 1 -- 172.21.15.12:0/940778066 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fa8ac035db0 msgr2=0x7fa8ac038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:37.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.181+0000 7fa8c82b0640 1 --2- 172.21.15.12:0/940778066 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fa8ac035db0 0x7fa8ac038270 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa8b4001570 tx=0x7fa8b4007ad0 comp rx=0 tx=0).stop 2024-09-11T23:03:37.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.181+0000 7fa8c82b0640 1 -- 172.21.15.12:0/940778066 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8c00a60c0 msgr2=0x7fa8c013c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:37.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.181+0000 7fa8c82b0640 1 --2- 172.21.15.12:0/940778066 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8c00a60c0 0x7fa8c013c5f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa8b80ae040 tx=0x7fa8b8019130 comp rx=0 tx=0).stop 2024-09-11T23:03:37.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.181+0000 7fa8c82b0640 1 -- 172.21.15.12:0/940778066 shutdown_connections 2024-09-11T23:03:37.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.181+0000 7fa8c82b0640 1 --2- 172.21.15.12:0/940778066 >> [v2:172.21.15.12:6816/3680911937,v1:172.21.15.12:6817/3680911937] conn(0x7fa8ac03cc70 0x7fa8ac03f0b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:37.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.181+0000 7fa8c82b0640 1 --2- 172.21.15.12:0/940778066 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fa8ac035db0 0x7fa8ac038270 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:37.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.181+0000 7fa8c82b0640 1 --2- 172.21.15.12:0/940778066 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8c00a60c0 0x7fa8c013c5f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:37.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.181+0000 7fa8c82b0640 1 -- 172.21.15.12:0/940778066 >> 172.21.15.12:0/940778066 conn(0x7fa8c00a94b0 msgr2=0x7fa8c00a8790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:37.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.181+0000 7fa8c82b0640 1 -- 172.21.15.12:0/940778066 shutdown_connections 2024-09-11T23:03:37.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.181+0000 7fa8c82b0640 1 -- 172.21.15.12:0/940778066 wait complete. 2024-09-11T23:03:37.203 INFO:teuthology.orchestra.run.smithi012.stdout:34359738373 2024-09-11T23:03:37.203 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-11T23:03:37.204 INFO:teuthology.orchestra.run.smithi012.stdout:34359738373 2024-09-11T23:03:37.204 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-11T23:03:37.205 INFO:teuthology.orchestra.run.smithi012.stdout:34359738373 2024-09-11T23:03:37.206 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-11T23:03:37.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.305+0000 7f128c54e640 1 Processor -- start 2024-09-11T23:03:37.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.305+0000 7f128c54e640 1 -- start start 2024-09-11T23:03:37.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.305+0000 7f128c54e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1284073740 0x7f1284072af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:37.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.305+0000 7f128c54e640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1284070cc0 con 0x7f1284137e50 2024-09-11T23:03:37.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.305+0000 7f128c54e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f1284072330 con 0x7f1284073740 2024-09-11T23:03:37.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.305+0000 7f1289ae9640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1284073740 0x7f1284072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:37.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.305+0000 7f1289ae9640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1284073740 0x7f1284072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35166/0 (socket says 172.21.15.12:35166) 2024-09-11T23:03:37.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.305+0000 7f1289ae9640 1 -- 172.21.15.12:0/397975005 learned_addr learned my addr 172.21.15.12:0/397975005 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:37.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.305+0000 7f128a2ea640 1 --1- 172.21.15.12:0/397975005 >> v1:172.21.15.12:6789/0 conn(0x7f1284137e50 0x7f1284138230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:49618/0 (socket says 172.21.15.12:49618) 2024-09-11T23:03:37.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.305+0000 7f1289ae9640 1 -- 172.21.15.12:0/397975005 >> v1:172.21.15.12:6789/0 conn(0x7f1284137e50 legacy=0x7f1284138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:37.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.305+0000 7f1289ae9640 1 -- 172.21.15.12:0/397975005 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12840a6810 con 0x7f1284073740 2024-09-11T23:03:37.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.305+0000 7f1289ae9640 1 --2- 172.21.15.12:0/397975005 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1284073740 0x7f1284072af0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f12740097f0 tx=0x7f127401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8903eba29cf6283 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:37.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.309+0000 7f12892e8640 1 -- 172.21.15.12:0/397975005 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12740aa590 con 0x7f1284073740 2024-09-11T23:03:37.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.309+0000 7f12892e8640 1 -- 172.21.15.12:0/397975005 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12740af070 con 0x7f1284073740 2024-09-11T23:03:37.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.309+0000 7f12892e8640 1 -- 172.21.15.12:0/397975005 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12740aa880 con 0x7f1284073740 2024-09-11T23:03:37.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.309+0000 7f128c54e640 1 -- 172.21.15.12:0/397975005 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1284073740 msgr2=0x7f1284072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:37.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.309+0000 7f128c54e640 1 --2- 172.21.15.12:0/397975005 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1284073740 0x7f1284072af0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f12740097f0 tx=0x7f127401c4e0 comp rx=0 tx=0).stop 2024-09-11T23:03:37.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.309+0000 7f128c54e640 1 -- 172.21.15.12:0/397975005 shutdown_connections 2024-09-11T23:03:37.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.309+0000 7f128c54e640 1 --2- 172.21.15.12:0/397975005 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1284073740 0x7f1284072af0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:37.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.309+0000 7f128c54e640 1 -- 172.21.15.12:0/397975005 >> 172.21.15.12:0/397975005 conn(0x7f12840aa140 msgr2=0x7f12840aa550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:37.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.309+0000 7f128c54e640 1 -- 172.21.15.12:0/397975005 shutdown_connections 2024-09-11T23:03:37.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.309+0000 7f128c54e640 1 -- 172.21.15.12:0/397975005 wait complete. 2024-09-11T23:03:37.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.309+0000 7f128c54e640 1 Processor -- start 2024-09-11T23:03:37.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.309+0000 7f128c54e640 1 -- start start 2024-09-11T23:03:37.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.309+0000 7f128c54e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1284073740 0x7f128409ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:37.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.309+0000 7f128c54e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f128413f7d0 con 0x7f1284073740 2024-09-11T23:03:37.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.309+0000 7f128a2ea640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1284073740 0x7f128409ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:37.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.309+0000 7f128a2ea640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1284073740 0x7f128409ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35168/0 (socket says 172.21.15.12:35168) 2024-09-11T23:03:37.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.309+0000 7f128a2ea640 1 -- 172.21.15.12:0/740802467 learned_addr learned my addr 172.21.15.12:0/740802467 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:37.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.309+0000 7f128a2ea640 1 -- 172.21.15.12:0/740802467 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f128406e4e0 con 0x7f1284073740 2024-09-11T23:03:37.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.309+0000 7f128a2ea640 1 --2- 172.21.15.12:0/740802467 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1284073740 0x7f128409ee10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f128000c410 tx=0x7f128000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:37.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.309+0000 7f127affd640 1 -- 172.21.15.12:0/740802467 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1280007410 con 0x7f1284073740 2024-09-11T23:03:37.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.309+0000 7f127affd640 1 -- 172.21.15.12:0/740802467 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12800075b0 con 0x7f1284073740 2024-09-11T23:03:37.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.309+0000 7f128c54e640 1 -- 172.21.15.12:0/740802467 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f128406d570 con 0x7f1284073740 2024-09-11T23:03:37.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.309+0000 7f127affd640 1 -- 172.21.15.12:0/740802467 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1280004920 con 0x7f1284073740 2024-09-11T23:03:37.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.309+0000 7f128c54e640 1 -- 172.21.15.12:0/740802467 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f128406dca0 con 0x7f1284073740 2024-09-11T23:03:37.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.313+0000 7f128c54e640 1 -- 172.21.15.12:0/740802467 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1284072af0 con 0x7f1284073740 2024-09-11T23:03:37.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.313+0000 7f127affd640 1 -- 172.21.15.12:0/740802467 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f128001a020 con 0x7f1284073740 2024-09-11T23:03:37.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.313+0000 7f127affd640 1 --2- 172.21.15.12:0/740802467 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f1268035d60 0x7f1268038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:37.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.313+0000 7f127affd640 1 -- 172.21.15.12:0/740802467 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3439+0+0 (secure 0 0 0) 0x7f1280047ed0 con 0x7f1284073740 2024-09-11T23:03:37.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.313+0000 7f1289ae9640 1 --2- 172.21.15.12:0/740802467 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f1268035d60 0x7f1268038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:37.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.313+0000 7f1289ae9640 1 --2- 172.21.15.12:0/740802467 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f1268035d60 0x7f1268038220 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f12740ae000 tx=0x7f12740a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:37.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.321+0000 7f127affd640 1 -- 172.21.15.12:0/740802467 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1280004b80 con 0x7f1284073740 2024-09-11T23:03:37.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.349+0000 7f23c91f5640 1 Processor -- start 2024-09-11T23:03:37.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.349+0000 7f23c91f5640 1 -- start start 2024-09-11T23:03:37.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.349+0000 7f23c91f5640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f23c413a200 0x7f23c413a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:37.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.349+0000 7f23c91f5640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23c40a1c00 con 0x7f23c409fc40 2024-09-11T23:03:37.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.349+0000 7f23c91f5640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f23c40a0e40 con 0x7f23c413a200 2024-09-11T23:03:37.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.349+0000 7f23c2d9d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f23c413a200 0x7f23c413a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:37.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.349+0000 7f23c259c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f23c409fc40 0x7f23c409d9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:49628/0 (socket says 172.21.15.12:49628) 2024-09-11T23:03:37.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.349+0000 7f23c259c640 1 -- 172.21.15.12:0/1237052192 learned_addr learned my addr 172.21.15.12:0/1237052192 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:03:37.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.349+0000 7f23c2d9d640 1 -- 172.21.15.12:0/1237052192 >> v1:172.21.15.12:6789/0 conn(0x7f23c409fc40 legacy=0x7f23c409d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:37.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.349+0000 7f23c2d9d640 1 -- 172.21.15.12:0/1237052192 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23c413ab20 con 0x7f23c413a200 2024-09-11T23:03:37.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.349+0000 7f23c2d9d640 1 --2- 172.21.15.12:0/1237052192 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23c413a200 0x7f23c413a5e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f23b4009740 tx=0x7f23b401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a23c315db2c096b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:37.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.349+0000 7f23c1d9b640 1 -- 172.21.15.12:0/1237052192 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23b40b0070 con 0x7f23c413a200 2024-09-11T23:03:37.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.349+0000 7f23c1d9b640 1 -- 172.21.15.12:0/1237052192 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23b40ab530 con 0x7f23c413a200 2024-09-11T23:03:37.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.349+0000 7f23c1d9b640 1 -- 172.21.15.12:0/1237052192 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23b40ab830 con 0x7f23c413a200 2024-09-11T23:03:37.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.353+0000 7f23c91f5640 1 -- 172.21.15.12:0/1237052192 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23c413a200 msgr2=0x7f23c413a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:37.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.353+0000 7f23c91f5640 1 --2- 172.21.15.12:0/1237052192 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23c413a200 0x7f23c413a5e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f23b4009740 tx=0x7f23b401c390 comp rx=0 tx=0).stop 2024-09-11T23:03:37.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.353+0000 7f23c91f5640 1 -- 172.21.15.12:0/1237052192 shutdown_connections 2024-09-11T23:03:37.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.353+0000 7f23c91f5640 1 --2- 172.21.15.12:0/1237052192 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23c413a200 0x7f23c413a5e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:37.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.353+0000 7f23c91f5640 1 -- 172.21.15.12:0/1237052192 >> 172.21.15.12:0/1237052192 conn(0x7f23c406da30 msgr2=0x7f23c406de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:37.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.353+0000 7f23c91f5640 1 -- 172.21.15.12:0/1237052192 shutdown_connections 2024-09-11T23:03:37.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.353+0000 7f23c91f5640 1 -- 172.21.15.12:0/1237052192 wait complete. 2024-09-11T23:03:37.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.353+0000 7f60acdd2640 1 Processor -- start 2024-09-11T23:03:37.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.353+0000 7f60acdd2640 1 -- start start 2024-09-11T23:03:37.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.353+0000 7f23c91f5640 1 Processor -- start 2024-09-11T23:03:37.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.353+0000 7f23c91f5640 1 -- start start 2024-09-11T23:03:37.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.353+0000 7f60acdd2640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f60a80a9ef0 0x7f60a809c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:37.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.353+0000 7f60acdd2640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60a809cfa0 con 0x7f60a80a9b10 2024-09-11T23:03:37.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.353+0000 7f60acdd2640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f60a809e150 con 0x7f60a80a9ef0 2024-09-11T23:03:37.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.353+0000 7f60a5d9b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f60a80a9ef0 0x7f60a809c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:37.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.353+0000 7f23c91f5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23c413a200 0x7f23c40a55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:37.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.353+0000 7f23c91f5640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f23c40a17c0 con 0x7f23c413a200 2024-09-11T23:03:37.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.353+0000 7f60a659c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f60a80a9b10 0x7f60a809a9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:49632/0 (socket says 172.21.15.12:49632) 2024-09-11T23:03:37.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.353+0000 7f60a659c640 1 -- 172.21.15.12:0/3719760309 learned_addr learned my addr 172.21.15.12:0/3719760309 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:03:37.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.353+0000 7f60a5d9b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f60a80a9ef0 0x7f60a809c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35182/0 (socket says 172.21.15.12:35182) 2024-09-11T23:03:37.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.353+0000 7f23c2d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23c413a200 0x7f23c40a55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:37.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.353+0000 7f23c2d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23c413a200 0x7f23c40a55f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35192/0 (socket says 172.21.15.12:35192) 2024-09-11T23:03:37.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.353+0000 7f23c2d9d640 1 -- 172.21.15.12:0/3023156657 learned_addr learned my addr 172.21.15.12:0/3023156657 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:37.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.353+0000 7f60a5d9b640 1 -- 172.21.15.12:0/3719760309 >> v1:172.21.15.12:6789/0 conn(0x7f60a80a9b10 legacy=0x7f60a809a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:37.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.353+0000 7f60a559a640 1 -- 172.21.15.12:0/3719760309 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3722970913 0 0) 0x7f60a809cfa0 con 0x7f60a80a9b10 2024-09-11T23:03:37.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.353+0000 7f60a5d9b640 1 -- 172.21.15.12:0/3719760309 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60a809d6f0 con 0x7f60a80a9ef0 2024-09-11T23:03:37.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.353+0000 7f23c2d9d640 1 -- 172.21.15.12:0/3023156657 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23c41d1a50 con 0x7f23c413a200 2024-09-11T23:03:37.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.353+0000 7f23c2d9d640 1 --2- 172.21.15.12:0/3023156657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23c413a200 0x7f23c40a55f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f23b4019fc0 tx=0x7f23b401abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:37.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.353+0000 7f23ab7fe640 1 -- 172.21.15.12:0/3023156657 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23b40b0050 con 0x7f23c413a200 2024-09-11T23:03:37.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.353+0000 7f23ab7fe640 1 -- 172.21.15.12:0/3023156657 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23b40b1040 con 0x7f23c413a200 2024-09-11T23:03:37.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.353+0000 7f23c91f5640 1 -- 172.21.15.12:0/3023156657 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23c40a6670 con 0x7f23c413a200 2024-09-11T23:03:37.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.353+0000 7f23ab7fe640 1 -- 172.21.15.12:0/3023156657 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23b40b5740 con 0x7f23c413a200 2024-09-11T23:03:37.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.353+0000 7f23c91f5640 1 -- 172.21.15.12:0/3023156657 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23c40a6360 con 0x7f23c413a200 2024-09-11T23:03:37.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.357+0000 7f23c91f5640 1 -- 172.21.15.12:0/3023156657 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23c40a0530 con 0x7f23c413a200 2024-09-11T23:03:37.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.357+0000 7f23ab7fe640 1 -- 172.21.15.12:0/3023156657 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f23b40be030 con 0x7f23c413a200 2024-09-11T23:03:37.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.357+0000 7f23ab7fe640 1 --2- 172.21.15.12:0/3023156657 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f23b0035db0 0x7f23b0038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:37.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.357+0000 7f23ab7fe640 1 -- 172.21.15.12:0/3023156657 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3439+0+0 (secure 0 0 0) 0x7f23b40bc070 con 0x7f23c413a200 2024-09-11T23:03:37.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.357+0000 7f23c259c640 1 --2- 172.21.15.12:0/3023156657 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f23b0035db0 0x7f23b0038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:37.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.357+0000 7f60a5d9b640 1 --2- 172.21.15.12:0/3719760309 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60a80a9ef0 0x7f60a809c1a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f609c009720 tx=0x7f609c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16cf8974cb54f3df server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:37.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.357+0000 7f23c259c640 1 --2- 172.21.15.12:0/3023156657 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f23b0035db0 0x7f23b0038270 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f23b8001610 tx=0x7f23b8007ad0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:37.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.361+0000 7f60a559a640 1 -- 172.21.15.12:0/3719760309 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f609c0b0070 con 0x7f60a80a9ef0 2024-09-11T23:03:37.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.361+0000 7f60a559a640 1 -- 172.21.15.12:0/3719760309 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f609c0ab530 con 0x7f60a80a9ef0 2024-09-11T23:03:37.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.361+0000 7f60a559a640 1 -- 172.21.15.12:0/3719760309 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f609c0ab830 con 0x7f60a80a9ef0 2024-09-11T23:03:37.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.361+0000 7f23ab7fe640 1 -- 172.21.15.12:0/3023156657 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f23b40c5020 con 0x7f23c413a200 2024-09-11T23:03:37.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.361+0000 7f60acdd2640 1 -- 172.21.15.12:0/3719760309 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60a80a9ef0 msgr2=0x7f60a809c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:37.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.361+0000 7f60acdd2640 1 --2- 172.21.15.12:0/3719760309 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60a80a9ef0 0x7f60a809c1a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f609c009720 tx=0x7f609c01c370 comp rx=0 tx=0).stop 2024-09-11T23:03:37.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.361+0000 7f60acdd2640 1 -- 172.21.15.12:0/3719760309 shutdown_connections 2024-09-11T23:03:37.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.361+0000 7f60acdd2640 1 --2- 172.21.15.12:0/3719760309 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60a80a9ef0 0x7f60a809c1a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:37.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.361+0000 7f60acdd2640 1 -- 172.21.15.12:0/3719760309 >> 172.21.15.12:0/3719760309 conn(0x7f60a806f940 msgr2=0x7f60a8071d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:37.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.361+0000 7f60acdd2640 1 -- 172.21.15.12:0/3719760309 shutdown_connections 2024-09-11T23:03:37.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.361+0000 7f60acdd2640 1 -- 172.21.15.12:0/3719760309 wait complete. 2024-09-11T23:03:37.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.361+0000 7f60acdd2640 1 Processor -- start 2024-09-11T23:03:37.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.361+0000 7f60acdd2640 1 -- start start 2024-09-11T23:03:37.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.361+0000 7f60acdd2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60a80a9b10 0x7f60a8123ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:37.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.361+0000 7f60acdd2640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f60a8141c20 con 0x7f60a80a9b10 2024-09-11T23:03:37.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.361+0000 7f60a659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60a80a9b10 0x7f60a8123ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:37.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.361+0000 7f60a659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60a80a9b10 0x7f60a8123ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35206/0 (socket says 172.21.15.12:35206) 2024-09-11T23:03:37.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.361+0000 7f60a659c640 1 -- 172.21.15.12:0/2723353065 learned_addr learned my addr 172.21.15.12:0/2723353065 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:37.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.361+0000 7f60a659c640 1 -- 172.21.15.12:0/2723353065 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60a81221d0 con 0x7f60a80a9b10 2024-09-11T23:03:37.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.361+0000 7f60a659c640 1 --2- 172.21.15.12:0/2723353065 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60a80a9b10 0x7f60a8123ba0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f609800c420 tx=0x7f609800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:37.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.361+0000 7f6096ffd640 1 -- 172.21.15.12:0/2723353065 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6098018070 con 0x7f60a80a9b10 2024-09-11T23:03:37.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.361+0000 7f6096ffd640 1 -- 172.21.15.12:0/2723353065 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60980074d0 con 0x7f60a80a9b10 2024-09-11T23:03:37.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.365+0000 7f60acdd2640 1 -- 172.21.15.12:0/2723353065 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60a8121630 con 0x7f60a80a9b10 2024-09-11T23:03:37.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.365+0000 7f6096ffd640 1 -- 172.21.15.12:0/2723353065 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6098004960 con 0x7f60a80a9b10 2024-09-11T23:03:37.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.365+0000 7f60acdd2640 1 -- 172.21.15.12:0/2723353065 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60a81224a0 con 0x7f60a80a9b10 2024-09-11T23:03:37.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.365+0000 7f60acdd2640 1 -- 172.21.15.12:0/2723353065 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60a809c1a0 con 0x7f60a80a9b10 2024-09-11T23:03:37.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.365+0000 7f6096ffd640 1 -- 172.21.15.12:0/2723353065 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f609801b070 con 0x7f60a80a9b10 2024-09-11T23:03:37.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.365+0000 7f6096ffd640 1 --2- 172.21.15.12:0/2723353065 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f6088035d60 0x7f6088038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:37.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.365+0000 7f6096ffd640 1 -- 172.21.15.12:0/2723353065 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3439+0+0 (secure 0 0 0) 0x7f6098047a20 con 0x7f60a80a9b10 2024-09-11T23:03:37.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.365+0000 7f60a5d9b640 1 --2- 172.21.15.12:0/2723353065 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f6088035d60 0x7f6088038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:37.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.365+0000 7f60a5d9b640 1 --2- 172.21.15.12:0/2723353065 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f6088035d60 0x7f6088038220 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f609c0ad000 tx=0x7f609c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:37.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.369+0000 7f6096ffd640 1 -- 172.21.15.12:0/2723353065 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6098011980 con 0x7f60a80a9b10 2024-09-11T23:03:37.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.481+0000 7f128c54e640 1 -- 172.21.15.12:0/740802467 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f12840a0300 con 0x7f1284073740 2024-09-11T23:03:37.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.485+0000 7f127affd640 1 -- 172.21.15.12:0/740802467 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f128001b9c0 con 0x7f1284073740 2024-09-11T23:03:37.487 INFO:teuthology.orchestra.run.smithi012.stdout:34359738372 2024-09-11T23:03:37.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.485+0000 7f128c54e640 1 -- 172.21.15.12:0/740802467 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f1268035d60 msgr2=0x7f1268038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:37.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.485+0000 7f128c54e640 1 --2- 172.21.15.12:0/740802467 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f1268035d60 0x7f1268038220 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f12740ae000 tx=0x7f12740a7000 comp rx=0 tx=0).stop 2024-09-11T23:03:37.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.485+0000 7f128c54e640 1 -- 172.21.15.12:0/740802467 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1284073740 msgr2=0x7f128409ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:37.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.485+0000 7f128c54e640 1 --2- 172.21.15.12:0/740802467 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1284073740 0x7f128409ee10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f128000c410 tx=0x7f128000c8d0 comp rx=0 tx=0).stop 2024-09-11T23:03:37.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.485+0000 7f128c54e640 1 -- 172.21.15.12:0/740802467 shutdown_connections 2024-09-11T23:03:37.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.485+0000 7f128c54e640 1 --2- 172.21.15.12:0/740802467 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f1268035d60 0x7f1268038220 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:37.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.485+0000 7f128c54e640 1 --2- 172.21.15.12:0/740802467 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1284073740 0x7f128409ee10 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:37.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.485+0000 7f128c54e640 1 -- 172.21.15.12:0/740802467 >> 172.21.15.12:0/740802467 conn(0x7f12840aa140 msgr2=0x7f1284134de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:37.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.485+0000 7f128c54e640 1 -- 172.21.15.12:0/740802467 shutdown_connections 2024-09-11T23:03:37.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.485+0000 7f128c54e640 1 -- 172.21.15.12:0/740802467 wait complete. 2024-09-11T23:03:37.504 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738372 for osd.2 2024-09-11T23:03:37.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.521+0000 7f23c91f5640 1 -- 172.21.15.12:0/3023156657 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f23c413a660 con 0x7f23c413a200 2024-09-11T23:03:37.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.521+0000 7f23ab7fe640 1 -- 172.21.15.12:0/3023156657 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f23b4016010 con 0x7f23c413a200 2024-09-11T23:03:37.526 INFO:teuthology.orchestra.run.smithi012.stdout:34359738372 2024-09-11T23:03:37.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.521+0000 7f23c91f5640 1 -- 172.21.15.12:0/3023156657 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f23b0035db0 msgr2=0x7f23b0038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:37.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.521+0000 7f23c91f5640 1 --2- 172.21.15.12:0/3023156657 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f23b0035db0 0x7f23b0038270 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f23b8001610 tx=0x7f23b8007ad0 comp rx=0 tx=0).stop 2024-09-11T23:03:37.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.521+0000 7f23c91f5640 1 -- 172.21.15.12:0/3023156657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23c413a200 msgr2=0x7f23c40a55f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:37.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.521+0000 7f23c91f5640 1 --2- 172.21.15.12:0/3023156657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23c413a200 0x7f23c40a55f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f23b4019fc0 tx=0x7f23b401abd0 comp rx=0 tx=0).stop 2024-09-11T23:03:37.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.521+0000 7f23c91f5640 1 -- 172.21.15.12:0/3023156657 shutdown_connections 2024-09-11T23:03:37.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.521+0000 7f23c91f5640 1 --2- 172.21.15.12:0/3023156657 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f23b0035db0 0x7f23b0038270 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:37.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.521+0000 7f23c91f5640 1 --2- 172.21.15.12:0/3023156657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23c413a200 0x7f23c40a55f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:37.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.521+0000 7f23c91f5640 1 -- 172.21.15.12:0/3023156657 >> 172.21.15.12:0/3023156657 conn(0x7f23c406da30 msgr2=0x7f23c4137370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:37.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.521+0000 7f23c91f5640 1 -- 172.21.15.12:0/3023156657 shutdown_connections 2024-09-11T23:03:37.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.521+0000 7f23c91f5640 1 -- 172.21.15.12:0/3023156657 wait complete. 2024-09-11T23:03:37.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.529+0000 7f60acdd2640 1 -- 172.21.15.12:0/2723353065 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f60a806cd70 con 0x7f60a80a9b10 2024-09-11T23:03:37.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.529+0000 7f6096ffd640 1 -- 172.21.15.12:0/2723353065 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6098004d90 con 0x7f60a80a9b10 2024-09-11T23:03:37.534 INFO:teuthology.orchestra.run.smithi012.stdout:34359738372 2024-09-11T23:03:37.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.533+0000 7f60acdd2640 1 -- 172.21.15.12:0/2723353065 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f6088035d60 msgr2=0x7f6088038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:37.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.533+0000 7f60acdd2640 1 --2- 172.21.15.12:0/2723353065 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f6088035d60 0x7f6088038220 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f609c0ad000 tx=0x7f609c008040 comp rx=0 tx=0).stop 2024-09-11T23:03:37.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.533+0000 7f60acdd2640 1 -- 172.21.15.12:0/2723353065 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60a80a9b10 msgr2=0x7f60a8123ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:37.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.533+0000 7f60acdd2640 1 --2- 172.21.15.12:0/2723353065 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60a80a9b10 0x7f60a8123ba0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f609800c420 tx=0x7f609800c8e0 comp rx=0 tx=0).stop 2024-09-11T23:03:37.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.533+0000 7f60acdd2640 1 -- 172.21.15.12:0/2723353065 shutdown_connections 2024-09-11T23:03:37.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.533+0000 7f60acdd2640 1 --2- 172.21.15.12:0/2723353065 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f6088035d60 0x7f6088038220 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:37.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.533+0000 7f60acdd2640 1 --2- 172.21.15.12:0/2723353065 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60a80a9b10 0x7f60a8123ba0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:37.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.533+0000 7f60acdd2640 1 -- 172.21.15.12:0/2723353065 >> 172.21.15.12:0/2723353065 conn(0x7f60a806f940 msgr2=0x7f60a813cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:37.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.533+0000 7f60acdd2640 1 -- 172.21.15.12:0/2723353065 shutdown_connections 2024-09-11T23:03:37.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:37.533+0000 7f60acdd2640 1 -- 172.21.15.12:0/2723353065 wait complete. 2024-09-11T23:03:37.541 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738372 for osd.1 2024-09-11T23:03:37.552 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738372 for osd.0 2024-09-11T23:03:38.505 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-11T23:03:38.543 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-11T23:03:38.552 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-11T23:03:38.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.633+0000 7fc0d7f61640 1 Processor -- start 2024-09-11T23:03:38.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.633+0000 7fc0d7f61640 1 -- start start 2024-09-11T23:03:38.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.633+0000 7fc0d7f61640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc0d0136da0 0x7fc0d0137180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:38.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.633+0000 7fc0d7f61640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0d00a1e90 con 0x7fc0d009ac20 2024-09-11T23:03:38.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.633+0000 7fc0d7f61640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fc0d01376c0 con 0x7fc0d0136da0 2024-09-11T23:03:38.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.633+0000 7fc0d5cfd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc0d0136da0 0x7fc0d0137180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:38.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.633+0000 7fc0d5cfd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc0d0136da0 0x7fc0d0137180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35210/0 (socket says 172.21.15.12:35210) 2024-09-11T23:03:38.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.633+0000 7fc0d5cfd640 1 -- 172.21.15.12:0/2406237738 learned_addr learned my addr 172.21.15.12:0/2406237738 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:38.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.633+0000 7fc0d5cfd640 1 -- 172.21.15.12:0/2406237738 >> v1:172.21.15.12:6789/0 conn(0x7fc0d009ac20 legacy=0x7fc0d00a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:38.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.633+0000 7fc0d4cfb640 1 -- 172.21.15.12:0/2406237738 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 799430410 0 0) 0x7fc0d00a1e90 con 0x7fc0d009ac20 2024-09-11T23:03:38.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.633+0000 7fc0d5cfd640 1 -- 172.21.15.12:0/2406237738 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0d00a0650 con 0x7fc0d0136da0 2024-09-11T23:03:38.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.637+0000 7fc0d5cfd640 1 --2- 172.21.15.12:0/2406237738 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc0d0136da0 0x7fc0d0137180 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc0097f0 tx=0x7fc0cc01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4002b7c4e4d3f48e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:38.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.637+0000 7fc0d4cfb640 1 -- 172.21.15.12:0/2406237738 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0cc0b0070 con 0x7fc0d0136da0 2024-09-11T23:03:38.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.637+0000 7fc0d4cfb640 1 -- 172.21.15.12:0/2406237738 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0cc0ab530 con 0x7fc0d0136da0 2024-09-11T23:03:38.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.637+0000 7fc0d4cfb640 1 -- 172.21.15.12:0/2406237738 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0cc0ab830 con 0x7fc0d0136da0 2024-09-11T23:03:38.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.637+0000 7fc0d7f61640 1 -- 172.21.15.12:0/2406237738 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc0d0136da0 msgr2=0x7fc0d0137180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:38.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.637+0000 7fc0d7f61640 1 --2- 172.21.15.12:0/2406237738 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc0d0136da0 0x7fc0d0137180 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc0097f0 tx=0x7fc0cc01c4e0 comp rx=0 tx=0).stop 2024-09-11T23:03:38.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.637+0000 7fc0d7f61640 1 -- 172.21.15.12:0/2406237738 shutdown_connections 2024-09-11T23:03:38.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.637+0000 7fc0d7f61640 1 --2- 172.21.15.12:0/2406237738 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc0d0136da0 0x7fc0d0137180 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:38.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.637+0000 7fc0d7f61640 1 -- 172.21.15.12:0/2406237738 >> 172.21.15.12:0/2406237738 conn(0x7fc0d00a82f0 msgr2=0x7fc0d00a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:38.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.637+0000 7fc0d7f61640 1 -- 172.21.15.12:0/2406237738 shutdown_connections 2024-09-11T23:03:38.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.637+0000 7fc0d7f61640 1 -- 172.21.15.12:0/2406237738 wait complete. 2024-09-11T23:03:38.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.637+0000 7fc0d7f61640 1 Processor -- start 2024-09-11T23:03:38.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.637+0000 7fc0d7f61640 1 -- start start 2024-09-11T23:03:38.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.637+0000 7fc0d7f61640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc0d009ac20 0x7fc0d0071bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:38.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.637+0000 7fc0d7f61640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d013ee20 con 0x7fc0d009ac20 2024-09-11T23:03:38.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.637+0000 7fc0d5cfd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc0d009ac20 0x7fc0d0071bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:38.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.641+0000 7fc0d5cfd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc0d009ac20 0x7fc0d0071bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35216/0 (socket says 172.21.15.12:35216) 2024-09-11T23:03:38.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.641+0000 7fc0d5cfd640 1 -- 172.21.15.12:0/3787923581 learned_addr learned my addr 172.21.15.12:0/3787923581 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:38.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.641+0000 7fc0d5cfd640 1 -- 172.21.15.12:0/3787923581 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0d011edc0 con 0x7fc0d009ac20 2024-09-11T23:03:38.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.641+0000 7fc0d5cfd640 1 --2- 172.21.15.12:0/3787923581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc0d009ac20 0x7fc0d0071bc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc01a110 tx=0x7fc0cc01ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:38.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.641+0000 7fc0c67fc640 1 -- 172.21.15.12:0/3787923581 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0cc0ba020 con 0x7fc0d009ac20 2024-09-11T23:03:38.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.641+0000 7fc0c67fc640 1 -- 172.21.15.12:0/3787923581 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0cc0b6420 con 0x7fc0d009ac20 2024-09-11T23:03:38.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.641+0000 7fc0c67fc640 1 -- 172.21.15.12:0/3787923581 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0cc0b0040 con 0x7fc0d009ac20 2024-09-11T23:03:38.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.641+0000 7fc0d7f61640 1 -- 172.21.15.12:0/3787923581 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0d0120450 con 0x7fc0d009ac20 2024-09-11T23:03:38.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.641+0000 7fc0d7f61640 1 -- 172.21.15.12:0/3787923581 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0d013bd20 con 0x7fc0d009ac20 2024-09-11T23:03:38.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.641+0000 7fc0c67fc640 1 -- 172.21.15.12:0/3787923581 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc0cc0bd020 con 0x7fc0d009ac20 2024-09-11T23:03:38.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.641+0000 7fc0d7f61640 1 -- 172.21.15.12:0/3787923581 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0d0120800 con 0x7fc0d009ac20 2024-09-11T23:03:38.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.641+0000 7fc0c67fc640 1 --2- 172.21.15.12:0/3787923581 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fc0b4035db0 0x7fc0b4038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:38.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.641+0000 7fc0c67fc640 1 -- 172.21.15.12:0/3787923581 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3439+0+0 (secure 0 0 0) 0x7fc0cc0e29c0 con 0x7fc0d009ac20 2024-09-11T23:03:38.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.641+0000 7fc0d54fc640 1 --2- 172.21.15.12:0/3787923581 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fc0b4035db0 0x7fc0b4038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:38.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.641+0000 7fc0d54fc640 1 --2- 172.21.15.12:0/3787923581 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fc0b4035db0 0x7fc0b4038270 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc0c0000f70 tx=0x7fc0c0007910 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:38.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.645+0000 7fc0c67fc640 1 -- 172.21.15.12:0/3787923581 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc0cc0c4030 con 0x7fc0d009ac20 2024-09-11T23:03:38.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.669+0000 7f2c5ea56640 1 Processor -- start 2024-09-11T23:03:38.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.669+0000 7f2c5ea56640 1 -- start start 2024-09-11T23:03:38.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.669+0000 7f2c5ea56640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2c5809fc40 0x7f2c5813ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:38.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.669+0000 7f2c5ea56640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c580a1c00 con 0x7f2c5813a200 2024-09-11T23:03:38.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.669+0000 7f2c5ea56640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f2c580a0e40 con 0x7f2c5809fc40 2024-09-11T23:03:38.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.673+0000 7f2c57fff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f2c5813a200 0x7f2c5813a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:49644/0 (socket says 172.21.15.12:49644) 2024-09-11T23:03:38.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.673+0000 7f2c57fff640 1 -- 172.21.15.12:0/1386027459 learned_addr learned my addr 172.21.15.12:0/1386027459 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:03:38.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.673+0000 7f2c577fe640 1 --2- 172.21.15.12:0/1386027459 >> v2:172.21.15.12:3300/0 conn(0x7f2c5809fc40 0x7f2c5813ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:38.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.673+0000 7f2c577fe640 1 -- 172.21.15.12:0/1386027459 >> v1:172.21.15.12:6789/0 conn(0x7f2c5813a200 legacy=0x7f2c5813a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:38.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.673+0000 7f2c577fe640 1 -- 172.21.15.12:0/1386027459 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c5809f350 con 0x7f2c5809fc40 2024-09-11T23:03:38.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.673+0000 7f2c577fe640 1 --2- 172.21.15.12:0/1386027459 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c5809fc40 0x7f2c5813ef80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c009740 tx=0x7f2c4c01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e85df676c04ba23d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:38.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.673+0000 7f2c56ffd640 1 -- 172.21.15.12:0/1386027459 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c4c0b0070 con 0x7f2c5809fc40 2024-09-11T23:03:38.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.673+0000 7f2c56ffd640 1 -- 172.21.15.12:0/1386027459 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c4c0ab530 con 0x7f2c5809fc40 2024-09-11T23:03:38.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.673+0000 7f2c56ffd640 1 -- 172.21.15.12:0/1386027459 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c4c0ab830 con 0x7f2c5809fc40 2024-09-11T23:03:38.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.673+0000 7f2c5ea56640 1 -- 172.21.15.12:0/1386027459 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c5809fc40 msgr2=0x7f2c5813ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:38.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.673+0000 7f2c5ea56640 1 --2- 172.21.15.12:0/1386027459 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c5809fc40 0x7f2c5813ef80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c009740 tx=0x7f2c4c01c390 comp rx=0 tx=0).stop 2024-09-11T23:03:38.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.673+0000 7f2c5ea56640 1 -- 172.21.15.12:0/1386027459 shutdown_connections 2024-09-11T23:03:38.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.673+0000 7f2c5ea56640 1 --2- 172.21.15.12:0/1386027459 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c5809fc40 0x7f2c5813ef80 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:38.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.673+0000 7f2c5ea56640 1 -- 172.21.15.12:0/1386027459 >> 172.21.15.12:0/1386027459 conn(0x7f2c5806da30 msgr2=0x7f2c5806de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:38.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.673+0000 7f2c5ea56640 1 -- 172.21.15.12:0/1386027459 shutdown_connections 2024-09-11T23:03:38.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.673+0000 7f2c5ea56640 1 -- 172.21.15.12:0/1386027459 wait complete. 2024-09-11T23:03:38.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.677+0000 7f2c5ea56640 1 Processor -- start 2024-09-11T23:03:38.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.677+0000 7f2c5ea56640 1 -- start start 2024-09-11T23:03:38.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.677+0000 7f2c5ea56640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c5813a200 0x7f2c580aafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:38.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.677+0000 7f2c5ea56640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2c58141ce0 con 0x7f2c5813a200 2024-09-11T23:03:38.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.677+0000 7f2c57fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c5813a200 0x7f2c580aafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:38.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.677+0000 7f2c57fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c5813a200 0x7f2c580aafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35242/0 (socket says 172.21.15.12:35242) 2024-09-11T23:03:38.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.677+0000 7f2c57fff640 1 -- 172.21.15.12:0/241023300 learned_addr learned my addr 172.21.15.12:0/241023300 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:38.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.677+0000 7f2c57fff640 1 -- 172.21.15.12:0/241023300 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c580aa560 con 0x7f2c5813a200 2024-09-11T23:03:38.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.677+0000 7f2c57fff640 1 --2- 172.21.15.12:0/241023300 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c5813a200 0x7f2c580aafa0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2c4800c480 tx=0x7f2c4800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:38.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.677+0000 7f2c54ff9640 1 -- 172.21.15.12:0/241023300 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c48017070 con 0x7f2c5813a200 2024-09-11T23:03:38.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.677+0000 7f2c54ff9640 1 -- 172.21.15.12:0/241023300 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c48005c20 con 0x7f2c5813a200 2024-09-11T23:03:38.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.677+0000 7f2c54ff9640 1 -- 172.21.15.12:0/241023300 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c48007070 con 0x7f2c5813a200 2024-09-11T23:03:38.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.677+0000 7f2c5ea56640 1 -- 172.21.15.12:0/241023300 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c580abd10 con 0x7f2c5813a200 2024-09-11T23:03:38.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.677+0000 7f2c5ea56640 1 -- 172.21.15.12:0/241023300 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c580abfc0 con 0x7f2c5813a200 2024-09-11T23:03:38.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.677+0000 7f2c54ff9640 1 -- 172.21.15.12:0/241023300 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2c4801a070 con 0x7f2c5813a200 2024-09-11T23:03:38.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.677+0000 7f2c54ff9640 1 --2- 172.21.15.12:0/241023300 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f2c44035db0 0x7f2c44038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:38.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.677+0000 7f2c5ea56640 1 -- 172.21.15.12:0/241023300 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c5813a660 con 0x7f2c5813a200 2024-09-11T23:03:38.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.677+0000 7f2c54ff9640 1 -- 172.21.15.12:0/241023300 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3439+0+0 (secure 0 0 0) 0x7f2c48047920 con 0x7f2c5813a200 2024-09-11T23:03:38.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.681+0000 7f2c577fe640 1 --2- 172.21.15.12:0/241023300 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f2c44035db0 0x7f2c44038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:38.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.681+0000 7f2c577fe640 1 --2- 172.21.15.12:0/241023300 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f2c44035db0 0x7f2c44038270 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c0ad000 tx=0x7f2c4c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:38.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.685+0000 7f6f2a7e9640 1 Processor -- start 2024-09-11T23:03:38.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.685+0000 7f6f2a7e9640 1 -- start start 2024-09-11T23:03:38.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.685+0000 7f6f2a7e9640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6f2409fc40 0x7f6f2413ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:38.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.685+0000 7f6f2a7e9640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f240a1c00 con 0x7f6f2413a200 2024-09-11T23:03:38.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.685+0000 7f6f2a7e9640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f6f240a0e40 con 0x7f6f2409fc40 2024-09-11T23:03:38.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.685+0000 7f6f1bfff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6f2409fc40 0x7f6f2413ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:38.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.685+0000 7f6f1bfff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6f2409fc40 0x7f6f2413ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35246/0 (socket says 172.21.15.12:35246) 2024-09-11T23:03:38.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.685+0000 7f6f1bfff640 1 -- 172.21.15.12:0/3515400107 learned_addr learned my addr 172.21.15.12:0/3515400107 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:38.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.685+0000 7f6f23fff640 1 --1- 172.21.15.12:0/3515400107 >> v1:172.21.15.12:6789/0 conn(0x7f6f2413a200 0x7f6f2413a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:49658/0 (socket says 172.21.15.12:49658) 2024-09-11T23:03:38.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.685+0000 7f6f1bfff640 1 -- 172.21.15.12:0/3515400107 >> v1:172.21.15.12:6789/0 conn(0x7f6f2413a200 legacy=0x7f6f2413a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:38.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.685+0000 7f6f1bfff640 1 -- 172.21.15.12:0/3515400107 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f2409f350 con 0x7f6f2409fc40 2024-09-11T23:03:38.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.685+0000 7f2c54ff9640 1 -- 172.21.15.12:0/241023300 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2c48007210 con 0x7f2c5813a200 2024-09-11T23:03:38.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.689+0000 7f6f1bfff640 1 --2- 172.21.15.12:0/3515400107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f2409fc40 0x7f6f2413ef80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c0097f0 tx=0x7f6f0c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d88aef47b0c1d4f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:38.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.689+0000 7f6f237fe640 1 -- 172.21.15.12:0/3515400107 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f0c0b0070 con 0x7f6f2409fc40 2024-09-11T23:03:38.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.689+0000 7f6f237fe640 1 -- 172.21.15.12:0/3515400107 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f0c0ab530 con 0x7f6f2409fc40 2024-09-11T23:03:38.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.689+0000 7f6f237fe640 1 -- 172.21.15.12:0/3515400107 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f0c0ab830 con 0x7f6f2409fc40 2024-09-11T23:03:38.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.689+0000 7f6f2a7e9640 1 -- 172.21.15.12:0/3515400107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f2409fc40 msgr2=0x7f6f2413ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:38.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.689+0000 7f6f2a7e9640 1 --2- 172.21.15.12:0/3515400107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f2409fc40 0x7f6f2413ef80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c0097f0 tx=0x7f6f0c01c450 comp rx=0 tx=0).stop 2024-09-11T23:03:38.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.689+0000 7f6f2a7e9640 1 -- 172.21.15.12:0/3515400107 shutdown_connections 2024-09-11T23:03:38.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.689+0000 7f6f2a7e9640 1 --2- 172.21.15.12:0/3515400107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f2409fc40 0x7f6f2413ef80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:38.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.689+0000 7f6f2a7e9640 1 -- 172.21.15.12:0/3515400107 >> 172.21.15.12:0/3515400107 conn(0x7f6f2406da30 msgr2=0x7f6f2406de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:38.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.689+0000 7f6f2a7e9640 1 -- 172.21.15.12:0/3515400107 shutdown_connections 2024-09-11T23:03:38.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.689+0000 7f6f2a7e9640 1 -- 172.21.15.12:0/3515400107 wait complete. 2024-09-11T23:03:38.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.689+0000 7f6f2a7e9640 1 Processor -- start 2024-09-11T23:03:38.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.689+0000 7f6f2a7e9640 1 -- start start 2024-09-11T23:03:38.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.689+0000 7f6f2a7e9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f2413a200 0x7f6f240aafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:38.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.689+0000 7f6f2a7e9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6f24141ce0 con 0x7f6f2413a200 2024-09-11T23:03:38.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.689+0000 7f6f23fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f2413a200 0x7f6f240aafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:38.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.689+0000 7f6f23fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f2413a200 0x7f6f240aafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35254/0 (socket says 172.21.15.12:35254) 2024-09-11T23:03:38.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.689+0000 7f6f23fff640 1 -- 172.21.15.12:0/2812437086 learned_addr learned my addr 172.21.15.12:0/2812437086 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:38.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.689+0000 7f6f23fff640 1 -- 172.21.15.12:0/2812437086 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f240aa560 con 0x7f6f2413a200 2024-09-11T23:03:38.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.689+0000 7f6f23fff640 1 --2- 172.21.15.12:0/2812437086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f2413a200 0x7f6f240aafa0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6f1400c410 tx=0x7f6f1400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:38.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.689+0000 7f6f217fa640 1 -- 172.21.15.12:0/2812437086 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f14007410 con 0x7f6f2413a200 2024-09-11T23:03:38.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.689+0000 7f6f217fa640 1 -- 172.21.15.12:0/2812437086 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f140075b0 con 0x7f6f2413a200 2024-09-11T23:03:38.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.689+0000 7f6f2a7e9640 1 -- 172.21.15.12:0/2812437086 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f240abd10 con 0x7f6f2413a200 2024-09-11T23:03:38.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.689+0000 7f6f217fa640 1 -- 172.21.15.12:0/2812437086 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f14004920 con 0x7f6f2413a200 2024-09-11T23:03:38.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.693+0000 7f6f2a7e9640 1 -- 172.21.15.12:0/2812437086 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f240abfc0 con 0x7f6f2413a200 2024-09-11T23:03:38.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.693+0000 7f6f217fa640 1 -- 172.21.15.12:0/2812437086 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6f1401a020 con 0x7f6f2413a200 2024-09-11T23:03:38.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.693+0000 7f6f217fa640 1 --2- 172.21.15.12:0/2812437086 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f6f04035db0 0x7f6f04038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:38.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.693+0000 7f6f217fa640 1 -- 172.21.15.12:0/2812437086 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3439+0+0 (secure 0 0 0) 0x7f6f1404b120 con 0x7f6f2413a200 2024-09-11T23:03:38.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.693+0000 7f6f1bfff640 1 --2- 172.21.15.12:0/2812437086 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f6f04035db0 0x7f6f04038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:38.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.693+0000 7f6f2a7e9640 1 -- 172.21.15.12:0/2812437086 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f2413a660 con 0x7f6f2413a200 2024-09-11T23:03:38.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.693+0000 7f6f1bfff640 1 --2- 172.21.15.12:0/2812437086 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f6f04035db0 0x7f6f04038270 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c0ad000 tx=0x7f6f0c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:38.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.697+0000 7f6f217fa640 1 -- 172.21.15.12:0/2812437086 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6f14046810 con 0x7f6f2413a200 2024-09-11T23:03:38.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.857+0000 7f6f2a7e9640 1 -- 172.21.15.12:0/2812437086 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f6f24073580 con 0x7f6f2413a200 2024-09-11T23:03:38.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.857+0000 7f6f217fa640 1 -- 172.21.15.12:0/2812437086 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6f14019e10 con 0x7f6f2413a200 2024-09-11T23:03:38.863 INFO:teuthology.orchestra.run.smithi012.stdout:34359738373 2024-09-11T23:03:38.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.861+0000 7f6f2a7e9640 1 -- 172.21.15.12:0/2812437086 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f6f04035db0 msgr2=0x7f6f04038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:38.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.861+0000 7f6f2a7e9640 1 --2- 172.21.15.12:0/2812437086 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f6f04035db0 0x7f6f04038270 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c0ad000 tx=0x7f6f0c008040 comp rx=0 tx=0).stop 2024-09-11T23:03:38.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.861+0000 7f6f2a7e9640 1 -- 172.21.15.12:0/2812437086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f2413a200 msgr2=0x7f6f240aafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:38.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.861+0000 7f6f2a7e9640 1 --2- 172.21.15.12:0/2812437086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f2413a200 0x7f6f240aafa0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6f1400c410 tx=0x7f6f1400c8d0 comp rx=0 tx=0).stop 2024-09-11T23:03:38.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.861+0000 7f6f2a7e9640 1 -- 172.21.15.12:0/2812437086 shutdown_connections 2024-09-11T23:03:38.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.861+0000 7f6f2a7e9640 1 --2- 172.21.15.12:0/2812437086 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f6f04035db0 0x7f6f04038270 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:38.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.861+0000 7f6f2a7e9640 1 --2- 172.21.15.12:0/2812437086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f2413a200 0x7f6f240aafa0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:38.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.861+0000 7f6f2a7e9640 1 -- 172.21.15.12:0/2812437086 >> 172.21.15.12:0/2812437086 conn(0x7f6f2406da30 msgr2=0x7f6f2409ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:38.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.861+0000 7f6f2a7e9640 1 -- 172.21.15.12:0/2812437086 shutdown_connections 2024-09-11T23:03:38.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.861+0000 7f6f2a7e9640 1 -- 172.21.15.12:0/2812437086 wait complete. 2024-09-11T23:03:38.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.865+0000 7fc0d7f61640 1 -- 172.21.15.12:0/3787923581 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fc0d00738b0 con 0x7fc0d009ac20 2024-09-11T23:03:38.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.865+0000 7fc0c67fc640 1 -- 172.21.15.12:0/3787923581 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc0cc0160d0 con 0x7fc0d009ac20 2024-09-11T23:03:38.869 INFO:teuthology.orchestra.run.smithi012.stdout:34359738373 2024-09-11T23:03:38.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.865+0000 7fc0d7f61640 1 -- 172.21.15.12:0/3787923581 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fc0b4035db0 msgr2=0x7fc0b4038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:38.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.865+0000 7fc0d7f61640 1 --2- 172.21.15.12:0/3787923581 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fc0b4035db0 0x7fc0b4038270 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc0c0000f70 tx=0x7fc0c0007910 comp rx=0 tx=0).stop 2024-09-11T23:03:38.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.865+0000 7fc0d7f61640 1 -- 172.21.15.12:0/3787923581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc0d009ac20 msgr2=0x7fc0d0071bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:38.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.865+0000 7fc0d7f61640 1 --2- 172.21.15.12:0/3787923581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc0d009ac20 0x7fc0d0071bc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc01a110 tx=0x7fc0cc01ad20 comp rx=0 tx=0).stop 2024-09-11T23:03:38.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.865+0000 7fc0d7f61640 1 -- 172.21.15.12:0/3787923581 shutdown_connections 2024-09-11T23:03:38.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.865+0000 7fc0d7f61640 1 --2- 172.21.15.12:0/3787923581 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fc0b4035db0 0x7fc0b4038270 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:38.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.865+0000 7fc0d7f61640 1 --2- 172.21.15.12:0/3787923581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc0d009ac20 0x7fc0d0071bc0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:38.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.865+0000 7fc0d7f61640 1 -- 172.21.15.12:0/3787923581 >> 172.21.15.12:0/3787923581 conn(0x7fc0d00a82f0 msgr2=0x7fc0d00a7170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:38.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.865+0000 7fc0d7f61640 1 -- 172.21.15.12:0/3787923581 shutdown_connections 2024-09-11T23:03:38.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.865+0000 7fc0d7f61640 1 -- 172.21.15.12:0/3787923581 wait complete. 2024-09-11T23:03:38.882 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738373 for osd.0 2024-09-11T23:03:38.882 DEBUG:teuthology.parallel:result is None 2024-09-11T23:03:38.887 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738373 for osd.2 2024-09-11T23:03:38.887 DEBUG:teuthology.parallel:result is None 2024-09-11T23:03:38.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.901+0000 7f2c5ea56640 1 -- 172.21.15.12:0/241023300 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f2c58073580 con 0x7f2c5813a200 2024-09-11T23:03:38.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.901+0000 7f2c54ff9640 1 -- 172.21.15.12:0/241023300 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2c48035070 con 0x7f2c5813a200 2024-09-11T23:03:38.905 INFO:teuthology.orchestra.run.smithi012.stdout:34359738373 2024-09-11T23:03:38.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.905+0000 7f2c5ea56640 1 -- 172.21.15.12:0/241023300 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f2c44035db0 msgr2=0x7f2c44038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:38.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.905+0000 7f2c5ea56640 1 --2- 172.21.15.12:0/241023300 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f2c44035db0 0x7f2c44038270 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c0ad000 tx=0x7f2c4c008040 comp rx=0 tx=0).stop 2024-09-11T23:03:38.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.905+0000 7f2c5ea56640 1 -- 172.21.15.12:0/241023300 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c5813a200 msgr2=0x7f2c580aafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:38.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.905+0000 7f2c5ea56640 1 --2- 172.21.15.12:0/241023300 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c5813a200 0x7f2c580aafa0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2c4800c480 tx=0x7f2c4800c940 comp rx=0 tx=0).stop 2024-09-11T23:03:38.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.905+0000 7f2c5ea56640 1 -- 172.21.15.12:0/241023300 shutdown_connections 2024-09-11T23:03:38.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.905+0000 7f2c5ea56640 1 --2- 172.21.15.12:0/241023300 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f2c44035db0 0x7f2c44038270 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:38.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.905+0000 7f2c5ea56640 1 --2- 172.21.15.12:0/241023300 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c5813a200 0x7f2c580aafa0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:38.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.905+0000 7f2c5ea56640 1 -- 172.21.15.12:0/241023300 >> 172.21.15.12:0/241023300 conn(0x7f2c5806da30 msgr2=0x7f2c5809ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:38.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.905+0000 7f2c5ea56640 1 -- 172.21.15.12:0/241023300 shutdown_connections 2024-09-11T23:03:38.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:38.905+0000 7f2c5ea56640 1 -- 172.21.15.12:0/241023300 wait complete. 2024-09-11T23:03:38.922 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738373 for osd.1 2024-09-11T23:03:38.923 DEBUG:teuthology.parallel:result is None 2024-09-11T23:03:38.923 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T23:03:38.923 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:03:39.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.085+0000 7f3ca60dc640 1 Processor -- start 2024-09-11T23:03:39.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.085+0000 7f3ca60dc640 1 -- start start 2024-09-11T23:03:39.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.085+0000 7f3ca60dc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3ca013a410 0x7f3ca00a6af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:39.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.085+0000 7f3ca60dc640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ca00a82a0 con 0x7f3ca00a4b80 2024-09-11T23:03:39.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.085+0000 7f3ca60dc640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f3ca00a3cb0 con 0x7f3ca013a410 2024-09-11T23:03:39.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.085+0000 7f3c9f7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3ca013a410 0x7f3ca00a6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:39.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.085+0000 7f3c9f7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3ca013a410 0x7f3ca00a6af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35264/0 (socket says 172.21.15.12:35264) 2024-09-11T23:03:39.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.085+0000 7f3c97fff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f3ca00a4b80 0x7f3ca00a7030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:49666/0 (socket says 172.21.15.12:49666) 2024-09-11T23:03:39.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.085+0000 7f3c9f7fe640 1 -- 172.21.15.12:0/2469903222 learned_addr learned my addr 172.21.15.12:0/2469903222 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:39.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.085+0000 7f3c9f7fe640 1 -- 172.21.15.12:0/2469903222 >> v1:172.21.15.12:6789/0 conn(0x7f3ca00a4b80 legacy=0x7f3ca00a7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:39.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.085+0000 7f3c9f7fe640 1 -- 172.21.15.12:0/2469903222 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ca0139fe0 con 0x7f3ca013a410 2024-09-11T23:03:39.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.085+0000 7f3c9f7fe640 1 --2- 172.21.15.12:0/2469903222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ca013a410 0x7f3ca00a6af0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3c900097f0 tx=0x7f3c9001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11e683c1a20e6e72 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:39.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.085+0000 7f3c9effd640 1 -- 172.21.15.12:0/2469903222 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c900b2070 con 0x7f3ca013a410 2024-09-11T23:03:39.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.085+0000 7f3c9effd640 1 -- 172.21.15.12:0/2469903222 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c900a9070 con 0x7f3ca013a410 2024-09-11T23:03:39.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.085+0000 7f3c9effd640 1 -- 172.21.15.12:0/2469903222 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c900ad5b0 con 0x7f3ca013a410 2024-09-11T23:03:39.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.089+0000 7f3ca60dc640 1 -- 172.21.15.12:0/2469903222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ca013a410 msgr2=0x7f3ca00a6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:39.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.089+0000 7f3ca60dc640 1 --2- 172.21.15.12:0/2469903222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ca013a410 0x7f3ca00a6af0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3c900097f0 tx=0x7f3c9001c450 comp rx=0 tx=0).stop 2024-09-11T23:03:39.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.089+0000 7f3ca60dc640 1 -- 172.21.15.12:0/2469903222 shutdown_connections 2024-09-11T23:03:39.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.089+0000 7f3ca60dc640 1 --2- 172.21.15.12:0/2469903222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ca013a410 0x7f3ca00a6af0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:39.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.089+0000 7f3ca60dc640 1 -- 172.21.15.12:0/2469903222 >> 172.21.15.12:0/2469903222 conn(0x7f3ca00ac2c0 msgr2=0x7f3ca00ac6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:39.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.089+0000 7f3ca60dc640 1 -- 172.21.15.12:0/2469903222 shutdown_connections 2024-09-11T23:03:39.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.089+0000 7f3ca60dc640 1 -- 172.21.15.12:0/2469903222 wait complete. 2024-09-11T23:03:39.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.089+0000 7f3ca60dc640 1 Processor -- start 2024-09-11T23:03:39.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.089+0000 7f3ca60dc640 1 -- start start 2024-09-11T23:03:39.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.089+0000 7f3ca60dc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ca00a4b80 0x7f3ca01ce900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:39.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.089+0000 7f3ca60dc640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca00a7740 con 0x7f3ca00a4b80 2024-09-11T23:03:39.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.089+0000 7f3c9f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ca00a4b80 0x7f3ca01ce900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:39.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.089+0000 7f3c9f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ca00a4b80 0x7f3ca01ce900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35274/0 (socket says 172.21.15.12:35274) 2024-09-11T23:03:39.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.089+0000 7f3c9f7fe640 1 -- 172.21.15.12:0/2730281022 learned_addr learned my addr 172.21.15.12:0/2730281022 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:39.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.089+0000 7f3c9f7fe640 1 -- 172.21.15.12:0/2730281022 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ca009c5c0 con 0x7f3ca00a4b80 2024-09-11T23:03:39.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.089+0000 7f3c9f7fe640 1 --2- 172.21.15.12:0/2730281022 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ca00a4b80 0x7f3ca01ce900 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3c900b0040 tx=0x7f3c9001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:39.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.089+0000 7f3c9cff9640 1 -- 172.21.15.12:0/2730281022 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c900bc020 con 0x7f3ca00a4b80 2024-09-11T23:03:39.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.089+0000 7f3c9cff9640 1 -- 172.21.15.12:0/2730281022 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c900add80 con 0x7f3ca00a4b80 2024-09-11T23:03:39.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.089+0000 7f3ca60dc640 1 -- 172.21.15.12:0/2730281022 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ca009aa80 con 0x7f3ca00a4b80 2024-09-11T23:03:39.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.089+0000 7f3c9cff9640 1 -- 172.21.15.12:0/2730281022 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c900b2040 con 0x7f3ca00a4b80 2024-09-11T23:03:39.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.089+0000 7f3ca60dc640 1 -- 172.21.15.12:0/2730281022 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ca009b7c0 con 0x7f3ca00a4b80 2024-09-11T23:03:39.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.089+0000 7f3c9cff9640 1 -- 172.21.15.12:0/2730281022 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3c900bf020 con 0x7f3ca00a4b80 2024-09-11T23:03:39.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.093+0000 7f3ca60dc640 1 -- 172.21.15.12:0/2730281022 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ca01ce710 con 0x7f3ca00a4b80 2024-09-11T23:03:39.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.093+0000 7f3c9cff9640 1 --2- 172.21.15.12:0/2730281022 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f3c80035db0 0x7f3c80038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:39.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.093+0000 7f3c9cff9640 1 -- 172.21.15.12:0/2730281022 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3439+0+0 (secure 0 0 0) 0x7f3c900e2990 con 0x7f3ca00a4b80 2024-09-11T23:03:39.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.093+0000 7f3c97fff640 1 --2- 172.21.15.12:0/2730281022 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f3c80035db0 0x7f3c80038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:39.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.093+0000 7f3c97fff640 1 --2- 172.21.15.12:0/2730281022 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f3c80035db0 0x7f3c80038270 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3c88000f70 tx=0x7f3c88007a90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:39.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.097+0000 7f3c9cff9640 1 -- 172.21.15.12:0/2730281022 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3c900c6030 con 0x7f3ca00a4b80 2024-09-11T23:03:39.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.249+0000 7f3ca60dc640 1 -- 172.21.15.12:0/2730281022 --> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3ca013f510 con 0x7f3c80035db0 2024-09-11T23:03:39.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.257+0000 7f3c9cff9640 1 -- 172.21.15.12:0/2730281022 <== mgr.4099 v2:172.21.15.12:6824/2765460338 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245951 (secure 0 0 0) 0x7f3c880070d0 con 0x7f3c80035db0 2024-09-11T23:03:39.264 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:03:39.265 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-11T23:03:39.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.261+0000 7f3ca60dc640 1 -- 172.21.15.12:0/2730281022 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f3c80035db0 msgr2=0x7f3c80038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:39.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.261+0000 7f3ca60dc640 1 --2- 172.21.15.12:0/2730281022 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f3c80035db0 0x7f3c80038270 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3c88000f70 tx=0x7f3c88007a90 comp rx=0 tx=0).stop 2024-09-11T23:03:39.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.261+0000 7f3ca60dc640 1 -- 172.21.15.12:0/2730281022 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ca00a4b80 msgr2=0x7f3ca01ce900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:39.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.261+0000 7f3ca60dc640 1 --2- 172.21.15.12:0/2730281022 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ca00a4b80 0x7f3ca01ce900 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3c900b0040 tx=0x7f3c9001ac90 comp rx=0 tx=0).stop 2024-09-11T23:03:39.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.261+0000 7f3ca60dc640 1 -- 172.21.15.12:0/2730281022 shutdown_connections 2024-09-11T23:03:39.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.261+0000 7f3ca60dc640 1 --2- 172.21.15.12:0/2730281022 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f3c80035db0 0x7f3c80038270 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:39.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.261+0000 7f3ca60dc640 1 --2- 172.21.15.12:0/2730281022 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ca00a4b80 0x7f3ca01ce900 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:39.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.261+0000 7f3ca60dc640 1 -- 172.21.15.12:0/2730281022 >> 172.21.15.12:0/2730281022 conn(0x7f3ca00ac2c0 msgr2=0x7f3ca00aa400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:39.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.261+0000 7f3ca60dc640 1 -- 172.21.15.12:0/2730281022 shutdown_connections 2024-09-11T23:03:39.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.261+0000 7f3ca60dc640 1 -- 172.21.15.12:0/2730281022 wait complete. 2024-09-11T23:03:39.281 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-11T23:03:37.516538+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":182,"num_write_kb":1908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":82728,"kb_used_data":1632,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283032792,"statfs":{"total":289910292480,"available":289825579008,"internally_reserved":0,"allocated":1671168,"data_stored":1313866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":82963791},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.902193"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.640948+0000","last_change":"2024-09-11T23:03:31.644980+0000","last_active":"2024-09-11T23:03:32.640948+0000","last_peered":"2024-09-11T23:03:32.640948+0000","last_clean":"2024-09-11T23:03:32.640948+0000","last_became_active":"2024-09-11T23:03:31.643322+0000","last_became_peered":"2024-09-11T23:03:31.643322+0000","last_unstale":"2024-09-11T23:03:32.640948+0000","last_undegraded":"2024-09-11T23:03:32.640948+0000","last_fullsized":"2024-09-11T23:03:32.640948+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:27.729873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.652887+0000","last_change":"2024-09-11T23:03:31.650677+0000","last_active":"2024-09-11T23:03:32.652887+0000","last_peered":"2024-09-11T23:03:32.652887+0000","last_clean":"2024-09-11T23:03:32.652887+0000","last_became_active":"2024-09-11T23:03:31.650405+0000","last_became_peered":"2024-09-11T23:03:31.650405+0000","last_unstale":"2024-09-11T23:03:32.652887+0000","last_undegraded":"2024-09-11T23:03:32.652887+0000","last_fullsized":"2024-09-11T23:03:32.652887+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:33.451482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.641555+0000","last_change":"2024-09-11T23:03:31.658194+0000","last_active":"2024-09-11T23:03:32.641555+0000","last_peered":"2024-09-11T23:03:32.641555+0000","last_clean":"2024-09-11T23:03:32.641555+0000","last_became_active":"2024-09-11T23:03:31.657911+0000","last_became_peered":"2024-09-11T23:03:31.657911+0000","last_unstale":"2024-09-11T23:03:32.641555+0000","last_undegraded":"2024-09-11T23:03:32.641555+0000","last_fullsized":"2024-09-11T23:03:32.641555+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:32.481125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.019254+0000","last_change":"2024-09-11T23:03:31.676906+0000","last_active":"2024-09-11T23:03:34.019254+0000","last_peered":"2024-09-11T23:03:34.019254+0000","last_clean":"2024-09-11T23:03:34.019254+0000","last_became_active":"2024-09-11T23:03:31.676592+0000","last_became_peered":"2024-09-11T23:03:31.676592+0000","last_unstale":"2024-09-11T23:03:34.019254+0000","last_undegraded":"2024-09-11T23:03:34.019254+0000","last_fullsized":"2024-09-11T23:03:34.019254+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:41.847795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.640491+0000","last_change":"2024-09-11T23:03:31.657824+0000","last_active":"2024-09-11T23:03:32.640491+0000","last_peered":"2024-09-11T23:03:32.640491+0000","last_clean":"2024-09-11T23:03:32.640491+0000","last_became_active":"2024-09-11T23:03:31.657535+0000","last_became_peered":"2024-09-11T23:03:31.657535+0000","last_unstale":"2024-09-11T23:03:32.640491+0000","last_undegraded":"2024-09-11T23:03:32.640491+0000","last_fullsized":"2024-09-11T23:03:32.640491+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:27.767863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.018908+0000","last_change":"2024-09-11T23:03:31.673561+0000","last_active":"2024-09-11T23:03:34.018908+0000","last_peered":"2024-09-11T23:03:34.018908+0000","last_clean":"2024-09-11T23:03:34.018908+0000","last_became_active":"2024-09-11T23:03:31.672515+0000","last_became_peered":"2024-09-11T23:03:31.672515+0000","last_unstale":"2024-09-11T23:03:34.018908+0000","last_undegraded":"2024-09-11T23:03:34.018908+0000","last_fullsized":"2024-09-11T23:03:34.018908+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:52.318572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.640534+0000","last_change":"2024-09-11T23:03:31.640733+0000","last_active":"2024-09-11T23:03:32.640534+0000","last_peered":"2024-09-11T23:03:32.640534+0000","last_clean":"2024-09-11T23:03:32.640534+0000","last_became_active":"2024-09-11T23:03:31.640419+0000","last_became_peered":"2024-09-11T23:03:31.640419+0000","last_unstale":"2024-09-11T23:03:32.640534+0000","last_undegraded":"2024-09-11T23:03:32.640534+0000","last_fullsized":"2024-09-11T23:03:32.640534+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:37.026086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.018431+0000","last_change":"2024-09-11T23:03:31.677179+0000","last_active":"2024-09-11T23:03:34.018431+0000","last_peered":"2024-09-11T23:03:34.018431+0000","last_clean":"2024-09-11T23:03:34.018431+0000","last_became_active":"2024-09-11T23:03:31.670449+0000","last_became_peered":"2024-09-11T23:03:31.670449+0000","last_unstale":"2024-09-11T23:03:34.018431+0000","last_undegraded":"2024-09-11T23:03:34.018431+0000","last_fullsized":"2024-09-11T23:03:34.018431+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:42.095319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.653219+0000","last_change":"2024-09-11T23:03:31.652750+0000","last_active":"2024-09-11T23:03:32.653219+0000","last_peered":"2024-09-11T23:03:32.653219+0000","last_clean":"2024-09-11T23:03:32.653219+0000","last_became_active":"2024-09-11T23:03:31.651659+0000","last_became_peered":"2024-09-11T23:03:31.651659+0000","last_unstale":"2024-09-11T23:03:32.653219+0000","last_undegraded":"2024-09-11T23:03:32.653219+0000","last_fullsized":"2024-09-11T23:03:32.653219+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:46.452154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.641542+0000","last_change":"2024-09-11T23:03:31.658062+0000","last_active":"2024-09-11T23:03:32.641542+0000","last_peered":"2024-09-11T23:03:32.641542+0000","last_clean":"2024-09-11T23:03:32.641542+0000","last_became_active":"2024-09-11T23:03:31.657713+0000","last_became_peered":"2024-09-11T23:03:31.657713+0000","last_unstale":"2024-09-11T23:03:32.641542+0000","last_undegraded":"2024-09-11T23:03:32.641542+0000","last_fullsized":"2024-09-11T23:03:32.641542+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:35.915905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.641119+0000","last_change":"2024-09-11T23:03:31.644330+0000","last_active":"2024-09-11T23:03:32.641119+0000","last_peered":"2024-09-11T23:03:32.641119+0000","last_clean":"2024-09-11T23:03:32.641119+0000","last_became_active":"2024-09-11T23:03:31.644082+0000","last_became_peered":"2024-09-11T23:03:31.644082+0000","last_unstale":"2024-09-11T23:03:32.641119+0000","last_undegraded":"2024-09-11T23:03:32.641119+0000","last_fullsized":"2024-09-11T23:03:32.641119+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:45.448849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.641082+0000","last_change":"2024-09-11T23:03:31.642201+0000","last_active":"2024-09-11T23:03:32.641082+0000","last_peered":"2024-09-11T23:03:32.641082+0000","last_clean":"2024-09-11T23:03:32.641082+0000","last_became_active":"2024-09-11T23:03:31.641846+0000","last_became_peered":"2024-09-11T23:03:31.641846+0000","last_unstale":"2024-09-11T23:03:32.641082+0000","last_undegraded":"2024-09-11T23:03:32.641082+0000","last_fullsized":"2024-09-11T23:03:32.641082+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:05.316156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.640544+0000","last_change":"2024-09-11T23:03:31.656241+0000","last_active":"2024-09-11T23:03:32.640544+0000","last_peered":"2024-09-11T23:03:32.640544+0000","last_clean":"2024-09-11T23:03:32.640544+0000","last_became_active":"2024-09-11T23:03:31.655038+0000","last_became_peered":"2024-09-11T23:03:31.655038+0000","last_unstale":"2024-09-11T23:03:32.640544+0000","last_undegraded":"2024-09-11T23:03:32.640544+0000","last_fullsized":"2024-09-11T23:03:32.640544+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:32.257331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.639641+0000","last_change":"2024-09-11T23:03:31.642497+0000","last_active":"2024-09-11T23:03:32.639641+0000","last_peered":"2024-09-11T23:03:32.639641+0000","last_clean":"2024-09-11T23:03:32.639641+0000","last_became_active":"2024-09-11T23:03:31.642002+0000","last_became_peered":"2024-09-11T23:03:31.642002+0000","last_unstale":"2024-09-11T23:03:32.639641+0000","last_undegraded":"2024-09-11T23:03:32.639641+0000","last_fullsized":"2024-09-11T23:03:32.639641+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:46.452154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.651813+0000","last_change":"2024-09-11T23:03:31.645457+0000","last_active":"2024-09-11T23:03:32.651813+0000","last_peered":"2024-09-11T23:03:32.651813+0000","last_clean":"2024-09-11T23:03:32.651813+0000","last_became_active":"2024-09-11T23:03:31.643894+0000","last_became_peered":"2024-09-11T23:03:31.643894+0000","last_unstale":"2024-09-11T23:03:32.651813+0000","last_undegraded":"2024-09-11T23:03:32.651813+0000","last_fullsized":"2024-09-11T23:03:32.651813+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:50:10.314960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.018911+0000","last_change":"2024-09-11T23:03:31.678032+0000","last_active":"2024-09-11T23:03:34.018911+0000","last_peered":"2024-09-11T23:03:34.018911+0000","last_clean":"2024-09-11T23:03:34.018911+0000","last_became_active":"2024-09-11T23:03:31.672976+0000","last_became_peered":"2024-09-11T23:03:31.672976+0000","last_unstale":"2024-09-11T23:03:34.018911+0000","last_undegraded":"2024-09-11T23:03:34.018911+0000","last_fullsized":"2024-09-11T23:03:34.018911+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:17.931079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.653399+0000","last_change":"2024-09-11T23:03:31.652625+0000","last_active":"2024-09-11T23:03:32.653399+0000","last_peered":"2024-09-11T23:03:32.653399+0000","last_clean":"2024-09-11T23:03:32.653399+0000","last_became_active":"2024-09-11T23:03:31.651397+0000","last_became_peered":"2024-09-11T23:03:31.651397+0000","last_unstale":"2024-09-11T23:03:32.653399+0000","last_undegraded":"2024-09-11T23:03:32.653399+0000","last_fullsized":"2024-09-11T23:03:32.653399+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:28.517523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.020235+0000","last_change":"2024-09-11T23:03:31.673847+0000","last_active":"2024-09-11T23:03:34.020235+0000","last_peered":"2024-09-11T23:03:34.020235+0000","last_clean":"2024-09-11T23:03:34.020235+0000","last_became_active":"2024-09-11T23:03:31.673484+0000","last_became_peered":"2024-09-11T23:03:31.673484+0000","last_unstale":"2024-09-11T23:03:34.020235+0000","last_undegraded":"2024-09-11T23:03:34.020235+0000","last_fullsized":"2024-09-11T23:03:34.020235+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:47.643082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.641493+0000","last_change":"2024-09-11T23:03:31.658165+0000","last_active":"2024-09-11T23:03:32.641493+0000","last_peered":"2024-09-11T23:03:32.641493+0000","last_clean":"2024-09-11T23:03:32.641493+0000","last_became_active":"2024-09-11T23:03:31.657520+0000","last_became_peered":"2024-09-11T23:03:31.657520+0000","last_unstale":"2024-09-11T23:03:32.641493+0000","last_undegraded":"2024-09-11T23:03:32.641493+0000","last_fullsized":"2024-09-11T23:03:32.641493+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:57.723854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.641206+0000","last_change":"2024-09-11T23:03:31.641111+0000","last_active":"2024-09-11T23:03:32.641206+0000","last_peered":"2024-09-11T23:03:32.641206+0000","last_clean":"2024-09-11T23:03:32.641206+0000","last_became_active":"2024-09-11T23:03:31.640663+0000","last_became_peered":"2024-09-11T23:03:31.640663+0000","last_unstale":"2024-09-11T23:03:32.641206+0000","last_undegraded":"2024-09-11T23:03:32.641206+0000","last_fullsized":"2024-09-11T23:03:32.641206+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:31.065660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.639998+0000","last_change":"2024-09-11T23:03:31.657160+0000","last_active":"2024-09-11T23:03:32.639998+0000","last_peered":"2024-09-11T23:03:32.639998+0000","last_clean":"2024-09-11T23:03:32.639998+0000","last_became_active":"2024-09-11T23:03:31.655894+0000","last_became_peered":"2024-09-11T23:03:31.655894+0000","last_unstale":"2024-09-11T23:03:32.639998+0000","last_undegraded":"2024-09-11T23:03:32.639998+0000","last_fullsized":"2024-09-11T23:03:32.639998+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:05.223112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.652057+0000","last_change":"2024-09-11T23:03:31.651347+0000","last_active":"2024-09-11T23:03:32.652057+0000","last_peered":"2024-09-11T23:03:32.652057+0000","last_clean":"2024-09-11T23:03:32.652057+0000","last_became_active":"2024-09-11T23:03:31.650762+0000","last_became_peered":"2024-09-11T23:03:31.650762+0000","last_unstale":"2024-09-11T23:03:32.652057+0000","last_undegraded":"2024-09-11T23:03:32.652057+0000","last_fullsized":"2024-09-11T23:03:32.652057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:52.318572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.639551+0000","last_change":"2024-09-11T23:03:31.649698+0000","last_active":"2024-09-11T23:03:32.639551+0000","last_peered":"2024-09-11T23:03:32.639551+0000","last_clean":"2024-09-11T23:03:32.639551+0000","last_became_active":"2024-09-11T23:03:31.649443+0000","last_became_peered":"2024-09-11T23:03:31.649443+0000","last_unstale":"2024-09-11T23:03:32.639551+0000","last_undegraded":"2024-09-11T23:03:32.639551+0000","last_fullsized":"2024-09-11T23:03:32.639551+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:55.777013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.639281+0000","last_change":"2024-09-11T23:03:31.674478+0000","last_active":"2024-09-11T23:03:32.639281+0000","last_peered":"2024-09-11T23:03:32.639281+0000","last_clean":"2024-09-11T23:03:32.639281+0000","last_became_active":"2024-09-11T23:03:31.674069+0000","last_became_peered":"2024-09-11T23:03:31.674069+0000","last_unstale":"2024-09-11T23:03:32.639281+0000","last_undegraded":"2024-09-11T23:03:32.639281+0000","last_fullsized":"2024-09-11T23:03:32.639281+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:33.451482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.020124+0000","last_change":"2024-09-11T23:03:31.673244+0000","last_active":"2024-09-11T23:03:34.020124+0000","last_peered":"2024-09-11T23:03:34.020124+0000","last_clean":"2024-09-11T23:03:34.020124+0000","last_became_active":"2024-09-11T23:03:31.672958+0000","last_became_peered":"2024-09-11T23:03:31.672958+0000","last_unstale":"2024-09-11T23:03:34.020124+0000","last_undegraded":"2024-09-11T23:03:34.020124+0000","last_fullsized":"2024-09-11T23:03:34.020124+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:44.003355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.020488+0000","last_change":"2024-09-11T23:03:31.677762+0000","last_active":"2024-09-11T23:03:34.020488+0000","last_peered":"2024-09-11T23:03:34.020488+0000","last_clean":"2024-09-11T23:03:34.020488+0000","last_became_active":"2024-09-11T23:03:31.677183+0000","last_became_peered":"2024-09-11T23:03:31.677183+0000","last_unstale":"2024-09-11T23:03:34.020488+0000","last_undegraded":"2024-09-11T23:03:34.020488+0000","last_fullsized":"2024-09-11T23:03:34.020488+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:10.683627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.653028+0000","last_change":"2024-09-11T23:03:31.659006+0000","last_active":"2024-09-11T23:03:32.653028+0000","last_peered":"2024-09-11T23:03:32.653028+0000","last_clean":"2024-09-11T23:03:32.653028+0000","last_became_active":"2024-09-11T23:03:31.658753+0000","last_became_peered":"2024-09-11T23:03:31.658753+0000","last_unstale":"2024-09-11T23:03:32.653028+0000","last_undegraded":"2024-09-11T23:03:32.653028+0000","last_fullsized":"2024-09-11T23:03:32.653028+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:41.606488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.641472+0000","last_change":"2024-09-11T23:03:31.663269+0000","last_active":"2024-09-11T23:03:32.641472+0000","last_peered":"2024-09-11T23:03:32.641472+0000","last_clean":"2024-09-11T23:03:32.641472+0000","last_became_active":"2024-09-11T23:03:31.661949+0000","last_became_peered":"2024-09-11T23:03:31.661949+0000","last_unstale":"2024-09-11T23:03:32.641472+0000","last_undegraded":"2024-09-11T23:03:32.641472+0000","last_fullsized":"2024-09-11T23:03:32.641472+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:49.515173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.639941+0000","last_change":"2024-09-11T23:03:31.663932+0000","last_active":"2024-09-11T23:03:32.639941+0000","last_peered":"2024-09-11T23:03:32.639941+0000","last_clean":"2024-09-11T23:03:32.639941+0000","last_became_active":"2024-09-11T23:03:31.663346+0000","last_became_peered":"2024-09-11T23:03:31.663346+0000","last_unstale":"2024-09-11T23:03:32.639941+0000","last_undegraded":"2024-09-11T23:03:32.639941+0000","last_fullsized":"2024-09-11T23:03:32.639941+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:43.655855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.639647+0000","last_change":"2024-09-11T23:03:31.663998+0000","last_active":"2024-09-11T23:03:32.639647+0000","last_peered":"2024-09-11T23:03:32.639647+0000","last_clean":"2024-09-11T23:03:32.639647+0000","last_became_active":"2024-09-11T23:03:31.663608+0000","last_became_peered":"2024-09-11T23:03:31.663608+0000","last_unstale":"2024-09-11T23:03:32.639647+0000","last_undegraded":"2024-09-11T23:03:32.639647+0000","last_fullsized":"2024-09-11T23:03:32.639647+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:28.517523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.018663+0000","last_change":"2024-09-11T23:03:31.668324+0000","last_active":"2024-09-11T23:03:34.018663+0000","last_peered":"2024-09-11T23:03:34.018663+0000","last_clean":"2024-09-11T23:03:34.018663+0000","last_became_active":"2024-09-11T23:03:31.667670+0000","last_became_peered":"2024-09-11T23:03:31.667670+0000","last_unstale":"2024-09-11T23:03:34.018663+0000","last_undegraded":"2024-09-11T23:03:34.018663+0000","last_fullsized":"2024-09-11T23:03:34.018663+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:39.031797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.018932+0000","last_change":"2024-09-11T23:03:31.678992+0000","last_active":"2024-09-11T23:03:34.018932+0000","last_peered":"2024-09-11T23:03:34.018932+0000","last_clean":"2024-09-11T23:03:34.018932+0000","last_became_active":"2024-09-11T23:03:31.676531+0000","last_became_peered":"2024-09-11T23:03:31.676531+0000","last_unstale":"2024-09-11T23:03:34.018932+0000","last_undegraded":"2024-09-11T23:03:34.018932+0000","last_fullsized":"2024-09-11T23:03:34.018932+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:59.854206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.651913+0000","last_change":"2024-09-11T23:03:31.657027+0000","last_active":"2024-09-11T23:03:32.651913+0000","last_peered":"2024-09-11T23:03:32.651913+0000","last_clean":"2024-09-11T23:03:32.651913+0000","last_became_active":"2024-09-11T23:03:31.656728+0000","last_became_peered":"2024-09-11T23:03:31.656728+0000","last_unstale":"2024-09-11T23:03:32.651913+0000","last_undegraded":"2024-09-11T23:03:32.651913+0000","last_fullsized":"2024-09-11T23:03:32.651913+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:13.638867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"15'1","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.652367+0000","last_change":"2024-09-11T23:03:30.660455+0000","last_active":"2024-09-11T23:03:32.652367+0000","last_peered":"2024-09-11T23:03:32.652367+0000","last_clean":"2024-09-11T23:03:32.652367+0000","last_became_active":"2024-09-11T23:03:30.660052+0000","last_became_peered":"2024-09-11T23:03:30.660052+0000","last_unstale":"2024-09-11T23:03:32.652367+0000","last_undegraded":"2024-09-11T23:03:32.652367+0000","last_fullsized":"2024-09-11T23:03:32.652367+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:11.604671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.640097+0000","last_change":"2024-09-11T23:03:31.644592+0000","last_active":"2024-09-11T23:03:32.640097+0000","last_peered":"2024-09-11T23:03:32.640097+0000","last_clean":"2024-09-11T23:03:32.640097+0000","last_became_active":"2024-09-11T23:03:31.644297+0000","last_became_peered":"2024-09-11T23:03:31.644297+0000","last_unstale":"2024-09-11T23:03:32.640097+0000","last_undegraded":"2024-09-11T23:03:32.640097+0000","last_fullsized":"2024-09-11T23:03:32.640097+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:50.216329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"15'1","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.019138+0000","last_change":"2024-09-11T23:03:30.653792+0000","last_active":"2024-09-11T23:03:34.019138+0000","last_peered":"2024-09-11T23:03:34.019138+0000","last_clean":"2024-09-11T23:03:34.019138+0000","last_became_active":"2024-09-11T23:03:30.653493+0000","last_became_peered":"2024-09-11T23:03:30.653493+0000","last_unstale":"2024-09-11T23:03:34.019138+0000","last_undegraded":"2024-09-11T23:03:34.019138+0000","last_fullsized":"2024-09-11T23:03:34.019138+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:37.723285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.640281+0000","last_change":"2024-09-11T23:03:30.653094+0000","last_active":"2024-09-11T23:03:32.640281+0000","last_peered":"2024-09-11T23:03:32.640281+0000","last_clean":"2024-09-11T23:03:32.640281+0000","last_became_active":"2024-09-11T23:03:30.652770+0000","last_became_peered":"2024-09-11T23:03:30.652770+0000","last_unstale":"2024-09-11T23:03:32.640281+0000","last_undegraded":"2024-09-11T23:03:32.640281+0000","last_fullsized":"2024-09-11T23:03:32.640281+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:43.385721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.019366+0000","last_change":"2024-09-11T23:03:31.679465+0000","last_active":"2024-09-11T23:03:34.019366+0000","last_peered":"2024-09-11T23:03:34.019366+0000","last_clean":"2024-09-11T23:03:34.019366+0000","last_became_active":"2024-09-11T23:03:31.677617+0000","last_became_peered":"2024-09-11T23:03:31.677617+0000","last_unstale":"2024-09-11T23:03:34.019366+0000","last_undegraded":"2024-09-11T23:03:34.019366+0000","last_fullsized":"2024-09-11T23:03:34.019366+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:13.638867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.639294+0000","last_change":"2024-09-11T23:03:30.663136+0000","last_active":"2024-09-11T23:03:32.639294+0000","last_peered":"2024-09-11T23:03:32.639294+0000","last_clean":"2024-09-11T23:03:32.639294+0000","last_became_active":"2024-09-11T23:03:30.662724+0000","last_became_peered":"2024-09-11T23:03:30.662724+0000","last_unstale":"2024-09-11T23:03:32.639294+0000","last_undegraded":"2024-09-11T23:03:32.639294+0000","last_fullsized":"2024-09-11T23:03:32.639294+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:03.253537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.651653+0000","last_change":"2024-09-11T23:03:31.657767+0000","last_active":"2024-09-11T23:03:32.651653+0000","last_peered":"2024-09-11T23:03:32.651653+0000","last_clean":"2024-09-11T23:03:32.651653+0000","last_became_active":"2024-09-11T23:03:31.656481+0000","last_became_peered":"2024-09-11T23:03:31.656481+0000","last_unstale":"2024-09-11T23:03:32.651653+0000","last_undegraded":"2024-09-11T23:03:32.651653+0000","last_fullsized":"2024-09-11T23:03:32.651653+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:17.931079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.653237+0000","last_change":"2024-09-11T23:03:30.658131+0000","last_active":"2024-09-11T23:03:32.653237+0000","last_peered":"2024-09-11T23:03:32.653237+0000","last_clean":"2024-09-11T23:03:32.653237+0000","last_became_active":"2024-09-11T23:03:30.655737+0000","last_became_peered":"2024-09-11T23:03:30.655737+0000","last_unstale":"2024-09-11T23:03:32.653237+0000","last_undegraded":"2024-09-11T23:03:32.653237+0000","last_fullsized":"2024-09-11T23:03:32.653237+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:43.385721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.021095+0000","last_change":"2024-09-11T23:03:31.678439+0000","last_active":"2024-09-11T23:03:34.021095+0000","last_peered":"2024-09-11T23:03:34.021095+0000","last_clean":"2024-09-11T23:03:34.021095+0000","last_became_active":"2024-09-11T23:03:31.677947+0000","last_became_peered":"2024-09-11T23:03:31.677947+0000","last_unstale":"2024-09-11T23:03:34.021095+0000","last_undegraded":"2024-09-11T23:03:34.021095+0000","last_fullsized":"2024-09-11T23:03:34.021095+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:55.777013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.641695+0000","last_change":"2024-09-11T23:03:30.664333+0000","last_active":"2024-09-11T23:03:32.641695+0000","last_peered":"2024-09-11T23:03:32.641695+0000","last_clean":"2024-09-11T23:03:32.641695+0000","last_became_active":"2024-09-11T23:03:30.664058+0000","last_became_peered":"2024-09-11T23:03:30.664058+0000","last_unstale":"2024-09-11T23:03:32.641695+0000","last_undegraded":"2024-09-11T23:03:32.641695+0000","last_fullsized":"2024-09-11T23:03:32.641695+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:39.066030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.641111+0000","last_change":"2024-09-11T23:03:31.644698+0000","last_active":"2024-09-11T23:03:32.641111+0000","last_peered":"2024-09-11T23:03:32.641111+0000","last_clean":"2024-09-11T23:03:32.641111+0000","last_became_active":"2024-09-11T23:03:31.642741+0000","last_became_peered":"2024-09-11T23:03:31.642741+0000","last_unstale":"2024-09-11T23:03:32.641111+0000","last_undegraded":"2024-09-11T23:03:32.641111+0000","last_fullsized":"2024-09-11T23:03:32.641111+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:43.743616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"15'3","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.653250+0000","last_change":"2024-09-11T23:03:30.661999+0000","last_active":"2024-09-11T23:03:32.653250+0000","last_peered":"2024-09-11T23:03:32.653250+0000","last_clean":"2024-09-11T23:03:32.653250+0000","last_became_active":"2024-09-11T23:03:30.661483+0000","last_became_peered":"2024-09-11T23:03:30.661483+0000","last_unstale":"2024-09-11T23:03:32.653250+0000","last_undegraded":"2024-09-11T23:03:32.653250+0000","last_fullsized":"2024-09-11T23:03:32.653250+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:11.610671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.652520+0000","last_change":"2024-09-11T23:03:31.663054+0000","last_active":"2024-09-11T23:03:32.652520+0000","last_peered":"2024-09-11T23:03:32.652520+0000","last_clean":"2024-09-11T23:03:32.652520+0000","last_became_active":"2024-09-11T23:03:31.662588+0000","last_became_peered":"2024-09-11T23:03:31.662588+0000","last_unstale":"2024-09-11T23:03:32.652520+0000","last_undegraded":"2024-09-11T23:03:32.652520+0000","last_fullsized":"2024-09-11T23:03:32.652520+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:05.113429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"15'6","reported_seq":20,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.019486+0000","last_change":"2024-09-11T23:03:30.664300+0000","last_active":"2024-09-11T23:03:34.019486+0000","last_peered":"2024-09-11T23:03:34.019486+0000","last_clean":"2024-09-11T23:03:34.019486+0000","last_became_active":"2024-09-11T23:03:30.663600+0000","last_became_peered":"2024-09-11T23:03:30.663600+0000","last_unstale":"2024-09-11T23:03:34.019486+0000","last_undegraded":"2024-09-11T23:03:34.019486+0000","last_fullsized":"2024-09-11T23:03:34.019486+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:16:21.984941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.641293+0000","last_change":"2024-09-11T23:03:31.643144+0000","last_active":"2024-09-11T23:03:32.641293+0000","last_peered":"2024-09-11T23:03:32.641293+0000","last_clean":"2024-09-11T23:03:32.641293+0000","last_became_active":"2024-09-11T23:03:31.642819+0000","last_became_peered":"2024-09-11T23:03:31.642819+0000","last_unstale":"2024-09-11T23:03:32.641293+0000","last_undegraded":"2024-09-11T23:03:32.641293+0000","last_fullsized":"2024-09-11T23:03:32.641293+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:16.554918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"15'2","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.640359+0000","last_change":"2024-09-11T23:03:30.652612+0000","last_active":"2024-09-11T23:03:32.640359+0000","last_peered":"2024-09-11T23:03:32.640359+0000","last_clean":"2024-09-11T23:03:32.640359+0000","last_became_active":"2024-09-11T23:03:30.652343+0000","last_became_peered":"2024-09-11T23:03:30.652343+0000","last_unstale":"2024-09-11T23:03:32.640359+0000","last_undegraded":"2024-09-11T23:03:32.640359+0000","last_fullsized":"2024-09-11T23:03:32.640359+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:11.610671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.639803+0000","last_change":"2024-09-11T23:03:31.642382+0000","last_active":"2024-09-11T23:03:32.639803+0000","last_peered":"2024-09-11T23:03:32.639803+0000","last_clean":"2024-09-11T23:03:32.639803+0000","last_became_active":"2024-09-11T23:03:31.641739+0000","last_became_peered":"2024-09-11T23:03:31.641739+0000","last_unstale":"2024-09-11T23:03:32.639803+0000","last_undegraded":"2024-09-11T23:03:32.639803+0000","last_fullsized":"2024-09-11T23:03:32.639803+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:18.508782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.019392+0000","last_change":"2024-09-11T23:03:30.662995+0000","last_active":"2024-09-11T23:03:34.019392+0000","last_peered":"2024-09-11T23:03:34.019392+0000","last_clean":"2024-09-11T23:03:34.019392+0000","last_became_active":"2024-09-11T23:03:30.662463+0000","last_became_peered":"2024-09-11T23:03:30.662463+0000","last_unstale":"2024-09-11T23:03:34.019392+0000","last_undegraded":"2024-09-11T23:03:34.019392+0000","last_fullsized":"2024-09-11T23:03:34.019392+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:11.604671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.652220+0000","last_change":"2024-09-11T23:03:31.650998+0000","last_active":"2024-09-11T23:03:32.652220+0000","last_peered":"2024-09-11T23:03:32.652220+0000","last_clean":"2024-09-11T23:03:32.652220+0000","last_became_active":"2024-09-11T23:03:31.650439+0000","last_became_peered":"2024-09-11T23:03:31.650439+0000","last_unstale":"2024-09-11T23:03:32.652220+0000","last_undegraded":"2024-09-11T23:03:32.652220+0000","last_fullsized":"2024-09-11T23:03:32.652220+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:44.003355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.640822+0000","last_change":"2024-09-11T23:03:30.662321+0000","last_active":"2024-09-11T23:03:32.640822+0000","last_peered":"2024-09-11T23:03:32.640822+0000","last_clean":"2024-09-11T23:03:32.640822+0000","last_became_active":"2024-09-11T23:03:30.661916+0000","last_became_peered":"2024-09-11T23:03:30.661916+0000","last_unstale":"2024-09-11T23:03:32.640822+0000","last_undegraded":"2024-09-11T23:03:32.640822+0000","last_fullsized":"2024-09-11T23:03:32.640822+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:37.723285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.651683+0000","last_change":"2024-09-11T23:03:31.643564+0000","last_active":"2024-09-11T23:03:32.651683+0000","last_peered":"2024-09-11T23:03:32.651683+0000","last_clean":"2024-09-11T23:03:32.651683+0000","last_became_active":"2024-09-11T23:03:31.643289+0000","last_became_peered":"2024-09-11T23:03:31.643289+0000","last_unstale":"2024-09-11T23:03:32.651683+0000","last_undegraded":"2024-09-11T23:03:32.651683+0000","last_fullsized":"2024-09-11T23:03:32.651683+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:59.854206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"15'8","reported_seq":22,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.019661+0000","last_change":"2024-09-11T23:03:30.659134+0000","last_active":"2024-09-11T23:03:34.019661+0000","last_peered":"2024-09-11T23:03:34.019661+0000","last_clean":"2024-09-11T23:03:34.019661+0000","last_became_active":"2024-09-11T23:03:30.658788+0000","last_became_peered":"2024-09-11T23:03:30.658788+0000","last_unstale":"2024-09-11T23:03:34.019661+0000","last_undegraded":"2024-09-11T23:03:34.019661+0000","last_fullsized":"2024-09-11T23:03:34.019661+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:05.436819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.018881+0000","last_change":"2024-09-11T23:03:31.668569+0000","last_active":"2024-09-11T23:03:34.018881+0000","last_peered":"2024-09-11T23:03:34.018881+0000","last_clean":"2024-09-11T23:03:34.018881+0000","last_became_active":"2024-09-11T23:03:31.668015+0000","last_became_peered":"2024-09-11T23:03:31.668015+0000","last_unstale":"2024-09-11T23:03:34.018881+0000","last_undegraded":"2024-09-11T23:03:34.018881+0000","last_fullsized":"2024-09-11T23:03:34.018881+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:08.195338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"15'1","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.641733+0000","last_change":"2024-09-11T23:03:30.668018+0000","last_active":"2024-09-11T23:03:32.641733+0000","last_peered":"2024-09-11T23:03:32.641733+0000","last_clean":"2024-09-11T23:03:32.641733+0000","last_became_active":"2024-09-11T23:03:30.667416+0000","last_became_peered":"2024-09-11T23:03:30.667416+0000","last_unstale":"2024-09-11T23:03:32.641733+0000","last_undegraded":"2024-09-11T23:03:32.641733+0000","last_fullsized":"2024-09-11T23:03:32.641733+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:20.264643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.021439+0000","last_change":"2024-09-11T23:03:31.678504+0000","last_active":"2024-09-11T23:03:34.021439+0000","last_peered":"2024-09-11T23:03:34.021439+0000","last_clean":"2024-09-11T23:03:34.021439+0000","last_became_active":"2024-09-11T23:03:31.678027+0000","last_became_peered":"2024-09-11T23:03:31.678027+0000","last_unstale":"2024-09-11T23:03:34.021439+0000","last_undegraded":"2024-09-11T23:03:34.021439+0000","last_fullsized":"2024-09-11T23:03:34.021439+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:41.606488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"15'2","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.021816+0000","last_change":"2024-09-11T23:03:30.655788+0000","last_active":"2024-09-11T23:03:34.021816+0000","last_peered":"2024-09-11T23:03:34.021816+0000","last_clean":"2024-09-11T23:03:34.021816+0000","last_became_active":"2024-09-11T23:03:30.655370+0000","last_became_peered":"2024-09-11T23:03:30.655370+0000","last_unstale":"2024-09-11T23:03:34.021816+0000","last_undegraded":"2024-09-11T23:03:34.021816+0000","last_fullsized":"2024-09-11T23:03:34.021816+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:23.634393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.641290+0000","last_change":"2024-09-11T23:03:31.644215+0000","last_active":"2024-09-11T23:03:32.641290+0000","last_peered":"2024-09-11T23:03:32.641290+0000","last_clean":"2024-09-11T23:03:32.641290+0000","last_became_active":"2024-09-11T23:03:31.642396+0000","last_became_peered":"2024-09-11T23:03:31.642396+0000","last_unstale":"2024-09-11T23:03:32.641290+0000","last_undegraded":"2024-09-11T23:03:32.641290+0000","last_fullsized":"2024-09-11T23:03:32.641290+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:10.771587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"15'1","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.653550+0000","last_change":"2024-09-11T23:03:30.654962+0000","last_active":"2024-09-11T23:03:32.653550+0000","last_peered":"2024-09-11T23:03:32.653550+0000","last_clean":"2024-09-11T23:03:32.653550+0000","last_became_active":"2024-09-11T23:03:30.650356+0000","last_became_peered":"2024-09-11T23:03:30.650356+0000","last_unstale":"2024-09-11T23:03:32.653550+0000","last_undegraded":"2024-09-11T23:03:32.653550+0000","last_fullsized":"2024-09-11T23:03:32.653550+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:56.281332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.641625+0000","last_change":"2024-09-11T23:03:31.643251+0000","last_active":"2024-09-11T23:03:32.641625+0000","last_peered":"2024-09-11T23:03:32.641625+0000","last_clean":"2024-09-11T23:03:32.641625+0000","last_became_active":"2024-09-11T23:03:31.642954+0000","last_became_peered":"2024-09-11T23:03:31.642954+0000","last_unstale":"2024-09-11T23:03:32.641625+0000","last_undegraded":"2024-09-11T23:03:32.641625+0000","last_fullsized":"2024-09-11T23:03:32.641625+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:32:49.310206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.019612+0000","last_change":"2024-09-11T23:03:30.653720+0000","last_active":"2024-09-11T23:03:34.019612+0000","last_peered":"2024-09-11T23:03:34.019612+0000","last_clean":"2024-09-11T23:03:34.019612+0000","last_became_active":"2024-09-11T23:03:30.653076+0000","last_became_peered":"2024-09-11T23:03:30.653076+0000","last_unstale":"2024-09-11T23:03:34.019612+0000","last_undegraded":"2024-09-11T23:03:34.019612+0000","last_fullsized":"2024-09-11T23:03:34.019612+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:43.385721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.652999+0000","last_change":"2024-09-11T23:03:31.667091+0000","last_active":"2024-09-11T23:03:32.652999+0000","last_peered":"2024-09-11T23:03:32.652999+0000","last_clean":"2024-09-11T23:03:32.652999+0000","last_became_active":"2024-09-11T23:03:31.666762+0000","last_became_peered":"2024-09-11T23:03:31.666762+0000","last_unstale":"2024-09-11T23:03:32.652999+0000","last_undegraded":"2024-09-11T23:03:32.652999+0000","last_fullsized":"2024-09-11T23:03:32.652999+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:55.777013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":147,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.651980+0000","last_change":"2024-09-11T23:03:26.382905+0000","last_active":"2024-09-11T23:03:32.651980+0000","last_peered":"2024-09-11T23:03:32.651980+0000","last_clean":"2024-09-11T23:03:32.651980+0000","last_became_active":"2024-09-11T23:03:26.380590+0000","last_became_peered":"2024-09-11T23:03:26.380590+0000","last_unstale":"2024-09-11T23:03:32.651980+0000","last_undegraded":"2024-09-11T23:03:32.651980+0000","last_fullsized":"2024-09-11T23:03:32.651980+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:24.361793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:24.361793+0000","last_clean_scrub_stamp":"2024-09-11T23:03:24.361793+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:46.577063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.652368+0000","last_change":"2024-09-11T23:03:30.650947+0000","last_active":"2024-09-11T23:03:32.652368+0000","last_peered":"2024-09-11T23:03:32.652368+0000","last_clean":"2024-09-11T23:03:32.652368+0000","last_became_active":"2024-09-11T23:03:30.640787+0000","last_became_peered":"2024-09-11T23:03:30.640787+0000","last_unstale":"2024-09-11T23:03:32.652368+0000","last_undegraded":"2024-09-11T23:03:32.652368+0000","last_fullsized":"2024-09-11T23:03:32.652368+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:39.066030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.652019+0000","last_change":"2024-09-11T23:03:31.662781+0000","last_active":"2024-09-11T23:03:32.652019+0000","last_peered":"2024-09-11T23:03:32.652019+0000","last_clean":"2024-09-11T23:03:32.652019+0000","last_became_active":"2024-09-11T23:03:31.662481+0000","last_became_peered":"2024-09-11T23:03:31.662481+0000","last_unstale":"2024-09-11T23:03:32.652019+0000","last_undegraded":"2024-09-11T23:03:32.652019+0000","last_fullsized":"2024-09-11T23:03:32.652019+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:49.970021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.019682+0000","last_change":"2024-09-11T23:03:30.665053+0000","last_active":"2024-09-11T23:03:34.019682+0000","last_peered":"2024-09-11T23:03:34.019682+0000","last_clean":"2024-09-11T23:03:34.019682+0000","last_became_active":"2024-09-11T23:03:30.664393+0000","last_became_peered":"2024-09-11T23:03:30.664393+0000","last_unstale":"2024-09-11T23:03:34.019682+0000","last_undegraded":"2024-09-11T23:03:34.019682+0000","last_fullsized":"2024-09-11T23:03:34.019682+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:34:50.423468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.640052+0000","last_change":"2024-09-11T23:03:31.673415+0000","last_active":"2024-09-11T23:03:32.640052+0000","last_peered":"2024-09-11T23:03:32.640052+0000","last_clean":"2024-09-11T23:03:32.640052+0000","last_became_active":"2024-09-11T23:03:31.673160+0000","last_became_peered":"2024-09-11T23:03:31.673160+0000","last_unstale":"2024-09-11T23:03:32.640052+0000","last_undegraded":"2024-09-11T23:03:32.640052+0000","last_fullsized":"2024-09-11T23:03:32.640052+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:14.861688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.018899+0000","last_change":"2024-09-11T23:03:30.663975+0000","last_active":"2024-09-11T23:03:34.018899+0000","last_peered":"2024-09-11T23:03:34.018899+0000","last_clean":"2024-09-11T23:03:34.018899+0000","last_became_active":"2024-09-11T23:03:30.663612+0000","last_became_peered":"2024-09-11T23:03:30.663612+0000","last_unstale":"2024-09-11T23:03:34.018899+0000","last_undegraded":"2024-09-11T23:03:34.018899+0000","last_fullsized":"2024-09-11T23:03:34.018899+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:03.253537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.651695+0000","last_change":"2024-09-11T23:03:31.672101+0000","last_active":"2024-09-11T23:03:32.651695+0000","last_peered":"2024-09-11T23:03:32.651695+0000","last_clean":"2024-09-11T23:03:32.651695+0000","last_became_active":"2024-09-11T23:03:31.671541+0000","last_became_peered":"2024-09-11T23:03:31.671541+0000","last_unstale":"2024-09-11T23:03:32.651695+0000","last_undegraded":"2024-09-11T23:03:32.651695+0000","last_fullsized":"2024-09-11T23:03:32.651695+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:41.847795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.639948+0000","last_change":"2024-09-11T23:03:30.665266+0000","last_active":"2024-09-11T23:03:32.639948+0000","last_peered":"2024-09-11T23:03:32.639948+0000","last_clean":"2024-09-11T23:03:32.639948+0000","last_became_active":"2024-09-11T23:03:30.664313+0000","last_became_peered":"2024-09-11T23:03:30.664313+0000","last_unstale":"2024-09-11T23:03:32.639948+0000","last_undegraded":"2024-09-11T23:03:32.639948+0000","last_fullsized":"2024-09-11T23:03:32.639948+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:11.604671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.640278+0000","last_change":"2024-09-11T23:03:31.663884+0000","last_active":"2024-09-11T23:03:32.640278+0000","last_peered":"2024-09-11T23:03:32.640278+0000","last_clean":"2024-09-11T23:03:32.640278+0000","last_became_active":"2024-09-11T23:03:31.662007+0000","last_became_peered":"2024-09-11T23:03:31.662007+0000","last_unstale":"2024-09-11T23:03:32.640278+0000","last_undegraded":"2024-09-11T23:03:32.640278+0000","last_fullsized":"2024-09-11T23:03:32.640278+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:15.829193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.652616+0000","last_change":"2024-09-11T23:03:30.662279+0000","last_active":"2024-09-11T23:03:32.652616+0000","last_peered":"2024-09-11T23:03:32.652616+0000","last_clean":"2024-09-11T23:03:32.652616+0000","last_became_active":"2024-09-11T23:03:30.661872+0000","last_became_peered":"2024-09-11T23:03:30.661872+0000","last_unstale":"2024-09-11T23:03:32.652616+0000","last_undegraded":"2024-09-11T23:03:32.652616+0000","last_fullsized":"2024-09-11T23:03:32.652616+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:16:21.984941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.019849+0000","last_change":"2024-09-11T23:03:31.673516+0000","last_active":"2024-09-11T23:03:34.019849+0000","last_peered":"2024-09-11T23:03:34.019849+0000","last_clean":"2024-09-11T23:03:34.019849+0000","last_became_active":"2024-09-11T23:03:31.672911+0000","last_became_peered":"2024-09-11T23:03:31.672911+0000","last_unstale":"2024-09-11T23:03:34.019849+0000","last_undegraded":"2024-09-11T23:03:34.019849+0000","last_fullsized":"2024-09-11T23:03:34.019849+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:23.103838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.653544+0000","last_change":"2024-09-11T23:03:30.661744+0000","last_active":"2024-09-11T23:03:32.653544+0000","last_peered":"2024-09-11T23:03:32.653544+0000","last_clean":"2024-09-11T23:03:32.653544+0000","last_became_active":"2024-09-11T23:03:30.661193+0000","last_became_peered":"2024-09-11T23:03:30.661193+0000","last_unstale":"2024-09-11T23:03:32.653544+0000","last_undegraded":"2024-09-11T23:03:32.653544+0000","last_fullsized":"2024-09-11T23:03:32.653544+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:33:15.409459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.652637+0000","last_change":"2024-09-11T23:03:31.656724+0000","last_active":"2024-09-11T23:03:32.652637+0000","last_peered":"2024-09-11T23:03:32.652637+0000","last_clean":"2024-09-11T23:03:32.652637+0000","last_became_active":"2024-09-11T23:03:31.654951+0000","last_became_peered":"2024-09-11T23:03:31.654951+0000","last_unstale":"2024-09-11T23:03:32.652637+0000","last_undegraded":"2024-09-11T23:03:32.652637+0000","last_fullsized":"2024-09-11T23:03:32.652637+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:10.683627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"16'1","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.652897+0000","last_change":"2024-09-11T23:03:30.662133+0000","last_active":"2024-09-11T23:03:32.652897+0000","last_peered":"2024-09-11T23:03:32.652897+0000","last_clean":"2024-09-11T23:03:32.652897+0000","last_became_active":"2024-09-11T23:03:30.661549+0000","last_became_peered":"2024-09-11T23:03:30.661549+0000","last_unstale":"2024-09-11T23:03:32.652897+0000","last_undegraded":"2024-09-11T23:03:32.652897+0000","last_fullsized":"2024-09-11T23:03:32.652897+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:03.253537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.020280+0000","last_change":"2024-09-11T23:03:31.672813+0000","last_active":"2024-09-11T23:03:34.020280+0000","last_peered":"2024-09-11T23:03:34.020280+0000","last_clean":"2024-09-11T23:03:34.020280+0000","last_became_active":"2024-09-11T23:03:31.672523+0000","last_became_peered":"2024-09-11T23:03:31.672523+0000","last_unstale":"2024-09-11T23:03:34.020280+0000","last_undegraded":"2024-09-11T23:03:34.020280+0000","last_fullsized":"2024-09-11T23:03:34.020280+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:05.113429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"15'2","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.653333+0000","last_change":"2024-09-11T23:03:30.662637+0000","last_active":"2024-09-11T23:03:32.653333+0000","last_peered":"2024-09-11T23:03:32.653333+0000","last_clean":"2024-09-11T23:03:32.653333+0000","last_became_active":"2024-09-11T23:03:30.661392+0000","last_became_peered":"2024-09-11T23:03:30.661392+0000","last_unstale":"2024-09-11T23:03:32.653333+0000","last_undegraded":"2024-09-11T23:03:32.653333+0000","last_fullsized":"2024-09-11T23:03:32.653333+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:23.634393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.641604+0000","last_change":"2024-09-11T23:03:31.642675+0000","last_active":"2024-09-11T23:03:32.641604+0000","last_peered":"2024-09-11T23:03:32.641604+0000","last_clean":"2024-09-11T23:03:32.641604+0000","last_became_active":"2024-09-11T23:03:31.641871+0000","last_became_peered":"2024-09-11T23:03:31.641871+0000","last_unstale":"2024-09-11T23:03:32.641604+0000","last_undegraded":"2024-09-11T23:03:32.641604+0000","last_fullsized":"2024-09-11T23:03:32.641604+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:50.218638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.639358+0000","last_change":"2024-09-11T23:03:30.652950+0000","last_active":"2024-09-11T23:03:32.639358+0000","last_peered":"2024-09-11T23:03:32.639358+0000","last_clean":"2024-09-11T23:03:32.639358+0000","last_became_active":"2024-09-11T23:03:30.652537+0000","last_became_peered":"2024-09-11T23:03:30.652537+0000","last_unstale":"2024-09-11T23:03:32.639358+0000","last_undegraded":"2024-09-11T23:03:32.639358+0000","last_fullsized":"2024-09-11T23:03:32.639358+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:16:21.984941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.639555+0000","last_change":"2024-09-11T23:03:31.672747+0000","last_active":"2024-09-11T23:03:32.639555+0000","last_peered":"2024-09-11T23:03:32.639555+0000","last_clean":"2024-09-11T23:03:32.639555+0000","last_became_active":"2024-09-11T23:03:31.672498+0000","last_became_peered":"2024-09-11T23:03:31.672498+0000","last_unstale":"2024-09-11T23:03:32.639555+0000","last_undegraded":"2024-09-11T23:03:32.639555+0000","last_fullsized":"2024-09-11T23:03:32.639555+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:41.606488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.651768+0000","last_change":"2024-09-11T23:03:30.660463+0000","last_active":"2024-09-11T23:03:32.651768+0000","last_peered":"2024-09-11T23:03:32.651768+0000","last_clean":"2024-09-11T23:03:32.651768+0000","last_became_active":"2024-09-11T23:03:30.660103+0000","last_became_peered":"2024-09-11T23:03:30.660103+0000","last_unstale":"2024-09-11T23:03:32.651768+0000","last_undegraded":"2024-09-11T23:03:32.651768+0000","last_fullsized":"2024-09-11T23:03:32.651768+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:37.723285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.019397+0000","last_change":"2024-09-11T23:03:31.668311+0000","last_active":"2024-09-11T23:03:34.019397+0000","last_peered":"2024-09-11T23:03:34.019397+0000","last_clean":"2024-09-11T23:03:34.019397+0000","last_became_active":"2024-09-11T23:03:31.668035+0000","last_became_peered":"2024-09-11T23:03:31.668035+0000","last_unstale":"2024-09-11T23:03:34.019397+0000","last_undegraded":"2024-09-11T23:03:34.019397+0000","last_fullsized":"2024-09-11T23:03:34.019397+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:49.970021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.652066+0000","last_change":"2024-09-11T23:03:30.660477+0000","last_active":"2024-09-11T23:03:32.652066+0000","last_peered":"2024-09-11T23:03:32.652066+0000","last_clean":"2024-09-11T23:03:32.652066+0000","last_became_active":"2024-09-11T23:03:30.660094+0000","last_became_peered":"2024-09-11T23:03:30.660094+0000","last_unstale":"2024-09-11T23:03:32.652066+0000","last_undegraded":"2024-09-11T23:03:32.652066+0000","last_fullsized":"2024-09-11T23:03:32.652066+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:24.925590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.652212+0000","last_change":"2024-09-11T23:03:31.668020+0000","last_active":"2024-09-11T23:03:32.652212+0000","last_peered":"2024-09-11T23:03:32.652212+0000","last_clean":"2024-09-11T23:03:32.652212+0000","last_became_active":"2024-09-11T23:03:31.667719+0000","last_became_peered":"2024-09-11T23:03:31.667719+0000","last_unstale":"2024-09-11T23:03:32.652212+0000","last_undegraded":"2024-09-11T23:03:32.652212+0000","last_fullsized":"2024-09-11T23:03:32.652212+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:23.103838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"15'2","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.640585+0000","last_change":"2024-09-11T23:03:30.651711+0000","last_active":"2024-09-11T23:03:32.640585+0000","last_peered":"2024-09-11T23:03:32.640585+0000","last_clean":"2024-09-11T23:03:32.640585+0000","last_became_active":"2024-09-11T23:03:30.651348+0000","last_became_peered":"2024-09-11T23:03:30.651348+0000","last_unstale":"2024-09-11T23:03:32.640585+0000","last_undegraded":"2024-09-11T23:03:32.640585+0000","last_fullsized":"2024-09-11T23:03:32.640585+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:56.281332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.639820+0000","last_change":"2024-09-11T23:03:31.642102+0000","last_active":"2024-09-11T23:03:32.639820+0000","last_peered":"2024-09-11T23:03:32.639820+0000","last_clean":"2024-09-11T23:03:32.639820+0000","last_became_active":"2024-09-11T23:03:31.641618+0000","last_became_peered":"2024-09-11T23:03:31.641618+0000","last_unstale":"2024-09-11T23:03:32.639820+0000","last_undegraded":"2024-09-11T23:03:32.639820+0000","last_fullsized":"2024-09-11T23:03:32.639820+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:37.226596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.019413+0000","last_change":"2024-09-11T23:03:31.673693+0000","last_active":"2024-09-11T23:03:34.019413+0000","last_peered":"2024-09-11T23:03:34.019413+0000","last_clean":"2024-09-11T23:03:34.019413+0000","last_became_active":"2024-09-11T23:03:31.673405+0000","last_became_peered":"2024-09-11T23:03:31.673405+0000","last_unstale":"2024-09-11T23:03:34.019413+0000","last_undegraded":"2024-09-11T23:03:34.019413+0000","last_fullsized":"2024-09-11T23:03:34.019413+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:50:10.314960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"15'2","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.641899+0000","last_change":"2024-09-11T23:03:30.665363+0000","last_active":"2024-09-11T23:03:32.641899+0000","last_peered":"2024-09-11T23:03:32.641899+0000","last_clean":"2024-09-11T23:03:32.641899+0000","last_became_active":"2024-09-11T23:03:30.665036+0000","last_became_peered":"2024-09-11T23:03:30.665036+0000","last_unstale":"2024-09-11T23:03:32.641899+0000","last_undegraded":"2024-09-11T23:03:32.641899+0000","last_fullsized":"2024-09-11T23:03:32.641899+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:24.925590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.652476+0000","last_change":"2024-09-11T23:03:31.645731+0000","last_active":"2024-09-11T23:03:32.652476+0000","last_peered":"2024-09-11T23:03:32.652476+0000","last_clean":"2024-09-11T23:03:32.652476+0000","last_became_active":"2024-09-11T23:03:31.645437+0000","last_became_peered":"2024-09-11T23:03:31.645437+0000","last_unstale":"2024-09-11T23:03:32.652476+0000","last_undegraded":"2024-09-11T23:03:32.652476+0000","last_fullsized":"2024-09-11T23:03:32.652476+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:47.643082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"15'2","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.641658+0000","last_change":"2024-09-11T23:03:30.665521+0000","last_active":"2024-09-11T23:03:32.641658+0000","last_peered":"2024-09-11T23:03:32.641658+0000","last_clean":"2024-09-11T23:03:32.641658+0000","last_became_active":"2024-09-11T23:03:30.664488+0000","last_became_peered":"2024-09-11T23:03:30.664488+0000","last_unstale":"2024-09-11T23:03:32.641658+0000","last_undegraded":"2024-09-11T23:03:32.641658+0000","last_fullsized":"2024-09-11T23:03:32.641658+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:23.634393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.641163+0000","last_change":"2024-09-11T23:03:31.643030+0000","last_active":"2024-09-11T23:03:32.641163+0000","last_peered":"2024-09-11T23:03:32.641163+0000","last_clean":"2024-09-11T23:03:32.641163+0000","last_became_active":"2024-09-11T23:03:31.642037+0000","last_became_peered":"2024-09-11T23:03:31.642037+0000","last_unstale":"2024-09-11T23:03:32.641163+0000","last_undegraded":"2024-09-11T23:03:32.641163+0000","last_fullsized":"2024-09-11T23:03:32.641163+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:14.694041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"15'1","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.021502+0000","last_change":"2024-09-11T23:03:30.653547+0000","last_active":"2024-09-11T23:03:34.021502+0000","last_peered":"2024-09-11T23:03:34.021502+0000","last_clean":"2024-09-11T23:03:34.021502+0000","last_became_active":"2024-09-11T23:03:30.652566+0000","last_became_peered":"2024-09-11T23:03:30.652566+0000","last_unstale":"2024-09-11T23:03:34.021502+0000","last_undegraded":"2024-09-11T23:03:34.021502+0000","last_fullsized":"2024-09-11T23:03:34.021502+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:39.066030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.020775+0000","last_change":"2024-09-11T23:03:31.678214+0000","last_active":"2024-09-11T23:03:34.020775+0000","last_peered":"2024-09-11T23:03:34.020775+0000","last_clean":"2024-09-11T23:03:34.020775+0000","last_became_active":"2024-09-11T23:03:31.677646+0000","last_became_peered":"2024-09-11T23:03:31.677646+0000","last_unstale":"2024-09-11T23:03:34.020775+0000","last_undegraded":"2024-09-11T23:03:34.020775+0000","last_fullsized":"2024-09-11T23:03:34.020775+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:33.451482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"15'4","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.641547+0000","last_change":"2024-09-11T23:03:30.667990+0000","last_active":"2024-09-11T23:03:32.641547+0000","last_peered":"2024-09-11T23:03:32.641547+0000","last_clean":"2024-09-11T23:03:32.641547+0000","last_became_active":"2024-09-11T23:03:30.667696+0000","last_became_peered":"2024-09-11T23:03:30.667696+0000","last_unstale":"2024-09-11T23:03:32.641547+0000","last_undegraded":"2024-09-11T23:03:32.641547+0000","last_fullsized":"2024-09-11T23:03:32.641547+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:33:15.409459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":159744,"data_stored":44486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":761856,"data_stored":635514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":74,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":749568,"data_stored":633866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:03:39.285 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:03:39.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.429+0000 7f449aa1d640 1 Processor -- start 2024-09-11T23:03:39.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.429+0000 7f449aa1d640 1 -- start start 2024-09-11T23:03:39.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.433+0000 7f449aa1d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f44940a5280 0x7f449409f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:39.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.433+0000 7f449aa1d640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44940a14c0 con 0x7f44940a4ea0 2024-09-11T23:03:39.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.433+0000 7f449aa1d640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f44940a1760 con 0x7f44940a5280 2024-09-11T23:03:39.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.433+0000 7f44937fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f44940a5280 0x7f449409f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:39.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.433+0000 7f4493fff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f44940a4ea0 0x7f449409f190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:49682/0 (socket says 172.21.15.12:49682) 2024-09-11T23:03:39.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.433+0000 7f44937fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f44940a5280 0x7f449409f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35288/0 (socket says 172.21.15.12:35288) 2024-09-11T23:03:39.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.433+0000 7f4493fff640 1 -- 172.21.15.12:0/310568133 learned_addr learned my addr 172.21.15.12:0/310568133 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:03:39.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.433+0000 7f44937fe640 1 -- 172.21.15.12:0/310568133 >> v1:172.21.15.12:6789/0 conn(0x7f44940a4ea0 legacy=0x7f449409f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:39.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.433+0000 7f44937fe640 1 -- 172.21.15.12:0/310568133 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44940a0d30 con 0x7f44940a5280 2024-09-11T23:03:39.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.433+0000 7f4492ffd640 1 -- 172.21.15.12:0/310568133 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2940353126 0 0) 0x7f44940a14c0 con 0x7f44940a4ea0 2024-09-11T23:03:39.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.433+0000 7f44937fe640 1 --2- 172.21.15.12:0/310568133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44940a5280 0x7f449409f8a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4484009d90 tx=0x7f448401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1f2594a53c2674a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:39.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.433+0000 7f4492ffd640 1 -- 172.21.15.12:0/310568133 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44840b2070 con 0x7f44940a5280 2024-09-11T23:03:39.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.433+0000 7f4492ffd640 1 -- 172.21.15.12:0/310568133 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44840a5630 con 0x7f44940a5280 2024-09-11T23:03:39.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.433+0000 7f4492ffd640 1 -- 172.21.15.12:0/310568133 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44840a5930 con 0x7f44940a5280 2024-09-11T23:03:39.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.433+0000 7f449aa1d640 1 -- 172.21.15.12:0/310568133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44940a5280 msgr2=0x7f449409f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:39.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.433+0000 7f449aa1d640 1 --2- 172.21.15.12:0/310568133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44940a5280 0x7f449409f8a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4484009d90 tx=0x7f448401c8e0 comp rx=0 tx=0).stop 2024-09-11T23:03:39.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.433+0000 7f449aa1d640 1 -- 172.21.15.12:0/310568133 shutdown_connections 2024-09-11T23:03:39.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.433+0000 7f449aa1d640 1 --2- 172.21.15.12:0/310568133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44940a5280 0x7f449409f8a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:39.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.433+0000 7f449aa1d640 1 -- 172.21.15.12:0/310568133 >> 172.21.15.12:0/310568133 conn(0x7f44940a8450 msgr2=0x7f44940a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:39.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.433+0000 7f449aa1d640 1 -- 172.21.15.12:0/310568133 shutdown_connections 2024-09-11T23:03:39.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.433+0000 7f449aa1d640 1 -- 172.21.15.12:0/310568133 wait complete. 2024-09-11T23:03:39.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.437+0000 7f449aa1d640 1 Processor -- start 2024-09-11T23:03:39.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.437+0000 7f449aa1d640 1 -- start start 2024-09-11T23:03:39.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.437+0000 7f449aa1d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44940a4ea0 0x7f4494135790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:39.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.437+0000 7f449aa1d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f44940a2030 con 0x7f44940a4ea0 2024-09-11T23:03:39.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.437+0000 7f4493fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44940a4ea0 0x7f4494135790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:39.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.437+0000 7f4493fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44940a4ea0 0x7f4494135790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35290/0 (socket says 172.21.15.12:35290) 2024-09-11T23:03:39.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.437+0000 7f4493fff640 1 -- 172.21.15.12:0/3680567736 learned_addr learned my addr 172.21.15.12:0/3680567736 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:39.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.437+0000 7f4493fff640 1 -- 172.21.15.12:0/3680567736 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f449411eb30 con 0x7f44940a4ea0 2024-09-11T23:03:39.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.437+0000 7f4493fff640 1 --2- 172.21.15.12:0/3680567736 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44940a4ea0 0x7f4494135790 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f447c00c420 tx=0x7f447c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:39.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.437+0000 7f4490ff9640 1 -- 172.21.15.12:0/3680567736 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f447c018070 con 0x7f44940a4ea0 2024-09-11T23:03:39.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.437+0000 7f4490ff9640 1 -- 172.21.15.12:0/3680567736 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f447c0074d0 con 0x7f44940a4ea0 2024-09-11T23:03:39.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.437+0000 7f4490ff9640 1 -- 172.21.15.12:0/3680567736 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f447c004960 con 0x7f44940a4ea0 2024-09-11T23:03:39.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.437+0000 7f449aa1d640 1 -- 172.21.15.12:0/3680567736 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4494120040 con 0x7f44940a4ea0 2024-09-11T23:03:39.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.437+0000 7f449aa1d640 1 -- 172.21.15.12:0/3680567736 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f449413ba50 con 0x7f44940a4ea0 2024-09-11T23:03:39.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.437+0000 7f4490ff9640 1 -- 172.21.15.12:0/3680567736 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f447c01b070 con 0x7f44940a4ea0 2024-09-11T23:03:39.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.437+0000 7f449aa1d640 1 -- 172.21.15.12:0/3680567736 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f449409fd60 con 0x7f44940a4ea0 2024-09-11T23:03:39.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.437+0000 7f4490ff9640 1 --2- 172.21.15.12:0/3680567736 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f4474035db0 0x7f4474038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:39.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.437+0000 7f4490ff9640 1 -- 172.21.15.12:0/3680567736 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3439+0+0 (secure 0 0 0) 0x7f447c047aa0 con 0x7f44940a4ea0 2024-09-11T23:03:39.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.437+0000 7f44937fe640 1 --2- 172.21.15.12:0/3680567736 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f4474035db0 0x7f4474038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:39.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.437+0000 7f44937fe640 1 --2- 172.21.15.12:0/3680567736 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f4474035db0 0x7f4474038270 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f44840af000 tx=0x7f44840a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:39.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.441+0000 7f4490ff9640 1 -- 172.21.15.12:0/3680567736 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f447c01c9d0 con 0x7f44940a4ea0 2024-09-11T23:03:39.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.597+0000 7f449aa1d640 1 -- 172.21.15.12:0/3680567736 --> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f449409f190 con 0x7f4474035db0 2024-09-11T23:03:39.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.613+0000 7f4490ff9640 1 -- 172.21.15.12:0/3680567736 <== mgr.4099 v2:172.21.15.12:6824/2765460338 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245915 (secure 0 0 0) 0x7f449409f190 con 0x7f4474035db0 2024-09-11T23:03:39.617 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:03:39.619 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-11T23:03:39.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.617+0000 7f449aa1d640 1 -- 172.21.15.12:0/3680567736 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f4474035db0 msgr2=0x7f4474038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:39.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.617+0000 7f449aa1d640 1 --2- 172.21.15.12:0/3680567736 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f4474035db0 0x7f4474038270 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f44840af000 tx=0x7f44840a7070 comp rx=0 tx=0).stop 2024-09-11T23:03:39.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.617+0000 7f449aa1d640 1 -- 172.21.15.12:0/3680567736 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44940a4ea0 msgr2=0x7f4494135790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:39.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.617+0000 7f449aa1d640 1 --2- 172.21.15.12:0/3680567736 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44940a4ea0 0x7f4494135790 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f447c00c420 tx=0x7f447c00c8e0 comp rx=0 tx=0).stop 2024-09-11T23:03:39.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.617+0000 7f449aa1d640 1 -- 172.21.15.12:0/3680567736 shutdown_connections 2024-09-11T23:03:39.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.617+0000 7f449aa1d640 1 --2- 172.21.15.12:0/3680567736 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f4474035db0 0x7f4474038270 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:39.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.617+0000 7f449aa1d640 1 --2- 172.21.15.12:0/3680567736 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44940a4ea0 0x7f4494135790 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:39.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.617+0000 7f449aa1d640 1 -- 172.21.15.12:0/3680567736 >> 172.21.15.12:0/3680567736 conn(0x7f44940a8450 msgr2=0x7f449413bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:39.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.617+0000 7f449aa1d640 1 -- 172.21.15.12:0/3680567736 shutdown_connections 2024-09-11T23:03:39.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.617+0000 7f449aa1d640 1 -- 172.21.15.12:0/3680567736 wait complete. 2024-09-11T23:03:39.635 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-11T23:03:39.516987+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":182,"num_write_kb":1908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":82728,"kb_used_data":1632,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283032792,"statfs":{"total":289910292480,"available":289825579008,"internally_reserved":0,"allocated":1671168,"data_stored":1313866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":82963791},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002057"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.640948+0000","last_change":"2024-09-11T23:03:31.644980+0000","last_active":"2024-09-11T23:03:32.640948+0000","last_peered":"2024-09-11T23:03:32.640948+0000","last_clean":"2024-09-11T23:03:32.640948+0000","last_became_active":"2024-09-11T23:03:31.643322+0000","last_became_peered":"2024-09-11T23:03:31.643322+0000","last_unstale":"2024-09-11T23:03:32.640948+0000","last_undegraded":"2024-09-11T23:03:32.640948+0000","last_fullsized":"2024-09-11T23:03:32.640948+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:27.729873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.652887+0000","last_change":"2024-09-11T23:03:31.650677+0000","last_active":"2024-09-11T23:03:32.652887+0000","last_peered":"2024-09-11T23:03:32.652887+0000","last_clean":"2024-09-11T23:03:32.652887+0000","last_became_active":"2024-09-11T23:03:31.650405+0000","last_became_peered":"2024-09-11T23:03:31.650405+0000","last_unstale":"2024-09-11T23:03:32.652887+0000","last_undegraded":"2024-09-11T23:03:32.652887+0000","last_fullsized":"2024-09-11T23:03:32.652887+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:33.451482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.641555+0000","last_change":"2024-09-11T23:03:31.658194+0000","last_active":"2024-09-11T23:03:32.641555+0000","last_peered":"2024-09-11T23:03:32.641555+0000","last_clean":"2024-09-11T23:03:32.641555+0000","last_became_active":"2024-09-11T23:03:31.657911+0000","last_became_peered":"2024-09-11T23:03:31.657911+0000","last_unstale":"2024-09-11T23:03:32.641555+0000","last_undegraded":"2024-09-11T23:03:32.641555+0000","last_fullsized":"2024-09-11T23:03:32.641555+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:32.481125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.019254+0000","last_change":"2024-09-11T23:03:31.676906+0000","last_active":"2024-09-11T23:03:34.019254+0000","last_peered":"2024-09-11T23:03:34.019254+0000","last_clean":"2024-09-11T23:03:34.019254+0000","last_became_active":"2024-09-11T23:03:31.676592+0000","last_became_peered":"2024-09-11T23:03:31.676592+0000","last_unstale":"2024-09-11T23:03:34.019254+0000","last_undegraded":"2024-09-11T23:03:34.019254+0000","last_fullsized":"2024-09-11T23:03:34.019254+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:41.847795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.640491+0000","last_change":"2024-09-11T23:03:31.657824+0000","last_active":"2024-09-11T23:03:32.640491+0000","last_peered":"2024-09-11T23:03:32.640491+0000","last_clean":"2024-09-11T23:03:32.640491+0000","last_became_active":"2024-09-11T23:03:31.657535+0000","last_became_peered":"2024-09-11T23:03:31.657535+0000","last_unstale":"2024-09-11T23:03:32.640491+0000","last_undegraded":"2024-09-11T23:03:32.640491+0000","last_fullsized":"2024-09-11T23:03:32.640491+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:27.767863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.018908+0000","last_change":"2024-09-11T23:03:31.673561+0000","last_active":"2024-09-11T23:03:34.018908+0000","last_peered":"2024-09-11T23:03:34.018908+0000","last_clean":"2024-09-11T23:03:34.018908+0000","last_became_active":"2024-09-11T23:03:31.672515+0000","last_became_peered":"2024-09-11T23:03:31.672515+0000","last_unstale":"2024-09-11T23:03:34.018908+0000","last_undegraded":"2024-09-11T23:03:34.018908+0000","last_fullsized":"2024-09-11T23:03:34.018908+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:52.318572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.640534+0000","last_change":"2024-09-11T23:03:31.640733+0000","last_active":"2024-09-11T23:03:32.640534+0000","last_peered":"2024-09-11T23:03:32.640534+0000","last_clean":"2024-09-11T23:03:32.640534+0000","last_became_active":"2024-09-11T23:03:31.640419+0000","last_became_peered":"2024-09-11T23:03:31.640419+0000","last_unstale":"2024-09-11T23:03:32.640534+0000","last_undegraded":"2024-09-11T23:03:32.640534+0000","last_fullsized":"2024-09-11T23:03:32.640534+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:37.026086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.018431+0000","last_change":"2024-09-11T23:03:31.677179+0000","last_active":"2024-09-11T23:03:34.018431+0000","last_peered":"2024-09-11T23:03:34.018431+0000","last_clean":"2024-09-11T23:03:34.018431+0000","last_became_active":"2024-09-11T23:03:31.670449+0000","last_became_peered":"2024-09-11T23:03:31.670449+0000","last_unstale":"2024-09-11T23:03:34.018431+0000","last_undegraded":"2024-09-11T23:03:34.018431+0000","last_fullsized":"2024-09-11T23:03:34.018431+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:42.095319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.653219+0000","last_change":"2024-09-11T23:03:31.652750+0000","last_active":"2024-09-11T23:03:32.653219+0000","last_peered":"2024-09-11T23:03:32.653219+0000","last_clean":"2024-09-11T23:03:32.653219+0000","last_became_active":"2024-09-11T23:03:31.651659+0000","last_became_peered":"2024-09-11T23:03:31.651659+0000","last_unstale":"2024-09-11T23:03:32.653219+0000","last_undegraded":"2024-09-11T23:03:32.653219+0000","last_fullsized":"2024-09-11T23:03:32.653219+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:46.452154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.641542+0000","last_change":"2024-09-11T23:03:31.658062+0000","last_active":"2024-09-11T23:03:32.641542+0000","last_peered":"2024-09-11T23:03:32.641542+0000","last_clean":"2024-09-11T23:03:32.641542+0000","last_became_active":"2024-09-11T23:03:31.657713+0000","last_became_peered":"2024-09-11T23:03:31.657713+0000","last_unstale":"2024-09-11T23:03:32.641542+0000","last_undegraded":"2024-09-11T23:03:32.641542+0000","last_fullsized":"2024-09-11T23:03:32.641542+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:35.915905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.641119+0000","last_change":"2024-09-11T23:03:31.644330+0000","last_active":"2024-09-11T23:03:32.641119+0000","last_peered":"2024-09-11T23:03:32.641119+0000","last_clean":"2024-09-11T23:03:32.641119+0000","last_became_active":"2024-09-11T23:03:31.644082+0000","last_became_peered":"2024-09-11T23:03:31.644082+0000","last_unstale":"2024-09-11T23:03:32.641119+0000","last_undegraded":"2024-09-11T23:03:32.641119+0000","last_fullsized":"2024-09-11T23:03:32.641119+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:45.448849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.641082+0000","last_change":"2024-09-11T23:03:31.642201+0000","last_active":"2024-09-11T23:03:32.641082+0000","last_peered":"2024-09-11T23:03:32.641082+0000","last_clean":"2024-09-11T23:03:32.641082+0000","last_became_active":"2024-09-11T23:03:31.641846+0000","last_became_peered":"2024-09-11T23:03:31.641846+0000","last_unstale":"2024-09-11T23:03:32.641082+0000","last_undegraded":"2024-09-11T23:03:32.641082+0000","last_fullsized":"2024-09-11T23:03:32.641082+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:05.316156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.640544+0000","last_change":"2024-09-11T23:03:31.656241+0000","last_active":"2024-09-11T23:03:32.640544+0000","last_peered":"2024-09-11T23:03:32.640544+0000","last_clean":"2024-09-11T23:03:32.640544+0000","last_became_active":"2024-09-11T23:03:31.655038+0000","last_became_peered":"2024-09-11T23:03:31.655038+0000","last_unstale":"2024-09-11T23:03:32.640544+0000","last_undegraded":"2024-09-11T23:03:32.640544+0000","last_fullsized":"2024-09-11T23:03:32.640544+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:32.257331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.639641+0000","last_change":"2024-09-11T23:03:31.642497+0000","last_active":"2024-09-11T23:03:32.639641+0000","last_peered":"2024-09-11T23:03:32.639641+0000","last_clean":"2024-09-11T23:03:32.639641+0000","last_became_active":"2024-09-11T23:03:31.642002+0000","last_became_peered":"2024-09-11T23:03:31.642002+0000","last_unstale":"2024-09-11T23:03:32.639641+0000","last_undegraded":"2024-09-11T23:03:32.639641+0000","last_fullsized":"2024-09-11T23:03:32.639641+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:46.452154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.651813+0000","last_change":"2024-09-11T23:03:31.645457+0000","last_active":"2024-09-11T23:03:32.651813+0000","last_peered":"2024-09-11T23:03:32.651813+0000","last_clean":"2024-09-11T23:03:32.651813+0000","last_became_active":"2024-09-11T23:03:31.643894+0000","last_became_peered":"2024-09-11T23:03:31.643894+0000","last_unstale":"2024-09-11T23:03:32.651813+0000","last_undegraded":"2024-09-11T23:03:32.651813+0000","last_fullsized":"2024-09-11T23:03:32.651813+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:50:10.314960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.018911+0000","last_change":"2024-09-11T23:03:31.678032+0000","last_active":"2024-09-11T23:03:34.018911+0000","last_peered":"2024-09-11T23:03:34.018911+0000","last_clean":"2024-09-11T23:03:34.018911+0000","last_became_active":"2024-09-11T23:03:31.672976+0000","last_became_peered":"2024-09-11T23:03:31.672976+0000","last_unstale":"2024-09-11T23:03:34.018911+0000","last_undegraded":"2024-09-11T23:03:34.018911+0000","last_fullsized":"2024-09-11T23:03:34.018911+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:17.931079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.653399+0000","last_change":"2024-09-11T23:03:31.652625+0000","last_active":"2024-09-11T23:03:32.653399+0000","last_peered":"2024-09-11T23:03:32.653399+0000","last_clean":"2024-09-11T23:03:32.653399+0000","last_became_active":"2024-09-11T23:03:31.651397+0000","last_became_peered":"2024-09-11T23:03:31.651397+0000","last_unstale":"2024-09-11T23:03:32.653399+0000","last_undegraded":"2024-09-11T23:03:32.653399+0000","last_fullsized":"2024-09-11T23:03:32.653399+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:28.517523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.020235+0000","last_change":"2024-09-11T23:03:31.673847+0000","last_active":"2024-09-11T23:03:34.020235+0000","last_peered":"2024-09-11T23:03:34.020235+0000","last_clean":"2024-09-11T23:03:34.020235+0000","last_became_active":"2024-09-11T23:03:31.673484+0000","last_became_peered":"2024-09-11T23:03:31.673484+0000","last_unstale":"2024-09-11T23:03:34.020235+0000","last_undegraded":"2024-09-11T23:03:34.020235+0000","last_fullsized":"2024-09-11T23:03:34.020235+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:47.643082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.641493+0000","last_change":"2024-09-11T23:03:31.658165+0000","last_active":"2024-09-11T23:03:32.641493+0000","last_peered":"2024-09-11T23:03:32.641493+0000","last_clean":"2024-09-11T23:03:32.641493+0000","last_became_active":"2024-09-11T23:03:31.657520+0000","last_became_peered":"2024-09-11T23:03:31.657520+0000","last_unstale":"2024-09-11T23:03:32.641493+0000","last_undegraded":"2024-09-11T23:03:32.641493+0000","last_fullsized":"2024-09-11T23:03:32.641493+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:57.723854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.641206+0000","last_change":"2024-09-11T23:03:31.641111+0000","last_active":"2024-09-11T23:03:32.641206+0000","last_peered":"2024-09-11T23:03:32.641206+0000","last_clean":"2024-09-11T23:03:32.641206+0000","last_became_active":"2024-09-11T23:03:31.640663+0000","last_became_peered":"2024-09-11T23:03:31.640663+0000","last_unstale":"2024-09-11T23:03:32.641206+0000","last_undegraded":"2024-09-11T23:03:32.641206+0000","last_fullsized":"2024-09-11T23:03:32.641206+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:31.065660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.639998+0000","last_change":"2024-09-11T23:03:31.657160+0000","last_active":"2024-09-11T23:03:32.639998+0000","last_peered":"2024-09-11T23:03:32.639998+0000","last_clean":"2024-09-11T23:03:32.639998+0000","last_became_active":"2024-09-11T23:03:31.655894+0000","last_became_peered":"2024-09-11T23:03:31.655894+0000","last_unstale":"2024-09-11T23:03:32.639998+0000","last_undegraded":"2024-09-11T23:03:32.639998+0000","last_fullsized":"2024-09-11T23:03:32.639998+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:05.223112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.652057+0000","last_change":"2024-09-11T23:03:31.651347+0000","last_active":"2024-09-11T23:03:32.652057+0000","last_peered":"2024-09-11T23:03:32.652057+0000","last_clean":"2024-09-11T23:03:32.652057+0000","last_became_active":"2024-09-11T23:03:31.650762+0000","last_became_peered":"2024-09-11T23:03:31.650762+0000","last_unstale":"2024-09-11T23:03:32.652057+0000","last_undegraded":"2024-09-11T23:03:32.652057+0000","last_fullsized":"2024-09-11T23:03:32.652057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:52.318572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.639551+0000","last_change":"2024-09-11T23:03:31.649698+0000","last_active":"2024-09-11T23:03:32.639551+0000","last_peered":"2024-09-11T23:03:32.639551+0000","last_clean":"2024-09-11T23:03:32.639551+0000","last_became_active":"2024-09-11T23:03:31.649443+0000","last_became_peered":"2024-09-11T23:03:31.649443+0000","last_unstale":"2024-09-11T23:03:32.639551+0000","last_undegraded":"2024-09-11T23:03:32.639551+0000","last_fullsized":"2024-09-11T23:03:32.639551+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:55.777013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.639281+0000","last_change":"2024-09-11T23:03:31.674478+0000","last_active":"2024-09-11T23:03:32.639281+0000","last_peered":"2024-09-11T23:03:32.639281+0000","last_clean":"2024-09-11T23:03:32.639281+0000","last_became_active":"2024-09-11T23:03:31.674069+0000","last_became_peered":"2024-09-11T23:03:31.674069+0000","last_unstale":"2024-09-11T23:03:32.639281+0000","last_undegraded":"2024-09-11T23:03:32.639281+0000","last_fullsized":"2024-09-11T23:03:32.639281+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:33.451482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.020124+0000","last_change":"2024-09-11T23:03:31.673244+0000","last_active":"2024-09-11T23:03:34.020124+0000","last_peered":"2024-09-11T23:03:34.020124+0000","last_clean":"2024-09-11T23:03:34.020124+0000","last_became_active":"2024-09-11T23:03:31.672958+0000","last_became_peered":"2024-09-11T23:03:31.672958+0000","last_unstale":"2024-09-11T23:03:34.020124+0000","last_undegraded":"2024-09-11T23:03:34.020124+0000","last_fullsized":"2024-09-11T23:03:34.020124+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:44.003355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.020488+0000","last_change":"2024-09-11T23:03:31.677762+0000","last_active":"2024-09-11T23:03:34.020488+0000","last_peered":"2024-09-11T23:03:34.020488+0000","last_clean":"2024-09-11T23:03:34.020488+0000","last_became_active":"2024-09-11T23:03:31.677183+0000","last_became_peered":"2024-09-11T23:03:31.677183+0000","last_unstale":"2024-09-11T23:03:34.020488+0000","last_undegraded":"2024-09-11T23:03:34.020488+0000","last_fullsized":"2024-09-11T23:03:34.020488+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:10.683627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.653028+0000","last_change":"2024-09-11T23:03:31.659006+0000","last_active":"2024-09-11T23:03:32.653028+0000","last_peered":"2024-09-11T23:03:32.653028+0000","last_clean":"2024-09-11T23:03:32.653028+0000","last_became_active":"2024-09-11T23:03:31.658753+0000","last_became_peered":"2024-09-11T23:03:31.658753+0000","last_unstale":"2024-09-11T23:03:32.653028+0000","last_undegraded":"2024-09-11T23:03:32.653028+0000","last_fullsized":"2024-09-11T23:03:32.653028+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:41.606488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.641472+0000","last_change":"2024-09-11T23:03:31.663269+0000","last_active":"2024-09-11T23:03:32.641472+0000","last_peered":"2024-09-11T23:03:32.641472+0000","last_clean":"2024-09-11T23:03:32.641472+0000","last_became_active":"2024-09-11T23:03:31.661949+0000","last_became_peered":"2024-09-11T23:03:31.661949+0000","last_unstale":"2024-09-11T23:03:32.641472+0000","last_undegraded":"2024-09-11T23:03:32.641472+0000","last_fullsized":"2024-09-11T23:03:32.641472+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:49.515173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.639941+0000","last_change":"2024-09-11T23:03:31.663932+0000","last_active":"2024-09-11T23:03:32.639941+0000","last_peered":"2024-09-11T23:03:32.639941+0000","last_clean":"2024-09-11T23:03:32.639941+0000","last_became_active":"2024-09-11T23:03:31.663346+0000","last_became_peered":"2024-09-11T23:03:31.663346+0000","last_unstale":"2024-09-11T23:03:32.639941+0000","last_undegraded":"2024-09-11T23:03:32.639941+0000","last_fullsized":"2024-09-11T23:03:32.639941+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:43.655855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.639647+0000","last_change":"2024-09-11T23:03:31.663998+0000","last_active":"2024-09-11T23:03:32.639647+0000","last_peered":"2024-09-11T23:03:32.639647+0000","last_clean":"2024-09-11T23:03:32.639647+0000","last_became_active":"2024-09-11T23:03:31.663608+0000","last_became_peered":"2024-09-11T23:03:31.663608+0000","last_unstale":"2024-09-11T23:03:32.639647+0000","last_undegraded":"2024-09-11T23:03:32.639647+0000","last_fullsized":"2024-09-11T23:03:32.639647+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:28.517523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.018663+0000","last_change":"2024-09-11T23:03:31.668324+0000","last_active":"2024-09-11T23:03:34.018663+0000","last_peered":"2024-09-11T23:03:34.018663+0000","last_clean":"2024-09-11T23:03:34.018663+0000","last_became_active":"2024-09-11T23:03:31.667670+0000","last_became_peered":"2024-09-11T23:03:31.667670+0000","last_unstale":"2024-09-11T23:03:34.018663+0000","last_undegraded":"2024-09-11T23:03:34.018663+0000","last_fullsized":"2024-09-11T23:03:34.018663+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:39.031797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.018932+0000","last_change":"2024-09-11T23:03:31.678992+0000","last_active":"2024-09-11T23:03:34.018932+0000","last_peered":"2024-09-11T23:03:34.018932+0000","last_clean":"2024-09-11T23:03:34.018932+0000","last_became_active":"2024-09-11T23:03:31.676531+0000","last_became_peered":"2024-09-11T23:03:31.676531+0000","last_unstale":"2024-09-11T23:03:34.018932+0000","last_undegraded":"2024-09-11T23:03:34.018932+0000","last_fullsized":"2024-09-11T23:03:34.018932+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:59.854206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.651913+0000","last_change":"2024-09-11T23:03:31.657027+0000","last_active":"2024-09-11T23:03:32.651913+0000","last_peered":"2024-09-11T23:03:32.651913+0000","last_clean":"2024-09-11T23:03:32.651913+0000","last_became_active":"2024-09-11T23:03:31.656728+0000","last_became_peered":"2024-09-11T23:03:31.656728+0000","last_unstale":"2024-09-11T23:03:32.651913+0000","last_undegraded":"2024-09-11T23:03:32.651913+0000","last_fullsized":"2024-09-11T23:03:32.651913+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:13.638867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"15'1","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.652367+0000","last_change":"2024-09-11T23:03:30.660455+0000","last_active":"2024-09-11T23:03:32.652367+0000","last_peered":"2024-09-11T23:03:32.652367+0000","last_clean":"2024-09-11T23:03:32.652367+0000","last_became_active":"2024-09-11T23:03:30.660052+0000","last_became_peered":"2024-09-11T23:03:30.660052+0000","last_unstale":"2024-09-11T23:03:32.652367+0000","last_undegraded":"2024-09-11T23:03:32.652367+0000","last_fullsized":"2024-09-11T23:03:32.652367+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:11.604671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.640097+0000","last_change":"2024-09-11T23:03:31.644592+0000","last_active":"2024-09-11T23:03:32.640097+0000","last_peered":"2024-09-11T23:03:32.640097+0000","last_clean":"2024-09-11T23:03:32.640097+0000","last_became_active":"2024-09-11T23:03:31.644297+0000","last_became_peered":"2024-09-11T23:03:31.644297+0000","last_unstale":"2024-09-11T23:03:32.640097+0000","last_undegraded":"2024-09-11T23:03:32.640097+0000","last_fullsized":"2024-09-11T23:03:32.640097+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:50.216329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"15'1","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.019138+0000","last_change":"2024-09-11T23:03:30.653792+0000","last_active":"2024-09-11T23:03:34.019138+0000","last_peered":"2024-09-11T23:03:34.019138+0000","last_clean":"2024-09-11T23:03:34.019138+0000","last_became_active":"2024-09-11T23:03:30.653493+0000","last_became_peered":"2024-09-11T23:03:30.653493+0000","last_unstale":"2024-09-11T23:03:34.019138+0000","last_undegraded":"2024-09-11T23:03:34.019138+0000","last_fullsized":"2024-09-11T23:03:34.019138+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:37.723285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.640281+0000","last_change":"2024-09-11T23:03:30.653094+0000","last_active":"2024-09-11T23:03:32.640281+0000","last_peered":"2024-09-11T23:03:32.640281+0000","last_clean":"2024-09-11T23:03:32.640281+0000","last_became_active":"2024-09-11T23:03:30.652770+0000","last_became_peered":"2024-09-11T23:03:30.652770+0000","last_unstale":"2024-09-11T23:03:32.640281+0000","last_undegraded":"2024-09-11T23:03:32.640281+0000","last_fullsized":"2024-09-11T23:03:32.640281+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:43.385721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.019366+0000","last_change":"2024-09-11T23:03:31.679465+0000","last_active":"2024-09-11T23:03:34.019366+0000","last_peered":"2024-09-11T23:03:34.019366+0000","last_clean":"2024-09-11T23:03:34.019366+0000","last_became_active":"2024-09-11T23:03:31.677617+0000","last_became_peered":"2024-09-11T23:03:31.677617+0000","last_unstale":"2024-09-11T23:03:34.019366+0000","last_undegraded":"2024-09-11T23:03:34.019366+0000","last_fullsized":"2024-09-11T23:03:34.019366+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:13.638867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.639294+0000","last_change":"2024-09-11T23:03:30.663136+0000","last_active":"2024-09-11T23:03:32.639294+0000","last_peered":"2024-09-11T23:03:32.639294+0000","last_clean":"2024-09-11T23:03:32.639294+0000","last_became_active":"2024-09-11T23:03:30.662724+0000","last_became_peered":"2024-09-11T23:03:30.662724+0000","last_unstale":"2024-09-11T23:03:32.639294+0000","last_undegraded":"2024-09-11T23:03:32.639294+0000","last_fullsized":"2024-09-11T23:03:32.639294+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:03.253537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.651653+0000","last_change":"2024-09-11T23:03:31.657767+0000","last_active":"2024-09-11T23:03:32.651653+0000","last_peered":"2024-09-11T23:03:32.651653+0000","last_clean":"2024-09-11T23:03:32.651653+0000","last_became_active":"2024-09-11T23:03:31.656481+0000","last_became_peered":"2024-09-11T23:03:31.656481+0000","last_unstale":"2024-09-11T23:03:32.651653+0000","last_undegraded":"2024-09-11T23:03:32.651653+0000","last_fullsized":"2024-09-11T23:03:32.651653+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:17.931079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.653237+0000","last_change":"2024-09-11T23:03:30.658131+0000","last_active":"2024-09-11T23:03:32.653237+0000","last_peered":"2024-09-11T23:03:32.653237+0000","last_clean":"2024-09-11T23:03:32.653237+0000","last_became_active":"2024-09-11T23:03:30.655737+0000","last_became_peered":"2024-09-11T23:03:30.655737+0000","last_unstale":"2024-09-11T23:03:32.653237+0000","last_undegraded":"2024-09-11T23:03:32.653237+0000","last_fullsized":"2024-09-11T23:03:32.653237+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:43.385721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.021095+0000","last_change":"2024-09-11T23:03:31.678439+0000","last_active":"2024-09-11T23:03:34.021095+0000","last_peered":"2024-09-11T23:03:34.021095+0000","last_clean":"2024-09-11T23:03:34.021095+0000","last_became_active":"2024-09-11T23:03:31.677947+0000","last_became_peered":"2024-09-11T23:03:31.677947+0000","last_unstale":"2024-09-11T23:03:34.021095+0000","last_undegraded":"2024-09-11T23:03:34.021095+0000","last_fullsized":"2024-09-11T23:03:34.021095+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:55.777013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.641695+0000","last_change":"2024-09-11T23:03:30.664333+0000","last_active":"2024-09-11T23:03:32.641695+0000","last_peered":"2024-09-11T23:03:32.641695+0000","last_clean":"2024-09-11T23:03:32.641695+0000","last_became_active":"2024-09-11T23:03:30.664058+0000","last_became_peered":"2024-09-11T23:03:30.664058+0000","last_unstale":"2024-09-11T23:03:32.641695+0000","last_undegraded":"2024-09-11T23:03:32.641695+0000","last_fullsized":"2024-09-11T23:03:32.641695+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:39.066030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.641111+0000","last_change":"2024-09-11T23:03:31.644698+0000","last_active":"2024-09-11T23:03:32.641111+0000","last_peered":"2024-09-11T23:03:32.641111+0000","last_clean":"2024-09-11T23:03:32.641111+0000","last_became_active":"2024-09-11T23:03:31.642741+0000","last_became_peered":"2024-09-11T23:03:31.642741+0000","last_unstale":"2024-09-11T23:03:32.641111+0000","last_undegraded":"2024-09-11T23:03:32.641111+0000","last_fullsized":"2024-09-11T23:03:32.641111+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:43.743616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"15'3","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.653250+0000","last_change":"2024-09-11T23:03:30.661999+0000","last_active":"2024-09-11T23:03:32.653250+0000","last_peered":"2024-09-11T23:03:32.653250+0000","last_clean":"2024-09-11T23:03:32.653250+0000","last_became_active":"2024-09-11T23:03:30.661483+0000","last_became_peered":"2024-09-11T23:03:30.661483+0000","last_unstale":"2024-09-11T23:03:32.653250+0000","last_undegraded":"2024-09-11T23:03:32.653250+0000","last_fullsized":"2024-09-11T23:03:32.653250+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:11.610671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.652520+0000","last_change":"2024-09-11T23:03:31.663054+0000","last_active":"2024-09-11T23:03:32.652520+0000","last_peered":"2024-09-11T23:03:32.652520+0000","last_clean":"2024-09-11T23:03:32.652520+0000","last_became_active":"2024-09-11T23:03:31.662588+0000","last_became_peered":"2024-09-11T23:03:31.662588+0000","last_unstale":"2024-09-11T23:03:32.652520+0000","last_undegraded":"2024-09-11T23:03:32.652520+0000","last_fullsized":"2024-09-11T23:03:32.652520+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:05.113429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"15'6","reported_seq":20,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.019486+0000","last_change":"2024-09-11T23:03:30.664300+0000","last_active":"2024-09-11T23:03:34.019486+0000","last_peered":"2024-09-11T23:03:34.019486+0000","last_clean":"2024-09-11T23:03:34.019486+0000","last_became_active":"2024-09-11T23:03:30.663600+0000","last_became_peered":"2024-09-11T23:03:30.663600+0000","last_unstale":"2024-09-11T23:03:34.019486+0000","last_undegraded":"2024-09-11T23:03:34.019486+0000","last_fullsized":"2024-09-11T23:03:34.019486+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:16:21.984941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.641293+0000","last_change":"2024-09-11T23:03:31.643144+0000","last_active":"2024-09-11T23:03:32.641293+0000","last_peered":"2024-09-11T23:03:32.641293+0000","last_clean":"2024-09-11T23:03:32.641293+0000","last_became_active":"2024-09-11T23:03:31.642819+0000","last_became_peered":"2024-09-11T23:03:31.642819+0000","last_unstale":"2024-09-11T23:03:32.641293+0000","last_undegraded":"2024-09-11T23:03:32.641293+0000","last_fullsized":"2024-09-11T23:03:32.641293+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:16.554918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"15'2","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.640359+0000","last_change":"2024-09-11T23:03:30.652612+0000","last_active":"2024-09-11T23:03:32.640359+0000","last_peered":"2024-09-11T23:03:32.640359+0000","last_clean":"2024-09-11T23:03:32.640359+0000","last_became_active":"2024-09-11T23:03:30.652343+0000","last_became_peered":"2024-09-11T23:03:30.652343+0000","last_unstale":"2024-09-11T23:03:32.640359+0000","last_undegraded":"2024-09-11T23:03:32.640359+0000","last_fullsized":"2024-09-11T23:03:32.640359+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:11.610671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.639803+0000","last_change":"2024-09-11T23:03:31.642382+0000","last_active":"2024-09-11T23:03:32.639803+0000","last_peered":"2024-09-11T23:03:32.639803+0000","last_clean":"2024-09-11T23:03:32.639803+0000","last_became_active":"2024-09-11T23:03:31.641739+0000","last_became_peered":"2024-09-11T23:03:31.641739+0000","last_unstale":"2024-09-11T23:03:32.639803+0000","last_undegraded":"2024-09-11T23:03:32.639803+0000","last_fullsized":"2024-09-11T23:03:32.639803+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:18.508782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.019392+0000","last_change":"2024-09-11T23:03:30.662995+0000","last_active":"2024-09-11T23:03:34.019392+0000","last_peered":"2024-09-11T23:03:34.019392+0000","last_clean":"2024-09-11T23:03:34.019392+0000","last_became_active":"2024-09-11T23:03:30.662463+0000","last_became_peered":"2024-09-11T23:03:30.662463+0000","last_unstale":"2024-09-11T23:03:34.019392+0000","last_undegraded":"2024-09-11T23:03:34.019392+0000","last_fullsized":"2024-09-11T23:03:34.019392+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:11.604671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.652220+0000","last_change":"2024-09-11T23:03:31.650998+0000","last_active":"2024-09-11T23:03:32.652220+0000","last_peered":"2024-09-11T23:03:32.652220+0000","last_clean":"2024-09-11T23:03:32.652220+0000","last_became_active":"2024-09-11T23:03:31.650439+0000","last_became_peered":"2024-09-11T23:03:31.650439+0000","last_unstale":"2024-09-11T23:03:32.652220+0000","last_undegraded":"2024-09-11T23:03:32.652220+0000","last_fullsized":"2024-09-11T23:03:32.652220+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:44.003355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.640822+0000","last_change":"2024-09-11T23:03:30.662321+0000","last_active":"2024-09-11T23:03:32.640822+0000","last_peered":"2024-09-11T23:03:32.640822+0000","last_clean":"2024-09-11T23:03:32.640822+0000","last_became_active":"2024-09-11T23:03:30.661916+0000","last_became_peered":"2024-09-11T23:03:30.661916+0000","last_unstale":"2024-09-11T23:03:32.640822+0000","last_undegraded":"2024-09-11T23:03:32.640822+0000","last_fullsized":"2024-09-11T23:03:32.640822+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:37.723285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.651683+0000","last_change":"2024-09-11T23:03:31.643564+0000","last_active":"2024-09-11T23:03:32.651683+0000","last_peered":"2024-09-11T23:03:32.651683+0000","last_clean":"2024-09-11T23:03:32.651683+0000","last_became_active":"2024-09-11T23:03:31.643289+0000","last_became_peered":"2024-09-11T23:03:31.643289+0000","last_unstale":"2024-09-11T23:03:32.651683+0000","last_undegraded":"2024-09-11T23:03:32.651683+0000","last_fullsized":"2024-09-11T23:03:32.651683+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:59.854206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"15'8","reported_seq":22,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.019661+0000","last_change":"2024-09-11T23:03:30.659134+0000","last_active":"2024-09-11T23:03:34.019661+0000","last_peered":"2024-09-11T23:03:34.019661+0000","last_clean":"2024-09-11T23:03:34.019661+0000","last_became_active":"2024-09-11T23:03:30.658788+0000","last_became_peered":"2024-09-11T23:03:30.658788+0000","last_unstale":"2024-09-11T23:03:34.019661+0000","last_undegraded":"2024-09-11T23:03:34.019661+0000","last_fullsized":"2024-09-11T23:03:34.019661+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:05.436819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.018881+0000","last_change":"2024-09-11T23:03:31.668569+0000","last_active":"2024-09-11T23:03:34.018881+0000","last_peered":"2024-09-11T23:03:34.018881+0000","last_clean":"2024-09-11T23:03:34.018881+0000","last_became_active":"2024-09-11T23:03:31.668015+0000","last_became_peered":"2024-09-11T23:03:31.668015+0000","last_unstale":"2024-09-11T23:03:34.018881+0000","last_undegraded":"2024-09-11T23:03:34.018881+0000","last_fullsized":"2024-09-11T23:03:34.018881+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:08.195338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"15'1","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.641733+0000","last_change":"2024-09-11T23:03:30.668018+0000","last_active":"2024-09-11T23:03:32.641733+0000","last_peered":"2024-09-11T23:03:32.641733+0000","last_clean":"2024-09-11T23:03:32.641733+0000","last_became_active":"2024-09-11T23:03:30.667416+0000","last_became_peered":"2024-09-11T23:03:30.667416+0000","last_unstale":"2024-09-11T23:03:32.641733+0000","last_undegraded":"2024-09-11T23:03:32.641733+0000","last_fullsized":"2024-09-11T23:03:32.641733+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:20.264643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.021439+0000","last_change":"2024-09-11T23:03:31.678504+0000","last_active":"2024-09-11T23:03:34.021439+0000","last_peered":"2024-09-11T23:03:34.021439+0000","last_clean":"2024-09-11T23:03:34.021439+0000","last_became_active":"2024-09-11T23:03:31.678027+0000","last_became_peered":"2024-09-11T23:03:31.678027+0000","last_unstale":"2024-09-11T23:03:34.021439+0000","last_undegraded":"2024-09-11T23:03:34.021439+0000","last_fullsized":"2024-09-11T23:03:34.021439+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:41.606488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"15'2","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.021816+0000","last_change":"2024-09-11T23:03:30.655788+0000","last_active":"2024-09-11T23:03:34.021816+0000","last_peered":"2024-09-11T23:03:34.021816+0000","last_clean":"2024-09-11T23:03:34.021816+0000","last_became_active":"2024-09-11T23:03:30.655370+0000","last_became_peered":"2024-09-11T23:03:30.655370+0000","last_unstale":"2024-09-11T23:03:34.021816+0000","last_undegraded":"2024-09-11T23:03:34.021816+0000","last_fullsized":"2024-09-11T23:03:34.021816+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:23.634393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.641290+0000","last_change":"2024-09-11T23:03:31.644215+0000","last_active":"2024-09-11T23:03:32.641290+0000","last_peered":"2024-09-11T23:03:32.641290+0000","last_clean":"2024-09-11T23:03:32.641290+0000","last_became_active":"2024-09-11T23:03:31.642396+0000","last_became_peered":"2024-09-11T23:03:31.642396+0000","last_unstale":"2024-09-11T23:03:32.641290+0000","last_undegraded":"2024-09-11T23:03:32.641290+0000","last_fullsized":"2024-09-11T23:03:32.641290+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:10.771587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"15'1","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.653550+0000","last_change":"2024-09-11T23:03:30.654962+0000","last_active":"2024-09-11T23:03:32.653550+0000","last_peered":"2024-09-11T23:03:32.653550+0000","last_clean":"2024-09-11T23:03:32.653550+0000","last_became_active":"2024-09-11T23:03:30.650356+0000","last_became_peered":"2024-09-11T23:03:30.650356+0000","last_unstale":"2024-09-11T23:03:32.653550+0000","last_undegraded":"2024-09-11T23:03:32.653550+0000","last_fullsized":"2024-09-11T23:03:32.653550+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:56.281332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.641625+0000","last_change":"2024-09-11T23:03:31.643251+0000","last_active":"2024-09-11T23:03:32.641625+0000","last_peered":"2024-09-11T23:03:32.641625+0000","last_clean":"2024-09-11T23:03:32.641625+0000","last_became_active":"2024-09-11T23:03:31.642954+0000","last_became_peered":"2024-09-11T23:03:31.642954+0000","last_unstale":"2024-09-11T23:03:32.641625+0000","last_undegraded":"2024-09-11T23:03:32.641625+0000","last_fullsized":"2024-09-11T23:03:32.641625+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:32:49.310206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.019612+0000","last_change":"2024-09-11T23:03:30.653720+0000","last_active":"2024-09-11T23:03:34.019612+0000","last_peered":"2024-09-11T23:03:34.019612+0000","last_clean":"2024-09-11T23:03:34.019612+0000","last_became_active":"2024-09-11T23:03:30.653076+0000","last_became_peered":"2024-09-11T23:03:30.653076+0000","last_unstale":"2024-09-11T23:03:34.019612+0000","last_undegraded":"2024-09-11T23:03:34.019612+0000","last_fullsized":"2024-09-11T23:03:34.019612+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:43.385721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.652999+0000","last_change":"2024-09-11T23:03:31.667091+0000","last_active":"2024-09-11T23:03:32.652999+0000","last_peered":"2024-09-11T23:03:32.652999+0000","last_clean":"2024-09-11T23:03:32.652999+0000","last_became_active":"2024-09-11T23:03:31.666762+0000","last_became_peered":"2024-09-11T23:03:31.666762+0000","last_unstale":"2024-09-11T23:03:32.652999+0000","last_undegraded":"2024-09-11T23:03:32.652999+0000","last_fullsized":"2024-09-11T23:03:32.652999+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:55.777013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":147,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.651980+0000","last_change":"2024-09-11T23:03:26.382905+0000","last_active":"2024-09-11T23:03:32.651980+0000","last_peered":"2024-09-11T23:03:32.651980+0000","last_clean":"2024-09-11T23:03:32.651980+0000","last_became_active":"2024-09-11T23:03:26.380590+0000","last_became_peered":"2024-09-11T23:03:26.380590+0000","last_unstale":"2024-09-11T23:03:32.651980+0000","last_undegraded":"2024-09-11T23:03:32.651980+0000","last_fullsized":"2024-09-11T23:03:32.651980+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:24.361793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:24.361793+0000","last_clean_scrub_stamp":"2024-09-11T23:03:24.361793+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:46.577063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.652368+0000","last_change":"2024-09-11T23:03:30.650947+0000","last_active":"2024-09-11T23:03:32.652368+0000","last_peered":"2024-09-11T23:03:32.652368+0000","last_clean":"2024-09-11T23:03:32.652368+0000","last_became_active":"2024-09-11T23:03:30.640787+0000","last_became_peered":"2024-09-11T23:03:30.640787+0000","last_unstale":"2024-09-11T23:03:32.652368+0000","last_undegraded":"2024-09-11T23:03:32.652368+0000","last_fullsized":"2024-09-11T23:03:32.652368+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:39.066030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.652019+0000","last_change":"2024-09-11T23:03:31.662781+0000","last_active":"2024-09-11T23:03:32.652019+0000","last_peered":"2024-09-11T23:03:32.652019+0000","last_clean":"2024-09-11T23:03:32.652019+0000","last_became_active":"2024-09-11T23:03:31.662481+0000","last_became_peered":"2024-09-11T23:03:31.662481+0000","last_unstale":"2024-09-11T23:03:32.652019+0000","last_undegraded":"2024-09-11T23:03:32.652019+0000","last_fullsized":"2024-09-11T23:03:32.652019+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:49.970021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.019682+0000","last_change":"2024-09-11T23:03:30.665053+0000","last_active":"2024-09-11T23:03:34.019682+0000","last_peered":"2024-09-11T23:03:34.019682+0000","last_clean":"2024-09-11T23:03:34.019682+0000","last_became_active":"2024-09-11T23:03:30.664393+0000","last_became_peered":"2024-09-11T23:03:30.664393+0000","last_unstale":"2024-09-11T23:03:34.019682+0000","last_undegraded":"2024-09-11T23:03:34.019682+0000","last_fullsized":"2024-09-11T23:03:34.019682+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:34:50.423468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.640052+0000","last_change":"2024-09-11T23:03:31.673415+0000","last_active":"2024-09-11T23:03:32.640052+0000","last_peered":"2024-09-11T23:03:32.640052+0000","last_clean":"2024-09-11T23:03:32.640052+0000","last_became_active":"2024-09-11T23:03:31.673160+0000","last_became_peered":"2024-09-11T23:03:31.673160+0000","last_unstale":"2024-09-11T23:03:32.640052+0000","last_undegraded":"2024-09-11T23:03:32.640052+0000","last_fullsized":"2024-09-11T23:03:32.640052+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:14.861688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.018899+0000","last_change":"2024-09-11T23:03:30.663975+0000","last_active":"2024-09-11T23:03:34.018899+0000","last_peered":"2024-09-11T23:03:34.018899+0000","last_clean":"2024-09-11T23:03:34.018899+0000","last_became_active":"2024-09-11T23:03:30.663612+0000","last_became_peered":"2024-09-11T23:03:30.663612+0000","last_unstale":"2024-09-11T23:03:34.018899+0000","last_undegraded":"2024-09-11T23:03:34.018899+0000","last_fullsized":"2024-09-11T23:03:34.018899+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:03.253537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.651695+0000","last_change":"2024-09-11T23:03:31.672101+0000","last_active":"2024-09-11T23:03:32.651695+0000","last_peered":"2024-09-11T23:03:32.651695+0000","last_clean":"2024-09-11T23:03:32.651695+0000","last_became_active":"2024-09-11T23:03:31.671541+0000","last_became_peered":"2024-09-11T23:03:31.671541+0000","last_unstale":"2024-09-11T23:03:32.651695+0000","last_undegraded":"2024-09-11T23:03:32.651695+0000","last_fullsized":"2024-09-11T23:03:32.651695+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:41.847795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.639948+0000","last_change":"2024-09-11T23:03:30.665266+0000","last_active":"2024-09-11T23:03:32.639948+0000","last_peered":"2024-09-11T23:03:32.639948+0000","last_clean":"2024-09-11T23:03:32.639948+0000","last_became_active":"2024-09-11T23:03:30.664313+0000","last_became_peered":"2024-09-11T23:03:30.664313+0000","last_unstale":"2024-09-11T23:03:32.639948+0000","last_undegraded":"2024-09-11T23:03:32.639948+0000","last_fullsized":"2024-09-11T23:03:32.639948+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:11.604671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.640278+0000","last_change":"2024-09-11T23:03:31.663884+0000","last_active":"2024-09-11T23:03:32.640278+0000","last_peered":"2024-09-11T23:03:32.640278+0000","last_clean":"2024-09-11T23:03:32.640278+0000","last_became_active":"2024-09-11T23:03:31.662007+0000","last_became_peered":"2024-09-11T23:03:31.662007+0000","last_unstale":"2024-09-11T23:03:32.640278+0000","last_undegraded":"2024-09-11T23:03:32.640278+0000","last_fullsized":"2024-09-11T23:03:32.640278+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:15.829193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.652616+0000","last_change":"2024-09-11T23:03:30.662279+0000","last_active":"2024-09-11T23:03:32.652616+0000","last_peered":"2024-09-11T23:03:32.652616+0000","last_clean":"2024-09-11T23:03:32.652616+0000","last_became_active":"2024-09-11T23:03:30.661872+0000","last_became_peered":"2024-09-11T23:03:30.661872+0000","last_unstale":"2024-09-11T23:03:32.652616+0000","last_undegraded":"2024-09-11T23:03:32.652616+0000","last_fullsized":"2024-09-11T23:03:32.652616+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:16:21.984941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.019849+0000","last_change":"2024-09-11T23:03:31.673516+0000","last_active":"2024-09-11T23:03:34.019849+0000","last_peered":"2024-09-11T23:03:34.019849+0000","last_clean":"2024-09-11T23:03:34.019849+0000","last_became_active":"2024-09-11T23:03:31.672911+0000","last_became_peered":"2024-09-11T23:03:31.672911+0000","last_unstale":"2024-09-11T23:03:34.019849+0000","last_undegraded":"2024-09-11T23:03:34.019849+0000","last_fullsized":"2024-09-11T23:03:34.019849+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:23.103838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.653544+0000","last_change":"2024-09-11T23:03:30.661744+0000","last_active":"2024-09-11T23:03:32.653544+0000","last_peered":"2024-09-11T23:03:32.653544+0000","last_clean":"2024-09-11T23:03:32.653544+0000","last_became_active":"2024-09-11T23:03:30.661193+0000","last_became_peered":"2024-09-11T23:03:30.661193+0000","last_unstale":"2024-09-11T23:03:32.653544+0000","last_undegraded":"2024-09-11T23:03:32.653544+0000","last_fullsized":"2024-09-11T23:03:32.653544+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:33:15.409459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.652637+0000","last_change":"2024-09-11T23:03:31.656724+0000","last_active":"2024-09-11T23:03:32.652637+0000","last_peered":"2024-09-11T23:03:32.652637+0000","last_clean":"2024-09-11T23:03:32.652637+0000","last_became_active":"2024-09-11T23:03:31.654951+0000","last_became_peered":"2024-09-11T23:03:31.654951+0000","last_unstale":"2024-09-11T23:03:32.652637+0000","last_undegraded":"2024-09-11T23:03:32.652637+0000","last_fullsized":"2024-09-11T23:03:32.652637+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:10.683627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"16'1","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.652897+0000","last_change":"2024-09-11T23:03:30.662133+0000","last_active":"2024-09-11T23:03:32.652897+0000","last_peered":"2024-09-11T23:03:32.652897+0000","last_clean":"2024-09-11T23:03:32.652897+0000","last_became_active":"2024-09-11T23:03:30.661549+0000","last_became_peered":"2024-09-11T23:03:30.661549+0000","last_unstale":"2024-09-11T23:03:32.652897+0000","last_undegraded":"2024-09-11T23:03:32.652897+0000","last_fullsized":"2024-09-11T23:03:32.652897+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:03.253537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.020280+0000","last_change":"2024-09-11T23:03:31.672813+0000","last_active":"2024-09-11T23:03:34.020280+0000","last_peered":"2024-09-11T23:03:34.020280+0000","last_clean":"2024-09-11T23:03:34.020280+0000","last_became_active":"2024-09-11T23:03:31.672523+0000","last_became_peered":"2024-09-11T23:03:31.672523+0000","last_unstale":"2024-09-11T23:03:34.020280+0000","last_undegraded":"2024-09-11T23:03:34.020280+0000","last_fullsized":"2024-09-11T23:03:34.020280+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:05.113429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"15'2","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.653333+0000","last_change":"2024-09-11T23:03:30.662637+0000","last_active":"2024-09-11T23:03:32.653333+0000","last_peered":"2024-09-11T23:03:32.653333+0000","last_clean":"2024-09-11T23:03:32.653333+0000","last_became_active":"2024-09-11T23:03:30.661392+0000","last_became_peered":"2024-09-11T23:03:30.661392+0000","last_unstale":"2024-09-11T23:03:32.653333+0000","last_undegraded":"2024-09-11T23:03:32.653333+0000","last_fullsized":"2024-09-11T23:03:32.653333+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:23.634393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.641604+0000","last_change":"2024-09-11T23:03:31.642675+0000","last_active":"2024-09-11T23:03:32.641604+0000","last_peered":"2024-09-11T23:03:32.641604+0000","last_clean":"2024-09-11T23:03:32.641604+0000","last_became_active":"2024-09-11T23:03:31.641871+0000","last_became_peered":"2024-09-11T23:03:31.641871+0000","last_unstale":"2024-09-11T23:03:32.641604+0000","last_undegraded":"2024-09-11T23:03:32.641604+0000","last_fullsized":"2024-09-11T23:03:32.641604+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:50.218638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.639358+0000","last_change":"2024-09-11T23:03:30.652950+0000","last_active":"2024-09-11T23:03:32.639358+0000","last_peered":"2024-09-11T23:03:32.639358+0000","last_clean":"2024-09-11T23:03:32.639358+0000","last_became_active":"2024-09-11T23:03:30.652537+0000","last_became_peered":"2024-09-11T23:03:30.652537+0000","last_unstale":"2024-09-11T23:03:32.639358+0000","last_undegraded":"2024-09-11T23:03:32.639358+0000","last_fullsized":"2024-09-11T23:03:32.639358+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:16:21.984941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.639555+0000","last_change":"2024-09-11T23:03:31.672747+0000","last_active":"2024-09-11T23:03:32.639555+0000","last_peered":"2024-09-11T23:03:32.639555+0000","last_clean":"2024-09-11T23:03:32.639555+0000","last_became_active":"2024-09-11T23:03:31.672498+0000","last_became_peered":"2024-09-11T23:03:31.672498+0000","last_unstale":"2024-09-11T23:03:32.639555+0000","last_undegraded":"2024-09-11T23:03:32.639555+0000","last_fullsized":"2024-09-11T23:03:32.639555+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:41.606488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.651768+0000","last_change":"2024-09-11T23:03:30.660463+0000","last_active":"2024-09-11T23:03:32.651768+0000","last_peered":"2024-09-11T23:03:32.651768+0000","last_clean":"2024-09-11T23:03:32.651768+0000","last_became_active":"2024-09-11T23:03:30.660103+0000","last_became_peered":"2024-09-11T23:03:30.660103+0000","last_unstale":"2024-09-11T23:03:32.651768+0000","last_undegraded":"2024-09-11T23:03:32.651768+0000","last_fullsized":"2024-09-11T23:03:32.651768+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:37.723285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.019397+0000","last_change":"2024-09-11T23:03:31.668311+0000","last_active":"2024-09-11T23:03:34.019397+0000","last_peered":"2024-09-11T23:03:34.019397+0000","last_clean":"2024-09-11T23:03:34.019397+0000","last_became_active":"2024-09-11T23:03:31.668035+0000","last_became_peered":"2024-09-11T23:03:31.668035+0000","last_unstale":"2024-09-11T23:03:34.019397+0000","last_undegraded":"2024-09-11T23:03:34.019397+0000","last_fullsized":"2024-09-11T23:03:34.019397+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:49.970021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.652066+0000","last_change":"2024-09-11T23:03:30.660477+0000","last_active":"2024-09-11T23:03:32.652066+0000","last_peered":"2024-09-11T23:03:32.652066+0000","last_clean":"2024-09-11T23:03:32.652066+0000","last_became_active":"2024-09-11T23:03:30.660094+0000","last_became_peered":"2024-09-11T23:03:30.660094+0000","last_unstale":"2024-09-11T23:03:32.652066+0000","last_undegraded":"2024-09-11T23:03:32.652066+0000","last_fullsized":"2024-09-11T23:03:32.652066+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:24.925590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.652212+0000","last_change":"2024-09-11T23:03:31.668020+0000","last_active":"2024-09-11T23:03:32.652212+0000","last_peered":"2024-09-11T23:03:32.652212+0000","last_clean":"2024-09-11T23:03:32.652212+0000","last_became_active":"2024-09-11T23:03:31.667719+0000","last_became_peered":"2024-09-11T23:03:31.667719+0000","last_unstale":"2024-09-11T23:03:32.652212+0000","last_undegraded":"2024-09-11T23:03:32.652212+0000","last_fullsized":"2024-09-11T23:03:32.652212+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:23.103838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"15'2","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.640585+0000","last_change":"2024-09-11T23:03:30.651711+0000","last_active":"2024-09-11T23:03:32.640585+0000","last_peered":"2024-09-11T23:03:32.640585+0000","last_clean":"2024-09-11T23:03:32.640585+0000","last_became_active":"2024-09-11T23:03:30.651348+0000","last_became_peered":"2024-09-11T23:03:30.651348+0000","last_unstale":"2024-09-11T23:03:32.640585+0000","last_undegraded":"2024-09-11T23:03:32.640585+0000","last_fullsized":"2024-09-11T23:03:32.640585+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:56.281332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.639820+0000","last_change":"2024-09-11T23:03:31.642102+0000","last_active":"2024-09-11T23:03:32.639820+0000","last_peered":"2024-09-11T23:03:32.639820+0000","last_clean":"2024-09-11T23:03:32.639820+0000","last_became_active":"2024-09-11T23:03:31.641618+0000","last_became_peered":"2024-09-11T23:03:31.641618+0000","last_unstale":"2024-09-11T23:03:32.639820+0000","last_undegraded":"2024-09-11T23:03:32.639820+0000","last_fullsized":"2024-09-11T23:03:32.639820+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:37.226596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.019413+0000","last_change":"2024-09-11T23:03:31.673693+0000","last_active":"2024-09-11T23:03:34.019413+0000","last_peered":"2024-09-11T23:03:34.019413+0000","last_clean":"2024-09-11T23:03:34.019413+0000","last_became_active":"2024-09-11T23:03:31.673405+0000","last_became_peered":"2024-09-11T23:03:31.673405+0000","last_unstale":"2024-09-11T23:03:34.019413+0000","last_undegraded":"2024-09-11T23:03:34.019413+0000","last_fullsized":"2024-09-11T23:03:34.019413+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:50:10.314960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"15'2","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.641899+0000","last_change":"2024-09-11T23:03:30.665363+0000","last_active":"2024-09-11T23:03:32.641899+0000","last_peered":"2024-09-11T23:03:32.641899+0000","last_clean":"2024-09-11T23:03:32.641899+0000","last_became_active":"2024-09-11T23:03:30.665036+0000","last_became_peered":"2024-09-11T23:03:30.665036+0000","last_unstale":"2024-09-11T23:03:32.641899+0000","last_undegraded":"2024-09-11T23:03:32.641899+0000","last_fullsized":"2024-09-11T23:03:32.641899+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:24.925590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.652476+0000","last_change":"2024-09-11T23:03:31.645731+0000","last_active":"2024-09-11T23:03:32.652476+0000","last_peered":"2024-09-11T23:03:32.652476+0000","last_clean":"2024-09-11T23:03:32.652476+0000","last_became_active":"2024-09-11T23:03:31.645437+0000","last_became_peered":"2024-09-11T23:03:31.645437+0000","last_unstale":"2024-09-11T23:03:32.652476+0000","last_undegraded":"2024-09-11T23:03:32.652476+0000","last_fullsized":"2024-09-11T23:03:32.652476+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:47.643082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"15'2","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.641658+0000","last_change":"2024-09-11T23:03:30.665521+0000","last_active":"2024-09-11T23:03:32.641658+0000","last_peered":"2024-09-11T23:03:32.641658+0000","last_clean":"2024-09-11T23:03:32.641658+0000","last_became_active":"2024-09-11T23:03:30.664488+0000","last_became_peered":"2024-09-11T23:03:30.664488+0000","last_unstale":"2024-09-11T23:03:32.641658+0000","last_undegraded":"2024-09-11T23:03:32.641658+0000","last_fullsized":"2024-09-11T23:03:32.641658+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:23.634393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.641163+0000","last_change":"2024-09-11T23:03:31.643030+0000","last_active":"2024-09-11T23:03:32.641163+0000","last_peered":"2024-09-11T23:03:32.641163+0000","last_clean":"2024-09-11T23:03:32.641163+0000","last_became_active":"2024-09-11T23:03:31.642037+0000","last_became_peered":"2024-09-11T23:03:31.642037+0000","last_unstale":"2024-09-11T23:03:32.641163+0000","last_undegraded":"2024-09-11T23:03:32.641163+0000","last_fullsized":"2024-09-11T23:03:32.641163+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:14.694041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"15'1","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.021502+0000","last_change":"2024-09-11T23:03:30.653547+0000","last_active":"2024-09-11T23:03:34.021502+0000","last_peered":"2024-09-11T23:03:34.021502+0000","last_clean":"2024-09-11T23:03:34.021502+0000","last_became_active":"2024-09-11T23:03:30.652566+0000","last_became_peered":"2024-09-11T23:03:30.652566+0000","last_unstale":"2024-09-11T23:03:34.021502+0000","last_undegraded":"2024-09-11T23:03:34.021502+0000","last_fullsized":"2024-09-11T23:03:34.021502+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:39.066030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:34.020775+0000","last_change":"2024-09-11T23:03:31.678214+0000","last_active":"2024-09-11T23:03:34.020775+0000","last_peered":"2024-09-11T23:03:34.020775+0000","last_clean":"2024-09-11T23:03:34.020775+0000","last_became_active":"2024-09-11T23:03:31.677646+0000","last_became_peered":"2024-09-11T23:03:31.677646+0000","last_unstale":"2024-09-11T23:03:34.020775+0000","last_undegraded":"2024-09-11T23:03:34.020775+0000","last_fullsized":"2024-09-11T23:03:34.020775+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:30.609034+0000","last_clean_scrub_stamp":"2024-09-11T23:03:30.609034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:33.451482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"15'4","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-11T23:03:32.641547+0000","last_change":"2024-09-11T23:03:30.667990+0000","last_active":"2024-09-11T23:03:32.641547+0000","last_peered":"2024-09-11T23:03:32.641547+0000","last_clean":"2024-09-11T23:03:32.641547+0000","last_became_active":"2024-09-11T23:03:30.667696+0000","last_became_peered":"2024-09-11T23:03:30.667696+0000","last_unstale":"2024-09-11T23:03:32.641547+0000","last_undegraded":"2024-09-11T23:03:32.641547+0000","last_fullsized":"2024-09-11T23:03:32.641547+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:29.601059+0000","last_clean_scrub_stamp":"2024-09-11T23:03:29.601059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:33:15.409459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":159744,"data_stored":44486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":761856,"data_stored":635514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":74,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":749568,"data_stored":633866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:03:39.639 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T23:03:39.639 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-11T23:03:39.639 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-11T23:03:39.639 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-11T23:03:39.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.785+0000 7fbe22ba4640 1 Processor -- start 2024-09-11T23:03:39.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.785+0000 7fbe22ba4640 1 -- start start 2024-09-11T23:03:39.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.789+0000 7fbe22ba4640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbe1c13a410 0x7fbe1c0a6af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:39.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.789+0000 7fbe22ba4640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe1c0a82a0 con 0x7fbe1c0a4b80 2024-09-11T23:03:39.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.789+0000 7fbe22ba4640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fbe1c0a3cb0 con 0x7fbe1c13a410 2024-09-11T23:03:39.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.789+0000 7fbe20940640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbe1c13a410 0x7fbe1c0a6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:39.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.789+0000 7fbe1bfff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fbe1c0a4b80 0x7fbe1c0a7030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:49684/0 (socket says 172.21.15.12:49684) 2024-09-11T23:03:39.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.789+0000 7fbe1bfff640 1 -- 172.21.15.12:0/1464292019 learned_addr learned my addr 172.21.15.12:0/1464292019 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:03:39.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.789+0000 7fbe20940640 1 -- 172.21.15.12:0/1464292019 >> v1:172.21.15.12:6789/0 conn(0x7fbe1c0a4b80 legacy=0x7fbe1c0a7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:39.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.789+0000 7fbe20940640 1 -- 172.21.15.12:0/1464292019 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe1c139fe0 con 0x7fbe1c13a410 2024-09-11T23:03:39.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.789+0000 7fbe20940640 1 --2- 172.21.15.12:0/1464292019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe1c13a410 0x7fbe1c0a6af0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c009740 tx=0x7fbe0c01c220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9995817466787242 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:39.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.789+0000 7fbe1b7fe640 1 -- 172.21.15.12:0/1464292019 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe0c0b0070 con 0x7fbe1c13a410 2024-09-11T23:03:39.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.789+0000 7fbe1b7fe640 1 -- 172.21.15.12:0/1464292019 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe0c0ab530 con 0x7fbe1c13a410 2024-09-11T23:03:39.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.789+0000 7fbe1b7fe640 1 -- 172.21.15.12:0/1464292019 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe0c0ab830 con 0x7fbe1c13a410 2024-09-11T23:03:39.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.789+0000 7fbe22ba4640 1 -- 172.21.15.12:0/1464292019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe1c13a410 msgr2=0x7fbe1c0a6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:39.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.789+0000 7fbe22ba4640 1 --2- 172.21.15.12:0/1464292019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe1c13a410 0x7fbe1c0a6af0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c009740 tx=0x7fbe0c01c220 comp rx=0 tx=0).stop 2024-09-11T23:03:39.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.789+0000 7fbe22ba4640 1 -- 172.21.15.12:0/1464292019 shutdown_connections 2024-09-11T23:03:39.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.789+0000 7fbe22ba4640 1 --2- 172.21.15.12:0/1464292019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe1c13a410 0x7fbe1c0a6af0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:39.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.789+0000 7fbe22ba4640 1 -- 172.21.15.12:0/1464292019 >> 172.21.15.12:0/1464292019 conn(0x7fbe1c0ac2c0 msgr2=0x7fbe1c0ac6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:39.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.789+0000 7fbe22ba4640 1 -- 172.21.15.12:0/1464292019 shutdown_connections 2024-09-11T23:03:39.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.789+0000 7fbe22ba4640 1 -- 172.21.15.12:0/1464292019 wait complete. 2024-09-11T23:03:39.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.793+0000 7fbe22ba4640 1 Processor -- start 2024-09-11T23:03:39.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.793+0000 7fbe22ba4640 1 -- start start 2024-09-11T23:03:39.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.793+0000 7fbe22ba4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe1c0a4b80 0x7fbe1c0a0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:39.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.793+0000 7fbe22ba4640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1c0a7740 con 0x7fbe1c0a4b80 2024-09-11T23:03:39.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.793+0000 7fbe20940640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe1c0a4b80 0x7fbe1c0a0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:39.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.793+0000 7fbe20940640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe1c0a4b80 0x7fbe1c0a0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35312/0 (socket says 172.21.15.12:35312) 2024-09-11T23:03:39.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.793+0000 7fbe20940640 1 -- 172.21.15.12:0/2632033723 learned_addr learned my addr 172.21.15.12:0/2632033723 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:39.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.793+0000 7fbe20940640 1 -- 172.21.15.12:0/2632033723 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe1c0a0840 con 0x7fbe1c0a4b80 2024-09-11T23:03:39.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.793+0000 7fbe20940640 1 --2- 172.21.15.12:0/2632033723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe1c0a4b80 0x7fbe1c0a0f90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c0ae040 tx=0x7fbe0c01aa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:39.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.793+0000 7fbe197fa640 1 -- 172.21.15.12:0/2632033723 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe0c0b0050 con 0x7fbe1c0a4b80 2024-09-11T23:03:39.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.793+0000 7fbe197fa640 1 -- 172.21.15.12:0/2632033723 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe0c0b1040 con 0x7fbe1c0a4b80 2024-09-11T23:03:39.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.793+0000 7fbe22ba4640 1 -- 172.21.15.12:0/2632033723 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe1c09ece0 con 0x7fbe1c0a4b80 2024-09-11T23:03:39.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.793+0000 7fbe197fa640 1 -- 172.21.15.12:0/2632033723 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe0c0b5780 con 0x7fbe1c0a4b80 2024-09-11T23:03:39.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.793+0000 7fbe22ba4640 1 -- 172.21.15.12:0/2632033723 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe1c09f5c0 con 0x7fbe1c0a4b80 2024-09-11T23:03:39.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.793+0000 7fbe22ba4640 1 -- 172.21.15.12:0/2632033723 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe1c0a6af0 con 0x7fbe1c0a4b80 2024-09-11T23:03:39.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.793+0000 7fbe197fa640 1 -- 172.21.15.12:0/2632033723 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbe0c0be030 con 0x7fbe1c0a4b80 2024-09-11T23:03:39.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.793+0000 7fbe197fa640 1 --2- 172.21.15.12:0/2632033723 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fbe08035db0 0x7fbe08038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:39.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.793+0000 7fbe197fa640 1 -- 172.21.15.12:0/2632033723 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3439+0+0 (secure 0 0 0) 0x7fbe0c0bc070 con 0x7fbe1c0a4b80 2024-09-11T23:03:39.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.793+0000 7fbe1bfff640 1 --2- 172.21.15.12:0/2632033723 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fbe08035db0 0x7fbe08038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:39.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.793+0000 7fbe1bfff640 1 --2- 172.21.15.12:0/2632033723 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fbe08035db0 0x7fbe08038270 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbe100017b0 tx=0x7fbe10007a30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:39.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.797+0000 7fbe197fa640 1 -- 172.21.15.12:0/2632033723 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbe0c0c5060 con 0x7fbe1c0a4b80 2024-09-11T23:03:40.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.997+0000 7fbe22ba4640 1 -- 172.21.15.12:0/2632033723 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fbe1c0a0a60 con 0x7fbe1c0a4b80 2024-09-11T23:03:40.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:39.997+0000 7fbe197fa640 1 -- 172.21.15.12:0/2632033723 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fbe0c015f30 con 0x7fbe1c0a4b80 2024-09-11T23:03:40.002 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:03:40.003 INFO:teuthology.orchestra.run.smithi012.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-11T23:03:40.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.001+0000 7fbe22ba4640 1 -- 172.21.15.12:0/2632033723 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fbe08035db0 msgr2=0x7fbe08038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:40.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.001+0000 7fbe22ba4640 1 --2- 172.21.15.12:0/2632033723 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fbe08035db0 0x7fbe08038270 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbe100017b0 tx=0x7fbe10007a30 comp rx=0 tx=0).stop 2024-09-11T23:03:40.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.001+0000 7fbe22ba4640 1 -- 172.21.15.12:0/2632033723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe1c0a4b80 msgr2=0x7fbe1c0a0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:40.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.001+0000 7fbe22ba4640 1 --2- 172.21.15.12:0/2632033723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe1c0a4b80 0x7fbe1c0a0f90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c0ae040 tx=0x7fbe0c01aa60 comp rx=0 tx=0).stop 2024-09-11T23:03:40.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.001+0000 7fbe22ba4640 1 -- 172.21.15.12:0/2632033723 shutdown_connections 2024-09-11T23:03:40.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.001+0000 7fbe22ba4640 1 --2- 172.21.15.12:0/2632033723 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fbe08035db0 0x7fbe08038270 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:40.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.001+0000 7fbe22ba4640 1 --2- 172.21.15.12:0/2632033723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe1c0a4b80 0x7fbe1c0a0f90 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:40.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.001+0000 7fbe22ba4640 1 -- 172.21.15.12:0/2632033723 >> 172.21.15.12:0/2632033723 conn(0x7fbe1c0ac2c0 msgr2=0x7fbe1c0ab940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:40.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.001+0000 7fbe22ba4640 1 -- 172.21.15.12:0/2632033723 shutdown_connections 2024-09-11T23:03:40.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.001+0000 7fbe22ba4640 1 -- 172.21.15.12:0/2632033723 wait complete. 2024-09-11T23:03:40.021 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-11T23:03:40.022 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:03:40.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.141+0000 7f40fbc92640 1 Processor -- start 2024-09-11T23:03:40.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.141+0000 7f40fbc92640 1 -- start start 2024-09-11T23:03:40.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.141+0000 7f40fbc92640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f40f413a410 0x7f40f40a6af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:40.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.141+0000 7f40fbc92640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40f40a82a0 con 0x7f40f40a4b80 2024-09-11T23:03:40.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.141+0000 7f40fbc92640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f40f40a3cb0 con 0x7f40f413a410 2024-09-11T23:03:40.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.141+0000 7f40f9a2e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f40f413a410 0x7f40f40a6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:40.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.141+0000 7f40f922d640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f40f40a4b80 0x7f40f40a7030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:49686/0 (socket says 172.21.15.12:49686) 2024-09-11T23:03:40.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.141+0000 7f40f922d640 1 -- 172.21.15.12:0/383832750 learned_addr learned my addr 172.21.15.12:0/383832750 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:03:40.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.141+0000 7f40f9a2e640 1 -- 172.21.15.12:0/383832750 >> v1:172.21.15.12:6789/0 conn(0x7f40f40a4b80 legacy=0x7f40f40a7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:40.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.141+0000 7f40f9a2e640 1 -- 172.21.15.12:0/383832750 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40f4139fe0 con 0x7f40f413a410 2024-09-11T23:03:40.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.141+0000 7f40f8a2c640 1 -- 172.21.15.12:0/383832750 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2216341334 0 0) 0x7f40f40a82a0 con 0x7f40f40a4b80 2024-09-11T23:03:40.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.141+0000 7f40f9a2e640 1 --2- 172.21.15.12:0/383832750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40f413a410 0x7f40f40a6af0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f40f0009740 tx=0x7f40f001c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46df6b27506b3d91 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:40.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.145+0000 7f40f8a2c640 1 -- 172.21.15.12:0/383832750 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40f00b0070 con 0x7f40f413a410 2024-09-11T23:03:40.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.145+0000 7f40f8a2c640 1 -- 172.21.15.12:0/383832750 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40f00ab530 con 0x7f40f413a410 2024-09-11T23:03:40.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.145+0000 7f40f8a2c640 1 -- 172.21.15.12:0/383832750 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40f00ab830 con 0x7f40f413a410 2024-09-11T23:03:40.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.145+0000 7f40fbc92640 1 -- 172.21.15.12:0/383832750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40f413a410 msgr2=0x7f40f40a6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:40.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.145+0000 7f40fbc92640 1 --2- 172.21.15.12:0/383832750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40f413a410 0x7f40f40a6af0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f40f0009740 tx=0x7f40f001c390 comp rx=0 tx=0).stop 2024-09-11T23:03:40.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.145+0000 7f40fbc92640 1 -- 172.21.15.12:0/383832750 shutdown_connections 2024-09-11T23:03:40.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.145+0000 7f40fbc92640 1 --2- 172.21.15.12:0/383832750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40f413a410 0x7f40f40a6af0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:40.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.145+0000 7f40fbc92640 1 -- 172.21.15.12:0/383832750 >> 172.21.15.12:0/383832750 conn(0x7f40f40ac2c0 msgr2=0x7f40f40ac6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:40.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.145+0000 7f40fbc92640 1 -- 172.21.15.12:0/383832750 shutdown_connections 2024-09-11T23:03:40.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.145+0000 7f40fbc92640 1 -- 172.21.15.12:0/383832750 wait complete. 2024-09-11T23:03:40.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.145+0000 7f40fbc92640 1 Processor -- start 2024-09-11T23:03:40.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.145+0000 7f40fbc92640 1 -- start start 2024-09-11T23:03:40.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.145+0000 7f40fbc92640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40f40a4b80 0x7f40f413d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:40.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.145+0000 7f40fbc92640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f40f40a7740 con 0x7f40f40a4b80 2024-09-11T23:03:40.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.145+0000 7f40f9a2e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40f40a4b80 0x7f40f413d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:40.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.145+0000 7f40f9a2e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40f40a4b80 0x7f40f413d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35318/0 (socket says 172.21.15.12:35318) 2024-09-11T23:03:40.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.145+0000 7f40f9a2e640 1 -- 172.21.15.12:0/2478799856 learned_addr learned my addr 172.21.15.12:0/2478799856 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:40.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.145+0000 7f40f9a2e640 1 -- 172.21.15.12:0/2478799856 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40f409acb0 con 0x7f40f40a4b80 2024-09-11T23:03:40.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.145+0000 7f40f9a2e640 1 --2- 172.21.15.12:0/2478799856 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40f40a4b80 0x7f40f413d270 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f40f0019fc0 tx=0x7f40f001abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:40.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.145+0000 7f40ea7fc640 1 -- 172.21.15.12:0/2478799856 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40f00b0040 con 0x7f40f40a4b80 2024-09-11T23:03:40.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.145+0000 7f40ea7fc640 1 -- 172.21.15.12:0/2478799856 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40f00abe40 con 0x7f40f40a4b80 2024-09-11T23:03:40.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.145+0000 7f40ea7fc640 1 -- 172.21.15.12:0/2478799856 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40f00041a0 con 0x7f40f40a4b80 2024-09-11T23:03:40.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.145+0000 7f40fbc92640 1 -- 172.21.15.12:0/2478799856 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40f409cf60 con 0x7f40f40a4b80 2024-09-11T23:03:40.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.145+0000 7f40fbc92640 1 -- 172.21.15.12:0/2478799856 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40f409a9d0 con 0x7f40f40a4b80 2024-09-11T23:03:40.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.149+0000 7f40fbc92640 1 -- 172.21.15.12:0/2478799856 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40f40a6af0 con 0x7f40f40a4b80 2024-09-11T23:03:40.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.149+0000 7f40ea7fc640 1 -- 172.21.15.12:0/2478799856 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f40f0004340 con 0x7f40f40a4b80 2024-09-11T23:03:40.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.149+0000 7f40ea7fc640 1 --2- 172.21.15.12:0/2478799856 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f40d8035db0 0x7f40d8038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:40.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.149+0000 7f40ea7fc640 1 -- 172.21.15.12:0/2478799856 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3439+0+0 (secure 0 0 0) 0x7f40f00e31f0 con 0x7f40f40a4b80 2024-09-11T23:03:40.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.149+0000 7f40f922d640 1 --2- 172.21.15.12:0/2478799856 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f40d8035db0 0x7f40d8038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:40.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.149+0000 7f40f922d640 1 --2- 172.21.15.12:0/2478799856 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f40d8035db0 0x7f40d8038270 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f40e4007fd0 tx=0x7f40e4007920 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:40.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.153+0000 7f40ea7fc640 1 -- 172.21.15.12:0/2478799856 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f40f0016010 con 0x7f40f40a4b80 2024-09-11T23:03:40.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.345+0000 7f40fbc92640 1 -- 172.21.15.12:0/2478799856 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f40f41390b0 con 0x7f40f40a4b80 2024-09-11T23:03:40.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.345+0000 7f40ea7fc640 1 -- 172.21.15.12:0/2478799856 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+3569 (secure 0 0 0) 0x7f40f00c0800 con 0x7f40f40a4b80 2024-09-11T23:03:40.351 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:03:40.351 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":7,"btime":"2024-09-11T23:03:34:638819+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4139,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6828/4176387551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":4176387551},{"type":"v1","addr":"172.21.15.12:6828","nonce":4176387551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:03:30.989250+0000","modified":"2024-09-11T23:03:34.002181+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4140":{"gid":4140,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6829/2850198678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6827","nonce":2850198678},{"type":"v1","addr":"172.21.15.12:6829","nonce":2850198678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4140,"qdb_cluster":[4140]},"id":1}]} 2024-09-11T23:03:40.351 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 7 2024-09-11T23:03:40.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.349+0000 7f40fbc92640 1 -- 172.21.15.12:0/2478799856 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f40d8035db0 msgr2=0x7f40d8038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:40.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.349+0000 7f40fbc92640 1 --2- 172.21.15.12:0/2478799856 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f40d8035db0 0x7f40d8038270 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f40e4007fd0 tx=0x7f40e4007920 comp rx=0 tx=0).stop 2024-09-11T23:03:40.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.349+0000 7f40fbc92640 1 -- 172.21.15.12:0/2478799856 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40f40a4b80 msgr2=0x7f40f413d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:40.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.349+0000 7f40fbc92640 1 --2- 172.21.15.12:0/2478799856 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40f40a4b80 0x7f40f413d270 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f40f0019fc0 tx=0x7f40f001abd0 comp rx=0 tx=0).stop 2024-09-11T23:03:40.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.349+0000 7f40fbc92640 1 -- 172.21.15.12:0/2478799856 shutdown_connections 2024-09-11T23:03:40.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.349+0000 7f40fbc92640 1 --2- 172.21.15.12:0/2478799856 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f40d8035db0 0x7f40d8038270 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:40.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.349+0000 7f40fbc92640 1 --2- 172.21.15.12:0/2478799856 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40f40a4b80 0x7f40f413d270 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:40.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.349+0000 7f40fbc92640 1 -- 172.21.15.12:0/2478799856 >> 172.21.15.12:0/2478799856 conn(0x7f40f40ac2c0 msgr2=0x7f40f413f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:40.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.349+0000 7f40fbc92640 1 -- 172.21.15.12:0/2478799856 shutdown_connections 2024-09-11T23:03:40.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.349+0000 7f40fbc92640 1 -- 172.21.15.12:0/2478799856 wait complete. 2024-09-11T23:03:40.369 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:03:40.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.489+0000 7fed02518640 1 Processor -- start 2024-09-11T23:03:40.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.489+0000 7fed02518640 1 -- start start 2024-09-11T23:03:40.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.493+0000 7fed02518640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fecfc13a410 0x7fecfc0a6af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:40.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.493+0000 7fed02518640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecfc0a82a0 con 0x7fecfc0a4b80 2024-09-11T23:03:40.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.493+0000 7fed02518640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fecfc0a3cb0 con 0x7fecfc13a410 2024-09-11T23:03:40.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.493+0000 7fecfbfff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fecfc13a410 0x7fecfc0a6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:40.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.493+0000 7fecfb7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fecfc0a4b80 0x7fecfc0a7030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:49696/0 (socket says 172.21.15.12:49696) 2024-09-11T23:03:40.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.493+0000 7fecfbfff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fecfc13a410 0x7fecfc0a6af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35326/0 (socket says 172.21.15.12:35326) 2024-09-11T23:03:40.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.493+0000 7fecfb7fe640 1 -- 172.21.15.12:0/2133542605 learned_addr learned my addr 172.21.15.12:0/2133542605 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:03:40.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.493+0000 7fecfbfff640 1 -- 172.21.15.12:0/2133542605 >> v1:172.21.15.12:6789/0 conn(0x7fecfc0a4b80 legacy=0x7fecfc0a7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:40.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.493+0000 7fecfbfff640 1 -- 172.21.15.12:0/2133542605 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecfc139fe0 con 0x7fecfc13a410 2024-09-11T23:03:40.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.493+0000 7fecfbfff640 1 --2- 172.21.15.12:0/2133542605 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecfc13a410 0x7fecfc0a6af0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fecec009740 tx=0x7fecec01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=255d22b9f5b1e164 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:40.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.493+0000 7fecfaffd640 1 -- 172.21.15.12:0/2133542605 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecec0b0070 con 0x7fecfc13a410 2024-09-11T23:03:40.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.493+0000 7fecfaffd640 1 -- 172.21.15.12:0/2133542605 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecec0ab530 con 0x7fecfc13a410 2024-09-11T23:03:40.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.493+0000 7fecfaffd640 1 -- 172.21.15.12:0/2133542605 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecec0ab830 con 0x7fecfc13a410 2024-09-11T23:03:40.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.493+0000 7fed02518640 1 -- 172.21.15.12:0/2133542605 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecfc13a410 msgr2=0x7fecfc0a6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:40.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.493+0000 7fed02518640 1 --2- 172.21.15.12:0/2133542605 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecfc13a410 0x7fecfc0a6af0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fecec009740 tx=0x7fecec01c390 comp rx=0 tx=0).stop 2024-09-11T23:03:40.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.493+0000 7fed02518640 1 -- 172.21.15.12:0/2133542605 shutdown_connections 2024-09-11T23:03:40.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.493+0000 7fed02518640 1 --2- 172.21.15.12:0/2133542605 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecfc13a410 0x7fecfc0a6af0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:40.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.493+0000 7fed02518640 1 -- 172.21.15.12:0/2133542605 >> 172.21.15.12:0/2133542605 conn(0x7fecfc0ac2c0 msgr2=0x7fecfc0ac6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:40.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.493+0000 7fed02518640 1 -- 172.21.15.12:0/2133542605 shutdown_connections 2024-09-11T23:03:40.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.493+0000 7fed02518640 1 -- 172.21.15.12:0/2133542605 wait complete. 2024-09-11T23:03:40.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.497+0000 7fed02518640 1 Processor -- start 2024-09-11T23:03:40.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.497+0000 7fed02518640 1 -- start start 2024-09-11T23:03:40.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.497+0000 7fed02518640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecfc0a4b80 0x7fecfc0a1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:40.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.497+0000 7fed02518640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fecfc0a7740 con 0x7fecfc0a4b80 2024-09-11T23:03:40.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.497+0000 7fecfbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecfc0a4b80 0x7fecfc0a1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:40.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.497+0000 7fecfbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecfc0a4b80 0x7fecfc0a1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35334/0 (socket says 172.21.15.12:35334) 2024-09-11T23:03:40.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.497+0000 7fecfbfff640 1 -- 172.21.15.12:0/4201862866 learned_addr learned my addr 172.21.15.12:0/4201862866 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:40.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.497+0000 7fecfbfff640 1 -- 172.21.15.12:0/4201862866 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecfc0a0700 con 0x7fecfc0a4b80 2024-09-11T23:03:40.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.497+0000 7fecfbfff640 1 --2- 172.21.15.12:0/4201862866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecfc0a4b80 0x7fecfc0a1140 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fecec019fc0 tx=0x7fecec01abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:40.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.497+0000 7fecf8ff9640 1 -- 172.21.15.12:0/4201862866 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecec0b0050 con 0x7fecfc0a4b80 2024-09-11T23:03:40.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.497+0000 7fecf8ff9640 1 -- 172.21.15.12:0/4201862866 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecec0b1040 con 0x7fecfc0a4b80 2024-09-11T23:03:40.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.497+0000 7fed02518640 1 -- 172.21.15.12:0/4201862866 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecfc13f070 con 0x7fecfc0a4b80 2024-09-11T23:03:40.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.497+0000 7fecf8ff9640 1 -- 172.21.15.12:0/4201862866 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecec0b5740 con 0x7fecfc0a4b80 2024-09-11T23:03:40.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.497+0000 7fed02518640 1 -- 172.21.15.12:0/4201862866 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecfc0a09c0 con 0x7fecfc0a4b80 2024-09-11T23:03:40.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.497+0000 7fecf8ff9640 1 -- 172.21.15.12:0/4201862866 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fecec0be030 con 0x7fecfc0a4b80 2024-09-11T23:03:40.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.497+0000 7fed02518640 1 -- 172.21.15.12:0/4201862866 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecfc0a6af0 con 0x7fecfc0a4b80 2024-09-11T23:03:40.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.497+0000 7fecf8ff9640 1 --2- 172.21.15.12:0/4201862866 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fece8035db0 0x7fece8038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:40.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.497+0000 7fecf8ff9640 1 -- 172.21.15.12:0/4201862866 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3439+0+0 (secure 0 0 0) 0x7fecec0bc070 con 0x7fecfc0a4b80 2024-09-11T23:03:40.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.497+0000 7fecfb7fe640 1 --2- 172.21.15.12:0/4201862866 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fece8035db0 0x7fece8038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:40.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.497+0000 7fecfb7fe640 1 --2- 172.21.15.12:0/4201862866 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fece8035db0 0x7fece8038270 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fecf0001610 tx=0x7fecf0007ad0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:40.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.501+0000 7fecf8ff9640 1 -- 172.21.15.12:0/4201862866 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fecec0c5020 con 0x7fecfc0a4b80 2024-09-11T23:03:40.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.693+0000 7fed02518640 1 -- 172.21.15.12:0/4201862866 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fecfc0a2eb0 con 0x7fecfc0a4b80 2024-09-11T23:03:40.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.693+0000 7fecf8ff9640 1 -- 172.21.15.12:0/4201862866 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+3569 (secure 0 0 0) 0x7fecec016010 con 0x7fecfc0a4b80 2024-09-11T23:03:40.698 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:03:40.698 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":7,"btime":"2024-09-11T23:03:34:638819+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4139,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6828/4176387551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":4176387551},{"type":"v1","addr":"172.21.15.12:6828","nonce":4176387551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:03:30.989250+0000","modified":"2024-09-11T23:03:34.002181+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4140":{"gid":4140,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6829/2850198678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6827","nonce":2850198678},{"type":"v1","addr":"172.21.15.12:6829","nonce":2850198678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4140,"qdb_cluster":[4140]},"id":1}]} 2024-09-11T23:03:40.699 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 7 2024-09-11T23:03:40.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.697+0000 7fed02518640 1 -- 172.21.15.12:0/4201862866 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fece8035db0 msgr2=0x7fece8038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:40.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.697+0000 7fed02518640 1 --2- 172.21.15.12:0/4201862866 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fece8035db0 0x7fece8038270 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fecf0001610 tx=0x7fecf0007ad0 comp rx=0 tx=0).stop 2024-09-11T23:03:40.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.697+0000 7fed02518640 1 -- 172.21.15.12:0/4201862866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecfc0a4b80 msgr2=0x7fecfc0a1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:40.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.697+0000 7fed02518640 1 --2- 172.21.15.12:0/4201862866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecfc0a4b80 0x7fecfc0a1140 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fecec019fc0 tx=0x7fecec01abd0 comp rx=0 tx=0).stop 2024-09-11T23:03:40.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.697+0000 7fed02518640 1 -- 172.21.15.12:0/4201862866 shutdown_connections 2024-09-11T23:03:40.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.697+0000 7fed02518640 1 --2- 172.21.15.12:0/4201862866 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fece8035db0 0x7fece8038270 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:40.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.697+0000 7fed02518640 1 --2- 172.21.15.12:0/4201862866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecfc0a4b80 0x7fecfc0a1140 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:40.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.697+0000 7fed02518640 1 -- 172.21.15.12:0/4201862866 >> 172.21.15.12:0/4201862866 conn(0x7fecfc0ac2c0 msgr2=0x7fecfc0ab750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:40.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.697+0000 7fed02518640 1 -- 172.21.15.12:0/4201862866 shutdown_connections 2024-09-11T23:03:40.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.697+0000 7fed02518640 1 -- 172.21.15.12:0/4201862866 wait complete. 2024-09-11T23:03:40.716 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:03:40.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.829+0000 7f80ba583640 1 Processor -- start 2024-09-11T23:03:40.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.829+0000 7f80ba583640 1 -- start start 2024-09-11T23:03:40.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.829+0000 7f80ba583640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f80b40a4b80 0x7f80b40a7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:40.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.829+0000 7f80ba583640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80b40a82a0 con 0x7f80b413a410 2024-09-11T23:03:40.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.829+0000 7f80ba583640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f80b40a3cb0 con 0x7f80b40a4b80 2024-09-11T23:03:40.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.829+0000 7f80b37fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f80b40a4b80 0x7f80b40a7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:40.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.829+0000 7f80b37fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f80b40a4b80 0x7f80b40a7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35346/0 (socket says 172.21.15.12:35346) 2024-09-11T23:03:40.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.829+0000 7f80b37fe640 1 -- 172.21.15.12:0/440053527 learned_addr learned my addr 172.21.15.12:0/440053527 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:40.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.829+0000 7f80b37fe640 1 -- 172.21.15.12:0/440053527 >> v1:172.21.15.12:6789/0 conn(0x7f80b413a410 legacy=0x7f80b40a6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:40.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.829+0000 7f80b37fe640 1 -- 172.21.15.12:0/440053527 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80b4139fe0 con 0x7f80b40a4b80 2024-09-11T23:03:40.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.833+0000 7f80b37fe640 1 --2- 172.21.15.12:0/440053527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80b40a4b80 0x7f80b40a7200 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f80a80097f0 tx=0x7f80a801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21184149fa6c20fd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:40.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.833+0000 7f80b2ffd640 1 -- 172.21.15.12:0/440053527 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80a80b2070 con 0x7f80b40a4b80 2024-09-11T23:03:40.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.833+0000 7f80b2ffd640 1 -- 172.21.15.12:0/440053527 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80a80a9070 con 0x7f80b40a4b80 2024-09-11T23:03:40.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.833+0000 7f80b2ffd640 1 -- 172.21.15.12:0/440053527 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80a80ad5b0 con 0x7f80b40a4b80 2024-09-11T23:03:40.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.833+0000 7f80ba583640 1 -- 172.21.15.12:0/440053527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80b40a4b80 msgr2=0x7f80b40a7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:40.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.833+0000 7f80ba583640 1 --2- 172.21.15.12:0/440053527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80b40a4b80 0x7f80b40a7200 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f80a80097f0 tx=0x7f80a801c450 comp rx=0 tx=0).stop 2024-09-11T23:03:40.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.833+0000 7f80ba583640 1 -- 172.21.15.12:0/440053527 shutdown_connections 2024-09-11T23:03:40.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.833+0000 7f80ba583640 1 --2- 172.21.15.12:0/440053527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80b40a4b80 0x7f80b40a7200 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:40.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.833+0000 7f80ba583640 1 -- 172.21.15.12:0/440053527 >> 172.21.15.12:0/440053527 conn(0x7f80b40ac2c0 msgr2=0x7f80b40ac6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:40.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.833+0000 7f80ba583640 1 -- 172.21.15.12:0/440053527 shutdown_connections 2024-09-11T23:03:40.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.833+0000 7f80ba583640 1 -- 172.21.15.12:0/440053527 wait complete. 2024-09-11T23:03:40.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.833+0000 7f80ba583640 1 Processor -- start 2024-09-11T23:03:40.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.833+0000 7f80ba583640 1 -- start start 2024-09-11T23:03:40.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.833+0000 7f80ba583640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80b40a4b80 0x7f80b40a0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:40.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.833+0000 7f80ba583640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f80b40a7740 con 0x7f80b40a4b80 2024-09-11T23:03:40.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.833+0000 7f80b3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80b40a4b80 0x7f80b40a0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:40.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.833+0000 7f80b3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80b40a4b80 0x7f80b40a0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35350/0 (socket says 172.21.15.12:35350) 2024-09-11T23:03:40.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.833+0000 7f80b3fff640 1 -- 172.21.15.12:0/3260446741 learned_addr learned my addr 172.21.15.12:0/3260446741 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:40.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.833+0000 7f80b3fff640 1 -- 172.21.15.12:0/3260446741 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80b40a1710 con 0x7f80b40a4b80 2024-09-11T23:03:40.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.833+0000 7f80b3fff640 1 --2- 172.21.15.12:0/3260446741 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80b40a4b80 0x7f80b40a0fd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f80a400c480 tx=0x7f80a400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:40.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.833+0000 7f80b0ff9640 1 -- 172.21.15.12:0/3260446741 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80a4005150 con 0x7f80b40a4b80 2024-09-11T23:03:40.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.833+0000 7f80b0ff9640 1 -- 172.21.15.12:0/3260446741 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80a40052f0 con 0x7f80b40a4b80 2024-09-11T23:03:40.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.833+0000 7f80ba583640 1 -- 172.21.15.12:0/3260446741 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80b40a1a30 con 0x7f80b40a4b80 2024-09-11T23:03:40.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.833+0000 7f80b0ff9640 1 -- 172.21.15.12:0/3260446741 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80a4007030 con 0x7f80b40a4b80 2024-09-11T23:03:40.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.833+0000 7f80ba583640 1 -- 172.21.15.12:0/3260446741 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80b409f590 con 0x7f80b40a4b80 2024-09-11T23:03:40.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.837+0000 7f80b0ff9640 1 -- 172.21.15.12:0/3260446741 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f80a4019020 con 0x7f80b40a4b80 2024-09-11T23:03:40.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.837+0000 7f80ba583640 1 -- 172.21.15.12:0/3260446741 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80b40a1510 con 0x7f80b40a4b80 2024-09-11T23:03:40.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.837+0000 7f80b0ff9640 1 --2- 172.21.15.12:0/3260446741 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f80a0035db0 0x7f80a0038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:40.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.837+0000 7f80b0ff9640 1 -- 172.21.15.12:0/3260446741 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3439+0+0 (secure 0 0 0) 0x7f80a4047940 con 0x7f80b40a4b80 2024-09-11T23:03:40.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.837+0000 7f80b37fe640 1 --2- 172.21.15.12:0/3260446741 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f80a0035db0 0x7f80a0038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:40.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.837+0000 7f80b37fe640 1 --2- 172.21.15.12:0/3260446741 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f80a0035db0 0x7f80a0038270 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f80a80af000 tx=0x7f80a8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:40.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:40.841+0000 7f80b0ff9640 1 -- 172.21.15.12:0/3260446741 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f80a401a560 con 0x7f80b40a4b80 2024-09-11T23:03:41.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.005+0000 7f80ba583640 1 -- 172.21.15.12:0/3260446741 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f80b409ecb0 con 0x7f80b40a4b80 2024-09-11T23:03:41.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.009+0000 7f80b0ff9640 1 -- 172.21.15.12:0/3260446741 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+10675 (secure 0 0 0) 0x7f80a401a780 con 0x7f80b40a4b80 2024-09-11T23:03:41.012 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:03:41.012 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":16,"fsid":"8be14356-3340-4500-91a2-4cbc6b511f65","created":"2024-09-11T23:03:10.620234+0000","modified":"2024-09-11T23:03:32.629844+0000","last_up_change":"2024-09-11T23:03:22.359028+0000","last_in_change":"2024-09-11T23:03:11.545817+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:03:23.587068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:03:28.893298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:03:29.993656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"153b72a1-40b1-400d-93ea-333e733f9bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6817","nonce":3680911937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6819","nonce":3680911937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6823","nonce":3680911937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6821","nonce":3680911937}]},"public_addr":"172.21.15.12:6817/3680911937","cluster_addr":"172.21.15.12:6819/3680911937","heartbeat_back_addr":"172.21.15.12:6823/3680911937","heartbeat_front_addr":"172.21.15.12:6821/3680911937","state":["exists","up"]},{"osd":1,"uuid":"94669e49-ee4f-4acf-9e25-e94374dda8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6801","nonce":236825163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6803","nonce":236825163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6807","nonce":236825163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6805","nonce":236825163}]},"public_addr":"172.21.15.12:6801/236825163","cluster_addr":"172.21.15.12:6803/236825163","heartbeat_back_addr":"172.21.15.12:6807/236825163","heartbeat_front_addr":"172.21.15.12:6805/236825163","state":["exists","up"]},{"osd":2,"uuid":"826dae4d-8888-4ec5-8f00-425b3be93814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6809","nonce":3263521655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6811","nonce":3263521655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6815","nonce":3263521655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6813","nonce":3263521655}]},"public_addr":"172.21.15.12:6809/3263521655","cluster_addr":"172.21.15.12:6811/3263521655","heartbeat_back_addr":"172.21.15.12:6815/3263521655","heartbeat_front_addr":"172.21.15.12:6813/3263521655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:19.398518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.761524+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.904997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:03:41.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.009+0000 7f80ba583640 1 -- 172.21.15.12:0/3260446741 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f80a0035db0 msgr2=0x7f80a0038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:41.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.009+0000 7f80ba583640 1 --2- 172.21.15.12:0/3260446741 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f80a0035db0 0x7f80a0038270 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f80a80af000 tx=0x7f80a8008040 comp rx=0 tx=0).stop 2024-09-11T23:03:41.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.009+0000 7f80ba583640 1 -- 172.21.15.12:0/3260446741 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80b40a4b80 msgr2=0x7f80b40a0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:41.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.009+0000 7f80ba583640 1 --2- 172.21.15.12:0/3260446741 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80b40a4b80 0x7f80b40a0fd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f80a400c480 tx=0x7f80a400c940 comp rx=0 tx=0).stop 2024-09-11T23:03:41.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.009+0000 7f80ba583640 1 -- 172.21.15.12:0/3260446741 shutdown_connections 2024-09-11T23:03:41.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.009+0000 7f80ba583640 1 --2- 172.21.15.12:0/3260446741 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f80a0035db0 0x7f80a0038270 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:41.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.009+0000 7f80ba583640 1 --2- 172.21.15.12:0/3260446741 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80b40a4b80 0x7f80b40a0fd0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:41.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.009+0000 7f80ba583640 1 -- 172.21.15.12:0/3260446741 >> 172.21.15.12:0/3260446741 conn(0x7f80b40ac2c0 msgr2=0x7f80b40aa560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:41.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.009+0000 7f80ba583640 1 -- 172.21.15.12:0/3260446741 shutdown_connections 2024-09-11T23:03:41.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.009+0000 7f80ba583640 1 -- 172.21.15.12:0/3260446741 wait complete. 2024-09-11T23:03:41.032 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:03:41.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.145+0000 7f54ea696640 1 Processor -- start 2024-09-11T23:03:41.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.149+0000 7f54ea696640 1 -- start start 2024-09-11T23:03:41.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.149+0000 7f54ea696640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f54e40a4b80 0x7f54e40a7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:41.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.149+0000 7f54ea696640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54e40a82a0 con 0x7f54e413a410 2024-09-11T23:03:41.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.149+0000 7f54ea696640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f54e40a3cb0 con 0x7f54e40a4b80 2024-09-11T23:03:41.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.149+0000 7f54e3fff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f54e413a410 0x7f54e40a6af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:49716/0 (socket says 172.21.15.12:49716) 2024-09-11T23:03:41.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.149+0000 7f54e3fff640 1 -- 172.21.15.12:0/530164387 learned_addr learned my addr 172.21.15.12:0/530164387 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:03:41.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.149+0000 7f54dbfff640 1 --2- 172.21.15.12:0/530164387 >> v2:172.21.15.12:3300/0 conn(0x7f54e40a4b80 0x7f54e40a7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:41.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.149+0000 7f54e37fe640 1 -- 172.21.15.12:0/530164387 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1386922148 0 0) 0x7f54e40a82a0 con 0x7f54e413a410 2024-09-11T23:03:41.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.149+0000 7f54e37fe640 1 -- 172.21.15.12:0/530164387 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54d0003530 con 0x7f54e413a410 2024-09-11T23:03:41.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.149+0000 7f54dbfff640 1 -- 172.21.15.12:0/530164387 >> v1:172.21.15.12:6789/0 conn(0x7f54e413a410 legacy=0x7f54e40a6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:41.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.149+0000 7f54dbfff640 1 -- 172.21.15.12:0/530164387 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54e4139fe0 con 0x7f54e40a4b80 2024-09-11T23:03:41.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.149+0000 7f54dbfff640 1 --2- 172.21.15.12:0/530164387 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54e40a4b80 0x7f54e40a7200 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f54d4009740 tx=0x7f54d401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b634262c5a9e9673 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:41.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.149+0000 7f54e37fe640 1 -- 172.21.15.12:0/530164387 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54d40b0070 con 0x7f54e40a4b80 2024-09-11T23:03:41.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.149+0000 7f54e37fe640 1 -- 172.21.15.12:0/530164387 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54d40ab530 con 0x7f54e40a4b80 2024-09-11T23:03:41.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.149+0000 7f54e37fe640 1 -- 172.21.15.12:0/530164387 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54d40ab810 con 0x7f54e40a4b80 2024-09-11T23:03:41.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.153+0000 7f54ea696640 1 -- 172.21.15.12:0/530164387 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54e40a4b80 msgr2=0x7f54e40a7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:41.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.153+0000 7f54ea696640 1 --2- 172.21.15.12:0/530164387 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54e40a4b80 0x7f54e40a7200 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f54d4009740 tx=0x7f54d401c390 comp rx=0 tx=0).stop 2024-09-11T23:03:41.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.153+0000 7f54ea696640 1 -- 172.21.15.12:0/530164387 shutdown_connections 2024-09-11T23:03:41.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.153+0000 7f54ea696640 1 --2- 172.21.15.12:0/530164387 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54e40a4b80 0x7f54e40a7200 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:41.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.153+0000 7f54ea696640 1 -- 172.21.15.12:0/530164387 >> 172.21.15.12:0/530164387 conn(0x7f54e40ac2c0 msgr2=0x7f54e40ac6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:41.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.153+0000 7f54ea696640 1 -- 172.21.15.12:0/530164387 shutdown_connections 2024-09-11T23:03:41.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.153+0000 7f54ea696640 1 -- 172.21.15.12:0/530164387 wait complete. 2024-09-11T23:03:41.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.153+0000 7f54ea696640 1 Processor -- start 2024-09-11T23:03:41.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.153+0000 7f54ea696640 1 -- start start 2024-09-11T23:03:41.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.153+0000 7f54ea696640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54e40a4b80 0x7f54e41ce810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:41.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.153+0000 7f54ea696640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f54e40a7740 con 0x7f54e40a4b80 2024-09-11T23:03:41.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.153+0000 7f54e3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54e40a4b80 0x7f54e41ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:41.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.153+0000 7f54e3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54e40a4b80 0x7f54e41ce810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35370/0 (socket says 172.21.15.12:35370) 2024-09-11T23:03:41.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.153+0000 7f54e3fff640 1 -- 172.21.15.12:0/1954923246 learned_addr learned my addr 172.21.15.12:0/1954923246 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:41.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.153+0000 7f54e3fff640 1 -- 172.21.15.12:0/1954923246 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54e413ef40 con 0x7f54e40a4b80 2024-09-11T23:03:41.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.153+0000 7f54e3fff640 1 --2- 172.21.15.12:0/1954923246 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54e40a4b80 0x7f54e41ce810 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f54cc00c3d0 tx=0x7f54cc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:41.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.153+0000 7f54e17fa640 1 -- 172.21.15.12:0/1954923246 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54cc017070 con 0x7f54e40a4b80 2024-09-11T23:03:41.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.153+0000 7f54e17fa640 1 -- 172.21.15.12:0/1954923246 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54cc005ce0 con 0x7f54e40a4b80 2024-09-11T23:03:41.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.153+0000 7f54ea696640 1 -- 172.21.15.12:0/1954923246 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54e413eb60 con 0x7f54e40a4b80 2024-09-11T23:03:41.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.153+0000 7f54e17fa640 1 -- 172.21.15.12:0/1954923246 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54cc0070d0 con 0x7f54e40a4b80 2024-09-11T23:03:41.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.153+0000 7f54ea696640 1 -- 172.21.15.12:0/1954923246 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54e409b430 con 0x7f54e40a4b80 2024-09-11T23:03:41.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.153+0000 7f54ea696640 1 -- 172.21.15.12:0/1954923246 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54e40a6af0 con 0x7f54e40a4b80 2024-09-11T23:03:41.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.153+0000 7f54e17fa640 1 -- 172.21.15.12:0/1954923246 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f54cc01a070 con 0x7f54e40a4b80 2024-09-11T23:03:41.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.153+0000 7f54e17fa640 1 --2- 172.21.15.12:0/1954923246 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f54c4035db0 0x7f54c4038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:41.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.153+0000 7f54e17fa640 1 -- 172.21.15.12:0/1954923246 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3439+0+0 (secure 0 0 0) 0x7f54cc047b30 con 0x7f54e40a4b80 2024-09-11T23:03:41.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.153+0000 7f54dbfff640 1 --2- 172.21.15.12:0/1954923246 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f54c4035db0 0x7f54c4038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:41.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.157+0000 7f54dbfff640 1 --2- 172.21.15.12:0/1954923246 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f54c4035db0 0x7f54c4038270 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f54d40ad000 tx=0x7f54d40a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:41.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.161+0000 7f54e17fa640 1 -- 172.21.15.12:0/1954923246 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f54cc019e10 con 0x7f54e40a4b80 2024-09-11T23:03:41.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.353+0000 7f54ea696640 1 -- 172.21.15.12:0/1954923246 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f54e40a2e90 con 0x7f54e40a4b80 2024-09-11T23:03:41.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.353+0000 7f54e17fa640 1 -- 172.21.15.12:0/1954923246 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+3569 (secure 0 0 0) 0x7f54cc047e20 con 0x7f54e40a4b80 2024-09-11T23:03:41.356 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:03:41.356 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":7,"btime":"2024-09-11T23:03:34:638819+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4139,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6828/4176387551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":4176387551},{"type":"v1","addr":"172.21.15.12:6828","nonce":4176387551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:03:30.989250+0000","modified":"2024-09-11T23:03:34.002181+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4140":{"gid":4140,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6829/2850198678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6827","nonce":2850198678},{"type":"v1","addr":"172.21.15.12:6829","nonce":2850198678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4140,"qdb_cluster":[4140]},"id":1}]} 2024-09-11T23:03:41.356 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 7 2024-09-11T23:03:41.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.353+0000 7f54ea696640 1 -- 172.21.15.12:0/1954923246 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f54c4035db0 msgr2=0x7f54c4038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:41.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.353+0000 7f54ea696640 1 --2- 172.21.15.12:0/1954923246 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f54c4035db0 0x7f54c4038270 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f54d40ad000 tx=0x7f54d40a6000 comp rx=0 tx=0).stop 2024-09-11T23:03:41.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.353+0000 7f54ea696640 1 -- 172.21.15.12:0/1954923246 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54e40a4b80 msgr2=0x7f54e41ce810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:41.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.353+0000 7f54ea696640 1 --2- 172.21.15.12:0/1954923246 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54e40a4b80 0x7f54e41ce810 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f54cc00c3d0 tx=0x7f54cc00c890 comp rx=0 tx=0).stop 2024-09-11T23:03:41.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.353+0000 7f54ea696640 1 -- 172.21.15.12:0/1954923246 shutdown_connections 2024-09-11T23:03:41.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.353+0000 7f54ea696640 1 --2- 172.21.15.12:0/1954923246 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f54c4035db0 0x7f54c4038270 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:41.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.353+0000 7f54ea696640 1 --2- 172.21.15.12:0/1954923246 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54e40a4b80 0x7f54e41ce810 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:41.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.353+0000 7f54ea696640 1 -- 172.21.15.12:0/1954923246 >> 172.21.15.12:0/1954923246 conn(0x7f54e40ac2c0 msgr2=0x7f54e413f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:41.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.353+0000 7f54ea696640 1 -- 172.21.15.12:0/1954923246 shutdown_connections 2024-09-11T23:03:41.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.353+0000 7f54ea696640 1 -- 172.21.15.12:0/1954923246 wait complete. 2024-09-11T23:03:41.574 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T23:03:30.989250+0000', 'modified': '2024-09-11T23:03:34.002181+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4140}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4140': {'gid': 4140, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.12:6829/2850198678', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6827', 'nonce': 2850198678}, {'type': 'v1', 'addr': '172.21.15.12:6829', 'nonce': 2850198678}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4140, 'qdb_cluster': [4140]} 2024-09-11T23:03:41.574 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T23:03:41.575 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-11T23:03:41.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.697+0000 7ff2cdf01640 1 Processor -- start 2024-09-11T23:03:41.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.697+0000 7ff2cdf01640 1 -- start start 2024-09-11T23:03:41.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.697+0000 7ff2cdf01640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff2c80a7350 0x7ff2c8137f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:41.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.697+0000 7ff2cdf01640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2c8137b10 con 0x7ff2c80a1c50 2024-09-11T23:03:41.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.697+0000 7ff2cdf01640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7ff2c80a0ea0 con 0x7ff2c80a7350 2024-09-11T23:03:41.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.697+0000 7ff2c77fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff2c80a7350 0x7ff2c8137f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:41.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.697+0000 7ff2c77fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff2c80a7350 0x7ff2c8137f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35384/0 (socket says 172.21.15.12:35384) 2024-09-11T23:03:41.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.697+0000 7ff2c77fe640 1 -- 172.21.15.12:0/3014231913 learned_addr learned my addr 172.21.15.12:0/3014231913 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:41.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.697+0000 7ff2c6ffd640 1 --1- 172.21.15.12:0/3014231913 >> v1:172.21.15.12:6789/0 conn(0x7ff2c80a1c50 0x7ff2c80a5b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:49728/0 (socket says 172.21.15.12:49728) 2024-09-11T23:03:41.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.697+0000 7ff2c77fe640 1 -- 172.21.15.12:0/3014231913 >> v1:172.21.15.12:6789/0 conn(0x7ff2c80a1c50 legacy=0x7ff2c80a5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:41.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.697+0000 7ff2c77fe640 1 -- 172.21.15.12:0/3014231913 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2c80a34c0 con 0x7ff2c80a7350 2024-09-11T23:03:41.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.701+0000 7ff2c77fe640 1 --2- 172.21.15.12:0/3014231913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2c80a7350 0x7ff2c8137f40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8009e50 tx=0x7ff2b801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5a50e5ad8112cc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:41.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.701+0000 7ff2c67fc640 1 -- 172.21.15.12:0/3014231913 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2b8009200 con 0x7ff2c80a7350 2024-09-11T23:03:41.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.701+0000 7ff2c67fc640 1 -- 172.21.15.12:0/3014231913 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2b80a5690 con 0x7ff2c80a7350 2024-09-11T23:03:41.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.701+0000 7ff2c67fc640 1 -- 172.21.15.12:0/3014231913 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2b80a5990 con 0x7ff2c80a7350 2024-09-11T23:03:41.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.701+0000 7ff2cdf01640 1 -- 172.21.15.12:0/3014231913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2c80a7350 msgr2=0x7ff2c8137f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:41.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.701+0000 7ff2cdf01640 1 --2- 172.21.15.12:0/3014231913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2c80a7350 0x7ff2c8137f40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8009e50 tx=0x7ff2b801c9a0 comp rx=0 tx=0).stop 2024-09-11T23:03:41.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.701+0000 7ff2cdf01640 1 -- 172.21.15.12:0/3014231913 shutdown_connections 2024-09-11T23:03:41.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.701+0000 7ff2cdf01640 1 --2- 172.21.15.12:0/3014231913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2c80a7350 0x7ff2c8137f40 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:41.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.701+0000 7ff2cdf01640 1 -- 172.21.15.12:0/3014231913 >> 172.21.15.12:0/3014231913 conn(0x7ff2c80aa740 msgr2=0x7ff2c80a6c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:41.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.701+0000 7ff2cdf01640 1 -- 172.21.15.12:0/3014231913 shutdown_connections 2024-09-11T23:03:41.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.701+0000 7ff2cdf01640 1 -- 172.21.15.12:0/3014231913 wait complete. 2024-09-11T23:03:41.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.701+0000 7ff2cdf01640 1 Processor -- start 2024-09-11T23:03:41.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.701+0000 7ff2cdf01640 1 -- start start 2024-09-11T23:03:41.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.701+0000 7ff2cdf01640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2c80a1c50 0x7ff2c809c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:41.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.701+0000 7ff2cdf01640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c813fdb0 con 0x7ff2c80a1c50 2024-09-11T23:03:41.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.701+0000 7ff2c77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2c80a1c50 0x7ff2c809c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:41.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.701+0000 7ff2c77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2c80a1c50 0x7ff2c809c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35398/0 (socket says 172.21.15.12:35398) 2024-09-11T23:03:41.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.701+0000 7ff2c77fe640 1 -- 172.21.15.12:0/2454731717 learned_addr learned my addr 172.21.15.12:0/2454731717 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:41.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.705+0000 7ff2c77fe640 1 -- 172.21.15.12:0/2454731717 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2c809df00 con 0x7ff2c80a1c50 2024-09-11T23:03:41.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.705+0000 7ff2c77fe640 1 --2- 172.21.15.12:0/2454731717 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2c80a1c50 0x7ff2c809c300 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff2b801a5d0 tx=0x7ff2b8019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:41.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.705+0000 7ff2affff640 1 -- 172.21.15.12:0/2454731717 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2b80bc020 con 0x7ff2c80a1c50 2024-09-11T23:03:41.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.705+0000 7ff2affff640 1 -- 172.21.15.12:0/2454731717 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2b80b8470 con 0x7ff2c80a1c50 2024-09-11T23:03:41.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.705+0000 7ff2cdf01640 1 -- 172.21.15.12:0/2454731717 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2c809fd40 con 0x7ff2c80a1c50 2024-09-11T23:03:41.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.705+0000 7ff2affff640 1 -- 172.21.15.12:0/2454731717 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2b8009510 con 0x7ff2c80a1c50 2024-09-11T23:03:41.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.705+0000 7ff2cdf01640 1 -- 172.21.15.12:0/2454731717 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2c81369c0 con 0x7ff2c80a1c50 2024-09-11T23:03:41.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.705+0000 7ff2affff640 1 -- 172.21.15.12:0/2454731717 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff2b80bf020 con 0x7ff2c80a1c50 2024-09-11T23:03:41.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.705+0000 7ff2affff640 1 --2- 172.21.15.12:0/2454731717 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7ff2b4035db0 0x7ff2b4038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:41.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.705+0000 7ff2affff640 1 -- 172.21.15.12:0/2454731717 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3439+0+0 (secure 0 0 0) 0x7ff2b80e3750 con 0x7ff2c80a1c50 2024-09-11T23:03:41.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.705+0000 7ff2c6ffd640 1 --2- 172.21.15.12:0/2454731717 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7ff2b4035db0 0x7ff2b4038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:41.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.705+0000 7ff2c6ffd640 1 --2- 172.21.15.12:0/2454731717 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7ff2b4035db0 0x7ff2b4038270 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc001560 tx=0x7ff2bc007a50 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:41.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.705+0000 7ff2d0fbd000 1 Processor -- start 2024-09-11T23:03:41.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.705+0000 7ff2d0fbd000 1 -- start start 2024-09-11T23:03:41.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.705+0000 7ff2d0fbd000 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e398421d30 0x55e39842ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:41.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.705+0000 7ff2d0fbd000 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55e39830cb60 con 0x55e398421d30 2024-09-11T23:03:41.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.705+0000 7ff2c77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e398421d30 0x55e39842ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:41.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.705+0000 7ff2c77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e398421d30 0x55e39842ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35408/0 (socket says 172.21.15.12:35408) 2024-09-11T23:03:41.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.705+0000 7ff2c77fe640 1 -- 172.21.15.12:0/3271264786 learned_addr learned my addr 172.21.15.12:0/3271264786 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:41.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.705+0000 7ff2c77fe640 1 -- 172.21.15.12:0/3271264786 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e39822be50 con 0x55e398421d30 2024-09-11T23:03:41.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.709+0000 7ff2c77fe640 1 --2- 172.21.15.12:0/3271264786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e398421d30 0x55e39842ab40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff2b80e25d0 tx=0x7ff2b80b7890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb0f365edb3c281f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:41.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.709+0000 7ff2ad7fa640 1 -- 172.21.15.12:0/3271264786 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2b80ce020 con 0x55e398421d30 2024-09-11T23:03:41.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.709+0000 7ff2ad7fa640 1 -- 172.21.15.12:0/3271264786 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2b80b6440 con 0x55e398421d30 2024-09-11T23:03:41.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.709+0000 7ff2ad7fa640 1 -- 172.21.15.12:0/3271264786 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2b80b8ad0 con 0x55e398421d30 2024-09-11T23:03:41.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.709+0000 7ff2d0fbd000 1 -- 172.21.15.12:0/3271264786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e398421d30 msgr2=0x55e39842ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:41.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.709+0000 7ff2d0fbd000 1 --2- 172.21.15.12:0/3271264786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e398421d30 0x55e39842ab40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff2b80e25d0 tx=0x7ff2b80b7890 comp rx=0 tx=0).stop 2024-09-11T23:03:41.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.709+0000 7ff2d0fbd000 1 -- 172.21.15.12:0/3271264786 shutdown_connections 2024-09-11T23:03:41.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.709+0000 7ff2d0fbd000 1 --2- 172.21.15.12:0/3271264786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e398421d30 0x55e39842ab40 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:41.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.709+0000 7ff2d0fbd000 1 -- 172.21.15.12:0/3271264786 >> 172.21.15.12:0/3271264786 conn(0x55e39841c680 msgr2=0x55e398421620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:41.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.709+0000 7ff2d0fbd000 1 -- 172.21.15.12:0/3271264786 shutdown_connections 2024-09-11T23:03:41.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.709+0000 7ff2d0fbd000 1 -- 172.21.15.12:0/3271264786 wait complete. 2024-09-11T23:03:41.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.709+0000 7ff2d0fbd000 1 -- start start 2024-09-11T23:03:41.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.709+0000 7ff2d0fbd000 1 Processor -- start 2024-09-11T23:03:41.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.709+0000 7ff2d0fbd000 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e398421d30 0x55e39842a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:41.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.709+0000 7ff2d0fbd000 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55e398219ed0 con 0x55e398421d30 2024-09-11T23:03:41.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.709+0000 7ff2d0fbd000 10 client.0 _ll_register_callbacks cb 0x55e398410820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:03:41.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.709+0000 7ff2c77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e398421d30 0x55e39842a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:41.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.709+0000 7ff2c77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e398421d30 0x55e39842a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35422/0 (socket says 172.21.15.12:35422) 2024-09-11T23:03:41.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.709+0000 7ff2c77fe640 1 -- 172.21.15.12:0/642393706 learned_addr learned my addr 172.21.15.12:0/642393706 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:41.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.709+0000 7ff2c77fe640 1 -- 172.21.15.12:0/642393706 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e39821a120 con 0x55e398421d30 2024-09-11T23:03:41.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.709+0000 7ff2c77fe640 1 --2- 172.21.15.12:0/642393706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e398421d30 0x55e39842a540 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff2b80c0930 tx=0x7ff2b8009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7af8c6b7599b1ded server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:41.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.709+0000 7ff2a67fc640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-11T23:03:41.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.709+0000 7ff2a67fc640 1 -- 172.21.15.12:0/642393706 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2b80ce040 con 0x55e398421d30 2024-09-11T23:03:41.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.709+0000 7ff2a67fc640 1 -- 172.21.15.12:0/642393706 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(16..16 src has 1..16) ==== 3439+0+0 (secure 0 0 0) 0x7ff2b80ac3a0 con 0x55e398421d30 2024-09-11T23:03:41.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.709+0000 7ff2d0fbd000 1 -- 172.21.15.12:0/642393706 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2b80b6440 con 0x55e398421d30 2024-09-11T23:03:41.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.709+0000 7ff2a67fc640 1 -- 172.21.15.12:0/642393706 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7ff2b80c09a0 con 0x55e398421d30 2024-09-11T23:03:41.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.709+0000 7ff2d0fbd000 10 client.4246 fetch_fsmap learned FSMap version 7 2024-09-11T23:03:41.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.709+0000 7ff2d0fbd000 1 -- 172.21.15.12:0/642393706 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55e398213450 con 0x55e398421d30 2024-09-11T23:03:41.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.709+0000 7ff2a67fc640 1 -- 172.21.15.12:0/642393706 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2b80b6440 con 0x55e398421d30 2024-09-11T23:03:41.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.709+0000 7ff2a67fc640 1 -- 172.21.15.12:0/642393706 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 7) ==== 2292+0+0 (secure 0 0 0) 0x7ff2b80b73d0 con 0x55e398421d30 2024-09-11T23:03:41.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.709+0000 7ff2d0fbd000 10 client.4246 fetch_fsmap finished waiting for FSMap version 7 2024-09-11T23:03:41.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.709+0000 7ff2d0fbd000 10 client.4246 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T23:03:41.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.709+0000 7ff2d0fbd000 20 client.4246 populate_metadata read hostname 'smithi012' 2024-09-11T23:03:41.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.709+0000 7ff2d0fbd000 1 --2- 172.21.15.12:0/642393706 >> [v2:172.21.15.12:6827/2850198678,v1:172.21.15.12:6829/2850198678] conn(0x55e398458160 0x55e3984566e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:41.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.709+0000 7ff2d0fbd000 4 client.4246 mds_command: new command op to 4140 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:03:41.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.709+0000 7ff2d0fbd000 1 -- 172.21.15.12:0/642393706 --> [v2:172.21.15.12:6827/2850198678,v1:172.21.15.12:6829/2850198678] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e39820dc00 con 0x55e398458160 2024-09-11T23:03:41.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.709+0000 7ff2c6ffd640 1 --2- 172.21.15.12:0/642393706 >> [v2:172.21.15.12:6827/2850198678,v1:172.21.15.12:6829/2850198678] conn(0x55e398458160 0x55e3984566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:41.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.709+0000 7ff2a67fc640 10 client.4246 ms_handle_connect on v2:172.21.15.12:6827/2850198678 2024-09-11T23:03:41.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.709+0000 7ff2c6ffd640 1 --2- 172.21.15.12:0/642393706 >> [v2:172.21.15.12:6827/2850198678,v1:172.21.15.12:6829/2850198678] conn(0x55e398458160 0x55e3984566e0 crc :-1 s=READY pgs=6 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d155f573ff76b6bf server_cookie=76282ae9b593e716 in_seq=0 out_seq=0 2024-09-11T23:03:41.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.713+0000 7ff2a67fc640 1 -- 172.21.15.12:0/642393706 <== mds.0 v2:172.21.15.12:6827/2850198678 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e39820dc00 con 0x55e398458160 2024-09-11T23:03:41.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.713+0000 7ff2a67fc640 10 client.4246 handle_command_reply: tid=0 2024-09-11T23:03:41.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.713+0000 7ff2d0fbd000 1 client.4246 shutdown 2024-09-11T23:03:41.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.713+0000 7ff2d0fbd000 1 -- 172.21.15.12:0/642393706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e398421d30 msgr2=0x55e39842a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:41.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.713+0000 7ff2d0fbd000 1 --2- 172.21.15.12:0/642393706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e398421d30 0x55e39842a540 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff2b80c0930 tx=0x7ff2b8009040 comp rx=0 tx=0).stop 2024-09-11T23:03:41.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.713+0000 7ff2d0fbd000 1 -- 172.21.15.12:0/642393706 shutdown_connections 2024-09-11T23:03:41.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.713+0000 7ff2d0fbd000 1 --2- 172.21.15.12:0/642393706 >> [v2:172.21.15.12:6827/2850198678,v1:172.21.15.12:6829/2850198678] conn(0x55e398458160 0x55e3984566e0 crc :-1 s=READY pgs=6 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:41.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.713+0000 7ff2d0fbd000 1 --2- 172.21.15.12:0/642393706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e398421d30 0x55e39842a540 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:41.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.713+0000 7ff2d0fbd000 1 -- 172.21.15.12:0/642393706 >> 172.21.15.12:0/642393706 conn(0x55e39841c680 msgr2=0x55e398421620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:41.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.713+0000 7ff2a67fc640 0 client.4246 ms_handle_reset on v2:172.21.15.12:6827/2850198678 2024-09-11T23:03:41.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.713+0000 7ff2d0fbd000 1 -- 172.21.15.12:0/642393706 shutdown_connections 2024-09-11T23:03:41.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.713+0000 7ff2d0fbd000 1 -- 172.21.15.12:0/642393706 wait complete. 2024-09-11T23:03:41.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.713+0000 7ff2d0fbd000 20 client.4246 trim_cache size 0 max 16384 2024-09-11T23:03:41.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.729+0000 7ff2d0fbd000 1 Processor -- start 2024-09-11T23:03:41.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.729+0000 7ff2d0fbd000 1 -- start start 2024-09-11T23:03:41.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.729+0000 7ff2d0fbd000 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e398421d30 0x55e39842a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:41.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.729+0000 7ff2d0fbd000 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c813bcf0 con 0x55e398421d30 2024-09-11T23:03:41.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.729+0000 7ff2c77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e398421d30 0x55e39842a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:41.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.729+0000 7ff2c77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e398421d30 0x55e39842a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35434/0 (socket says 172.21.15.12:35434) 2024-09-11T23:03:41.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.729+0000 7ff2c77fe640 1 -- 172.21.15.12:0/3001631426 learned_addr learned my addr 172.21.15.12:0/3001631426 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:41.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.729+0000 7ff2c77fe640 1 -- 172.21.15.12:0/3001631426 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3981fafd0 con 0x55e398421d30 2024-09-11T23:03:41.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.729+0000 7ff2c77fe640 1 --2- 172.21.15.12:0/3001631426 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e398421d30 0x55e39842a1c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8009c90 tx=0x7ff2b80d5070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15aee6bdc4a244d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:41.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.729+0000 7ff2acff9640 1 -- 172.21.15.12:0/3001631426 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2b80ce030 con 0x55e398421d30 2024-09-11T23:03:41.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.729+0000 7ff2acff9640 1 -- 172.21.15.12:0/3001631426 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2b80b8ad0 con 0x55e398421d30 2024-09-11T23:03:41.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.729+0000 7ff2acff9640 1 -- 172.21.15.12:0/3001631426 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2b80b7540 con 0x55e398421d30 2024-09-11T23:03:41.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.729+0000 7ff2d0fbd000 1 -- 172.21.15.12:0/3001631426 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e398421d30 msgr2=0x55e39842a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:41.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.729+0000 7ff2d0fbd000 1 --2- 172.21.15.12:0/3001631426 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e398421d30 0x55e39842a1c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8009c90 tx=0x7ff2b80d5070 comp rx=0 tx=0).stop 2024-09-11T23:03:41.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.729+0000 7ff2d0fbd000 1 -- 172.21.15.12:0/3001631426 shutdown_connections 2024-09-11T23:03:41.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.729+0000 7ff2d0fbd000 1 --2- 172.21.15.12:0/3001631426 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e398421d30 0x55e39842a1c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:41.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.729+0000 7ff2d0fbd000 1 -- 172.21.15.12:0/3001631426 >> 172.21.15.12:0/3001631426 conn(0x55e39841c680 msgr2=0x55e398429ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:41.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.729+0000 7ff2d0fbd000 1 -- 172.21.15.12:0/3001631426 shutdown_connections 2024-09-11T23:03:41.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.729+0000 7ff2d0fbd000 1 -- 172.21.15.12:0/3001631426 wait complete. 2024-09-11T23:03:41.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.733+0000 7ff2d0fbd000 1 -- start start 2024-09-11T23:03:41.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.733+0000 7ff2d0fbd000 1 Processor -- start 2024-09-11T23:03:41.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.733+0000 7ff2d0fbd000 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e398421d30 0x55e398465210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:41.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.733+0000 7ff2d0fbd000 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55e398273c70 con 0x55e398421d30 2024-09-11T23:03:41.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.733+0000 7ff2d0fbd000 10 client.0 _ll_register_callbacks cb 0x7ff2b80c0440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:03:41.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.733+0000 7ff2c77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e398421d30 0x55e398465210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:41.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.733+0000 7ff2c77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e398421d30 0x55e398465210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35450/0 (socket says 172.21.15.12:35450) 2024-09-11T23:03:41.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.733+0000 7ff2c77fe640 1 -- 172.21.15.12:0/2645480122 learned_addr learned my addr 172.21.15.12:0/2645480122 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:41.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.733+0000 7ff2c77fe640 1 -- 172.21.15.12:0/2645480122 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3982f6750 con 0x55e398421d30 2024-09-11T23:03:41.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.733+0000 7ff2c77fe640 1 --2- 172.21.15.12:0/2645480122 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e398421d30 0x55e398465210 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff2b80c0930 tx=0x7ff2b80c0820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a458e98b013858f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:41.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.733+0000 7ff2a67fc640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-11T23:03:41.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.733+0000 7ff2a67fc640 1 -- 172.21.15.12:0/2645480122 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2b80ce040 con 0x55e398421d30 2024-09-11T23:03:41.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.733+0000 7ff2a67fc640 1 -- 172.21.15.12:0/2645480122 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(16..16 src has 1..16) ==== 3439+0+0 (secure 0 0 0) 0x7ff2b80fd060 con 0x55e398421d30 2024-09-11T23:03:41.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.733+0000 7ff2d0fbd000 1 -- 172.21.15.12:0/2645480122 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2b80b8ad0 con 0x55e398421d30 2024-09-11T23:03:41.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.733+0000 7ff2a67fc640 1 -- 172.21.15.12:0/2645480122 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7ff2b80c0de0 con 0x55e398421d30 2024-09-11T23:03:41.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.733+0000 7ff2d0fbd000 10 client.4248 fetch_fsmap learned FSMap version 7 2024-09-11T23:03:41.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.733+0000 7ff2d0fbd000 1 -- 172.21.15.12:0/2645480122 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55e398201a30 con 0x55e398421d30 2024-09-11T23:03:41.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.733+0000 7ff2a67fc640 1 -- 172.21.15.12:0/2645480122 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2b80b8ad0 con 0x55e398421d30 2024-09-11T23:03:41.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.733+0000 7ff2a67fc640 1 -- 172.21.15.12:0/2645480122 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 7) ==== 2292+0+0 (secure 0 0 0) 0x7ff2b80b5730 con 0x55e398421d30 2024-09-11T23:03:41.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.733+0000 7ff2d0fbd000 10 client.4248 fetch_fsmap finished waiting for FSMap version 7 2024-09-11T23:03:41.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.733+0000 7ff2d0fbd000 10 client.4248 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T23:03:41.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.733+0000 7ff2d0fbd000 20 client.4248 populate_metadata read hostname 'smithi012' 2024-09-11T23:03:41.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.733+0000 7ff2d0fbd000 1 --2- 172.21.15.12:0/2645480122 >> [v2:172.21.15.12:6827/2850198678,v1:172.21.15.12:6829/2850198678] conn(0x55e398465750 0x55e398465b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:41.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.733+0000 7ff2d0fbd000 4 client.4248 mds_command: new command op to 4140 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:03:41.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.733+0000 7ff2d0fbd000 1 -- 172.21.15.12:0/2645480122 --> [v2:172.21.15.12:6827/2850198678,v1:172.21.15.12:6829/2850198678] -- command(tid 0: {"prefix": "status"}) -- 0x55e398422480 con 0x55e398465750 2024-09-11T23:03:41.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.733+0000 7ff2c6ffd640 1 --2- 172.21.15.12:0/2645480122 >> [v2:172.21.15.12:6827/2850198678,v1:172.21.15.12:6829/2850198678] conn(0x55e398465750 0x55e398465b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:41.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.733+0000 7ff2a67fc640 10 client.4248 ms_handle_connect on v2:172.21.15.12:6827/2850198678 2024-09-11T23:03:41.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.733+0000 7ff2c6ffd640 1 --2- 172.21.15.12:0/2645480122 >> [v2:172.21.15.12:6827/2850198678,v1:172.21.15.12:6829/2850198678] conn(0x55e398465750 0x55e398465b30 crc :-1 s=READY pgs=7 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea763b39467f0c1c server_cookie=5d3a75a35d1a11fd in_seq=0 out_seq=0 2024-09-11T23:03:41.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.733+0000 7ff2a67fc640 1 -- 172.21.15.12:0/2645480122 <== mds.0 v2:172.21.15.12:6827/2850198678 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55e398422480 con 0x55e398465750 2024-09-11T23:03:41.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.733+0000 7ff2a67fc640 10 client.4248 handle_command_reply: tid=0 2024-09-11T23:03:41.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.733+0000 7ff2d0fbd000 1 client.4248 shutdown 2024-09-11T23:03:41.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.733+0000 7ff2d0fbd000 1 -- 172.21.15.12:0/2645480122 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e398421d30 msgr2=0x55e398465210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:41.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.733+0000 7ff2d0fbd000 1 --2- 172.21.15.12:0/2645480122 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e398421d30 0x55e398465210 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff2b80c0930 tx=0x7ff2b80c0820 comp rx=0 tx=0).stop 2024-09-11T23:03:41.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.733+0000 7ff2d0fbd000 1 -- 172.21.15.12:0/2645480122 shutdown_connections 2024-09-11T23:03:41.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.733+0000 7ff2d0fbd000 1 --2- 172.21.15.12:0/2645480122 >> [v2:172.21.15.12:6827/2850198678,v1:172.21.15.12:6829/2850198678] conn(0x55e398465750 0x55e398465b30 crc :-1 s=READY pgs=7 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:41.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.733+0000 7ff2d0fbd000 1 --2- 172.21.15.12:0/2645480122 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e398421d30 0x55e398465210 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:41.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.733+0000 7ff2d0fbd000 1 -- 172.21.15.12:0/2645480122 >> 172.21.15.12:0/2645480122 conn(0x55e39841c680 msgr2=0x55e39842a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:41.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.733+0000 7ff2a67fc640 0 client.4248 ms_handle_reset on v2:172.21.15.12:6827/2850198678 2024-09-11T23:03:41.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.733+0000 7ff2d0fbd000 1 -- 172.21.15.12:0/2645480122 shutdown_connections 2024-09-11T23:03:41.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.733+0000 7ff2d0fbd000 1 -- 172.21.15.12:0/2645480122 wait complete. 2024-09-11T23:03:41.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.733+0000 7ff2d0fbd000 20 client.4248 trim_cache size 0 max 16384 2024-09-11T23:03:41.743 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T23:03:41.743 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "8be14356-3340-4500-91a2-4cbc6b511f65", 2024-09-11T23:03:41.743 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 0, 2024-09-11T23:03:41.743 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4140, 2024-09-11T23:03:41.743 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-09-11T23:03:41.744 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-09-11T23:03:41.744 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-09-11T23:03:41.744 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 10.116309159, 2024-09-11T23:03:41.744 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 7, 2024-09-11T23:03:41.744 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 16, 2024-09-11T23:03:41.744 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 16, 2024-09-11T23:03:41.744 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 16.152692268999999 2024-09-11T23:03:41.744 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T23:03:41.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.733+0000 7ff2cdf01640 1 -- 172.21.15.12:0/2454731717 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7ff2b4035db0 msgr2=0x7ff2b4038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:41.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.733+0000 7ff2cdf01640 1 --2- 172.21.15.12:0/2454731717 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7ff2b4035db0 0x7ff2b4038270 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc001560 tx=0x7ff2bc007a50 comp rx=0 tx=0).stop 2024-09-11T23:03:41.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.733+0000 7ff2cdf01640 1 -- 172.21.15.12:0/2454731717 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2c80a1c50 msgr2=0x7ff2c809c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:41.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.733+0000 7ff2cdf01640 1 --2- 172.21.15.12:0/2454731717 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2c80a1c50 0x7ff2c809c300 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff2b801a5d0 tx=0x7ff2b8019740 comp rx=0 tx=0).stop 2024-09-11T23:03:41.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.733+0000 7ff2cdf01640 1 -- 172.21.15.12:0/2454731717 shutdown_connections 2024-09-11T23:03:41.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.733+0000 7ff2cdf01640 1 --2- 172.21.15.12:0/2454731717 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7ff2b4035db0 0x7ff2b4038270 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:41.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.733+0000 7ff2cdf01640 1 --2- 172.21.15.12:0/2454731717 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2c80a1c50 0x7ff2c809c300 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:41.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.733+0000 7ff2cdf01640 1 -- 172.21.15.12:0/2454731717 >> 172.21.15.12:0/2454731717 conn(0x7ff2c80aa740 msgr2=0x7ff2c80728e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:41.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.733+0000 7ff2cdf01640 1 -- 172.21.15.12:0/2454731717 shutdown_connections 2024-09-11T23:03:41.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:41.733+0000 7ff2cdf01640 1 -- 172.21.15.12:0/2454731717 wait complete. 2024-09-11T23:03:41.753 INFO:teuthology.run_tasks:Running task sequential... 2024-09-11T23:03:41.767 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-11T23:03:41.767 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-11T23:03:41.768 INFO:teuthology.task.print:Enabling mgr modules 2024-09-11T23:03:41.768 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-11T23:03:41.826 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-11T23:03:41.826 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-09-11T23:03:41.826 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-11T23:03:41.826 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-11T23:03:41.827 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T23:03:41.827 INFO:tasks.ceph_fuse:client.1 config is {} 2024-09-11T23:03:41.827 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-11T23:03:41.827 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-11T23:03:41.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:03:41.827 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2024-09-11T23:03:41.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:03:41.834 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link delete ceph-brx 2024-09-11T23:03:41.890 INFO:teuthology.orchestra.run.smithi012.stderr:Cannot find device "ceph-brx" 2024-09-11T23:03:41.891 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:03:41.891 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-11T23:03:41.891 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-11T23:03:41.892 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T23:03:42.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.049+0000 7f9b13362640 1 Processor -- start 2024-09-11T23:03:42.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.049+0000 7f9b13362640 1 -- start start 2024-09-11T23:03:42.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.049+0000 7f9b13362640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9b0c137e60 0x7f9b0c138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:42.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.049+0000 7f9b13362640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b0c09e930 con 0x7f9b0c09f6e0 2024-09-11T23:03:42.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.049+0000 7f9b13362640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f9b0c1379e0 con 0x7f9b0c137e60 2024-09-11T23:03:42.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.049+0000 7f9b110fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9b0c137e60 0x7f9b0c138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:42.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.049+0000 7f9b108fd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f9b0c09f6e0 0x7f9b0c0a36a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:49738/0 (socket says 172.21.15.12:49738) 2024-09-11T23:03:42.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.049+0000 7f9b108fd640 1 -- 172.21.15.12:0/1178199505 learned_addr learned my addr 172.21.15.12:0/1178199505 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:03:42.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.049+0000 7f9b110fe640 1 -- 172.21.15.12:0/1178199505 >> v1:172.21.15.12:6789/0 conn(0x7f9b0c09f6e0 legacy=0x7f9b0c0a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:42.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.049+0000 7f9b03fff640 1 -- 172.21.15.12:0/1178199505 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4233036827 0 0) 0x7f9b0c09e930 con 0x7f9b0c09f6e0 2024-09-11T23:03:42.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.049+0000 7f9b110fe640 1 -- 172.21.15.12:0/1178199505 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b0c09d910 con 0x7f9b0c137e60 2024-09-11T23:03:42.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.053+0000 7f9b110fe640 1 --2- 172.21.15.12:0/1178199505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b0c137e60 0x7f9b0c138240 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9b08009d90 tx=0x7f9b0801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e05cee7b68e998d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:42.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.053+0000 7f9b03fff640 1 -- 172.21.15.12:0/1178199505 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b080b2070 con 0x7f9b0c137e60 2024-09-11T23:03:42.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.053+0000 7f9b03fff640 1 -- 172.21.15.12:0/1178199505 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b080a5900 con 0x7f9b0c137e60 2024-09-11T23:03:42.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.053+0000 7f9b03fff640 1 -- 172.21.15.12:0/1178199505 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b080a5c00 con 0x7f9b0c137e60 2024-09-11T23:03:42.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.053+0000 7f9b13362640 1 -- 172.21.15.12:0/1178199505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b0c137e60 msgr2=0x7f9b0c138240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:42.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.053+0000 7f9b13362640 1 --2- 172.21.15.12:0/1178199505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b0c137e60 0x7f9b0c138240 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9b08009d90 tx=0x7f9b0801c970 comp rx=0 tx=0).stop 2024-09-11T23:03:42.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.053+0000 7f9b13362640 1 -- 172.21.15.12:0/1178199505 shutdown_connections 2024-09-11T23:03:42.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.053+0000 7f9b13362640 1 --2- 172.21.15.12:0/1178199505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b0c137e60 0x7f9b0c138240 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:42.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.053+0000 7f9b13362640 1 -- 172.21.15.12:0/1178199505 >> 172.21.15.12:0/1178199505 conn(0x7f9b0c0a8450 msgr2=0x7f9b0c0a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:42.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.053+0000 7f9b13362640 1 -- 172.21.15.12:0/1178199505 shutdown_connections 2024-09-11T23:03:42.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.053+0000 7f9b13362640 1 -- 172.21.15.12:0/1178199505 wait complete. 2024-09-11T23:03:42.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.053+0000 7f9b13362640 1 Processor -- start 2024-09-11T23:03:42.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.053+0000 7f9b13362640 1 -- start start 2024-09-11T23:03:42.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.053+0000 7f9b13362640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b0c09f6e0 0x7f9b0c133780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:42.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.053+0000 7f9b13362640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9b0c13fe00 con 0x7f9b0c09f6e0 2024-09-11T23:03:42.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.053+0000 7f9b110fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b0c09f6e0 0x7f9b0c133780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:42.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.053+0000 7f9b110fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b0c09f6e0 0x7f9b0c133780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35474/0 (socket says 172.21.15.12:35474) 2024-09-11T23:03:42.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.053+0000 7f9b110fe640 1 -- 172.21.15.12:0/1782300501 learned_addr learned my addr 172.21.15.12:0/1782300501 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:42.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.057+0000 7f9b110fe640 1 -- 172.21.15.12:0/1782300501 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b0c070860 con 0x7f9b0c09f6e0 2024-09-11T23:03:42.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.057+0000 7f9b110fe640 1 --2- 172.21.15.12:0/1782300501 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b0c09f6e0 0x7f9b0c133780 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9b0801c9b0 tx=0x7f9b08019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:42.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.057+0000 7f9b01ffb640 1 -- 172.21.15.12:0/1782300501 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b080bd020 con 0x7f9b0c09f6e0 2024-09-11T23:03:42.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.057+0000 7f9b01ffb640 1 -- 172.21.15.12:0/1782300501 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b080ad5f0 con 0x7f9b0c09f6e0 2024-09-11T23:03:42.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.057+0000 7f9b13362640 1 -- 172.21.15.12:0/1782300501 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b0c070580 con 0x7f9b0c09f6e0 2024-09-11T23:03:42.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.057+0000 7f9b01ffb640 1 -- 172.21.15.12:0/1782300501 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b080b2040 con 0x7f9b0c09f6e0 2024-09-11T23:03:42.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.057+0000 7f9b13362640 1 -- 172.21.15.12:0/1782300501 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b0c073060 con 0x7f9b0c09f6e0 2024-09-11T23:03:42.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.057+0000 7f9b13362640 1 -- 172.21.15.12:0/1782300501 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b0c073230 con 0x7f9b0c09f6e0 2024-09-11T23:03:42.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.057+0000 7f9b01ffb640 1 -- 172.21.15.12:0/1782300501 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9b080c0020 con 0x7f9b0c09f6e0 2024-09-11T23:03:42.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.057+0000 7f9b01ffb640 1 --2- 172.21.15.12:0/1782300501 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f9af0035db0 0x7f9af0038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:42.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.057+0000 7f9b01ffb640 1 -- 172.21.15.12:0/1782300501 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3439+0+0 (secure 0 0 0) 0x7f9b080e3800 con 0x7f9b0c09f6e0 2024-09-11T23:03:42.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.057+0000 7f9b108fd640 1 --2- 172.21.15.12:0/1782300501 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f9af0035db0 0x7f9af0038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:42.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.057+0000 7f9b108fd640 1 --2- 172.21.15.12:0/1782300501 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f9af0035db0 0x7f9af0038270 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9afc007fd0 tx=0x7f9afc007920 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:42.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.061+0000 7f9b01ffb640 1 -- 172.21.15.12:0/1782300501 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9b080c7030 con 0x7f9b0c09f6e0 2024-09-11T23:03:42.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.261+0000 7f9b13362640 1 -- 172.21.15.12:0/1782300501 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f9b0c06bc60 con 0x7f9b0c09f6e0 2024-09-11T23:03:42.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.261+0000 7f9b01ffb640 1 -- 172.21.15.12:0/1782300501 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7f9b08016560 con 0x7f9b0c09f6e0 2024-09-11T23:03:42.265 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T23:03:42.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.265+0000 7f9b13362640 1 -- 172.21.15.12:0/1782300501 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f9af0035db0 msgr2=0x7f9af0038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:42.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.265+0000 7f9b13362640 1 --2- 172.21.15.12:0/1782300501 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f9af0035db0 0x7f9af0038270 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9afc007fd0 tx=0x7f9afc007920 comp rx=0 tx=0).stop 2024-09-11T23:03:42.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.265+0000 7f9b13362640 1 -- 172.21.15.12:0/1782300501 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b0c09f6e0 msgr2=0x7f9b0c133780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:42.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.265+0000 7f9b13362640 1 --2- 172.21.15.12:0/1782300501 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b0c09f6e0 0x7f9b0c133780 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9b0801c9b0 tx=0x7f9b08019710 comp rx=0 tx=0).stop 2024-09-11T23:03:42.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.265+0000 7f9b13362640 1 -- 172.21.15.12:0/1782300501 shutdown_connections 2024-09-11T23:03:42.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.265+0000 7f9b13362640 1 --2- 172.21.15.12:0/1782300501 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f9af0035db0 0x7f9af0038270 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:42.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.265+0000 7f9b13362640 1 --2- 172.21.15.12:0/1782300501 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b0c09f6e0 0x7f9b0c133780 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:42.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.265+0000 7f9b13362640 1 -- 172.21.15.12:0/1782300501 >> 172.21.15.12:0/1782300501 conn(0x7f9b0c0a8450 msgr2=0x7f9b0c134650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:42.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.265+0000 7f9b13362640 1 -- 172.21.15.12:0/1782300501 shutdown_connections 2024-09-11T23:03:42.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42.265+0000 7f9b13362640 1 -- 172.21.15.12:0/1782300501 wait complete. 2024-09-11T23:03:42.283 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-11T23:03:42.283 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:03:42.284 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi012.front.sepia.ceph.com 2024-09-11T23:03:42.284 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T23:03:42.284 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T23:03:42.284 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-11T23:03:42.284 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T23:03:42.284 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:03:42.284 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:03:42.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:03:42.284 DEBUG:teuthology.orchestra.run.smithi012:> ip addr 2024-09-11T23:03:42.290 INFO:teuthology.orchestra.run.smithi012.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:03:42.290 INFO:teuthology.orchestra.run.smithi012.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:03:42.290 INFO:teuthology.orchestra.run.smithi012.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:03:42.290 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:03:42.290 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 ::1/128 scope host 2024-09-11T23:03:42.290 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:03:42.290 INFO:teuthology.orchestra.run.smithi012.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:03:42.291 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a4 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:03:42.291 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f0 2024-09-11T23:03:42.291 INFO:teuthology.orchestra.run.smithi012.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:03:42.291 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a5 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:03:42.291 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f1 2024-09-11T23:03:42.291 INFO:teuthology.orchestra.run.smithi012.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:03:42.291 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:ea brd ff:ff:ff:ff:ff:ff 2024-09-11T23:03:42.291 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f0 2024-09-11T23:03:42.291 INFO:teuthology.orchestra.run.smithi012.stdout: inet 172.21.15.12/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-11T23:03:42.291 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft 42519sec preferred_lft 42519sec 2024-09-11T23:03:42.291 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::ae1f:6bff:fef8:25ea/64 scope link 2024-09-11T23:03:42.291 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:03:42.291 INFO:teuthology.orchestra.run.smithi012.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:03:42.291 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:eb brd ff:ff:ff:ff:ff:ff 2024-09-11T23:03:42.292 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f1 2024-09-11T23:03:42.292 INFO:teuthology.orchestra.run.smithi012.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-11T23:03:42.292 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 02:42:d6:75:63:83 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:03:42.292 INFO:teuthology.orchestra.run.smithi012.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-11T23:03:42.292 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:03:42.292 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-11T23:03:42.292 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:03:42.292 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-09-11T23:03:42.293 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link add name ceph-brx type bridge 2024-09-11T23:03:42.293 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip addr flush dev ceph-brx 2024-09-11T23:03:42.293 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set ceph-brx up 2024-09-11T23:03:42.293 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-11T23:03:42.293 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-09-11T23:03:42.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:03:42.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:03:42.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:03:42.414 DEBUG:teuthology.orchestra.run.smithi012:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:03:42.422 INFO:teuthology.orchestra.run.smithi012.stdout:1 2024-09-11T23:03:42.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:03:42.424 DEBUG:teuthology.orchestra.run.smithi012:> route 2024-09-11T23:03:42.489 INFO:teuthology.orchestra.run.smithi012.stdout:Kernel IP routing table 2024-09-11T23:03:42.489 INFO:teuthology.orchestra.run.smithi012.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:03:42.489 INFO:teuthology.orchestra.run.smithi012.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-11T23:03:42.489 INFO:teuthology.orchestra.run.smithi012.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-11T23:03:42.489 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-11T23:03:42.489 INFO:teuthology.orchestra.run.smithi012.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:03:42.490 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:03:42.490 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-09-11T23:03:42.490 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-11T23:03:42.490 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-11T23:03:42.490 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-11T23:03:42.490 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-09-11T23:03:42.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:03:42.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:03:42.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:03:42.613 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2024-09-11T23:03:42.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:03:42.619 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list-id 2024-09-11T23:03:42.667 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:03:42.668 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-09-11T23:03:42.668 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:03:42.668 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-11T23:03:42.668 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-09-11T23:03:42.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:03:42.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:03:42.789 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-11T23:03:42.789 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:03:42.789 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-09-11T23:03:42.789 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-11T23:03:42.789 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-11T23:03:42.789 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-11T23:03:42.789 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-11T23:03:42.789 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-11T23:03:42.789 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-09-11T23:03:42.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:03:42.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:03:42.892 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:03:42.892 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-09-11T23:03:42.892 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set brx.0 up 2024-09-11T23:03:42.893 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set dev brx.0 master ceph-brx 2024-09-11T23:03:42.893 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-09-11T23:03:42.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:03:42.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:03:42.997 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-11T23:03:42.997 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:03:42.997 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T23:03:43.044 INFO:teuthology.orchestra.run.smithi012.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:03:43.044 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:03:43.045 DEBUG:teuthology.orchestra.run.smithi012:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:03:43.095 DEBUG:teuthology.orchestra.run.smithi012:> sudo modprobe fuse 2024-09-11T23:03:43.153 DEBUG:teuthology.orchestra.run.smithi012:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:03:43.202 INFO:teuthology.orchestra.run.smithi012.stdout:/sys 2024-09-11T23:03:43.202 INFO:teuthology.orchestra.run.smithi012.stdout:/proc 2024-09-11T23:03:43.202 INFO:teuthology.orchestra.run.smithi012.stdout:/dev 2024-09-11T23:03:43.202 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/pts 2024-09-11T23:03:43.203 INFO:teuthology.orchestra.run.smithi012.stdout:/run 2024-09-11T23:03:43.203 INFO:teuthology.orchestra.run.smithi012.stdout:/ 2024-09-11T23:03:43.203 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/security 2024-09-11T23:03:43.203 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/shm 2024-09-11T23:03:43.203 INFO:teuthology.orchestra.run.smithi012.stdout:/run/lock 2024-09-11T23:03:43.203 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup 2024-09-11T23:03:43.203 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/pstore 2024-09-11T23:03:43.203 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/bpf 2024-09-11T23:03:43.203 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:03:43.203 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/hugepages 2024-09-11T23:03:43.203 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/mqueue 2024-09-11T23:03:43.203 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/debug 2024-09-11T23:03:43.203 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/tracing 2024-09-11T23:03:43.203 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/fs/nfsd 2024-09-11T23:03:43.204 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/fuse/connections 2024-09-11T23:03:43.204 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/config 2024-09-11T23:03:43.204 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:03:43.204 INFO:teuthology.orchestra.run.smithi012.stdout:/run/rpc_pipefs 2024-09-11T23:03:43.204 INFO:teuthology.orchestra.run.smithi012.stdout:/run/user/1000 2024-09-11T23:03:43.204 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph 2024-09-11T23:03:43.204 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:03:43.204 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:03:43.204 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:03:43.204 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns 2024-09-11T23:03:43.204 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:03:43.204 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:03:43.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:03:43.205 DEBUG:teuthology.orchestra.run.smithi012:> ls /sys/fs/fuse/connections 2024-09-11T23:03:43.252 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-11T23:03:43.252 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-11T23:03:43.297 DEBUG:teuthology.orchestra.run.smithi012:> sudo modprobe fuse 2024-09-11T23:03:43.312 DEBUG:teuthology.orchestra.run.smithi012:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:03:43.360 INFO:teuthology.orchestra.run.smithi012.stdout:/sys 2024-09-11T23:03:43.360 INFO:teuthology.orchestra.run.smithi012.stdout:/proc 2024-09-11T23:03:43.360 INFO:teuthology.orchestra.run.smithi012.stdout:/dev 2024-09-11T23:03:43.361 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/pts 2024-09-11T23:03:43.361 INFO:teuthology.orchestra.run.smithi012.stdout:/run 2024-09-11T23:03:43.361 INFO:teuthology.orchestra.run.smithi012.stdout:/ 2024-09-11T23:03:43.361 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/security 2024-09-11T23:03:43.361 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/shm 2024-09-11T23:03:43.361 INFO:teuthology.orchestra.run.smithi012.stdout:/run/lock 2024-09-11T23:03:43.361 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup 2024-09-11T23:03:43.361 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/pstore 2024-09-11T23:03:43.361 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/bpf 2024-09-11T23:03:43.361 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:03:43.361 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/hugepages 2024-09-11T23:03:43.362 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/mqueue 2024-09-11T23:03:43.362 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/debug 2024-09-11T23:03:43.362 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/tracing 2024-09-11T23:03:43.362 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/fs/nfsd 2024-09-11T23:03:43.362 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/fuse/connections 2024-09-11T23:03:43.362 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/config 2024-09-11T23:03:43.362 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:03:43.362 INFO:teuthology.orchestra.run.smithi012.stdout:/run/rpc_pipefs 2024-09-11T23:03:43.362 INFO:teuthology.orchestra.run.smithi012.stdout:/run/user/1000 2024-09-11T23:03:43.362 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph 2024-09-11T23:03:43.362 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:03:43.363 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:03:43.363 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:03:43.363 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns 2024-09-11T23:03:43.363 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:03:43.363 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:03:43.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:03:43.364 DEBUG:teuthology.orchestra.run.smithi012:> ls /sys/fs/fuse/connections 2024-09-11T23:03:43.377 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi012.stderr:2024-09-11T23:03:43.373+0000 7efeba36b580 -1 init, newargv = 0x561d900ae4e0 newargc=15 2024-09-11T23:03:43.377 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi012.stderr:ceph-fuse[33392]: starting ceph client 2024-09-11T23:03:43.382 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi012.stderr:ceph-fuse[33392]: starting fuse 2024-09-11T23:03:44.485 DEBUG:teuthology.orchestra.run.smithi012:> sudo modprobe fuse 2024-09-11T23:03:45.358 DEBUG:teuthology.orchestra.run.smithi012:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:03:45.407 INFO:teuthology.orchestra.run.smithi012.stdout:/sys 2024-09-11T23:03:45.407 INFO:teuthology.orchestra.run.smithi012.stdout:/proc 2024-09-11T23:03:45.407 INFO:teuthology.orchestra.run.smithi012.stdout:/dev 2024-09-11T23:03:45.407 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/pts 2024-09-11T23:03:45.407 INFO:teuthology.orchestra.run.smithi012.stdout:/run 2024-09-11T23:03:45.408 INFO:teuthology.orchestra.run.smithi012.stdout:/ 2024-09-11T23:03:45.408 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/security 2024-09-11T23:03:45.408 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/shm 2024-09-11T23:03:45.408 INFO:teuthology.orchestra.run.smithi012.stdout:/run/lock 2024-09-11T23:03:45.408 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup 2024-09-11T23:03:45.408 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/pstore 2024-09-11T23:03:45.408 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/bpf 2024-09-11T23:03:45.408 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:03:45.408 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/hugepages 2024-09-11T23:03:45.408 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/mqueue 2024-09-11T23:03:45.408 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/debug 2024-09-11T23:03:45.408 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/tracing 2024-09-11T23:03:45.408 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/fs/nfsd 2024-09-11T23:03:45.408 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/fuse/connections 2024-09-11T23:03:45.409 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/config 2024-09-11T23:03:45.409 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:03:45.409 INFO:teuthology.orchestra.run.smithi012.stdout:/run/rpc_pipefs 2024-09-11T23:03:45.409 INFO:teuthology.orchestra.run.smithi012.stdout:/run/user/1000 2024-09-11T23:03:45.409 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph 2024-09-11T23:03:45.409 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:03:45.409 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:03:45.409 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:03:45.409 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns 2024-09-11T23:03:45.409 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:03:45.409 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:03:45.409 INFO:teuthology.orchestra.run.smithi012.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-11T23:03:45.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:03:45.410 DEBUG:teuthology.orchestra.run.smithi012:> ls /sys/fs/fuse/connections 2024-09-11T23:03:45.461 INFO:teuthology.orchestra.run.smithi012.stdout:45 2024-09-11T23:03:45.461 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-11T23:03:45.461 DEBUG:teuthology.orchestra.run.smithi012:> sudo stdin-killer -- python3 -c ' 2024-09-11T23:03:45.461 DEBUG:teuthology.orchestra.run.smithi012:> import glob 2024-09-11T23:03:45.461 DEBUG:teuthology.orchestra.run.smithi012:> import re 2024-09-11T23:03:45.461 DEBUG:teuthology.orchestra.run.smithi012:> import os 2024-09-11T23:03:45.461 DEBUG:teuthology.orchestra.run.smithi012:> import subprocess 2024-09-11T23:03:45.462 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:03:45.462 DEBUG:teuthology.orchestra.run.smithi012:> def _find_admin_socket(client_name): 2024-09-11T23:03:45.462 DEBUG:teuthology.orchestra.run.smithi012:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-11T23:03:45.462 DEBUG:teuthology.orchestra.run.smithi012:> files = glob.glob(asok_path) 2024-09-11T23:03:45.462 DEBUG:teuthology.orchestra.run.smithi012:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-11T23:03:45.462 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:03:45.462 DEBUG:teuthology.orchestra.run.smithi012:> # Given a non-glob path, it better be there 2024-09-11T23:03:45.462 DEBUG:teuthology.orchestra.run.smithi012:> if "*" not in asok_path: 2024-09-11T23:03:45.462 DEBUG:teuthology.orchestra.run.smithi012:> assert(len(files) == 1) 2024-09-11T23:03:45.462 DEBUG:teuthology.orchestra.run.smithi012:> return files[0] 2024-09-11T23:03:45.462 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:03:45.462 DEBUG:teuthology.orchestra.run.smithi012:> for f in files: 2024-09-11T23:03:45.462 DEBUG:teuthology.orchestra.run.smithi012:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T23:03:45.462 DEBUG:teuthology.orchestra.run.smithi012:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T23:03:45.462 DEBUG:teuthology.orchestra.run.smithi012:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T23:03:45.463 DEBUG:teuthology.orchestra.run.smithi012:> contents = proc_f.read() 2024-09-11T23:03:45.463 DEBUG:teuthology.orchestra.run.smithi012:> if mountpoint in contents: 2024-09-11T23:03:45.463 DEBUG:teuthology.orchestra.run.smithi012:> return f 2024-09-11T23:03:45.463 DEBUG:teuthology.orchestra.run.smithi012:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T23:03:45.463 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:03:45.463 DEBUG:teuthology.orchestra.run.smithi012:> print(_find_admin_socket("client.0")) 2024-09-11T23:03:45.463 DEBUG:teuthology.orchestra.run.smithi012:> ' 2024-09-11T23:03:45.590 INFO:teuthology.orchestra.run.smithi012.stdout:/var/run/ceph/ceph-client.0.33392.asok 2024-09-11T23:03:45.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:03:45.602 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.33392.asok 2024-09-11T23:03:45.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:03:45.603 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.33392.asok status 2024-09-11T23:03:45.765 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T23:03:45.765 INFO:teuthology.orchestra.run.smithi012.stdout: "metadata": { 2024-09-11T23:03:45.765 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-11T23:03:45.765 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T23:03:45.765 INFO:teuthology.orchestra.run.smithi012.stdout: "entity_id": "0", 2024-09-11T23:03:45.765 INFO:teuthology.orchestra.run.smithi012.stdout: "hostname": "smithi012", 2024-09-11T23:03:45.765 INFO:teuthology.orchestra.run.smithi012.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-11T23:03:45.765 INFO:teuthology.orchestra.run.smithi012.stdout: "pid": "33392", 2024-09-11T23:03:45.765 INFO:teuthology.orchestra.run.smithi012.stdout: "root": "/" 2024-09-11T23:03:45.765 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:03:45.765 INFO:teuthology.orchestra.run.smithi012.stdout: "dentry_count": 0, 2024-09-11T23:03:45.766 INFO:teuthology.orchestra.run.smithi012.stdout: "dentry_pinned_count": 0, 2024-09-11T23:03:45.766 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4254, 2024-09-11T23:03:45.766 INFO:teuthology.orchestra.run.smithi012.stdout: "inst": { 2024-09-11T23:03:45.766 INFO:teuthology.orchestra.run.smithi012.stdout: "name": { 2024-09-11T23:03:45.766 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "client", 2024-09-11T23:03:45.766 INFO:teuthology.orchestra.run.smithi012.stdout: "num": 4254 2024-09-11T23:03:45.766 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:03:45.766 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": { 2024-09-11T23:03:45.766 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T23:03:45.766 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "192.168.0.1:0", 2024-09-11T23:03:45.766 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 3096615806 2024-09-11T23:03:45.766 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:03:45.766 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:03:45.766 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": { 2024-09-11T23:03:45.767 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T23:03:45.767 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "192.168.0.1:0", 2024-09-11T23:03:45.767 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 3096615806 2024-09-11T23:03:45.767 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:03:45.767 INFO:teuthology.orchestra.run.smithi012.stdout: "inst_str": "client.4254 192.168.0.1:0/3096615806", 2024-09-11T23:03:45.767 INFO:teuthology.orchestra.run.smithi012.stdout: "addr_str": "192.168.0.1:0/3096615806", 2024-09-11T23:03:45.767 INFO:teuthology.orchestra.run.smithi012.stdout: "inode_count": 1, 2024-09-11T23:03:45.767 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_epoch": 7, 2024-09-11T23:03:45.767 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_epoch": 16, 2024-09-11T23:03:45.767 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_epoch_barrier": 0, 2024-09-11T23:03:45.767 INFO:teuthology.orchestra.run.smithi012.stdout: "blocklisted": false, 2024-09-11T23:03:45.767 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs" 2024-09-11T23:03:45.767 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T23:03:45.778 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-11T23:03:45.779 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T23:03:45.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:45.901+0000 7f003735b640 1 Processor -- start 2024-09-11T23:03:45.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:45.901+0000 7f003735b640 1 -- start start 2024-09-11T23:03:45.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:45.905+0000 7f003735b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0030136ca0 0x7f003009ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:45.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:45.905+0000 7f003735b640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00300a1ff0 con 0x7f0030137080 2024-09-11T23:03:45.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:45.905+0000 7f003735b640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f00300a12e0 con 0x7f0030136ca0 2024-09-11T23:03:45.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:45.905+0000 7f00350f7640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0030136ca0 0x7f003009ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:45.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:45.905+0000 7f00348f6640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f0030137080 0x7f00300a36a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56838/0 (socket says 172.21.15.12:56838) 2024-09-11T23:03:45.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:45.905+0000 7f00348f6640 1 -- 172.21.15.12:0/3104822355 learned_addr learned my addr 172.21.15.12:0/3104822355 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:03:45.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:45.905+0000 7f00350f7640 1 -- 172.21.15.12:0/3104822355 >> v1:172.21.15.12:6789/0 conn(0x7f0030137080 legacy=0x7f00300a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:45.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:45.905+0000 7f00350f7640 1 -- 172.21.15.12:0/3104822355 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00300a0eb0 con 0x7f0030136ca0 2024-09-11T23:03:45.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:45.905+0000 7f0027fff640 1 -- 172.21.15.12:0/3104822355 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 408189688 0 0) 0x7f00300a1ff0 con 0x7f0030137080 2024-09-11T23:03:45.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:45.905+0000 7f00350f7640 1 --2- 172.21.15.12:0/3104822355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0030136ca0 0x7f003009ad90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f002c009740 tx=0x7f002c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=143439ae909d4e51 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:45.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:45.905+0000 7f0027fff640 1 -- 172.21.15.12:0/3104822355 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f002c0b0070 con 0x7f0030136ca0 2024-09-11T23:03:45.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:45.905+0000 7f0027fff640 1 -- 172.21.15.12:0/3104822355 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f002c0ab400 con 0x7f0030136ca0 2024-09-11T23:03:45.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:45.905+0000 7f0027fff640 1 -- 172.21.15.12:0/3104822355 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f002c0ab700 con 0x7f0030136ca0 2024-09-11T23:03:45.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:45.909+0000 7f003735b640 1 -- 172.21.15.12:0/3104822355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0030136ca0 msgr2=0x7f003009ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:45.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:45.909+0000 7f003735b640 1 --2- 172.21.15.12:0/3104822355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0030136ca0 0x7f003009ad90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f002c009740 tx=0x7f002c01c420 comp rx=0 tx=0).stop 2024-09-11T23:03:45.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:45.909+0000 7f003735b640 1 -- 172.21.15.12:0/3104822355 shutdown_connections 2024-09-11T23:03:45.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:45.909+0000 7f003735b640 1 --2- 172.21.15.12:0/3104822355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0030136ca0 0x7f003009ad90 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:45.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:45.909+0000 7f003735b640 1 -- 172.21.15.12:0/3104822355 >> 172.21.15.12:0/3104822355 conn(0x7f00300a8450 msgr2=0x7f00300a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:45.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:45.909+0000 7f003735b640 1 -- 172.21.15.12:0/3104822355 shutdown_connections 2024-09-11T23:03:45.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:45.909+0000 7f003735b640 1 -- 172.21.15.12:0/3104822355 wait complete. 2024-09-11T23:03:45.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:45.909+0000 7f003735b640 1 Processor -- start 2024-09-11T23:03:45.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:45.909+0000 7f003735b640 1 -- start start 2024-09-11T23:03:45.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:45.909+0000 7f003735b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0030136ca0 0x7f0030139d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:45.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:45.909+0000 7f003735b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f003013ed10 con 0x7f0030136ca0 2024-09-11T23:03:45.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:45.909+0000 7f00350f7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0030136ca0 0x7f0030139d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:45.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:45.909+0000 7f00350f7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0030136ca0 0x7f0030139d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47220/0 (socket says 172.21.15.12:47220) 2024-09-11T23:03:45.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:45.909+0000 7f00350f7640 1 -- 172.21.15.12:0/2586900787 learned_addr learned my addr 172.21.15.12:0/2586900787 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:45.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:45.909+0000 7f00350f7640 1 -- 172.21.15.12:0/2586900787 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f003009c9c0 con 0x7f0030136ca0 2024-09-11T23:03:45.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:45.909+0000 7f00350f7640 1 --2- 172.21.15.12:0/2586900787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0030136ca0 0x7f0030139d40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f002c0ae040 tx=0x7f002c01ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:45.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:45.909+0000 7f0025ffb640 1 -- 172.21.15.12:0/2586900787 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f002c0b0050 con 0x7f0030136ca0 2024-09-11T23:03:45.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:45.909+0000 7f0025ffb640 1 -- 172.21.15.12:0/2586900787 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f002c0b1040 con 0x7f0030136ca0 2024-09-11T23:03:45.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:45.909+0000 7f003735b640 1 -- 172.21.15.12:0/2586900787 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00300737f0 con 0x7f0030136ca0 2024-09-11T23:03:45.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:45.909+0000 7f0025ffb640 1 -- 172.21.15.12:0/2586900787 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f002c0b7580 con 0x7f0030136ca0 2024-09-11T23:03:45.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:45.909+0000 7f003735b640 1 -- 172.21.15.12:0/2586900787 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00301311f0 con 0x7f0030136ca0 2024-09-11T23:03:45.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:45.909+0000 7f0025ffb640 1 -- 172.21.15.12:0/2586900787 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f002c0be030 con 0x7f0030136ca0 2024-09-11T23:03:45.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:45.909+0000 7f003735b640 1 -- 172.21.15.12:0/2586900787 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f003013ae00 con 0x7f0030136ca0 2024-09-11T23:03:45.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:45.909+0000 7f0025ffb640 1 --2- 172.21.15.12:0/2586900787 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f0014035d60 0x7f0014038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:45.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:45.913+0000 7f0025ffb640 1 -- 172.21.15.12:0/2586900787 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3439+0+0 (secure 0 0 0) 0x7f002c0bc070 con 0x7f0030136ca0 2024-09-11T23:03:45.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:45.913+0000 7f00348f6640 1 --2- 172.21.15.12:0/2586900787 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f0014035d60 0x7f0014038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:45.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:45.913+0000 7f00348f6640 1 --2- 172.21.15.12:0/2586900787 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f0014035d60 0x7f0014038220 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0020007fd0 tx=0x7f0020007920 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:45.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:45.917+0000 7f0025ffb640 1 -- 172.21.15.12:0/2586900787 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f002c0c5020 con 0x7f0030136ca0 2024-09-11T23:03:46.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:46.113+0000 7f003735b640 1 -- 172.21.15.12:0/2586900787 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f003009ad90 con 0x7f0030136ca0 2024-09-11T23:03:46.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:46.117+0000 7f0025ffb640 1 -- 172.21.15.12:0/2586900787 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7f002c016010 con 0x7f0030136ca0 2024-09-11T23:03:46.119 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T23:03:46.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:46.117+0000 7f003735b640 1 -- 172.21.15.12:0/2586900787 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f0014035d60 msgr2=0x7f0014038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:46.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:46.117+0000 7f003735b640 1 --2- 172.21.15.12:0/2586900787 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f0014035d60 0x7f0014038220 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0020007fd0 tx=0x7f0020007920 comp rx=0 tx=0).stop 2024-09-11T23:03:46.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:46.117+0000 7f003735b640 1 -- 172.21.15.12:0/2586900787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0030136ca0 msgr2=0x7f0030139d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:46.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:46.117+0000 7f003735b640 1 --2- 172.21.15.12:0/2586900787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0030136ca0 0x7f0030139d40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f002c0ae040 tx=0x7f002c01ac60 comp rx=0 tx=0).stop 2024-09-11T23:03:46.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:46.117+0000 7f003735b640 1 -- 172.21.15.12:0/2586900787 shutdown_connections 2024-09-11T23:03:46.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:46.117+0000 7f003735b640 1 --2- 172.21.15.12:0/2586900787 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f0014035d60 0x7f0014038220 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:46.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:46.117+0000 7f003735b640 1 --2- 172.21.15.12:0/2586900787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0030136ca0 0x7f0030139d40 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:46.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:46.117+0000 7f003735b640 1 -- 172.21.15.12:0/2586900787 >> 172.21.15.12:0/2586900787 conn(0x7f00300a8450 msgr2=0x7f0030133a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:46.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:46.117+0000 7f003735b640 1 -- 172.21.15.12:0/2586900787 shutdown_connections 2024-09-11T23:03:46.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:46.117+0000 7f003735b640 1 -- 172.21.15.12:0/2586900787 wait complete. 2024-09-11T23:03:46.139 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-11T23:03:46.139 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:03:46.139 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi012.front.sepia.ceph.com 2024-09-11T23:03:46.139 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-11T23:03:46.139 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-11T23:03:46.139 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-11T23:03:46.139 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T23:03:46.139 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:03:46.139 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:03:46.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:03:46.140 DEBUG:teuthology.orchestra.run.smithi012:> ip addr 2024-09-11T23:03:46.146 INFO:teuthology.orchestra.run.smithi012.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:03:46.146 INFO:teuthology.orchestra.run.smithi012.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:03:46.146 INFO:teuthology.orchestra.run.smithi012.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:03:46.146 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:03:46.146 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 ::1/128 scope host 2024-09-11T23:03:46.146 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:03:46.146 INFO:teuthology.orchestra.run.smithi012.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:03:46.146 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a4 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:03:46.147 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f0 2024-09-11T23:03:46.147 INFO:teuthology.orchestra.run.smithi012.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:03:46.147 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a5 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:03:46.147 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f1 2024-09-11T23:03:46.147 INFO:teuthology.orchestra.run.smithi012.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:03:46.147 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:ea brd ff:ff:ff:ff:ff:ff 2024-09-11T23:03:46.147 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f0 2024-09-11T23:03:46.147 INFO:teuthology.orchestra.run.smithi012.stdout: inet 172.21.15.12/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-11T23:03:46.147 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft 42515sec preferred_lft 42515sec 2024-09-11T23:03:46.147 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::ae1f:6bff:fef8:25ea/64 scope link 2024-09-11T23:03:46.147 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:03:46.147 INFO:teuthology.orchestra.run.smithi012.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:03:46.147 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:eb brd ff:ff:ff:ff:ff:ff 2024-09-11T23:03:46.148 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f1 2024-09-11T23:03:46.148 INFO:teuthology.orchestra.run.smithi012.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-11T23:03:46.148 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 02:42:d6:75:63:83 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:03:46.148 INFO:teuthology.orchestra.run.smithi012.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-11T23:03:46.148 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:03:46.148 INFO:teuthology.orchestra.run.smithi012.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:03:46.148 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-11T23:03:46.148 INFO:teuthology.orchestra.run.smithi012.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T23:03:46.148 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:03:46.148 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-11T23:03:46.148 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:03:46.148 INFO:teuthology.orchestra.run.smithi012.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:03:46.148 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:03:46.149 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-11T23:03:46.149 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:03:46.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:03:46.149 DEBUG:teuthology.orchestra.run.smithi012:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:03:46.203 INFO:teuthology.orchestra.run.smithi012.stdout:1 2024-09-11T23:03:46.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:03:46.205 DEBUG:teuthology.orchestra.run.smithi012:> route 2024-09-11T23:03:46.258 INFO:teuthology.orchestra.run.smithi012.stdout:Kernel IP routing table 2024-09-11T23:03:46.258 INFO:teuthology.orchestra.run.smithi012.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:03:46.258 INFO:teuthology.orchestra.run.smithi012.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-11T23:03:46.258 INFO:teuthology.orchestra.run.smithi012.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-11T23:03:46.258 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-11T23:03:46.258 INFO:teuthology.orchestra.run.smithi012.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:03:46.258 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:03:46.259 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-09-11T23:03:46.259 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-11T23:03:46.259 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-11T23:03:46.259 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-11T23:03:46.259 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-09-11T23:03:46.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:03:46.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:03:46.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:03:46.390 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2024-09-11T23:03:46.396 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T23:03:46.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:03:46.397 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list-id 2024-09-11T23:03:46.444 INFO:teuthology.orchestra.run.smithi012.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-11T23:03:46.444 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:03:46.444 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-09-11T23:03:46.445 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:03:46.445 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 1 2024-09-11T23:03:46.445 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-09-11T23:03:46.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:03:46.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:03:46.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:03:46.565 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-11T23:03:46.580 INFO:teuthology.orchestra.run.smithi012.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:03:46.580 INFO:teuthology.orchestra.run.smithi012.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:03:46.580 INFO:teuthology.orchestra.run.smithi012.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:03:46.580 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:03:46.580 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 ::1/128 scope host 2024-09-11T23:03:46.580 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:03:46.580 INFO:teuthology.orchestra.run.smithi012.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:03:46.580 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 1e:8f:bb:9f:08:99 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-11T23:03:46.580 INFO:teuthology.orchestra.run.smithi012.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-11T23:03:46.580 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:03:46.580 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::1c8f:bbff:fe9f:899/64 scope link 2024-09-11T23:03:46.580 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:03:46.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:03:46.582 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-11T23:03:46.635 INFO:teuthology.orchestra.run.smithi012.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:03:46.635 INFO:teuthology.orchestra.run.smithi012.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:03:46.635 INFO:teuthology.orchestra.run.smithi012.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:03:46.635 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:03:46.635 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 ::1/128 scope host 2024-09-11T23:03:46.635 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:03:46.635 INFO:teuthology.orchestra.run.smithi012.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:03:46.636 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 1e:8f:bb:9f:08:99 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-11T23:03:46.636 INFO:teuthology.orchestra.run.smithi012.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-11T23:03:46.636 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:03:46.636 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::1c8f:bbff:fe9f:899/64 scope link 2024-09-11T23:03:46.636 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:03:46.637 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.2/16 2024-09-11T23:03:46.637 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:03:46.637 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-09-11T23:03:46.637 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.1 2024-09-11T23:03:46.637 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-11T23:03:46.637 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-11T23:03:46.637 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-11T23:03:46.638 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-11T23:03:46.638 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-09-11T23:03:46.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:03:46.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:03:46.785 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:03:46.785 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-09-11T23:03:46.785 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set brx.1 up 2024-09-11T23:03:46.785 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set dev brx.1 master ceph-brx 2024-09-11T23:03:46.785 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-09-11T23:03:46.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:03:46.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:03:46.847 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-11T23:03:46.847 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:03:46.848 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-11T23:03:46.896 INFO:teuthology.orchestra.run.smithi012.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:03:46.896 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:03:46.897 DEBUG:teuthology.orchestra.run.smithi012:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-11T23:03:46.944 DEBUG:teuthology.orchestra.run.smithi012:> sudo modprobe fuse 2024-09-11T23:03:47.002 DEBUG:teuthology.orchestra.run.smithi012:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:03:47.049 INFO:teuthology.orchestra.run.smithi012.stdout:/sys 2024-09-11T23:03:47.050 INFO:teuthology.orchestra.run.smithi012.stdout:/proc 2024-09-11T23:03:47.050 INFO:teuthology.orchestra.run.smithi012.stdout:/dev 2024-09-11T23:03:47.050 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/pts 2024-09-11T23:03:47.050 INFO:teuthology.orchestra.run.smithi012.stdout:/run 2024-09-11T23:03:47.050 INFO:teuthology.orchestra.run.smithi012.stdout:/ 2024-09-11T23:03:47.050 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/security 2024-09-11T23:03:47.050 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/shm 2024-09-11T23:03:47.050 INFO:teuthology.orchestra.run.smithi012.stdout:/run/lock 2024-09-11T23:03:47.050 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup 2024-09-11T23:03:47.050 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/pstore 2024-09-11T23:03:47.050 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/bpf 2024-09-11T23:03:47.050 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:03:47.050 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/hugepages 2024-09-11T23:03:47.051 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/mqueue 2024-09-11T23:03:47.051 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/debug 2024-09-11T23:03:47.051 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/tracing 2024-09-11T23:03:47.051 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/fs/nfsd 2024-09-11T23:03:47.051 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/fuse/connections 2024-09-11T23:03:47.051 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/config 2024-09-11T23:03:47.051 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:03:47.051 INFO:teuthology.orchestra.run.smithi012.stdout:/run/rpc_pipefs 2024-09-11T23:03:47.051 INFO:teuthology.orchestra.run.smithi012.stdout:/run/user/1000 2024-09-11T23:03:47.051 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph 2024-09-11T23:03:47.051 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:03:47.051 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:03:47.051 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:03:47.051 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns 2024-09-11T23:03:47.052 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:03:47.052 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:03:47.052 INFO:teuthology.orchestra.run.smithi012.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-11T23:03:47.052 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:03:47.052 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:03:47.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:03:47.053 DEBUG:teuthology.orchestra.run.smithi012:> ls /sys/fs/fuse/connections 2024-09-11T23:03:47.104 INFO:teuthology.orchestra.run.smithi012.stdout:45 2024-09-11T23:03:47.105 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [45] 2024-09-11T23:03:47.105 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-11T23:03:47.150 DEBUG:teuthology.orchestra.run.smithi012:> sudo modprobe fuse 2024-09-11T23:03:47.165 DEBUG:teuthology.orchestra.run.smithi012:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:03:47.212 INFO:teuthology.orchestra.run.smithi012.stdout:/sys 2024-09-11T23:03:47.212 INFO:teuthology.orchestra.run.smithi012.stdout:/proc 2024-09-11T23:03:47.212 INFO:teuthology.orchestra.run.smithi012.stdout:/dev 2024-09-11T23:03:47.212 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/pts 2024-09-11T23:03:47.212 INFO:teuthology.orchestra.run.smithi012.stdout:/run 2024-09-11T23:03:47.212 INFO:teuthology.orchestra.run.smithi012.stdout:/ 2024-09-11T23:03:47.212 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/security 2024-09-11T23:03:47.213 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/shm 2024-09-11T23:03:47.213 INFO:teuthology.orchestra.run.smithi012.stdout:/run/lock 2024-09-11T23:03:47.213 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup 2024-09-11T23:03:47.213 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/pstore 2024-09-11T23:03:47.213 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/bpf 2024-09-11T23:03:47.213 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:03:47.213 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/hugepages 2024-09-11T23:03:47.213 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/mqueue 2024-09-11T23:03:47.214 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/debug 2024-09-11T23:03:47.214 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/tracing 2024-09-11T23:03:47.214 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/fs/nfsd 2024-09-11T23:03:47.214 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/fuse/connections 2024-09-11T23:03:47.214 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/config 2024-09-11T23:03:47.214 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:03:47.214 INFO:teuthology.orchestra.run.smithi012.stdout:/run/rpc_pipefs 2024-09-11T23:03:47.214 INFO:teuthology.orchestra.run.smithi012.stdout:/run/user/1000 2024-09-11T23:03:47.214 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph 2024-09-11T23:03:47.214 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:03:47.214 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:03:47.214 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:03:47.214 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns 2024-09-11T23:03:47.214 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:03:47.215 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:03:47.215 INFO:teuthology.orchestra.run.smithi012.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-11T23:03:47.215 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:03:47.215 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:03:47.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:03:47.216 DEBUG:teuthology.orchestra.run.smithi012:> ls /sys/fs/fuse/connections 2024-09-11T23:03:47.235 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi012.stderr:2024-09-11T23:03:47.229+0000 7fed0c7af580 -1 init, newargv = 0x55cefc7e24e0 newargc=15 2024-09-11T23:03:47.235 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi012.stderr:ceph-fuse[33537]: starting ceph client 2024-09-11T23:03:47.240 INFO:teuthology.orchestra.run.smithi012.stdout:45 2024-09-11T23:03:47.240 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi012.stderr:ceph-fuse[33537]: starting fuse 2024-09-11T23:03:48.342 DEBUG:teuthology.orchestra.run.smithi012:> sudo modprobe fuse 2024-09-11T23:03:48.358 DEBUG:teuthology.orchestra.run.smithi012:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:03:48.407 INFO:teuthology.orchestra.run.smithi012.stdout:/sys 2024-09-11T23:03:48.407 INFO:teuthology.orchestra.run.smithi012.stdout:/proc 2024-09-11T23:03:48.407 INFO:teuthology.orchestra.run.smithi012.stdout:/dev 2024-09-11T23:03:48.407 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/pts 2024-09-11T23:03:48.407 INFO:teuthology.orchestra.run.smithi012.stdout:/run 2024-09-11T23:03:48.407 INFO:teuthology.orchestra.run.smithi012.stdout:/ 2024-09-11T23:03:48.408 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/security 2024-09-11T23:03:48.408 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/shm 2024-09-11T23:03:48.408 INFO:teuthology.orchestra.run.smithi012.stdout:/run/lock 2024-09-11T23:03:48.408 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup 2024-09-11T23:03:48.408 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/pstore 2024-09-11T23:03:48.408 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/bpf 2024-09-11T23:03:48.408 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:03:48.408 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/hugepages 2024-09-11T23:03:48.408 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/mqueue 2024-09-11T23:03:48.408 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/debug 2024-09-11T23:03:48.408 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/tracing 2024-09-11T23:03:48.408 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/fs/nfsd 2024-09-11T23:03:48.408 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/fuse/connections 2024-09-11T23:03:48.409 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/config 2024-09-11T23:03:48.409 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:03:48.409 INFO:teuthology.orchestra.run.smithi012.stdout:/run/rpc_pipefs 2024-09-11T23:03:48.409 INFO:teuthology.orchestra.run.smithi012.stdout:/run/user/1000 2024-09-11T23:03:48.409 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph 2024-09-11T23:03:48.409 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:03:48.409 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:03:48.409 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:03:48.409 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns 2024-09-11T23:03:48.409 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:03:48.409 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:03:48.409 INFO:teuthology.orchestra.run.smithi012.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-11T23:03:48.409 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:03:48.410 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:03:48.410 INFO:teuthology.orchestra.run.smithi012.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-11T23:03:48.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:03:48.411 DEBUG:teuthology.orchestra.run.smithi012:> ls /sys/fs/fuse/connections 2024-09-11T23:03:48.456 INFO:teuthology.orchestra.run.smithi012.stdout:45 2024-09-11T23:03:48.457 INFO:teuthology.orchestra.run.smithi012.stdout:46 2024-09-11T23:03:48.457 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45, 46] 2024-09-11T23:03:48.457 DEBUG:teuthology.orchestra.run.smithi012:> sudo stdin-killer -- python3 -c ' 2024-09-11T23:03:48.457 DEBUG:teuthology.orchestra.run.smithi012:> import glob 2024-09-11T23:03:48.457 DEBUG:teuthology.orchestra.run.smithi012:> import re 2024-09-11T23:03:48.457 DEBUG:teuthology.orchestra.run.smithi012:> import os 2024-09-11T23:03:48.457 DEBUG:teuthology.orchestra.run.smithi012:> import subprocess 2024-09-11T23:03:48.457 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:03:48.458 DEBUG:teuthology.orchestra.run.smithi012:> def _find_admin_socket(client_name): 2024-09-11T23:03:48.458 DEBUG:teuthology.orchestra.run.smithi012:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-11T23:03:48.458 DEBUG:teuthology.orchestra.run.smithi012:> files = glob.glob(asok_path) 2024-09-11T23:03:48.458 DEBUG:teuthology.orchestra.run.smithi012:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-11T23:03:48.458 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:03:48.458 DEBUG:teuthology.orchestra.run.smithi012:> # Given a non-glob path, it better be there 2024-09-11T23:03:48.458 DEBUG:teuthology.orchestra.run.smithi012:> if "*" not in asok_path: 2024-09-11T23:03:48.458 DEBUG:teuthology.orchestra.run.smithi012:> assert(len(files) == 1) 2024-09-11T23:03:48.458 DEBUG:teuthology.orchestra.run.smithi012:> return files[0] 2024-09-11T23:03:48.458 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:03:48.458 DEBUG:teuthology.orchestra.run.smithi012:> for f in files: 2024-09-11T23:03:48.458 DEBUG:teuthology.orchestra.run.smithi012:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T23:03:48.458 DEBUG:teuthology.orchestra.run.smithi012:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T23:03:48.458 DEBUG:teuthology.orchestra.run.smithi012:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T23:03:48.458 DEBUG:teuthology.orchestra.run.smithi012:> contents = proc_f.read() 2024-09-11T23:03:48.459 DEBUG:teuthology.orchestra.run.smithi012:> if mountpoint in contents: 2024-09-11T23:03:48.459 DEBUG:teuthology.orchestra.run.smithi012:> return f 2024-09-11T23:03:48.459 DEBUG:teuthology.orchestra.run.smithi012:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T23:03:48.459 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:03:48.459 DEBUG:teuthology.orchestra.run.smithi012:> print(_find_admin_socket("client.1")) 2024-09-11T23:03:48.459 DEBUG:teuthology.orchestra.run.smithi012:> ' 2024-09-11T23:03:48.585 INFO:teuthology.orchestra.run.smithi012.stdout:/var/run/ceph/ceph-client.1.33537.asok 2024-09-11T23:03:48.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:03:48.596 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.33537.asok 2024-09-11T23:03:48.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:03:48.596 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.33537.asok status 2024-09-11T23:03:48.751 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T23:03:48.751 INFO:teuthology.orchestra.run.smithi012.stdout: "metadata": { 2024-09-11T23:03:48.751 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-11T23:03:48.751 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T23:03:48.751 INFO:teuthology.orchestra.run.smithi012.stdout: "entity_id": "1", 2024-09-11T23:03:48.751 INFO:teuthology.orchestra.run.smithi012.stdout: "hostname": "smithi012", 2024-09-11T23:03:48.752 INFO:teuthology.orchestra.run.smithi012.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-11T23:03:48.752 INFO:teuthology.orchestra.run.smithi012.stdout: "pid": "33537", 2024-09-11T23:03:48.752 INFO:teuthology.orchestra.run.smithi012.stdout: "root": "/" 2024-09-11T23:03:48.752 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:03:48.752 INFO:teuthology.orchestra.run.smithi012.stdout: "dentry_count": 0, 2024-09-11T23:03:48.752 INFO:teuthology.orchestra.run.smithi012.stdout: "dentry_pinned_count": 0, 2024-09-11T23:03:48.752 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4260, 2024-09-11T23:03:48.752 INFO:teuthology.orchestra.run.smithi012.stdout: "inst": { 2024-09-11T23:03:48.752 INFO:teuthology.orchestra.run.smithi012.stdout: "name": { 2024-09-11T23:03:48.752 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "client", 2024-09-11T23:03:48.752 INFO:teuthology.orchestra.run.smithi012.stdout: "num": 4260 2024-09-11T23:03:48.752 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:03:48.752 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": { 2024-09-11T23:03:48.753 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T23:03:48.753 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "192.168.0.2:0", 2024-09-11T23:03:48.753 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 3411846064 2024-09-11T23:03:48.753 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:03:48.753 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:03:48.753 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": { 2024-09-11T23:03:48.753 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T23:03:48.753 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "192.168.0.2:0", 2024-09-11T23:03:48.753 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 3411846064 2024-09-11T23:03:48.753 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:03:48.753 INFO:teuthology.orchestra.run.smithi012.stdout: "inst_str": "client.4260 192.168.0.2:0/3411846064", 2024-09-11T23:03:48.753 INFO:teuthology.orchestra.run.smithi012.stdout: "addr_str": "192.168.0.2:0/3411846064", 2024-09-11T23:03:48.753 INFO:teuthology.orchestra.run.smithi012.stdout: "inode_count": 1, 2024-09-11T23:03:48.753 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_epoch": 7, 2024-09-11T23:03:48.754 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_epoch": 16, 2024-09-11T23:03:48.754 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_epoch_barrier": 0, 2024-09-11T23:03:48.754 INFO:teuthology.orchestra.run.smithi012.stdout: "blocklisted": false, 2024-09-11T23:03:48.754 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs" 2024-09-11T23:03:48.754 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T23:03:48.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:03:48.766 DEBUG:teuthology.orchestra.run.smithi012:> stat --file-system '--printf=%T 2024-09-11T23:03:48.766 DEBUG:teuthology.orchestra.run.smithi012:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-11T23:03:48.772 INFO:teuthology.orchestra.run.smithi012.stdout:fuseblk 2024-09-11T23:03:48.772 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-11T23:03:48.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:03:48.773 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:03:48.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:03:48.829 DEBUG:teuthology.orchestra.run.smithi012:> stat --file-system '--printf=%T 2024-09-11T23:03:48.829 DEBUG:teuthology.orchestra.run.smithi012:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-11T23:03:48.878 INFO:teuthology.orchestra.run.smithi012.stdout:fuseblk 2024-09-11T23:03:48.878 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-11T23:03:48.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:03:48.878 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-11T23:03:48.937 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-11T23:03:48.984 INFO:tasks.cephfs_test_runner:Starting test: test_dump (tasks.cephfs.test_fstop.TestFSTop) Tests 'cephfs-top --dump' output is valid 2024-09-11T23:03:48.985 INFO:tasks.cephfs_test_runner:test_dump (tasks.cephfs.test_fstop.TestFSTop) 2024-09-11T23:03:48.985 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:03:49.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.113+0000 7f66200c8640 1 Processor -- start 2024-09-11T23:03:49.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.113+0000 7f66200c8640 1 -- start start 2024-09-11T23:03:49.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.117+0000 7f66200c8640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6618137e60 0x7f6618138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:49.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.117+0000 7f66200c8640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f661809e930 con 0x7f661809f6e0 2024-09-11T23:03:49.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.117+0000 7f66200c8640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f66181379e0 con 0x7f6618137e60 2024-09-11T23:03:49.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.117+0000 7f661de64640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6618137e60 0x7f6618138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:49.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.117+0000 7f661d663640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f661809f6e0 0x7f66180a36a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56850/0 (socket says 172.21.15.12:56850) 2024-09-11T23:03:49.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.117+0000 7f661d663640 1 -- 172.21.15.12:0/1029663011 learned_addr learned my addr 172.21.15.12:0/1029663011 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:03:49.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.117+0000 7f661de64640 1 -- 172.21.15.12:0/1029663011 >> v1:172.21.15.12:6789/0 conn(0x7f661809f6e0 legacy=0x7f66180a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:49.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.117+0000 7f661de64640 1 -- 172.21.15.12:0/1029663011 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f661809d910 con 0x7f6618137e60 2024-09-11T23:03:49.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.117+0000 7f661de64640 1 --2- 172.21.15.12:0/1029663011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6618137e60 0x7f6618138240 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6614009740 tx=0x7f661401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7445b5034800412 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:49.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.117+0000 7f661ce62640 1 -- 172.21.15.12:0/1029663011 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66140ab570 con 0x7f6618137e60 2024-09-11T23:03:49.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.117+0000 7f661ce62640 1 -- 172.21.15.12:0/1029663011 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66140b0070 con 0x7f6618137e60 2024-09-11T23:03:49.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.117+0000 7f661ce62640 1 -- 172.21.15.12:0/1029663011 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66140ab860 con 0x7f6618137e60 2024-09-11T23:03:49.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.117+0000 7f66200c8640 1 -- 172.21.15.12:0/1029663011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6618137e60 msgr2=0x7f6618138240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:49.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.117+0000 7f66200c8640 1 --2- 172.21.15.12:0/1029663011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6618137e60 0x7f6618138240 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6614009740 tx=0x7f661401c420 comp rx=0 tx=0).stop 2024-09-11T23:03:49.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.117+0000 7f66200c8640 1 -- 172.21.15.12:0/1029663011 shutdown_connections 2024-09-11T23:03:49.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.117+0000 7f66200c8640 1 --2- 172.21.15.12:0/1029663011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6618137e60 0x7f6618138240 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:49.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.117+0000 7f66200c8640 1 -- 172.21.15.12:0/1029663011 >> 172.21.15.12:0/1029663011 conn(0x7f66180a8450 msgr2=0x7f66180a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:49.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.121+0000 7f66200c8640 1 -- 172.21.15.12:0/1029663011 shutdown_connections 2024-09-11T23:03:49.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.121+0000 7f66200c8640 1 -- 172.21.15.12:0/1029663011 wait complete. 2024-09-11T23:03:49.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.121+0000 7f66200c8640 1 Processor -- start 2024-09-11T23:03:49.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.121+0000 7f66200c8640 1 -- start start 2024-09-11T23:03:49.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.121+0000 7f66200c8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f661809f6e0 0x7f66181cc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:49.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.121+0000 7f66200c8640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f661813fe00 con 0x7f661809f6e0 2024-09-11T23:03:49.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.121+0000 7f661de64640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f661809f6e0 0x7f66181cc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:49.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.121+0000 7f661de64640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f661809f6e0 0x7f66181cc9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47240/0 (socket says 172.21.15.12:47240) 2024-09-11T23:03:49.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.121+0000 7f661de64640 1 -- 172.21.15.12:0/1862522229 learned_addr learned my addr 172.21.15.12:0/1862522229 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:49.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.121+0000 7f661de64640 1 -- 172.21.15.12:0/1862522229 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6618073740 con 0x7f661809f6e0 2024-09-11T23:03:49.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.121+0000 7f661de64640 1 --2- 172.21.15.12:0/1862522229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f661809f6e0 0x7f66181cc9f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6614009740 tx=0x7f661401ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:49.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.121+0000 7f660e7fc640 1 -- 172.21.15.12:0/1862522229 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66140abde0 con 0x7f661809f6e0 2024-09-11T23:03:49.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.121+0000 7f660e7fc640 1 -- 172.21.15.12:0/1862522229 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66140bf410 con 0x7f661809f6e0 2024-09-11T23:03:49.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.121+0000 7f66200c8640 1 -- 172.21.15.12:0/1862522229 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66181cc5c0 con 0x7f661809f6e0 2024-09-11T23:03:49.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.121+0000 7f660e7fc640 1 -- 172.21.15.12:0/1862522229 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66140bf730 con 0x7f661809f6e0 2024-09-11T23:03:49.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.121+0000 7f66200c8640 1 -- 172.21.15.12:0/1862522229 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66180724c0 con 0x7f661809f6e0 2024-09-11T23:03:49.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.121+0000 7f660e7fc640 1 -- 172.21.15.12:0/1862522229 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f66140bd020 con 0x7f661809f6e0 2024-09-11T23:03:49.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.121+0000 7f66200c8640 1 -- 172.21.15.12:0/1862522229 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6618073430 con 0x7f661809f6e0 2024-09-11T23:03:49.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.121+0000 7f660e7fc640 1 --2- 172.21.15.12:0/1862522229 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f65fc035db0 0x7f65fc038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:49.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.121+0000 7f660e7fc640 1 -- 172.21.15.12:0/1862522229 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3439+0+0 (secure 0 0 0) 0x7f66140e2c40 con 0x7f661809f6e0 2024-09-11T23:03:49.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.121+0000 7f661d663640 1 --2- 172.21.15.12:0/1862522229 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f65fc035db0 0x7f65fc038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:49.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.121+0000 7f661d663640 1 --2- 172.21.15.12:0/1862522229 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f65fc035db0 0x7f65fc038270 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6608005890 tx=0x7f6608007a90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:49.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.125+0000 7f660e7fc640 1 -- 172.21.15.12:0/1862522229 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6614016010 con 0x7f661809f6e0 2024-09-11T23:03:49.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.289+0000 7f66200c8640 1 -- 172.21.15.12:0/1862522229 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6618138240 con 0x7f661809f6e0 2024-09-11T23:03:49.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.293+0000 7f660e7fc640 1 -- 172.21.15.12:0/1862522229 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+10675 (secure 0 0 0) 0x7f66140b5780 con 0x7f661809f6e0 2024-09-11T23:03:49.297 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:03:49.298 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":16,"fsid":"8be14356-3340-4500-91a2-4cbc6b511f65","created":"2024-09-11T23:03:10.620234+0000","modified":"2024-09-11T23:03:32.629844+0000","last_up_change":"2024-09-11T23:03:22.359028+0000","last_in_change":"2024-09-11T23:03:11.545817+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:03:23.587068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:03:28.893298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:03:29.993656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"153b72a1-40b1-400d-93ea-333e733f9bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6817","nonce":3680911937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6819","nonce":3680911937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6823","nonce":3680911937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6821","nonce":3680911937}]},"public_addr":"172.21.15.12:6817/3680911937","cluster_addr":"172.21.15.12:6819/3680911937","heartbeat_back_addr":"172.21.15.12:6823/3680911937","heartbeat_front_addr":"172.21.15.12:6821/3680911937","state":["exists","up"]},{"osd":1,"uuid":"94669e49-ee4f-4acf-9e25-e94374dda8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6801","nonce":236825163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6803","nonce":236825163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6807","nonce":236825163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6805","nonce":236825163}]},"public_addr":"172.21.15.12:6801/236825163","cluster_addr":"172.21.15.12:6803/236825163","heartbeat_back_addr":"172.21.15.12:6807/236825163","heartbeat_front_addr":"172.21.15.12:6805/236825163","state":["exists","up"]},{"osd":2,"uuid":"826dae4d-8888-4ec5-8f00-425b3be93814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6809","nonce":3263521655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6811","nonce":3263521655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6815","nonce":3263521655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6813","nonce":3263521655}]},"public_addr":"172.21.15.12:6809/3263521655","cluster_addr":"172.21.15.12:6811/3263521655","heartbeat_back_addr":"172.21.15.12:6815/3263521655","heartbeat_front_addr":"172.21.15.12:6813/3263521655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:19.398518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.761524+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.904997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:03:49.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.293+0000 7f66200c8640 1 -- 172.21.15.12:0/1862522229 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f65fc035db0 msgr2=0x7f65fc038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:49.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.293+0000 7f66200c8640 1 --2- 172.21.15.12:0/1862522229 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f65fc035db0 0x7f65fc038270 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6608005890 tx=0x7f6608007a90 comp rx=0 tx=0).stop 2024-09-11T23:03:49.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.293+0000 7f66200c8640 1 -- 172.21.15.12:0/1862522229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f661809f6e0 msgr2=0x7f66181cc9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:49.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.293+0000 7f66200c8640 1 --2- 172.21.15.12:0/1862522229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f661809f6e0 0x7f66181cc9f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6614009740 tx=0x7f661401ac60 comp rx=0 tx=0).stop 2024-09-11T23:03:49.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.293+0000 7f66200c8640 1 -- 172.21.15.12:0/1862522229 shutdown_connections 2024-09-11T23:03:49.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.293+0000 7f66200c8640 1 --2- 172.21.15.12:0/1862522229 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f65fc035db0 0x7f65fc038270 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:49.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.293+0000 7f66200c8640 1 --2- 172.21.15.12:0/1862522229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f661809f6e0 0x7f66181cc9f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:49.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.293+0000 7f66200c8640 1 -- 172.21.15.12:0/1862522229 >> 172.21.15.12:0/1862522229 conn(0x7f66180a8450 msgr2=0x7f6618135f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:49.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.293+0000 7f66200c8640 1 -- 172.21.15.12:0/1862522229 shutdown_connections 2024-09-11T23:03:49.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.293+0000 7f66200c8640 1 -- 172.21.15.12:0/1862522229 wait complete. 2024-09-11T23:03:49.316 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T23:03:23.587068+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-11T23:03:28.893298+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-11T23:03:29.993656+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3600000143051147, 'score_stable': 1.3600000143051147, 'optimal_score': 1, 'raw_score_acting': 1.3600000143051147, 'raw_score_stable': 1.3600000143051147, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T23:03:49.316 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-11T23:03:49.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.437+0000 7f1f8f385640 1 Processor -- start 2024-09-11T23:03:49.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.437+0000 7f1f8f385640 1 -- start start 2024-09-11T23:03:49.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.437+0000 7f1f8f385640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1f880a8110 0x7f1f8813ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:49.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.437+0000 7f1f8f385640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f880a4e40 con 0x7f1f880a71c0 2024-09-11T23:03:49.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.437+0000 7f1f8f385640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f1f880a6af0 con 0x7f1f880a8110 2024-09-11T23:03:49.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.437+0000 7f1f8d121640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1f880a71c0 0x7f1f880a75a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56854/0 (socket says 172.21.15.12:56854) 2024-09-11T23:03:49.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.437+0000 7f1f8d121640 1 -- 172.21.15.12:0/728815651 learned_addr learned my addr 172.21.15.12:0/728815651 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:03:49.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.437+0000 7f1f8c920640 1 --2- 172.21.15.12:0/728815651 >> v2:172.21.15.12:3300/0 conn(0x7f1f880a8110 0x7f1f8813ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:49.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.437+0000 7f1f8c920640 1 -- 172.21.15.12:0/728815651 >> v1:172.21.15.12:6789/0 conn(0x7f1f880a71c0 legacy=0x7f1f880a75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:49.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.437+0000 7f1f8c920640 1 -- 172.21.15.12:0/728815651 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f880a3f50 con 0x7f1f880a8110 2024-09-11T23:03:49.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.441+0000 7f1f8c920640 1 --2- 172.21.15.12:0/728815651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f880a8110 0x7f1f8813ef50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1f84009740 tx=0x7f1f8401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5cfd09865d31d44 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:49.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.441+0000 7f1f7bfff640 1 -- 172.21.15.12:0/728815651 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f840b0070 con 0x7f1f880a8110 2024-09-11T23:03:49.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.441+0000 7f1f7bfff640 1 -- 172.21.15.12:0/728815651 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f840ab530 con 0x7f1f880a8110 2024-09-11T23:03:49.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.441+0000 7f1f7bfff640 1 -- 172.21.15.12:0/728815651 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f840ab830 con 0x7f1f880a8110 2024-09-11T23:03:49.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.441+0000 7f1f8f385640 1 -- 172.21.15.12:0/728815651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f880a8110 msgr2=0x7f1f8813ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:49.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.441+0000 7f1f8f385640 1 --2- 172.21.15.12:0/728815651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f880a8110 0x7f1f8813ef50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1f84009740 tx=0x7f1f8401c390 comp rx=0 tx=0).stop 2024-09-11T23:03:49.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.441+0000 7f1f8f385640 1 -- 172.21.15.12:0/728815651 shutdown_connections 2024-09-11T23:03:49.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.441+0000 7f1f8f385640 1 --2- 172.21.15.12:0/728815651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f880a8110 0x7f1f8813ef50 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:49.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.441+0000 7f1f8f385640 1 -- 172.21.15.12:0/728815651 >> 172.21.15.12:0/728815651 conn(0x7f1f880ac4f0 msgr2=0x7f1f880ac900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:49.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.441+0000 7f1f8f385640 1 -- 172.21.15.12:0/728815651 shutdown_connections 2024-09-11T23:03:49.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.441+0000 7f1f8f385640 1 -- 172.21.15.12:0/728815651 wait complete. 2024-09-11T23:03:49.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.441+0000 7f1f8f385640 1 Processor -- start 2024-09-11T23:03:49.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.441+0000 7f1f8f385640 1 -- start start 2024-09-11T23:03:49.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.441+0000 7f1f8f385640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f880a71c0 0x7f1f880a10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:49.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.441+0000 7f1f8f385640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1f8806dd50 con 0x7f1f880a71c0 2024-09-11T23:03:49.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.441+0000 7f1f8d121640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f880a71c0 0x7f1f880a10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:49.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.441+0000 7f1f8d121640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f880a71c0 0x7f1f880a10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47248/0 (socket says 172.21.15.12:47248) 2024-09-11T23:03:49.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.441+0000 7f1f8d121640 1 -- 172.21.15.12:0/512356676 learned_addr learned my addr 172.21.15.12:0/512356676 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:49.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.441+0000 7f1f8d121640 1 -- 172.21.15.12:0/512356676 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f8809eb60 con 0x7f1f880a71c0 2024-09-11T23:03:49.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.441+0000 7f1f8d121640 1 --2- 172.21.15.12:0/512356676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f880a71c0 0x7f1f880a10c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c00c480 tx=0x7f1f7c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:49.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.441+0000 7f1f79ffb640 1 -- 172.21.15.12:0/512356676 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f7c017070 con 0x7f1f880a71c0 2024-09-11T23:03:49.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.441+0000 7f1f79ffb640 1 -- 172.21.15.12:0/512356676 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f7c005c20 con 0x7f1f880a71c0 2024-09-11T23:03:49.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.441+0000 7f1f8f385640 1 -- 172.21.15.12:0/512356676 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f880a28d0 con 0x7f1f880a71c0 2024-09-11T23:03:49.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.441+0000 7f1f79ffb640 1 -- 172.21.15.12:0/512356676 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f7c007070 con 0x7f1f880a71c0 2024-09-11T23:03:49.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.441+0000 7f1f8f385640 1 -- 172.21.15.12:0/512356676 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f880a0970 con 0x7f1f880a71c0 2024-09-11T23:03:49.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.445+0000 7f1f8f385640 1 -- 172.21.15.12:0/512356676 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f8809eda0 con 0x7f1f880a71c0 2024-09-11T23:03:49.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.445+0000 7f1f79ffb640 1 -- 172.21.15.12:0/512356676 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1f7c01a070 con 0x7f1f880a71c0 2024-09-11T23:03:49.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.445+0000 7f1f79ffb640 1 --2- 172.21.15.12:0/512356676 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f1f6c035db0 0x7f1f6c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:49.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.445+0000 7f1f79ffb640 1 -- 172.21.15.12:0/512356676 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3439+0+0 (secure 0 0 0) 0x7f1f7c047960 con 0x7f1f880a71c0 2024-09-11T23:03:49.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.445+0000 7f1f8c920640 1 --2- 172.21.15.12:0/512356676 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f1f6c035db0 0x7f1f6c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:49.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.445+0000 7f1f8c920640 1 --2- 172.21.15.12:0/512356676 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f1f6c035db0 0x7f1f6c038270 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1f840ad000 tx=0x7f1f840a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:49.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.449+0000 7f1f79ffb640 1 -- 172.21.15.12:0/512356676 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1f7c007210 con 0x7f1f880a71c0 2024-09-11T23:03:49.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.613+0000 7f1f8f385640 1 -- 172.21.15.12:0/512356676 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1f880a75a0 con 0x7f1f880a71c0 2024-09-11T23:03:49.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.613+0000 7f1f79ffb640 1 -- 172.21.15.12:0/512356676 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7f1f7c01b3b0 con 0x7f1f880a71c0 2024-09-11T23:03:49.619 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2024-09-11T23:03:49.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.617+0000 7f1f8f385640 1 -- 172.21.15.12:0/512356676 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f1f6c035db0 msgr2=0x7f1f6c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:49.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.617+0000 7f1f8f385640 1 --2- 172.21.15.12:0/512356676 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f1f6c035db0 0x7f1f6c038270 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1f840ad000 tx=0x7f1f840a6000 comp rx=0 tx=0).stop 2024-09-11T23:03:49.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.617+0000 7f1f8f385640 1 -- 172.21.15.12:0/512356676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f880a71c0 msgr2=0x7f1f880a10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:49.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.617+0000 7f1f8f385640 1 --2- 172.21.15.12:0/512356676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f880a71c0 0x7f1f880a10c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c00c480 tx=0x7f1f7c00c940 comp rx=0 tx=0).stop 2024-09-11T23:03:49.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.617+0000 7f1f8f385640 1 -- 172.21.15.12:0/512356676 shutdown_connections 2024-09-11T23:03:49.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.617+0000 7f1f8f385640 1 --2- 172.21.15.12:0/512356676 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f1f6c035db0 0x7f1f6c038270 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:49.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.617+0000 7f1f8f385640 1 --2- 172.21.15.12:0/512356676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f880a71c0 0x7f1f880a10c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:49.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.617+0000 7f1f8f385640 1 -- 172.21.15.12:0/512356676 >> 172.21.15.12:0/512356676 conn(0x7f1f880ac4f0 msgr2=0x7f1f88139bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:49.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.617+0000 7f1f8f385640 1 -- 172.21.15.12:0/512356676 shutdown_connections 2024-09-11T23:03:49.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.617+0000 7f1f8f385640 1 -- 172.21.15.12:0/512356676 wait complete. 2024-09-11T23:03:49.638 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-11T23:03:49.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.769+0000 7f9e79c0a640 1 Processor -- start 2024-09-11T23:03:49.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.769+0000 7f9e79c0a640 1 -- start start 2024-09-11T23:03:49.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.769+0000 7f9e79c0a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9e74137180 0x7f9e7413ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:49.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.769+0000 7f9e79c0a640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e740a1e90 con 0x7f9e74136da0 2024-09-11T23:03:49.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.769+0000 7f9e79c0a640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f9e74136750 con 0x7f9e74137180 2024-09-11T23:03:49.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.769+0000 7f9e737fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f9e74136da0 0x7f9e7409ac20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56870/0 (socket says 172.21.15.12:56870) 2024-09-11T23:03:49.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.769+0000 7f9e737fe640 1 -- 172.21.15.12:0/3830143698 learned_addr learned my addr 172.21.15.12:0/3830143698 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:03:49.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.769+0000 7f9e72ffd640 1 --2- 172.21.15.12:0/3830143698 >> v2:172.21.15.12:3300/0 conn(0x7f9e74137180 0x7f9e7413ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:49.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.769+0000 7f9e727fc640 1 -- 172.21.15.12:0/3830143698 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 863872142 0 0) 0x7f9e740a1e90 con 0x7f9e74136da0 2024-09-11T23:03:49.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.769+0000 7f9e727fc640 1 -- 172.21.15.12:0/3830143698 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e5c003530 con 0x7f9e74136da0 2024-09-11T23:03:49.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.769+0000 7f9e72ffd640 1 -- 172.21.15.12:0/3830143698 >> v1:172.21.15.12:6789/0 conn(0x7f9e74136da0 legacy=0x7f9e7409ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:49.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.769+0000 7f9e72ffd640 1 -- 172.21.15.12:0/3830143698 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e740a0650 con 0x7f9e74137180 2024-09-11T23:03:49.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.769+0000 7f9e72ffd640 1 --2- 172.21.15.12:0/3830143698 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e74137180 0x7f9e7413ba70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9e64009d90 tx=0x7f9e6401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69c84e3c13f10618 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:49.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.769+0000 7f9e727fc640 1 -- 172.21.15.12:0/3830143698 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e640b2070 con 0x7f9e74137180 2024-09-11T23:03:49.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.769+0000 7f9e727fc640 1 -- 172.21.15.12:0/3830143698 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e640a56e0 con 0x7f9e74137180 2024-09-11T23:03:49.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.773+0000 7f9e727fc640 1 -- 172.21.15.12:0/3830143698 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e640a59c0 con 0x7f9e74137180 2024-09-11T23:03:49.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.773+0000 7f9e79c0a640 1 -- 172.21.15.12:0/3830143698 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e74137180 msgr2=0x7f9e7413ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:49.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.773+0000 7f9e79c0a640 1 --2- 172.21.15.12:0/3830143698 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e74137180 0x7f9e7413ba70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9e64009d90 tx=0x7f9e6401c970 comp rx=0 tx=0).stop 2024-09-11T23:03:49.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.773+0000 7f9e79c0a640 1 -- 172.21.15.12:0/3830143698 shutdown_connections 2024-09-11T23:03:49.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.773+0000 7f9e79c0a640 1 --2- 172.21.15.12:0/3830143698 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e74137180 0x7f9e7413ba70 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:49.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.773+0000 7f9e79c0a640 1 -- 172.21.15.12:0/3830143698 >> 172.21.15.12:0/3830143698 conn(0x7f9e740a82f0 msgr2=0x7f9e740a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:49.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.773+0000 7f9e79c0a640 1 -- 172.21.15.12:0/3830143698 shutdown_connections 2024-09-11T23:03:49.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.773+0000 7f9e79c0a640 1 -- 172.21.15.12:0/3830143698 wait complete. 2024-09-11T23:03:49.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.773+0000 7f9e79c0a640 1 Processor -- start 2024-09-11T23:03:49.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.773+0000 7f9e79c0a640 1 -- start start 2024-09-11T23:03:49.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.773+0000 7f9e79c0a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e74136da0 0x7f9e7411e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:49.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.773+0000 7f9e79c0a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9e7413e950 con 0x7f9e74136da0 2024-09-11T23:03:49.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.773+0000 7f9e737fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e74136da0 0x7f9e7411e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:49.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.773+0000 7f9e737fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e74136da0 0x7f9e7411e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47264/0 (socket says 172.21.15.12:47264) 2024-09-11T23:03:49.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.773+0000 7f9e737fe640 1 -- 172.21.15.12:0/3680250269 learned_addr learned my addr 172.21.15.12:0/3680250269 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:49.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.773+0000 7f9e737fe640 1 -- 172.21.15.12:0/3680250269 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e74073400 con 0x7f9e74136da0 2024-09-11T23:03:49.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.773+0000 7f9e737fe640 1 --2- 172.21.15.12:0/3680250269 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e74136da0 0x7f9e7411e850 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9e6800c3d0 tx=0x7f9e6800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:49.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.773+0000 7f9e5bfff640 1 -- 172.21.15.12:0/3680250269 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e68017070 con 0x7f9e74136da0 2024-09-11T23:03:49.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.773+0000 7f9e5bfff640 1 -- 172.21.15.12:0/3680250269 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e68005ce0 con 0x7f9e74136da0 2024-09-11T23:03:49.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.773+0000 7f9e79c0a640 1 -- 172.21.15.12:0/3680250269 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e740718a0 con 0x7f9e74136da0 2024-09-11T23:03:49.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.773+0000 7f9e5bfff640 1 -- 172.21.15.12:0/3680250269 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e680070d0 con 0x7f9e74136da0 2024-09-11T23:03:49.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.773+0000 7f9e79c0a640 1 -- 172.21.15.12:0/3680250269 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e741cbb20 con 0x7f9e74136da0 2024-09-11T23:03:49.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.777+0000 7f9e5bfff640 1 -- 172.21.15.12:0/3680250269 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9e6801a070 con 0x7f9e74136da0 2024-09-11T23:03:49.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.777+0000 7f9e79c0a640 1 -- 172.21.15.12:0/3680250269 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e740730f0 con 0x7f9e74136da0 2024-09-11T23:03:49.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.777+0000 7f9e5bfff640 1 --2- 172.21.15.12:0/3680250269 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f9e60035db0 0x7f9e60038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:49.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.777+0000 7f9e5bfff640 1 -- 172.21.15.12:0/3680250269 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3439+0+0 (secure 0 0 0) 0x7f9e68047a70 con 0x7f9e74136da0 2024-09-11T23:03:49.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.777+0000 7f9e72ffd640 1 --2- 172.21.15.12:0/3680250269 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f9e60035db0 0x7f9e60038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:49.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.777+0000 7f9e72ffd640 1 --2- 172.21.15.12:0/3680250269 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f9e60035db0 0x7f9e60038270 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9e640af000 tx=0x7f9e640a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:49.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.781+0000 7f9e5bfff640 1 -- 172.21.15.12:0/3680250269 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9e68019e10 con 0x7f9e74136da0 2024-09-11T23:03:49.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.949+0000 7f9e79c0a640 1 -- 172.21.15.12:0/3680250269 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f9e7409ac20 con 0x7f9e74136da0 2024-09-11T23:03:49.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.949+0000 7f9e5bfff640 1 -- 172.21.15.12:0/3680250269 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v16) ==== 104+0+11 (secure 0 0 0) 0x7f9e68047e20 con 0x7f9e74136da0 2024-09-11T23:03:49.954 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2024-09-11T23:03:49.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.953+0000 7f9e79c0a640 1 -- 172.21.15.12:0/3680250269 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f9e60035db0 msgr2=0x7f9e60038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:49.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.953+0000 7f9e79c0a640 1 --2- 172.21.15.12:0/3680250269 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f9e60035db0 0x7f9e60038270 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9e640af000 tx=0x7f9e640a7070 comp rx=0 tx=0).stop 2024-09-11T23:03:49.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.953+0000 7f9e79c0a640 1 -- 172.21.15.12:0/3680250269 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e74136da0 msgr2=0x7f9e7411e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:49.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.953+0000 7f9e79c0a640 1 --2- 172.21.15.12:0/3680250269 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e74136da0 0x7f9e7411e850 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9e6800c3d0 tx=0x7f9e6800c890 comp rx=0 tx=0).stop 2024-09-11T23:03:49.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.953+0000 7f9e79c0a640 1 -- 172.21.15.12:0/3680250269 shutdown_connections 2024-09-11T23:03:49.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.953+0000 7f9e79c0a640 1 --2- 172.21.15.12:0/3680250269 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f9e60035db0 0x7f9e60038270 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:49.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.953+0000 7f9e79c0a640 1 --2- 172.21.15.12:0/3680250269 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e74136da0 0x7f9e7411e850 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:49.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.953+0000 7f9e79c0a640 1 -- 172.21.15.12:0/3680250269 >> 172.21.15.12:0/3680250269 conn(0x7f9e740a82f0 msgr2=0x7f9e740a2770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:49.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.953+0000 7f9e79c0a640 1 -- 172.21.15.12:0/3680250269 shutdown_connections 2024-09-11T23:03:49.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:49.953+0000 7f9e79c0a640 1 -- 172.21.15.12:0/3680250269 wait complete. 2024-09-11T23:03:49.973 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-11T23:03:50.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.093+0000 7f911a390640 1 Processor -- start 2024-09-11T23:03:50.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.093+0000 7f911a390640 1 -- start start 2024-09-11T23:03:50.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.093+0000 7f911a390640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f911406d800 0x7f911406dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:50.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.093+0000 7f911a390640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91140a22b0 con 0x7f911406cd70 2024-09-11T23:03:50.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.093+0000 7f911a390640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f91140a0f60 con 0x7f911406d800 2024-09-11T23:03:50.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.093+0000 7f9113fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f911406d800 0x7f911406dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:50.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.093+0000 7f91137fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f911406cd70 0x7f9114139c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56874/0 (socket says 172.21.15.12:56874) 2024-09-11T23:03:50.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.093+0000 7f91137fe640 1 -- 172.21.15.12:0/3227638653 learned_addr learned my addr 172.21.15.12:0/3227638653 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:03:50.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.093+0000 7f9113fff640 1 -- 172.21.15.12:0/3227638653 >> v1:172.21.15.12:6789/0 conn(0x7f911406cd70 legacy=0x7f9114139c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:50.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.093+0000 7f9113fff640 1 -- 172.21.15.12:0/3227638653 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f911406e120 con 0x7f911406d800 2024-09-11T23:03:50.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.093+0000 7f9112ffd640 1 -- 172.21.15.12:0/3227638653 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 176419591 0 0) 0x7f91140a22b0 con 0x7f911406cd70 2024-09-11T23:03:50.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.097+0000 7f9113fff640 1 --2- 172.21.15.12:0/3227638653 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f911406d800 0x7f911406dbe0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9104009740 tx=0x7f910401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65a8d0d545ab0d17 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:50.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.097+0000 7f9112ffd640 1 -- 172.21.15.12:0/3227638653 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91040b0070 con 0x7f911406d800 2024-09-11T23:03:50.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.097+0000 7f9112ffd640 1 -- 172.21.15.12:0/3227638653 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91040ab530 con 0x7f911406d800 2024-09-11T23:03:50.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.097+0000 7f9112ffd640 1 -- 172.21.15.12:0/3227638653 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91040ab830 con 0x7f911406d800 2024-09-11T23:03:50.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.097+0000 7f911a390640 1 -- 172.21.15.12:0/3227638653 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f911406d800 msgr2=0x7f911406dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:50.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.097+0000 7f911a390640 1 --2- 172.21.15.12:0/3227638653 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f911406d800 0x7f911406dbe0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9104009740 tx=0x7f910401c390 comp rx=0 tx=0).stop 2024-09-11T23:03:50.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.097+0000 7f911a390640 1 -- 172.21.15.12:0/3227638653 shutdown_connections 2024-09-11T23:03:50.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.097+0000 7f911a390640 1 --2- 172.21.15.12:0/3227638653 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f911406d800 0x7f911406dbe0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:50.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.097+0000 7f911a390640 1 -- 172.21.15.12:0/3227638653 >> 172.21.15.12:0/3227638653 conn(0x7f9114070df0 msgr2=0x7f9114073210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:50.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.097+0000 7f911a390640 1 -- 172.21.15.12:0/3227638653 shutdown_connections 2024-09-11T23:03:50.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.097+0000 7f911a390640 1 -- 172.21.15.12:0/3227638653 wait complete. 2024-09-11T23:03:50.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.097+0000 7f911a390640 1 Processor -- start 2024-09-11T23:03:50.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.097+0000 7f911a390640 1 -- start start 2024-09-11T23:03:50.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.097+0000 7f911a390640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f911406d800 0x7f91140a9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:50.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.097+0000 7f911a390640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f91141420f0 con 0x7f911406d800 2024-09-11T23:03:50.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.097+0000 7f9113fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f911406d800 0x7f91140a9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:50.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.101+0000 7f9113fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f911406d800 0x7f91140a9bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47276/0 (socket says 172.21.15.12:47276) 2024-09-11T23:03:50.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.101+0000 7f9113fff640 1 -- 172.21.15.12:0/816287850 learned_addr learned my addr 172.21.15.12:0/816287850 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:50.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.101+0000 7f9113fff640 1 -- 172.21.15.12:0/816287850 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91140a9310 con 0x7f911406d800 2024-09-11T23:03:50.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.101+0000 7f9113fff640 1 --2- 172.21.15.12:0/816287850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f911406d800 0x7f91140a9bd0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9104019fc0 tx=0x7f910401abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:50.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.101+0000 7f9110ff9640 1 -- 172.21.15.12:0/816287850 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91040bb070 con 0x7f911406d800 2024-09-11T23:03:50.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.101+0000 7f9110ff9640 1 -- 172.21.15.12:0/816287850 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9104004020 con 0x7f911406d800 2024-09-11T23:03:50.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.101+0000 7f9110ff9640 1 -- 172.21.15.12:0/816287850 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91040b0040 con 0x7f911406d800 2024-09-11T23:03:50.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.101+0000 7f911a390640 1 -- 172.21.15.12:0/816287850 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91140a81e0 con 0x7f911406d800 2024-09-11T23:03:50.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.101+0000 7f911a390640 1 -- 172.21.15.12:0/816287850 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91140a87b0 con 0x7f911406d800 2024-09-11T23:03:50.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.101+0000 7f911a390640 1 -- 172.21.15.12:0/816287850 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f911406dbe0 con 0x7f911406d800 2024-09-11T23:03:50.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.101+0000 7f9110ff9640 1 -- 172.21.15.12:0/816287850 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9104004300 con 0x7f911406d800 2024-09-11T23:03:50.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.101+0000 7f9110ff9640 1 --2- 172.21.15.12:0/816287850 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f9100035db0 0x7f9100038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:50.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.101+0000 7f9110ff9640 1 -- 172.21.15.12:0/816287850 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3439+0+0 (secure 0 0 0) 0x7f91040e2fc0 con 0x7f911406d800 2024-09-11T23:03:50.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.101+0000 7f91137fe640 1 --2- 172.21.15.12:0/816287850 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f9100035db0 0x7f9100038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:50.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.101+0000 7f91137fe640 1 --2- 172.21.15.12:0/816287850 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f9100035db0 0x7f9100038270 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9108000c10 tx=0x7f9108007a50 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:50.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.109+0000 7f9110ff9640 1 -- 172.21.15.12:0/816287850 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9104016010 con 0x7f911406d800 2024-09-11T23:03:50.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.285+0000 7f911a390640 1 -- 172.21.15.12:0/816287850 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f911413ef30 con 0x7f911406d800 2024-09-11T23:03:50.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.289+0000 7f9110ff9640 1 -- 172.21.15.12:0/816287850 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v16) ==== 100+0+11 (secure 0 0 0) 0x7f91040b5ca0 con 0x7f911406d800 2024-09-11T23:03:50.292 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2024-09-11T23:03:50.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.289+0000 7f911a390640 1 -- 172.21.15.12:0/816287850 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f9100035db0 msgr2=0x7f9100038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:50.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.289+0000 7f911a390640 1 --2- 172.21.15.12:0/816287850 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f9100035db0 0x7f9100038270 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9108000c10 tx=0x7f9108007a50 comp rx=0 tx=0).stop 2024-09-11T23:03:50.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.289+0000 7f911a390640 1 -- 172.21.15.12:0/816287850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f911406d800 msgr2=0x7f91140a9bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:50.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.289+0000 7f911a390640 1 --2- 172.21.15.12:0/816287850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f911406d800 0x7f91140a9bd0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9104019fc0 tx=0x7f910401abd0 comp rx=0 tx=0).stop 2024-09-11T23:03:50.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.289+0000 7f911a390640 1 -- 172.21.15.12:0/816287850 shutdown_connections 2024-09-11T23:03:50.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.289+0000 7f911a390640 1 --2- 172.21.15.12:0/816287850 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f9100035db0 0x7f9100038270 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:50.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.289+0000 7f911a390640 1 --2- 172.21.15.12:0/816287850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f911406d800 0x7f91140a9bd0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:50.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.289+0000 7f911a390640 1 -- 172.21.15.12:0/816287850 >> 172.21.15.12:0/816287850 conn(0x7f9114070df0 msgr2=0x7f9114136dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:50.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.289+0000 7f911a390640 1 -- 172.21.15.12:0/816287850 shutdown_connections 2024-09-11T23:03:50.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.289+0000 7f911a390640 1 -- 172.21.15.12:0/816287850 wait complete. 2024-09-11T23:03:50.312 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_fstop.TestFSTop.test_dump' 2024-09-11T23:03:50.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.441+0000 7fbafd5ba640 1 Processor -- start 2024-09-11T23:03:50.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.441+0000 7fbafd5ba640 1 -- start start 2024-09-11T23:03:50.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.441+0000 7fbafd5ba640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbaf813cde0 0x7fbaf813f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:50.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.441+0000 7fbafd5ba640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaf80a0f10 con 0x7fbaf81359a0 2024-09-11T23:03:50.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.441+0000 7fbafd5ba640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fbaf80a0ce0 con 0x7fbaf813cde0 2024-09-11T23:03:50.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.445+0000 7fbaf6ffd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fbaf81359a0 0x7fbaf8135d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56882/0 (socket says 172.21.15.12:56882) 2024-09-11T23:03:50.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.445+0000 7fbaf6ffd640 1 -- 172.21.15.12:0/1846392425 learned_addr learned my addr 172.21.15.12:0/1846392425 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:03:50.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.445+0000 7fbaf67fc640 1 --2- 172.21.15.12:0/1846392425 >> v2:172.21.15.12:3300/0 conn(0x7fbaf813cde0 0x7fbaf813f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:50.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.445+0000 7fbaf5ffb640 1 -- 172.21.15.12:0/1846392425 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3037257022 0 0) 0x7fbaf80a0f10 con 0x7fbaf81359a0 2024-09-11T23:03:50.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.445+0000 7fbaf5ffb640 1 -- 172.21.15.12:0/1846392425 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbad8003530 con 0x7fbaf81359a0 2024-09-11T23:03:50.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.445+0000 7fbaf67fc640 1 -- 172.21.15.12:0/1846392425 >> v1:172.21.15.12:6789/0 conn(0x7fbaf81359a0 legacy=0x7fbaf8135d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:50.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.445+0000 7fbaf67fc640 1 -- 172.21.15.12:0/1846392425 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaf80a02a0 con 0x7fbaf813cde0 2024-09-11T23:03:50.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.445+0000 7fbaf67fc640 1 --2- 172.21.15.12:0/1846392425 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbaf813cde0 0x7fbaf813f1d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbae0009d90 tx=0x7fbae001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4821651df09821d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:50.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.445+0000 7fbaf5ffb640 1 -- 172.21.15.12:0/1846392425 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbae00b2070 con 0x7fbaf813cde0 2024-09-11T23:03:50.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.445+0000 7fbaf5ffb640 1 -- 172.21.15.12:0/1846392425 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbae00a5650 con 0x7fbaf813cde0 2024-09-11T23:03:50.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.445+0000 7fbaf5ffb640 1 -- 172.21.15.12:0/1846392425 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbae00a5950 con 0x7fbaf813cde0 2024-09-11T23:03:50.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.445+0000 7fbafd5ba640 1 -- 172.21.15.12:0/1846392425 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbaf813cde0 msgr2=0x7fbaf813f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:50.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.445+0000 7fbafd5ba640 1 --2- 172.21.15.12:0/1846392425 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbaf813cde0 0x7fbaf813f1d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbae0009d90 tx=0x7fbae001c8e0 comp rx=0 tx=0).stop 2024-09-11T23:03:50.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.445+0000 7fbafd5ba640 1 -- 172.21.15.12:0/1846392425 shutdown_connections 2024-09-11T23:03:50.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.445+0000 7fbafd5ba640 1 --2- 172.21.15.12:0/1846392425 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbaf813cde0 0x7fbaf813f1d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:50.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.445+0000 7fbafd5ba640 1 -- 172.21.15.12:0/1846392425 >> 172.21.15.12:0/1846392425 conn(0x7fbaf8068000 msgr2=0x7fbaf80a58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:50.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.445+0000 7fbafd5ba640 1 -- 172.21.15.12:0/1846392425 shutdown_connections 2024-09-11T23:03:50.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.445+0000 7fbafd5ba640 1 -- 172.21.15.12:0/1846392425 wait complete. 2024-09-11T23:03:50.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.449+0000 7fbafd5ba640 1 Processor -- start 2024-09-11T23:03:50.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.449+0000 7fbafd5ba640 1 -- start start 2024-09-11T23:03:50.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.449+0000 7fbafd5ba640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbaf81359a0 0x7fbaf809ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:50.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.449+0000 7fbafd5ba640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf8141f30 con 0x7fbaf81359a0 2024-09-11T23:03:50.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.449+0000 7fbaf6ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbaf81359a0 0x7fbaf809ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:50.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.449+0000 7fbaf6ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbaf81359a0 0x7fbaf809ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47306/0 (socket says 172.21.15.12:47306) 2024-09-11T23:03:50.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.449+0000 7fbaf6ffd640 1 -- 172.21.15.12:0/1362665357 learned_addr learned my addr 172.21.15.12:0/1362665357 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:50.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.449+0000 7fbaf6ffd640 1 -- 172.21.15.12:0/1362665357 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaf809f5a0 con 0x7fbaf81359a0 2024-09-11T23:03:50.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.449+0000 7fbaf6ffd640 1 --2- 172.21.15.12:0/1362665357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbaf81359a0 0x7fbaf809ee30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbae800c450 tx=0x7fbae800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:50.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.449+0000 7fbaef7fe640 1 -- 172.21.15.12:0/1362665357 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbae8017070 con 0x7fbaf81359a0 2024-09-11T23:03:50.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.449+0000 7fbaef7fe640 1 -- 172.21.15.12:0/1362665357 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbae8005c20 con 0x7fbaf81359a0 2024-09-11T23:03:50.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.449+0000 7fbafd5ba640 1 -- 172.21.15.12:0/1362665357 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaf813c550 con 0x7fbaf81359a0 2024-09-11T23:03:50.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.449+0000 7fbaef7fe640 1 -- 172.21.15.12:0/1362665357 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbae8007070 con 0x7fbaf81359a0 2024-09-11T23:03:50.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.449+0000 7fbafd5ba640 1 -- 172.21.15.12:0/1362665357 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaf809c5b0 con 0x7fbaf81359a0 2024-09-11T23:03:50.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.449+0000 7fbaef7fe640 1 -- 172.21.15.12:0/1362665357 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbae801a070 con 0x7fbaf81359a0 2024-09-11T23:03:50.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.449+0000 7fbafd5ba640 1 -- 172.21.15.12:0/1362665357 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaf809f770 con 0x7fbaf81359a0 2024-09-11T23:03:50.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.449+0000 7fbaef7fe640 1 --2- 172.21.15.12:0/1362665357 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fbadc035db0 0x7fbadc038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:50.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.449+0000 7fbaef7fe640 1 -- 172.21.15.12:0/1362665357 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3439+0+0 (secure 0 0 0) 0x7fbae80478c0 con 0x7fbaf81359a0 2024-09-11T23:03:50.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.449+0000 7fbaf67fc640 1 --2- 172.21.15.12:0/1362665357 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fbadc035db0 0x7fbadc038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:50.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.449+0000 7fbaf67fc640 1 --2- 172.21.15.12:0/1362665357 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fbadc035db0 0x7fbadc038270 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbae00af000 tx=0x7fbae00a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:50.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.457+0000 7fbaef7fe640 1 -- 172.21.15.12:0/1362665357 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbae8012460 con 0x7fbaf81359a0 2024-09-11T23:03:50.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:50.685+0000 7fbafd5ba640 1 -- 172.21.15.12:0/1362665357 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fstop.TestFSTop.test_dump"]} v 0) -- 0x7fbaf8135d80 con 0x7fbaf81359a0 2024-09-11T23:03:51.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.577+0000 7fbaef7fe640 1 -- 172.21.15.12:0/1362665357 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fstop.TestFSTop.test_dump"]}]=0 v36) ==== 125+0+0 (secure 0 0 0) 0x7fbae8007540 con 0x7fbaf81359a0 2024-09-11T23:03:51.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.581+0000 7fbafd5ba640 1 -- 172.21.15.12:0/1362665357 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fbadc035db0 msgr2=0x7fbadc038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:51.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.581+0000 7fbafd5ba640 1 --2- 172.21.15.12:0/1362665357 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fbadc035db0 0x7fbadc038270 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbae00af000 tx=0x7fbae00a7070 comp rx=0 tx=0).stop 2024-09-11T23:03:51.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.581+0000 7fbafd5ba640 1 -- 172.21.15.12:0/1362665357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbaf81359a0 msgr2=0x7fbaf809ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:51.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.581+0000 7fbafd5ba640 1 --2- 172.21.15.12:0/1362665357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbaf81359a0 0x7fbaf809ee30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbae800c450 tx=0x7fbae800c910 comp rx=0 tx=0).stop 2024-09-11T23:03:51.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.581+0000 7fbafd5ba640 1 -- 172.21.15.12:0/1362665357 shutdown_connections 2024-09-11T23:03:51.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.581+0000 7fbafd5ba640 1 --2- 172.21.15.12:0/1362665357 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fbadc035db0 0x7fbadc038270 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:51.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.581+0000 7fbafd5ba640 1 --2- 172.21.15.12:0/1362665357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbaf81359a0 0x7fbaf809ee30 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:51.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.581+0000 7fbafd5ba640 1 -- 172.21.15.12:0/1362665357 >> 172.21.15.12:0/1362665357 conn(0x7fbaf8068000 msgr2=0x7fbaf813abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:51.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.581+0000 7fbafd5ba640 1 -- 172.21.15.12:0/1362665357 shutdown_connections 2024-09-11T23:03:51.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.581+0000 7fbafd5ba640 1 -- 172.21.15.12:0/1362665357 wait complete. 2024-09-11T23:03:51.606 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-11T23:03:51.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.737+0000 7f982192e640 1 Processor -- start 2024-09-11T23:03:51.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.737+0000 7f982192e640 1 -- start start 2024-09-11T23:03:51.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.737+0000 7f982192e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f981c136bb0 0x7f981c136f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:51.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.737+0000 7f982192e640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f981c0a6b00 con 0x7f981c0a32e0 2024-09-11T23:03:51.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.737+0000 7f982192e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f981c0a2c60 con 0x7f981c136bb0 2024-09-11T23:03:51.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.737+0000 7f9813fff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f981c0a32e0 0x7f981c139ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56888/0 (socket says 172.21.15.12:56888) 2024-09-11T23:03:51.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.737+0000 7f9813fff640 1 -- 172.21.15.12:0/3073059021 learned_addr learned my addr 172.21.15.12:0/3073059021 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:03:51.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.737+0000 7f981affd640 1 --2- 172.21.15.12:0/3073059021 >> v2:172.21.15.12:3300/0 conn(0x7f981c136bb0 0x7f981c136f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:51.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.737+0000 7f981a7fc640 1 -- 172.21.15.12:0/3073059021 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2758880722 0 0) 0x7f981c0a6b00 con 0x7f981c0a32e0 2024-09-11T23:03:51.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.737+0000 7f981a7fc640 1 -- 172.21.15.12:0/3073059021 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9808003530 con 0x7f981c0a32e0 2024-09-11T23:03:51.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.737+0000 7f981affd640 1 -- 172.21.15.12:0/3073059021 >> v1:172.21.15.12:6789/0 conn(0x7f981c0a32e0 legacy=0x7f981c139ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:51.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.737+0000 7f981a7fc640 1 -- 172.21.15.12:0/3073059021 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2760163689 0 0) 0x7f9808003530 con 0x7f981c0a32e0 2024-09-11T23:03:51.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.737+0000 7f981affd640 1 -- 172.21.15.12:0/3073059021 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f981c0a8020 con 0x7f981c136bb0 2024-09-11T23:03:51.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.741+0000 7f981affd640 1 --2- 172.21.15.12:0/3073059021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f981c136bb0 0x7f981c136f90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f980c009740 tx=0x7f980c01c2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beb3c15b1bea87c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:51.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.741+0000 7f981a7fc640 1 -- 172.21.15.12:0/3073059021 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f980c0b0070 con 0x7f981c136bb0 2024-09-11T23:03:51.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.741+0000 7f981a7fc640 1 -- 172.21.15.12:0/3073059021 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f980c0ab400 con 0x7f981c136bb0 2024-09-11T23:03:51.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.741+0000 7f981a7fc640 1 -- 172.21.15.12:0/3073059021 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98040015b0 con 0x7f981c136bb0 2024-09-11T23:03:51.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.741+0000 7f982192e640 1 -- 172.21.15.12:0/3073059021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f981c136bb0 msgr2=0x7f981c136f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:51.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.741+0000 7f982192e640 1 --2- 172.21.15.12:0/3073059021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f981c136bb0 0x7f981c136f90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f980c009740 tx=0x7f980c01c2b0 comp rx=0 tx=0).stop 2024-09-11T23:03:51.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.741+0000 7f982192e640 1 -- 172.21.15.12:0/3073059021 shutdown_connections 2024-09-11T23:03:51.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.741+0000 7f982192e640 1 --2- 172.21.15.12:0/3073059021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f981c136bb0 0x7f981c136f90 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:51.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.741+0000 7f982192e640 1 -- 172.21.15.12:0/3073059021 >> 172.21.15.12:0/3073059021 conn(0x7f981c0a8b60 msgr2=0x7f981c0a8f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:51.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.741+0000 7f982192e640 1 -- 172.21.15.12:0/3073059021 shutdown_connections 2024-09-11T23:03:51.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.741+0000 7f982192e640 1 -- 172.21.15.12:0/3073059021 wait complete. 2024-09-11T23:03:51.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.741+0000 7f982192e640 1 Processor -- start 2024-09-11T23:03:51.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.741+0000 7f982192e640 1 -- start start 2024-09-11T23:03:51.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.741+0000 7f982192e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f981c0a32e0 0x7f981c09bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:51.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.741+0000 7f982192e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f981c0a4d30 con 0x7f981c0a32e0 2024-09-11T23:03:51.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.741+0000 7f981affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f981c0a32e0 0x7f981c09bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:51.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.741+0000 7f981affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f981c0a32e0 0x7f981c09bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47314/0 (socket says 172.21.15.12:47314) 2024-09-11T23:03:51.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.741+0000 7f981affd640 1 -- 172.21.15.12:0/3049947360 learned_addr learned my addr 172.21.15.12:0/3049947360 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:51.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.745+0000 7f981affd640 1 -- 172.21.15.12:0/3049947360 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f981c13dd90 con 0x7f981c0a32e0 2024-09-11T23:03:51.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.745+0000 7f981affd640 1 --2- 172.21.15.12:0/3049947360 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f981c0a32e0 0x7f981c09bdf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f980c0ae040 tx=0x7f980c01aaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:51.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.745+0000 7f9818ff9640 1 -- 172.21.15.12:0/3049947360 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f980c0b0050 con 0x7f981c0a32e0 2024-09-11T23:03:51.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.745+0000 7f9818ff9640 1 -- 172.21.15.12:0/3049947360 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f980c0b1040 con 0x7f981c0a32e0 2024-09-11T23:03:51.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.745+0000 7f9818ff9640 1 -- 172.21.15.12:0/3049947360 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f980c0b75c0 con 0x7f981c0a32e0 2024-09-11T23:03:51.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.745+0000 7f982192e640 1 -- 172.21.15.12:0/3049947360 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f981c13e790 con 0x7f981c0a32e0 2024-09-11T23:03:51.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.745+0000 7f982192e640 1 -- 172.21.15.12:0/3049947360 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f981c09b670 con 0x7f981c0a32e0 2024-09-11T23:03:51.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.745+0000 7f9818ff9640 1 -- 172.21.15.12:0/3049947360 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f980c0be030 con 0x7f981c0a32e0 2024-09-11T23:03:51.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.745+0000 7f982192e640 1 -- 172.21.15.12:0/3049947360 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f981c09c330 con 0x7f981c0a32e0 2024-09-11T23:03:51.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.745+0000 7f9818ff9640 1 --2- 172.21.15.12:0/3049947360 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f97fc035db0 0x7f97fc038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:51.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.745+0000 7f9818ff9640 1 -- 172.21.15.12:0/3049947360 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3439+0+0 (secure 0 0 0) 0x7f980c0bc070 con 0x7f981c0a32e0 2024-09-11T23:03:51.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.745+0000 7f9813fff640 1 --2- 172.21.15.12:0/3049947360 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f97fc035db0 0x7f97fc038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:51.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.745+0000 7f9813fff640 1 --2- 172.21.15.12:0/3049947360 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f97fc035db0 0x7f97fc038270 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9804005890 tx=0x7f9804001240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:51.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.749+0000 7f9818ff9640 1 -- 172.21.15.12:0/3049947360 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f980c0c5060 con 0x7f981c0a32e0 2024-09-11T23:03:51.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.913+0000 7f982192e640 1 -- 172.21.15.12:0/3049947360 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f981c073390 con 0x7f981c0a32e0 2024-09-11T23:03:51.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.917+0000 7f9818ff9640 1 -- 172.21.15.12:0/3049947360 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v5)=0 v5) ==== 122+0+0 (secure 0 0 0) 0x7f980c015f30 con 0x7f981c0a32e0 2024-09-11T23:03:51.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.917+0000 7f982192e640 1 -- 172.21.15.12:0/3049947360 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f97fc035db0 msgr2=0x7f97fc038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:51.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.917+0000 7f982192e640 1 --2- 172.21.15.12:0/3049947360 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f97fc035db0 0x7f97fc038270 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9804005890 tx=0x7f9804001240 comp rx=0 tx=0).stop 2024-09-11T23:03:51.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.917+0000 7f982192e640 1 -- 172.21.15.12:0/3049947360 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f981c0a32e0 msgr2=0x7f981c09bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:51.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.917+0000 7f982192e640 1 --2- 172.21.15.12:0/3049947360 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f981c0a32e0 0x7f981c09bdf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f980c0ae040 tx=0x7f980c01aaf0 comp rx=0 tx=0).stop 2024-09-11T23:03:51.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.917+0000 7f982192e640 1 -- 172.21.15.12:0/3049947360 shutdown_connections 2024-09-11T23:03:51.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.917+0000 7f982192e640 1 --2- 172.21.15.12:0/3049947360 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f97fc035db0 0x7f97fc038270 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:51.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.917+0000 7f982192e640 1 --2- 172.21.15.12:0/3049947360 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f981c0a32e0 0x7f981c09bdf0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:51.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.917+0000 7f982192e640 1 -- 172.21.15.12:0/3049947360 >> 172.21.15.12:0/3049947360 conn(0x7f981c0a8b60 msgr2=0x7f981c135d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:51.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.917+0000 7f982192e640 1 -- 172.21.15.12:0/3049947360 shutdown_connections 2024-09-11T23:03:51.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:51.917+0000 7f982192e640 1 -- 172.21.15.12:0/3049947360 wait complete. 2024-09-11T23:03:51.940 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T23:03:51.941 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:03:51.997 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T23:03:51.997 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T23:03:51.997 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:03:52.003 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T23:03:52.003 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:03:52.052 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:03:52.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.221+0000 7f45e1f8a640 1 Processor -- start 2024-09-11T23:03:52.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.221+0000 7f45e1f8a640 1 -- start start 2024-09-11T23:03:52.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.221+0000 7f45e1f8a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f45dc137de0 0x7f45dc09f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:52.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.221+0000 7f45e1f8a640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45dc09d690 con 0x7f45dc1381c0 2024-09-11T23:03:52.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.221+0000 7f45e1f8a640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f45dc09ea90 con 0x7f45dc137de0 2024-09-11T23:03:52.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.221+0000 7f45db7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f45dc137de0 0x7f45dc09f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:52.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.221+0000 7f45d3fff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f45dc1381c0 0x7f45dc0a36a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56892/0 (socket says 172.21.15.12:56892) 2024-09-11T23:03:52.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.221+0000 7f45d3fff640 1 -- 172.21.15.12:0/3100557870 learned_addr learned my addr 172.21.15.12:0/3100557870 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:03:52.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.221+0000 7f45db7fe640 1 -- 172.21.15.12:0/3100557870 >> v1:172.21.15.12:6789/0 conn(0x7f45dc1381c0 legacy=0x7f45dc0a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:52.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.221+0000 7f45db7fe640 1 -- 172.21.15.12:0/3100557870 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45dc09f6d0 con 0x7f45dc137de0 2024-09-11T23:03:52.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.225+0000 7f45db7fe640 1 --2- 172.21.15.12:0/3100557870 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45dc137de0 0x7f45dc09f190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f45c4009740 tx=0x7f45c401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63955d7cb80569e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:52.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.225+0000 7f45daffd640 1 -- 172.21.15.12:0/3100557870 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45c40b0070 con 0x7f45dc137de0 2024-09-11T23:03:52.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.225+0000 7f45daffd640 1 -- 172.21.15.12:0/3100557870 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45c40a4e50 con 0x7f45dc137de0 2024-09-11T23:03:52.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.225+0000 7f45daffd640 1 -- 172.21.15.12:0/3100557870 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45c40ab680 con 0x7f45dc137de0 2024-09-11T23:03:52.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.225+0000 7f45e1f8a640 1 -- 172.21.15.12:0/3100557870 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45dc137de0 msgr2=0x7f45dc09f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:52.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.225+0000 7f45e1f8a640 1 --2- 172.21.15.12:0/3100557870 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45dc137de0 0x7f45dc09f190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f45c4009740 tx=0x7f45c401c390 comp rx=0 tx=0).stop 2024-09-11T23:03:52.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.225+0000 7f45e1f8a640 1 -- 172.21.15.12:0/3100557870 shutdown_connections 2024-09-11T23:03:52.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.225+0000 7f45e1f8a640 1 --2- 172.21.15.12:0/3100557870 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45dc137de0 0x7f45dc09f190 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:52.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.225+0000 7f45e1f8a640 1 -- 172.21.15.12:0/3100557870 >> 172.21.15.12:0/3100557870 conn(0x7f45dc0a82f0 msgr2=0x7f45dc0a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:52.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.225+0000 7f45e1f8a640 1 -- 172.21.15.12:0/3100557870 shutdown_connections 2024-09-11T23:03:52.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.225+0000 7f45e1f8a640 1 -- 172.21.15.12:0/3100557870 wait complete. 2024-09-11T23:03:52.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.225+0000 7f45e1f8a640 1 Processor -- start 2024-09-11T23:03:52.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.225+0000 7f45e1f8a640 1 -- start start 2024-09-11T23:03:52.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.225+0000 7f45e1f8a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45dc137de0 0x7f45dc06fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:52.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.225+0000 7f45e1f8a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f45dc09e7d0 con 0x7f45dc137de0 2024-09-11T23:03:52.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.225+0000 7f45db7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45dc137de0 0x7f45dc06fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:52.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.225+0000 7f45db7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45dc137de0 0x7f45dc06fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47336/0 (socket says 172.21.15.12:47336) 2024-09-11T23:03:52.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.225+0000 7f45db7fe640 1 -- 172.21.15.12:0/121244127 learned_addr learned my addr 172.21.15.12:0/121244127 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:52.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.225+0000 7f45db7fe640 1 -- 172.21.15.12:0/121244127 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45dc073320 con 0x7f45dc137de0 2024-09-11T23:03:52.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.229+0000 7f45db7fe640 1 --2- 172.21.15.12:0/121244127 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45dc137de0 0x7f45dc06fba0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f45c40ae040 tx=0x7f45c401abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:52.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.229+0000 7f45d8ff9640 1 -- 172.21.15.12:0/121244127 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45c40b0050 con 0x7f45dc137de0 2024-09-11T23:03:52.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.229+0000 7f45d8ff9640 1 -- 172.21.15.12:0/121244127 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45c40b1040 con 0x7f45dc137de0 2024-09-11T23:03:52.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.229+0000 7f45e1f8a640 1 -- 172.21.15.12:0/121244127 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45dc1350f0 con 0x7f45dc137de0 2024-09-11T23:03:52.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.229+0000 7f45d8ff9640 1 -- 172.21.15.12:0/121244127 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45c40b7450 con 0x7f45dc137de0 2024-09-11T23:03:52.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.229+0000 7f45e1f8a640 1 -- 172.21.15.12:0/121244127 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45dc0a0dc0 con 0x7f45dc137de0 2024-09-11T23:03:52.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.229+0000 7f45d8ff9640 1 -- 172.21.15.12:0/121244127 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f45c40be030 con 0x7f45dc137de0 2024-09-11T23:03:52.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.229+0000 7f45e1f8a640 1 -- 172.21.15.12:0/121244127 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45dc1352c0 con 0x7f45dc137de0 2024-09-11T23:03:52.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.229+0000 7f45d8ff9640 1 --2- 172.21.15.12:0/121244127 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f45bc035db0 0x7f45bc038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:52.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.229+0000 7f45d8ff9640 1 -- 172.21.15.12:0/121244127 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3439+0+0 (secure 0 0 0) 0x7f45c40bc070 con 0x7f45dc137de0 2024-09-11T23:03:52.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.229+0000 7f45d3fff640 1 --2- 172.21.15.12:0/121244127 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f45bc035db0 0x7f45bc038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:52.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.229+0000 7f45d3fff640 1 --2- 172.21.15.12:0/121244127 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f45bc035db0 0x7f45bc038270 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f45cc001610 tx=0x7f45cc007ad0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:52.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.233+0000 7f45d8ff9640 1 -- 172.21.15.12:0/121244127 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f45c40c5060 con 0x7f45dc137de0 2024-09-11T23:03:52.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.409+0000 7f45e1f8a640 1 -- 172.21.15.12:0/121244127 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f45dc09f190 con 0x7f45dc137de0 2024-09-11T23:03:52.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.409+0000 7f45d8ff9640 1 -- 172.21.15.12:0/121244127 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v16) ==== 80+0+0 (secure 0 0 0) 0x7f45c4016010 con 0x7f45dc137de0 2024-09-11T23:03:52.415 INFO:teuthology.orchestra.run.smithi012.stderr:listed 0 entries 2024-09-11T23:03:52.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.413+0000 7f45e1f8a640 1 -- 172.21.15.12:0/121244127 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f45bc035db0 msgr2=0x7f45bc038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:52.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.413+0000 7f45e1f8a640 1 --2- 172.21.15.12:0/121244127 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f45bc035db0 0x7f45bc038270 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f45cc001610 tx=0x7f45cc007ad0 comp rx=0 tx=0).stop 2024-09-11T23:03:52.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.413+0000 7f45e1f8a640 1 -- 172.21.15.12:0/121244127 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45dc137de0 msgr2=0x7f45dc06fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:52.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.413+0000 7f45e1f8a640 1 --2- 172.21.15.12:0/121244127 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45dc137de0 0x7f45dc06fba0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f45c40ae040 tx=0x7f45c401abd0 comp rx=0 tx=0).stop 2024-09-11T23:03:52.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.413+0000 7f45e1f8a640 1 -- 172.21.15.12:0/121244127 shutdown_connections 2024-09-11T23:03:52.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.413+0000 7f45e1f8a640 1 --2- 172.21.15.12:0/121244127 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f45bc035db0 0x7f45bc038270 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:52.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.413+0000 7f45e1f8a640 1 --2- 172.21.15.12:0/121244127 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45dc137de0 0x7f45dc06fba0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:52.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.413+0000 7f45e1f8a640 1 -- 172.21.15.12:0/121244127 >> 172.21.15.12:0/121244127 conn(0x7f45dc0a82f0 msgr2=0x7f45dc0a62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:52.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.413+0000 7f45e1f8a640 1 -- 172.21.15.12:0/121244127 shutdown_connections 2024-09-11T23:03:52.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.413+0000 7f45e1f8a640 1 -- 172.21.15.12:0/121244127 wait complete. 2024-09-11T23:03:52.433 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T23:03:52.433 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:03:52.438 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:03:52.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.601+0000 7feafe116640 1 Processor -- start 2024-09-11T23:03:52.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.601+0000 7feafe116640 1 -- start start 2024-09-11T23:03:52.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.601+0000 7feafe116640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7feaf809fc40 0x7feaf813ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:52.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.601+0000 7feafe116640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feaf80a1c00 con 0x7feaf813a200 2024-09-11T23:03:52.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.601+0000 7feafe116640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7feaf80a0e40 con 0x7feaf809fc40 2024-09-11T23:03:52.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.601+0000 7feaf6ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7feaf809fc40 0x7feaf813ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:52.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.601+0000 7feaf77fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7feaf813a200 0x7feaf813a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56906/0 (socket says 172.21.15.12:56906) 2024-09-11T23:03:52.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.601+0000 7feaf77fe640 1 -- 172.21.15.12:0/1623684175 learned_addr learned my addr 172.21.15.12:0/1623684175 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:03:52.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.601+0000 7feaf6ffd640 1 -- 172.21.15.12:0/1623684175 >> v1:172.21.15.12:6789/0 conn(0x7feaf813a200 legacy=0x7feaf813a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:52.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.601+0000 7feaf6ffd640 1 -- 172.21.15.12:0/1623684175 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaf809f350 con 0x7feaf809fc40 2024-09-11T23:03:52.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.605+0000 7feaf6ffd640 1 --2- 172.21.15.12:0/1623684175 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feaf809fc40 0x7feaf813ef80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7feaec009740 tx=0x7feaec01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e920a189161b8dde server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:52.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.605+0000 7feaf67fc640 1 -- 172.21.15.12:0/1623684175 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feaec0b0070 con 0x7feaf809fc40 2024-09-11T23:03:52.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.605+0000 7feaf67fc640 1 -- 172.21.15.12:0/1623684175 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaec0ab530 con 0x7feaf809fc40 2024-09-11T23:03:52.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.605+0000 7feaf67fc640 1 -- 172.21.15.12:0/1623684175 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feaec0ab830 con 0x7feaf809fc40 2024-09-11T23:03:52.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.605+0000 7feafe116640 1 -- 172.21.15.12:0/1623684175 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feaf809fc40 msgr2=0x7feaf813ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:52.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.605+0000 7feafe116640 1 --2- 172.21.15.12:0/1623684175 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feaf809fc40 0x7feaf813ef80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7feaec009740 tx=0x7feaec01c390 comp rx=0 tx=0).stop 2024-09-11T23:03:52.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.605+0000 7feafe116640 1 -- 172.21.15.12:0/1623684175 shutdown_connections 2024-09-11T23:03:52.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.605+0000 7feafe116640 1 --2- 172.21.15.12:0/1623684175 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feaf809fc40 0x7feaf813ef80 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:52.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.605+0000 7feafe116640 1 -- 172.21.15.12:0/1623684175 >> 172.21.15.12:0/1623684175 conn(0x7feaf806da30 msgr2=0x7feaf806de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:52.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.605+0000 7feafe116640 1 -- 172.21.15.12:0/1623684175 shutdown_connections 2024-09-11T23:03:52.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.605+0000 7feafe116640 1 -- 172.21.15.12:0/1623684175 wait complete. 2024-09-11T23:03:52.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.605+0000 7feafe116640 1 Processor -- start 2024-09-11T23:03:52.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.605+0000 7feafe116640 1 -- start start 2024-09-11T23:03:52.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.605+0000 7feafe116640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feaf813a200 0x7feaf80aafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:52.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.605+0000 7feafe116640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7feaf8141ce0 con 0x7feaf813a200 2024-09-11T23:03:52.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.605+0000 7feaf77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feaf813a200 0x7feaf80aafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:52.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.605+0000 7feaf77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feaf813a200 0x7feaf80aafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47352/0 (socket says 172.21.15.12:47352) 2024-09-11T23:03:52.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.605+0000 7feaf77fe640 1 -- 172.21.15.12:0/1465960538 learned_addr learned my addr 172.21.15.12:0/1465960538 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:52.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.605+0000 7feaf77fe640 1 -- 172.21.15.12:0/1465960538 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaf80aa560 con 0x7feaf813a200 2024-09-11T23:03:52.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.609+0000 7feaf77fe640 1 --2- 172.21.15.12:0/1465960538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feaf813a200 0x7feaf80aafa0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7feae800c480 tx=0x7feae800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:52.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.609+0000 7feadffff640 1 -- 172.21.15.12:0/1465960538 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feae8017070 con 0x7feaf813a200 2024-09-11T23:03:52.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.609+0000 7feadffff640 1 -- 172.21.15.12:0/1465960538 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feae8005c20 con 0x7feaf813a200 2024-09-11T23:03:52.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.609+0000 7feafe116640 1 -- 172.21.15.12:0/1465960538 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaf80abd10 con 0x7feaf813a200 2024-09-11T23:03:52.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.609+0000 7feadffff640 1 -- 172.21.15.12:0/1465960538 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feae8007070 con 0x7feaf813a200 2024-09-11T23:03:52.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.609+0000 7feafe116640 1 -- 172.21.15.12:0/1465960538 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaf80abfc0 con 0x7feaf813a200 2024-09-11T23:03:52.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.609+0000 7feadffff640 1 -- 172.21.15.12:0/1465960538 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7feae801a070 con 0x7feaf813a200 2024-09-11T23:03:52.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.609+0000 7feafe116640 1 -- 172.21.15.12:0/1465960538 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaf813a660 con 0x7feaf813a200 2024-09-11T23:03:52.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.609+0000 7feadffff640 1 --2- 172.21.15.12:0/1465960538 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7feae4035db0 0x7feae4038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:52.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.609+0000 7feadffff640 1 -- 172.21.15.12:0/1465960538 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3439+0+0 (secure 0 0 0) 0x7feae8047920 con 0x7feaf813a200 2024-09-11T23:03:52.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.609+0000 7feaf6ffd640 1 --2- 172.21.15.12:0/1465960538 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7feae4035db0 0x7feae4038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:52.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.609+0000 7feaf6ffd640 1 --2- 172.21.15.12:0/1465960538 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7feae4035db0 0x7feae4038270 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7feaec0ad000 tx=0x7feaec008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:52.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.613+0000 7feadffff640 1 -- 172.21.15.12:0/1465960538 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7feae8007210 con 0x7feaf813a200 2024-09-11T23:03:52.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.789+0000 7feafe116640 1 -- 172.21.15.12:0/1465960538 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7feaf8073580 con 0x7feaf813a200 2024-09-11T23:03:52.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.789+0000 7feadffff640 1 -- 172.21.15.12:0/1465960538 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v16) ==== 80+0+0 (secure 0 0 0) 0x7feae801b400 con 0x7feaf813a200 2024-09-11T23:03:52.793 INFO:teuthology.orchestra.run.smithi012.stderr:listed 0 entries 2024-09-11T23:03:52.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.789+0000 7feafe116640 1 -- 172.21.15.12:0/1465960538 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7feae4035db0 msgr2=0x7feae4038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:52.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.789+0000 7feafe116640 1 --2- 172.21.15.12:0/1465960538 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7feae4035db0 0x7feae4038270 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7feaec0ad000 tx=0x7feaec008040 comp rx=0 tx=0).stop 2024-09-11T23:03:52.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.789+0000 7feafe116640 1 -- 172.21.15.12:0/1465960538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feaf813a200 msgr2=0x7feaf80aafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:52.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.789+0000 7feafe116640 1 --2- 172.21.15.12:0/1465960538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feaf813a200 0x7feaf80aafa0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7feae800c480 tx=0x7feae800c940 comp rx=0 tx=0).stop 2024-09-11T23:03:52.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.789+0000 7feafe116640 1 -- 172.21.15.12:0/1465960538 shutdown_connections 2024-09-11T23:03:52.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.789+0000 7feafe116640 1 --2- 172.21.15.12:0/1465960538 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7feae4035db0 0x7feae4038270 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:52.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.789+0000 7feafe116640 1 --2- 172.21.15.12:0/1465960538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feaf813a200 0x7feaf80aafa0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:52.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.789+0000 7feafe116640 1 -- 172.21.15.12:0/1465960538 >> 172.21.15.12:0/1465960538 conn(0x7feaf806da30 msgr2=0x7feaf809ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:52.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.789+0000 7feafe116640 1 -- 172.21.15.12:0/1465960538 shutdown_connections 2024-09-11T23:03:52.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:52.789+0000 7feafe116640 1 -- 172.21.15.12:0/1465960538 wait complete. 2024-09-11T23:03:52.811 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi012.front.sepia.ceph.com... 2024-09-11T23:03:52.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:03:52.811 DEBUG:teuthology.orchestra.run.smithi012:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-11T23:03:52.832 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:03:52.832 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi012.front.sepia.ceph.com 2024-09-11T23:03:52.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:03:52.832 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-11T23:03:52.896 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T23:03:52.896 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:03:52.944 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T23:03:52.945 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:03:52.992 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:03:53.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.161+0000 7f623d624640 1 Processor -- start 2024-09-11T23:03:53.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.161+0000 7f623d624640 1 -- start start 2024-09-11T23:03:53.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.161+0000 7f623d624640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f623813a200 0x7f623813a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:53.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.161+0000 7f623d624640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62380a1c00 con 0x7f623809fc40 2024-09-11T23:03:53.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.161+0000 7f623d624640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f62380a0e40 con 0x7f623813a200 2024-09-11T23:03:53.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.161+0000 7f6236ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f623813a200 0x7f623813a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:53.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.161+0000 7f62367fc640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f623809fc40 0x7f623809d9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56912/0 (socket says 172.21.15.12:56912) 2024-09-11T23:03:53.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.161+0000 7f62367fc640 1 -- 172.21.15.12:0/2279303268 learned_addr learned my addr 172.21.15.12:0/2279303268 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:03:53.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.161+0000 7f6236ffd640 1 --2- 172.21.15.12:0/2279303268 >> v2:172.21.15.12:3300/0 conn(0x7f623813a200 0x7f623813a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47354/0 (socket says 172.21.15.12:47354) 2024-09-11T23:03:53.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.161+0000 7f6236ffd640 1 -- 172.21.15.12:0/2279303268 >> v1:172.21.15.12:6789/0 conn(0x7f623809fc40 legacy=0x7f623809d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:53.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.161+0000 7f6236ffd640 1 -- 172.21.15.12:0/2279303268 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f623813ab20 con 0x7f623813a200 2024-09-11T23:03:53.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.165+0000 7f6236ffd640 1 --2- 172.21.15.12:0/2279303268 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f623813a200 0x7f623813a5e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6228009740 tx=0x7f622801c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24d7badd8afc059e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:53.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.165+0000 7f6235ffb640 1 -- 172.21.15.12:0/2279303268 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62280b0070 con 0x7f623813a200 2024-09-11T23:03:53.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.165+0000 7f6235ffb640 1 -- 172.21.15.12:0/2279303268 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62280ab530 con 0x7f623813a200 2024-09-11T23:03:53.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.165+0000 7f6235ffb640 1 -- 172.21.15.12:0/2279303268 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62280ab830 con 0x7f623813a200 2024-09-11T23:03:53.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.165+0000 7f623d624640 1 -- 172.21.15.12:0/2279303268 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f623813a200 msgr2=0x7f623813a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:53.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.165+0000 7f623d624640 1 --2- 172.21.15.12:0/2279303268 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f623813a200 0x7f623813a5e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6228009740 tx=0x7f622801c390 comp rx=0 tx=0).stop 2024-09-11T23:03:53.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.165+0000 7f623d624640 1 -- 172.21.15.12:0/2279303268 shutdown_connections 2024-09-11T23:03:53.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.165+0000 7f623d624640 1 --2- 172.21.15.12:0/2279303268 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f623813a200 0x7f623813a5e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:53.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.165+0000 7f623d624640 1 -- 172.21.15.12:0/2279303268 >> 172.21.15.12:0/2279303268 conn(0x7f623806da30 msgr2=0x7f623806de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:53.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.165+0000 7f623d624640 1 -- 172.21.15.12:0/2279303268 shutdown_connections 2024-09-11T23:03:53.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.165+0000 7f623d624640 1 -- 172.21.15.12:0/2279303268 wait complete. 2024-09-11T23:03:53.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.165+0000 7f623d624640 1 Processor -- start 2024-09-11T23:03:53.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.165+0000 7f623d624640 1 -- start start 2024-09-11T23:03:53.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.169+0000 7f623d624640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f623813a200 0x7f62380a55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:53.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.169+0000 7f623d624640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f62380a17c0 con 0x7f623813a200 2024-09-11T23:03:53.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.169+0000 7f6236ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f623813a200 0x7f62380a55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:53.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.169+0000 7f6236ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f623813a200 0x7f62380a55f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47370/0 (socket says 172.21.15.12:47370) 2024-09-11T23:03:53.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.169+0000 7f6236ffd640 1 -- 172.21.15.12:0/2426803212 learned_addr learned my addr 172.21.15.12:0/2426803212 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:53.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.169+0000 7f6236ffd640 1 -- 172.21.15.12:0/2426803212 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62381d1a50 con 0x7f623813a200 2024-09-11T23:03:53.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.169+0000 7f6236ffd640 1 --2- 172.21.15.12:0/2426803212 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f623813a200 0x7f62380a55f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6228019fc0 tx=0x7f622801abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:53.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.169+0000 7f621f7fe640 1 -- 172.21.15.12:0/2426803212 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62280b0050 con 0x7f623813a200 2024-09-11T23:03:53.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.169+0000 7f621f7fe640 1 -- 172.21.15.12:0/2426803212 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62280b1040 con 0x7f623813a200 2024-09-11T23:03:53.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.169+0000 7f623d624640 1 -- 172.21.15.12:0/2426803212 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62380a6670 con 0x7f623813a200 2024-09-11T23:03:53.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.169+0000 7f621f7fe640 1 -- 172.21.15.12:0/2426803212 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62280b5740 con 0x7f623813a200 2024-09-11T23:03:53.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.169+0000 7f623d624640 1 -- 172.21.15.12:0/2426803212 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62380a6360 con 0x7f623813a200 2024-09-11T23:03:53.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.169+0000 7f621f7fe640 1 -- 172.21.15.12:0/2426803212 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f62280be030 con 0x7f623813a200 2024-09-11T23:03:53.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.169+0000 7f623d624640 1 -- 172.21.15.12:0/2426803212 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62380a0530 con 0x7f623813a200 2024-09-11T23:03:53.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.169+0000 7f621f7fe640 1 --2- 172.21.15.12:0/2426803212 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f6224035db0 0x7f6224038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:53.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.169+0000 7f621f7fe640 1 -- 172.21.15.12:0/2426803212 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3439+0+0 (secure 0 0 0) 0x7f62280bc070 con 0x7f623813a200 2024-09-11T23:03:53.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.169+0000 7f62367fc640 1 --2- 172.21.15.12:0/2426803212 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f6224035db0 0x7f6224038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:53.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.169+0000 7f62367fc640 1 --2- 172.21.15.12:0/2426803212 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f6224035db0 0x7f6224038270 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f622c001610 tx=0x7f622c007ad0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:53.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.173+0000 7f621f7fe640 1 -- 172.21.15.12:0/2426803212 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f62280c5020 con 0x7f623813a200 2024-09-11T23:03:53.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.341+0000 7f623d624640 1 -- 172.21.15.12:0/2426803212 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f623813a660 con 0x7f623813a200 2024-09-11T23:03:53.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.341+0000 7f621f7fe640 1 -- 172.21.15.12:0/2426803212 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v16) ==== 80+0+0 (secure 0 0 0) 0x7f6228016010 con 0x7f623813a200 2024-09-11T23:03:53.346 INFO:teuthology.orchestra.run.smithi012.stderr:listed 0 entries 2024-09-11T23:03:53.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.345+0000 7f623d624640 1 -- 172.21.15.12:0/2426803212 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f6224035db0 msgr2=0x7f6224038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:53.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.345+0000 7f623d624640 1 --2- 172.21.15.12:0/2426803212 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f6224035db0 0x7f6224038270 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f622c001610 tx=0x7f622c007ad0 comp rx=0 tx=0).stop 2024-09-11T23:03:53.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.345+0000 7f623d624640 1 -- 172.21.15.12:0/2426803212 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f623813a200 msgr2=0x7f62380a55f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:53.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.345+0000 7f623d624640 1 --2- 172.21.15.12:0/2426803212 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f623813a200 0x7f62380a55f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6228019fc0 tx=0x7f622801abd0 comp rx=0 tx=0).stop 2024-09-11T23:03:53.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.345+0000 7f623d624640 1 -- 172.21.15.12:0/2426803212 shutdown_connections 2024-09-11T23:03:53.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.345+0000 7f623d624640 1 --2- 172.21.15.12:0/2426803212 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f6224035db0 0x7f6224038270 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:53.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.345+0000 7f623d624640 1 --2- 172.21.15.12:0/2426803212 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f623813a200 0x7f62380a55f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:53.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.345+0000 7f623d624640 1 -- 172.21.15.12:0/2426803212 >> 172.21.15.12:0/2426803212 conn(0x7f623806da30 msgr2=0x7f6238137370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:53.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.345+0000 7f623d624640 1 -- 172.21.15.12:0/2426803212 shutdown_connections 2024-09-11T23:03:53.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.345+0000 7f623d624640 1 -- 172.21.15.12:0/2426803212 wait complete. 2024-09-11T23:03:53.364 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T23:03:53.364 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:03:53.370 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:03:53.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.529+0000 7f5751494640 1 Processor -- start 2024-09-11T23:03:53.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.529+0000 7f5751494640 1 -- start start 2024-09-11T23:03:53.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.529+0000 7f5751494640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f574c1341a0 0x7f574c134c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:53.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.529+0000 7f5751494640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f574c1346a0 con 0x7f574c1348a0 2024-09-11T23:03:53.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.529+0000 7f5751494640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f574c09d420 con 0x7f574c1341a0 2024-09-11T23:03:53.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.529+0000 7f574a7fc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f574c1341a0 0x7f574c134c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:53.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.529+0000 7f574a7fc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f574c1341a0 0x7f574c134c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47386/0 (socket says 172.21.15.12:47386) 2024-09-11T23:03:53.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.529+0000 7f574a7fc640 1 -- 172.21.15.12:0/91330661 learned_addr learned my addr 172.21.15.12:0/91330661 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:53.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.529+0000 7f574affd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f574c1348a0 0x7f574c137790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56922/0 (socket says 172.21.15.12:56922) 2024-09-11T23:03:53.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.529+0000 7f574a7fc640 1 -- 172.21.15.12:0/91330661 >> v1:172.21.15.12:6789/0 conn(0x7f574c1348a0 legacy=0x7f574c137790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:53.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.529+0000 7f574a7fc640 1 -- 172.21.15.12:0/91330661 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f574c09ede0 con 0x7f574c1341a0 2024-09-11T23:03:53.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.533+0000 7f574a7fc640 1 --2- 172.21.15.12:0/91330661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f574c1341a0 0x7f574c134c80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5734009820 tx=0x7f573401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dc767a165af6fb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:53.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.533+0000 7f5749ffb640 1 -- 172.21.15.12:0/91330661 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57340b0070 con 0x7f574c1341a0 2024-09-11T23:03:53.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.533+0000 7f5749ffb640 1 -- 172.21.15.12:0/91330661 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57340ab530 con 0x7f574c1341a0 2024-09-11T23:03:53.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.533+0000 7f5749ffb640 1 -- 172.21.15.12:0/91330661 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57340ab830 con 0x7f574c1341a0 2024-09-11T23:03:53.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.533+0000 7f5751494640 1 -- 172.21.15.12:0/91330661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f574c1341a0 msgr2=0x7f574c134c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:53.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.533+0000 7f5751494640 1 --2- 172.21.15.12:0/91330661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f574c1341a0 0x7f574c134c80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5734009820 tx=0x7f573401c4c0 comp rx=0 tx=0).stop 2024-09-11T23:03:53.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.533+0000 7f5751494640 1 -- 172.21.15.12:0/91330661 shutdown_connections 2024-09-11T23:03:53.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.533+0000 7f5751494640 1 --2- 172.21.15.12:0/91330661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f574c1341a0 0x7f574c134c80 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:53.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.533+0000 7f5751494640 1 -- 172.21.15.12:0/91330661 >> 172.21.15.12:0/91330661 conn(0x7f574c070ba0 msgr2=0x7f574c072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:53.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.533+0000 7f5751494640 1 -- 172.21.15.12:0/91330661 shutdown_connections 2024-09-11T23:03:53.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.533+0000 7f5751494640 1 -- 172.21.15.12:0/91330661 wait complete. 2024-09-11T23:03:53.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.533+0000 7f5751494640 1 Processor -- start 2024-09-11T23:03:53.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.533+0000 7f5751494640 1 -- start start 2024-09-11T23:03:53.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.537+0000 7f5751494640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f574c1341a0 0x7f574c1cc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:53.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.537+0000 7f5751494640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f574c13fcb0 con 0x7f574c1341a0 2024-09-11T23:03:53.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.537+0000 7f574affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f574c1341a0 0x7f574c1cc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:53.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.537+0000 7f574affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f574c1341a0 0x7f574c1cc6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47388/0 (socket says 172.21.15.12:47388) 2024-09-11T23:03:53.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.537+0000 7f574affd640 1 -- 172.21.15.12:0/2045941712 learned_addr learned my addr 172.21.15.12:0/2045941712 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:53.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.537+0000 7f574affd640 1 -- 172.21.15.12:0/2045941712 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f574c1cbfb0 con 0x7f574c1341a0 2024-09-11T23:03:53.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.537+0000 7f574affd640 1 --2- 172.21.15.12:0/2045941712 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f574c1341a0 0x7f574c1cc6a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f574400c7f0 tx=0x7f574400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:53.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.537+0000 7f57437fe640 1 -- 172.21.15.12:0/2045941712 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5744017070 con 0x7f574c1341a0 2024-09-11T23:03:53.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.537+0000 7f57437fe640 1 -- 172.21.15.12:0/2045941712 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f574400a610 con 0x7f574c1341a0 2024-09-11T23:03:53.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.537+0000 7f57437fe640 1 -- 172.21.15.12:0/2045941712 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f574400a8f0 con 0x7f574c1341a0 2024-09-11T23:03:53.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.537+0000 7f5751494640 1 -- 172.21.15.12:0/2045941712 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f574c13bcb0 con 0x7f574c1341a0 2024-09-11T23:03:53.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.537+0000 7f5751494640 1 -- 172.21.15.12:0/2045941712 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f574c13c590 con 0x7f574c1341a0 2024-09-11T23:03:53.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.537+0000 7f57437fe640 1 -- 172.21.15.12:0/2045941712 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f574401a070 con 0x7f574c1341a0 2024-09-11T23:03:53.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.537+0000 7f5751494640 1 -- 172.21.15.12:0/2045941712 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f574c0008e0 con 0x7f574c1341a0 2024-09-11T23:03:53.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.537+0000 7f57437fe640 1 --2- 172.21.15.12:0/2045941712 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f572c035db0 0x7f572c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:53.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.537+0000 7f57437fe640 1 -- 172.21.15.12:0/2045941712 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3439+0+0 (secure 0 0 0) 0x7f5744047cb0 con 0x7f574c1341a0 2024-09-11T23:03:53.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.537+0000 7f574a7fc640 1 --2- 172.21.15.12:0/2045941712 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f572c035db0 0x7f572c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:53.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.537+0000 7f574a7fc640 1 --2- 172.21.15.12:0/2045941712 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f572c035db0 0x7f572c038270 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f57340ad000 tx=0x7f5734008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:53.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.541+0000 7f57437fe640 1 -- 172.21.15.12:0/2045941712 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5744011c30 con 0x7f574c1341a0 2024-09-11T23:03:53.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.721+0000 7f5751494640 1 -- 172.21.15.12:0/2045941712 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f574c13b9d0 con 0x7f574c1341a0 2024-09-11T23:03:53.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.721+0000 7f57437fe640 1 -- 172.21.15.12:0/2045941712 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v16) ==== 80+0+0 (secure 0 0 0) 0x7f57440073f0 con 0x7f574c1341a0 2024-09-11T23:03:53.725 INFO:teuthology.orchestra.run.smithi012.stderr:listed 0 entries 2024-09-11T23:03:53.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.721+0000 7f5751494640 1 -- 172.21.15.12:0/2045941712 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f572c035db0 msgr2=0x7f572c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:53.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.721+0000 7f5751494640 1 --2- 172.21.15.12:0/2045941712 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f572c035db0 0x7f572c038270 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f57340ad000 tx=0x7f5734008040 comp rx=0 tx=0).stop 2024-09-11T23:03:53.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.721+0000 7f5751494640 1 -- 172.21.15.12:0/2045941712 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f574c1341a0 msgr2=0x7f574c1cc6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:53.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.721+0000 7f5751494640 1 --2- 172.21.15.12:0/2045941712 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f574c1341a0 0x7f574c1cc6a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f574400c7f0 tx=0x7f574400ccb0 comp rx=0 tx=0).stop 2024-09-11T23:03:53.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.721+0000 7f5751494640 1 -- 172.21.15.12:0/2045941712 shutdown_connections 2024-09-11T23:03:53.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.721+0000 7f5751494640 1 --2- 172.21.15.12:0/2045941712 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f572c035db0 0x7f572c038270 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:53.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.721+0000 7f5751494640 1 --2- 172.21.15.12:0/2045941712 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f574c1341a0 0x7f574c1cc6a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:53.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.721+0000 7f5751494640 1 -- 172.21.15.12:0/2045941712 >> 172.21.15.12:0/2045941712 conn(0x7f574c070ba0 msgr2=0x7f574c130e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:53.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.725+0000 7f5751494640 1 -- 172.21.15.12:0/2045941712 shutdown_connections 2024-09-11T23:03:53.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.725+0000 7f5751494640 1 -- 172.21.15.12:0/2045941712 wait complete. 2024-09-11T23:03:53.745 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi012.front.sepia.ceph.com... 2024-09-11T23:03:53.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:03:53.745 DEBUG:teuthology.orchestra.run.smithi012:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-11T23:03:53.758 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:03:53.758 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi012.front.sepia.ceph.com 2024-09-11T23:03:53.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:03:53.758 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-11T23:03:53.804 INFO:tasks.cephfs.cephfs_test_case:[, ] 2024-09-11T23:03:53.804 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:03:53.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.969+0000 7fca18dd8640 1 Processor -- start 2024-09-11T23:03:53.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.969+0000 7fca18dd8640 1 -- start start 2024-09-11T23:03:53.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.973+0000 7fca18dd8640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fca14136ca0 0x7fca1409ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:53.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.973+0000 7fca18dd8640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca140a1ff0 con 0x7fca14137080 2024-09-11T23:03:53.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.973+0000 7fca18dd8640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fca140a12e0 con 0x7fca14136ca0 2024-09-11T23:03:53.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.973+0000 7fca11d9b640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fca14137080 0x7fca140a36a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56924/0 (socket says 172.21.15.12:56924) 2024-09-11T23:03:53.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.973+0000 7fca11d9b640 1 -- 172.21.15.12:0/1051715909 learned_addr learned my addr 172.21.15.12:0/1051715909 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:03:53.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.973+0000 7fca1259c640 1 --2- 172.21.15.12:0/1051715909 >> v2:172.21.15.12:3300/0 conn(0x7fca14136ca0 0x7fca1409ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:53.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.973+0000 7fca1159a640 1 -- 172.21.15.12:0/1051715909 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1732730566 0 0) 0x7fca140a1ff0 con 0x7fca14137080 2024-09-11T23:03:53.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.973+0000 7fca1159a640 1 -- 172.21.15.12:0/1051715909 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc9fc003530 con 0x7fca14137080 2024-09-11T23:03:53.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.973+0000 7fca1259c640 1 -- 172.21.15.12:0/1051715909 >> v1:172.21.15.12:6789/0 conn(0x7fca14137080 legacy=0x7fca140a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:53.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.973+0000 7fca1259c640 1 -- 172.21.15.12:0/1051715909 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca140a0eb0 con 0x7fca14136ca0 2024-09-11T23:03:53.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.977+0000 7fca1259c640 1 --2- 172.21.15.12:0/1051715909 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca14136ca0 0x7fca1409ad90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fca04009740 tx=0x7fca0401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f83ada43dec2380 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:53.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.977+0000 7fca1159a640 1 -- 172.21.15.12:0/1051715909 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca040b0070 con 0x7fca14136ca0 2024-09-11T23:03:53.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.977+0000 7fca1159a640 1 -- 172.21.15.12:0/1051715909 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca040ab400 con 0x7fca14136ca0 2024-09-11T23:03:53.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.977+0000 7fca1159a640 1 -- 172.21.15.12:0/1051715909 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca040ab700 con 0x7fca14136ca0 2024-09-11T23:03:53.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.977+0000 7fca18dd8640 1 -- 172.21.15.12:0/1051715909 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca14136ca0 msgr2=0x7fca1409ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:53.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.977+0000 7fca18dd8640 1 --2- 172.21.15.12:0/1051715909 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca14136ca0 0x7fca1409ad90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fca04009740 tx=0x7fca0401c420 comp rx=0 tx=0).stop 2024-09-11T23:03:53.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.977+0000 7fca18dd8640 1 -- 172.21.15.12:0/1051715909 shutdown_connections 2024-09-11T23:03:53.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.977+0000 7fca18dd8640 1 --2- 172.21.15.12:0/1051715909 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca14136ca0 0x7fca1409ad90 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:53.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.977+0000 7fca18dd8640 1 -- 172.21.15.12:0/1051715909 >> 172.21.15.12:0/1051715909 conn(0x7fca140a8450 msgr2=0x7fca140a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:53.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.977+0000 7fca18dd8640 1 -- 172.21.15.12:0/1051715909 shutdown_connections 2024-09-11T23:03:53.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.977+0000 7fca18dd8640 1 -- 172.21.15.12:0/1051715909 wait complete. 2024-09-11T23:03:53.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.977+0000 7fca18dd8640 1 Processor -- start 2024-09-11T23:03:53.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.977+0000 7fca18dd8640 1 -- start start 2024-09-11T23:03:53.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.977+0000 7fca18dd8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca14136ca0 0x7fca14070c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:53.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.977+0000 7fca18dd8640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fca1413ed10 con 0x7fca14136ca0 2024-09-11T23:03:53.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.977+0000 7fca1259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca14136ca0 0x7fca14070c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:53.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.977+0000 7fca1259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca14136ca0 0x7fca14070c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47398/0 (socket says 172.21.15.12:47398) 2024-09-11T23:03:53.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.977+0000 7fca1259c640 1 -- 172.21.15.12:0/2122465445 learned_addr learned my addr 172.21.15.12:0/2122465445 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:53.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.977+0000 7fca1259c640 1 -- 172.21.15.12:0/2122465445 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca1406ff50 con 0x7fca14136ca0 2024-09-11T23:03:53.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.977+0000 7fca1259c640 1 --2- 172.21.15.12:0/2122465445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca14136ca0 0x7fca14070c80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fca0401a050 tx=0x7fca040191c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:53.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.977+0000 7fca02ffd640 1 -- 172.21.15.12:0/2122465445 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca040b0040 con 0x7fca14136ca0 2024-09-11T23:03:53.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.977+0000 7fca02ffd640 1 -- 172.21.15.12:0/2122465445 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca040abc40 con 0x7fca14136ca0 2024-09-11T23:03:53.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.977+0000 7fca02ffd640 1 -- 172.21.15.12:0/2122465445 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca04004020 con 0x7fca14136ca0 2024-09-11T23:03:53.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.977+0000 7fca18dd8640 1 -- 172.21.15.12:0/2122465445 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca1406e760 con 0x7fca14136ca0 2024-09-11T23:03:53.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.977+0000 7fca18dd8640 1 -- 172.21.15.12:0/2122465445 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca140711c0 con 0x7fca14136ca0 2024-09-11T23:03:53.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.981+0000 7fca18dd8640 1 -- 172.21.15.12:0/2122465445 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca1409ad90 con 0x7fca14136ca0 2024-09-11T23:03:53.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.981+0000 7fca02ffd640 1 -- 172.21.15.12:0/2122465445 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fca040041c0 con 0x7fca14136ca0 2024-09-11T23:03:53.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.981+0000 7fca02ffd640 1 --2- 172.21.15.12:0/2122465445 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fc9f4035db0 0x7fc9f4038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:53.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.981+0000 7fca02ffd640 1 -- 172.21.15.12:0/2122465445 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3439+0+0 (secure 0 0 0) 0x7fca040e2480 con 0x7fca14136ca0 2024-09-11T23:03:53.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.981+0000 7fca11d9b640 1 --2- 172.21.15.12:0/2122465445 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fc9f4035db0 0x7fc9f4038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:53.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.981+0000 7fca11d9b640 1 --2- 172.21.15.12:0/2122465445 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fc9f4035db0 0x7fc9f4038270 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fca080012f0 tx=0x7fca08001430 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:53.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:53.985+0000 7fca02ffd640 1 -- 172.21.15.12:0/2122465445 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fca040c1030 con 0x7fca14136ca0 2024-09-11T23:03:54.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.177+0000 7fca18dd8640 1 -- 172.21.15.12:0/2122465445 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fca1406fab0 con 0x7fca14136ca0 2024-09-11T23:03:54.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.177+0000 7fca02ffd640 1 -- 172.21.15.12:0/2122465445 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+3569 (secure 0 0 0) 0x7fca040b8030 con 0x7fca14136ca0 2024-09-11T23:03:54.183 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:03:54.183 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":7,"btime":"2024-09-11T23:03:34:638819+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4139,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6828/4176387551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":4176387551},{"type":"v1","addr":"172.21.15.12:6828","nonce":4176387551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:03:30.989250+0000","modified":"2024-09-11T23:03:34.002181+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4140":{"gid":4140,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6829/2850198678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6827","nonce":2850198678},{"type":"v1","addr":"172.21.15.12:6829","nonce":2850198678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4140,"qdb_cluster":[4140]},"id":1}]} 2024-09-11T23:03:54.183 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 7 2024-09-11T23:03:54.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.181+0000 7fca18dd8640 1 -- 172.21.15.12:0/2122465445 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fc9f4035db0 msgr2=0x7fc9f4038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:54.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.181+0000 7fca18dd8640 1 --2- 172.21.15.12:0/2122465445 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fc9f4035db0 0x7fc9f4038270 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fca080012f0 tx=0x7fca08001430 comp rx=0 tx=0).stop 2024-09-11T23:03:54.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.181+0000 7fca18dd8640 1 -- 172.21.15.12:0/2122465445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca14136ca0 msgr2=0x7fca14070c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:54.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.181+0000 7fca18dd8640 1 --2- 172.21.15.12:0/2122465445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca14136ca0 0x7fca14070c80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fca0401a050 tx=0x7fca040191c0 comp rx=0 tx=0).stop 2024-09-11T23:03:54.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.181+0000 7fca18dd8640 1 -- 172.21.15.12:0/2122465445 shutdown_connections 2024-09-11T23:03:54.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.181+0000 7fca18dd8640 1 --2- 172.21.15.12:0/2122465445 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fc9f4035db0 0x7fc9f4038270 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:54.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.181+0000 7fca18dd8640 1 --2- 172.21.15.12:0/2122465445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca14136ca0 0x7fca14070c80 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:54.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.181+0000 7fca18dd8640 1 -- 172.21.15.12:0/2122465445 >> 172.21.15.12:0/2122465445 conn(0x7fca140a8450 msgr2=0x7fca1409d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:54.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.181+0000 7fca18dd8640 1 -- 172.21.15.12:0/2122465445 shutdown_connections 2024-09-11T23:03:54.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.181+0000 7fca18dd8640 1 -- 172.21.15.12:0/2122465445 wait complete. 2024-09-11T23:03:54.201 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:03:54.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.321+0000 7f1784a07640 1 Processor -- start 2024-09-11T23:03:54.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.321+0000 7f1784a07640 1 -- start start 2024-09-11T23:03:54.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.321+0000 7f1784a07640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1780138660 0x7f17800a0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:54.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.321+0000 7f1784a07640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17800a0e80 con 0x7f1780067a00 2024-09-11T23:03:54.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.321+0000 7f1784a07640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f1780067de0 con 0x7f1780138660 2024-09-11T23:03:54.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.321+0000 7f1777fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1780138660 0x7f17800a0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:54.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.321+0000 7f177e59c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1780067a00 0x7f1780137f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:33696/0 (socket says 172.21.15.12:33696) 2024-09-11T23:03:54.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.321+0000 7f177e59c640 1 -- 172.21.15.12:0/1622879236 learned_addr learned my addr 172.21.15.12:0/1622879236 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:03:54.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.321+0000 7f1777fff640 1 -- 172.21.15.12:0/1622879236 >> v1:172.21.15.12:6789/0 conn(0x7f1780067a00 legacy=0x7f1780137f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:54.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.321+0000 7f1777fff640 1 -- 172.21.15.12:0/1622879236 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1780137b20 con 0x7f1780138660 2024-09-11T23:03:54.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.321+0000 7f1777fff640 1 --2- 172.21.15.12:0/1622879236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1780138660 0x7f17800a0860 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1768009740 tx=0x7f176801c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39eb3c801df5fd5b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:54.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.321+0000 7f177dd9b640 1 -- 172.21.15.12:0/1622879236 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17680b0070 con 0x7f1780138660 2024-09-11T23:03:54.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.325+0000 7f177dd9b640 1 -- 172.21.15.12:0/1622879236 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17680ab530 con 0x7f1780138660 2024-09-11T23:03:54.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.325+0000 7f177dd9b640 1 -- 172.21.15.12:0/1622879236 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17680ab830 con 0x7f1780138660 2024-09-11T23:03:54.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.325+0000 7f1784a07640 1 -- 172.21.15.12:0/1622879236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1780138660 msgr2=0x7f17800a0860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:54.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.325+0000 7f1784a07640 1 --2- 172.21.15.12:0/1622879236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1780138660 0x7f17800a0860 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1768009740 tx=0x7f176801c390 comp rx=0 tx=0).stop 2024-09-11T23:03:54.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.325+0000 7f1784a07640 1 -- 172.21.15.12:0/1622879236 shutdown_connections 2024-09-11T23:03:54.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.325+0000 7f1784a07640 1 --2- 172.21.15.12:0/1622879236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1780138660 0x7f17800a0860 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:54.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.325+0000 7f1784a07640 1 -- 172.21.15.12:0/1622879236 >> 172.21.15.12:0/1622879236 conn(0x7f178009b910 msgr2=0x7f178009dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:54.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.325+0000 7f1784a07640 1 -- 172.21.15.12:0/1622879236 shutdown_connections 2024-09-11T23:03:54.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.325+0000 7f1784a07640 1 -- 172.21.15.12:0/1622879236 wait complete. 2024-09-11T23:03:54.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.325+0000 7f1784a07640 1 Processor -- start 2024-09-11T23:03:54.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.325+0000 7f1784a07640 1 -- start start 2024-09-11T23:03:54.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.325+0000 7f1784a07640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1780067a00 0x7f1780134ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:54.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.325+0000 7f1784a07640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f178013f8e0 con 0x7f1780067a00 2024-09-11T23:03:54.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.325+0000 7f177e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1780067a00 0x7f1780134ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:54.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.325+0000 7f177e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1780067a00 0x7f1780134ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57774/0 (socket says 172.21.15.12:57774) 2024-09-11T23:03:54.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.325+0000 7f177e59c640 1 -- 172.21.15.12:0/3103878697 learned_addr learned my addr 172.21.15.12:0/3103878697 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:54.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.325+0000 7f177e59c640 1 -- 172.21.15.12:0/3103878697 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17800a8f80 con 0x7f1780067a00 2024-09-11T23:03:54.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.325+0000 7f177e59c640 1 --2- 172.21.15.12:0/3103878697 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1780067a00 0x7f1780134ae0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f177000c2f0 tx=0x7f177000c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:54.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.325+0000 7f1776ffd640 1 -- 172.21.15.12:0/3103878697 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1770017070 con 0x7f1780067a00 2024-09-11T23:03:54.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.325+0000 7f1776ffd640 1 -- 172.21.15.12:0/3103878697 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1770005c20 con 0x7f1780067a00 2024-09-11T23:03:54.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.325+0000 7f1776ffd640 1 -- 172.21.15.12:0/3103878697 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17700070d0 con 0x7f1780067a00 2024-09-11T23:03:54.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.325+0000 7f1784a07640 1 -- 172.21.15.12:0/3103878697 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1780139f60 con 0x7f1780067a00 2024-09-11T23:03:54.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.325+0000 7f1784a07640 1 -- 172.21.15.12:0/3103878697 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17800a1780 con 0x7f1780067a00 2024-09-11T23:03:54.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.325+0000 7f1784a07640 1 -- 172.21.15.12:0/3103878697 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17800a0860 con 0x7f1780067a00 2024-09-11T23:03:54.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.325+0000 7f1776ffd640 1 -- 172.21.15.12:0/3103878697 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f177001a070 con 0x7f1780067a00 2024-09-11T23:03:54.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.325+0000 7f1776ffd640 1 --2- 172.21.15.12:0/3103878697 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f1760035db0 0x7f1760038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:54.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.329+0000 7f1776ffd640 1 -- 172.21.15.12:0/3103878697 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3439+0+0 (secure 0 0 0) 0x7f17700478c0 con 0x7f1780067a00 2024-09-11T23:03:54.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.329+0000 7f1777fff640 1 --2- 172.21.15.12:0/3103878697 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f1760035db0 0x7f1760038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:54.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.329+0000 7f1777fff640 1 --2- 172.21.15.12:0/3103878697 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f1760035db0 0x7f1760038270 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f17680ad000 tx=0x7f17680a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:54.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.333+0000 7f1776ffd640 1 -- 172.21.15.12:0/3103878697 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1770007270 con 0x7f1780067a00 2024-09-11T23:03:54.516 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:03:54.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.529+0000 7f1784a07640 1 -- 172.21.15.12:0/3103878697 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f17800a1250 con 0x7f1780067a00 2024-09-11T23:03:54.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.529+0000 7f1776ffd640 1 -- 172.21.15.12:0/3103878697 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+3569 (secure 0 0 0) 0x7f1770012400 con 0x7f1780067a00 2024-09-11T23:03:54.533 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:03:54.533 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":7,"btime":"2024-09-11T23:03:34:638819+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4139,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6828/4176387551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":4176387551},{"type":"v1","addr":"172.21.15.12:6828","nonce":4176387551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:03:30.989250+0000","modified":"2024-09-11T23:03:34.002181+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4140":{"gid":4140,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6829/2850198678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6827","nonce":2850198678},{"type":"v1","addr":"172.21.15.12:6829","nonce":2850198678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4140,"qdb_cluster":[4140]},"id":1}]} 2024-09-11T23:03:54.533 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 7 2024-09-11T23:03:54.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.529+0000 7f1784a07640 1 -- 172.21.15.12:0/3103878697 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f1760035db0 msgr2=0x7f1760038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:54.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.529+0000 7f1784a07640 1 --2- 172.21.15.12:0/3103878697 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f1760035db0 0x7f1760038270 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f17680ad000 tx=0x7f17680a6000 comp rx=0 tx=0).stop 2024-09-11T23:03:54.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.529+0000 7f1784a07640 1 -- 172.21.15.12:0/3103878697 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1780067a00 msgr2=0x7f1780134ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:54.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.529+0000 7f1784a07640 1 --2- 172.21.15.12:0/3103878697 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1780067a00 0x7f1780134ae0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f177000c2f0 tx=0x7f177000c7b0 comp rx=0 tx=0).stop 2024-09-11T23:03:54.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.529+0000 7f1784a07640 1 -- 172.21.15.12:0/3103878697 shutdown_connections 2024-09-11T23:03:54.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.529+0000 7f1784a07640 1 --2- 172.21.15.12:0/3103878697 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f1760035db0 0x7f1760038270 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:54.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.529+0000 7f1784a07640 1 --2- 172.21.15.12:0/3103878697 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1780067a00 0x7f1780134ae0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:54.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.529+0000 7f1784a07640 1 -- 172.21.15.12:0/3103878697 >> 172.21.15.12:0/3103878697 conn(0x7f178009b910 msgr2=0x7f1780137d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:54.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.529+0000 7f1784a07640 1 -- 172.21.15.12:0/3103878697 shutdown_connections 2024-09-11T23:03:54.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.529+0000 7f1784a07640 1 -- 172.21.15.12:0/3103878697 wait complete. 2024-09-11T23:03:54.550 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:03:54.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.713+0000 7f0886dfa640 1 Processor -- start 2024-09-11T23:03:54.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.713+0000 7f0886dfa640 1 -- start start 2024-09-11T23:03:54.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.713+0000 7f0886dfa640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f088009fc80 0x7f088013b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:54.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.713+0000 7f0886dfa640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08800a14c0 con 0x7f088009f190 2024-09-11T23:03:54.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.713+0000 7f0886dfa640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f08800a1760 con 0x7f088009fc80 2024-09-11T23:03:54.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.713+0000 7f087ffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f088009fc80 0x7f088013b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:54.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.713+0000 7f087ffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f088009fc80 0x7f088013b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57776/0 (socket says 172.21.15.12:57776) 2024-09-11T23:03:54.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.713+0000 7f087ffff640 1 -- 172.21.15.12:0/892507196 learned_addr learned my addr 172.21.15.12:0/892507196 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:54.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.713+0000 7f087ffff640 1 -- 172.21.15.12:0/892507196 >> v1:172.21.15.12:6789/0 conn(0x7f088009f190 legacy=0x7f088009f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:54.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.713+0000 7f087ffff640 1 -- 172.21.15.12:0/892507196 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08800a0d30 con 0x7f088009fc80 2024-09-11T23:03:54.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.713+0000 7f087ffff640 1 --2- 172.21.15.12:0/892507196 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f088009fc80 0x7f088013b780 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f08740097f0 tx=0x7f087401d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8625412f572239ba server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:54.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.713+0000 7f087f7fe640 1 -- 172.21.15.12:0/892507196 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08740ac400 con 0x7f088009fc80 2024-09-11T23:03:54.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.713+0000 7f087f7fe640 1 -- 172.21.15.12:0/892507196 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08740b1070 con 0x7f088009fc80 2024-09-11T23:03:54.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.713+0000 7f087f7fe640 1 -- 172.21.15.12:0/892507196 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08740ac5c0 con 0x7f088009fc80 2024-09-11T23:03:54.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.717+0000 7f0886dfa640 1 -- 172.21.15.12:0/892507196 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f088009fc80 msgr2=0x7f088013b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:54.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.717+0000 7f0886dfa640 1 --2- 172.21.15.12:0/892507196 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f088009fc80 0x7f088013b780 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f08740097f0 tx=0x7f087401d560 comp rx=0 tx=0).stop 2024-09-11T23:03:54.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.717+0000 7f0886dfa640 1 -- 172.21.15.12:0/892507196 shutdown_connections 2024-09-11T23:03:54.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.717+0000 7f0886dfa640 1 --2- 172.21.15.12:0/892507196 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f088009fc80 0x7f088013b780 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:54.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.717+0000 7f0886dfa640 1 -- 172.21.15.12:0/892507196 >> 172.21.15.12:0/892507196 conn(0x7f08800a8450 msgr2=0x7f08800a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:54.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.717+0000 7f0886dfa640 1 -- 172.21.15.12:0/892507196 shutdown_connections 2024-09-11T23:03:54.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.717+0000 7f0886dfa640 1 -- 172.21.15.12:0/892507196 wait complete. 2024-09-11T23:03:54.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.717+0000 7f0886dfa640 1 Processor -- start 2024-09-11T23:03:54.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.717+0000 7f0886dfa640 1 -- start start 2024-09-11T23:03:54.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.717+0000 7f0886dfa640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f088009f190 0x7f088011f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:54.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.717+0000 7f0886dfa640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f08800a2030 con 0x7f088009f190 2024-09-11T23:03:54.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.717+0000 7f0884b96640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f088009f190 0x7f088011f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:54.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.717+0000 7f0884b96640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f088009f190 0x7f088011f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57780/0 (socket says 172.21.15.12:57780) 2024-09-11T23:03:54.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.717+0000 7f0884b96640 1 -- 172.21.15.12:0/1373015900 learned_addr learned my addr 172.21.15.12:0/1373015900 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:54.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.717+0000 7f0884b96640 1 -- 172.21.15.12:0/1373015900 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0880123a70 con 0x7f088009f190 2024-09-11T23:03:54.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.717+0000 7f0884b96640 1 --2- 172.21.15.12:0/1373015900 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f088009f190 0x7f088011f840 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f087000c7f0 tx=0x7f087000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:54.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.717+0000 7f087d7fa640 1 -- 172.21.15.12:0/1373015900 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0870016020 con 0x7f088009f190 2024-09-11T23:03:54.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.717+0000 7f087d7fa640 1 -- 172.21.15.12:0/1373015900 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0870006cb0 con 0x7f088009f190 2024-09-11T23:03:54.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.717+0000 7f087d7fa640 1 -- 172.21.15.12:0/1373015900 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f087000a7f0 con 0x7f088009f190 2024-09-11T23:03:54.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.717+0000 7f0886dfa640 1 -- 172.21.15.12:0/1373015900 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0880123320 con 0x7f088009f190 2024-09-11T23:03:54.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.717+0000 7f0886dfa640 1 -- 172.21.15.12:0/1373015900 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f088009b1f0 con 0x7f088009f190 2024-09-11T23:03:54.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.717+0000 7f0886dfa640 1 -- 172.21.15.12:0/1373015900 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f088009f570 con 0x7f088009f190 2024-09-11T23:03:54.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.717+0000 7f087d7fa640 1 -- 172.21.15.12:0/1373015900 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f087000a990 con 0x7f088009f190 2024-09-11T23:03:54.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.717+0000 7f087d7fa640 1 --2- 172.21.15.12:0/1373015900 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f086c035db0 0x7f086c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:54.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.717+0000 7f087d7fa640 1 -- 172.21.15.12:0/1373015900 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3439+0+0 (secure 0 0 0) 0x7f0870048160 con 0x7f088009f190 2024-09-11T23:03:54.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.717+0000 7f087ffff640 1 --2- 172.21.15.12:0/1373015900 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f086c035db0 0x7f086c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:54.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.721+0000 7f087ffff640 1 --2- 172.21.15.12:0/1373015900 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f086c035db0 0x7f086c038270 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f08740b0000 tx=0x7f08740a8000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:54.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.725+0000 7f087d7fa640 1 -- 172.21.15.12:0/1373015900 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0870020060 con 0x7f088009f190 2024-09-11T23:03:54.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.885+0000 7f0886dfa640 1 -- 172.21.15.12:0/1373015900 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f088009ee70 con 0x7f088009f190 2024-09-11T23:03:54.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.889+0000 7f087d7fa640 1 -- 172.21.15.12:0/1373015900 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+10675 (secure 0 0 0) 0x7f0880123a70 con 0x7f088009f190 2024-09-11T23:03:54.893 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:03:54.893 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":16,"fsid":"8be14356-3340-4500-91a2-4cbc6b511f65","created":"2024-09-11T23:03:10.620234+0000","modified":"2024-09-11T23:03:32.629844+0000","last_up_change":"2024-09-11T23:03:22.359028+0000","last_in_change":"2024-09-11T23:03:11.545817+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:03:23.587068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:03:28.893298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:03:29.993656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"153b72a1-40b1-400d-93ea-333e733f9bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6817","nonce":3680911937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6819","nonce":3680911937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6823","nonce":3680911937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6821","nonce":3680911937}]},"public_addr":"172.21.15.12:6817/3680911937","cluster_addr":"172.21.15.12:6819/3680911937","heartbeat_back_addr":"172.21.15.12:6823/3680911937","heartbeat_front_addr":"172.21.15.12:6821/3680911937","state":["exists","up"]},{"osd":1,"uuid":"94669e49-ee4f-4acf-9e25-e94374dda8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6801","nonce":236825163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6803","nonce":236825163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6807","nonce":236825163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6805","nonce":236825163}]},"public_addr":"172.21.15.12:6801/236825163","cluster_addr":"172.21.15.12:6803/236825163","heartbeat_back_addr":"172.21.15.12:6807/236825163","heartbeat_front_addr":"172.21.15.12:6805/236825163","state":["exists","up"]},{"osd":2,"uuid":"826dae4d-8888-4ec5-8f00-425b3be93814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6809","nonce":3263521655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6811","nonce":3263521655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6815","nonce":3263521655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6813","nonce":3263521655}]},"public_addr":"172.21.15.12:6809/3263521655","cluster_addr":"172.21.15.12:6811/3263521655","heartbeat_back_addr":"172.21.15.12:6815/3263521655","heartbeat_front_addr":"172.21.15.12:6813/3263521655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:19.398518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.761524+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.904997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:03:54.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.889+0000 7f0886dfa640 1 -- 172.21.15.12:0/1373015900 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f086c035db0 msgr2=0x7f086c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:54.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.893+0000 7f0886dfa640 1 --2- 172.21.15.12:0/1373015900 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f086c035db0 0x7f086c038270 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f08740b0000 tx=0x7f08740a8000 comp rx=0 tx=0).stop 2024-09-11T23:03:54.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.893+0000 7f0886dfa640 1 -- 172.21.15.12:0/1373015900 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f088009f190 msgr2=0x7f088011f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:54.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.893+0000 7f0886dfa640 1 --2- 172.21.15.12:0/1373015900 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f088009f190 0x7f088011f840 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f087000c7f0 tx=0x7f087000ccb0 comp rx=0 tx=0).stop 2024-09-11T23:03:54.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.893+0000 7f0886dfa640 1 -- 172.21.15.12:0/1373015900 shutdown_connections 2024-09-11T23:03:54.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.893+0000 7f0886dfa640 1 --2- 172.21.15.12:0/1373015900 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f086c035db0 0x7f086c038270 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:54.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.893+0000 7f0886dfa640 1 --2- 172.21.15.12:0/1373015900 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f088009f190 0x7f088011f840 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:54.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.893+0000 7f0886dfa640 1 -- 172.21.15.12:0/1373015900 >> 172.21.15.12:0/1373015900 conn(0x7f08800a8450 msgr2=0x7f0880136d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:54.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.893+0000 7f0886dfa640 1 -- 172.21.15.12:0/1373015900 shutdown_connections 2024-09-11T23:03:54.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:54.893+0000 7f0886dfa640 1 -- 172.21.15.12:0/1373015900 wait complete. 2024-09-11T23:03:54.912 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T23:03:54.912 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:03:55.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.033+0000 7fb570f3f640 1 Processor -- start 2024-09-11T23:03:55.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.033+0000 7fb570f3f640 1 -- start start 2024-09-11T23:03:55.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.033+0000 7fb570f3f640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb56c09f6e0 0x7fb56c13cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:55.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.033+0000 7fb570f3f640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb56c09e930 con 0x7fb56c137e60 2024-09-11T23:03:55.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.033+0000 7fb570f3f640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fb56c1379e0 con 0x7fb56c09f6e0 2024-09-11T23:03:55.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.033+0000 7fb56a59c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fb56c137e60 0x7fb56c138240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:33714/0 (socket says 172.21.15.12:33714) 2024-09-11T23:03:55.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.033+0000 7fb56a59c640 1 -- 172.21.15.12:0/2163140702 learned_addr learned my addr 172.21.15.12:0/2163140702 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:03:55.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.033+0000 7fb569d9b640 1 --2- 172.21.15.12:0/2163140702 >> v2:172.21.15.12:3300/0 conn(0x7fb56c09f6e0 0x7fb56c13cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:55.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.033+0000 7fb56959a640 1 -- 172.21.15.12:0/2163140702 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 695087210 0 0) 0x7fb56c09e930 con 0x7fb56c137e60 2024-09-11T23:03:55.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.033+0000 7fb56959a640 1 -- 172.21.15.12:0/2163140702 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb554003530 con 0x7fb56c137e60 2024-09-11T23:03:55.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.033+0000 7fb569d9b640 1 -- 172.21.15.12:0/2163140702 >> v1:172.21.15.12:6789/0 conn(0x7fb56c137e60 legacy=0x7fb56c138240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:55.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.033+0000 7fb569d9b640 1 -- 172.21.15.12:0/2163140702 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb56c09d910 con 0x7fb56c09f6e0 2024-09-11T23:03:55.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.033+0000 7fb569d9b640 1 --2- 172.21.15.12:0/2163140702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb56c09f6e0 0x7fb56c13cc60 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb560009d90 tx=0x7fb56001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cd190335160d85 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:55.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.033+0000 7fb56959a640 1 -- 172.21.15.12:0/2163140702 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5600b2070 con 0x7fb56c09f6e0 2024-09-11T23:03:55.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.037+0000 7fb56959a640 1 -- 172.21.15.12:0/2163140702 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5600a5900 con 0x7fb56c09f6e0 2024-09-11T23:03:55.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.037+0000 7fb56959a640 1 -- 172.21.15.12:0/2163140702 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5600a5be0 con 0x7fb56c09f6e0 2024-09-11T23:03:55.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.037+0000 7fb570f3f640 1 -- 172.21.15.12:0/2163140702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb56c09f6e0 msgr2=0x7fb56c13cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:55.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.037+0000 7fb570f3f640 1 --2- 172.21.15.12:0/2163140702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb56c09f6e0 0x7fb56c13cc60 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb560009d90 tx=0x7fb56001c970 comp rx=0 tx=0).stop 2024-09-11T23:03:55.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.037+0000 7fb570f3f640 1 -- 172.21.15.12:0/2163140702 shutdown_connections 2024-09-11T23:03:55.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.037+0000 7fb570f3f640 1 --2- 172.21.15.12:0/2163140702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb56c09f6e0 0x7fb56c13cc60 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:55.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.037+0000 7fb570f3f640 1 -- 172.21.15.12:0/2163140702 >> 172.21.15.12:0/2163140702 conn(0x7fb56c0a8450 msgr2=0x7fb56c0a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:55.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.037+0000 7fb570f3f640 1 -- 172.21.15.12:0/2163140702 shutdown_connections 2024-09-11T23:03:55.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.037+0000 7fb570f3f640 1 -- 172.21.15.12:0/2163140702 wait complete. 2024-09-11T23:03:55.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.037+0000 7fb570f3f640 1 Processor -- start 2024-09-11T23:03:55.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.037+0000 7fb570f3f640 1 -- start start 2024-09-11T23:03:55.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.037+0000 7fb570f3f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb56c09f6e0 0x7fb56c11e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:55.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.037+0000 7fb570f3f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb56c13fd50 con 0x7fb56c09f6e0 2024-09-11T23:03:55.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.037+0000 7fb56a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb56c09f6e0 0x7fb56c11e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:55.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.037+0000 7fb56a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb56c09f6e0 0x7fb56c11e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57810/0 (socket says 172.21.15.12:57810) 2024-09-11T23:03:55.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.037+0000 7fb56a59c640 1 -- 172.21.15.12:0/1618817261 learned_addr learned my addr 172.21.15.12:0/1618817261 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:55.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.037+0000 7fb56a59c640 1 -- 172.21.15.12:0/1618817261 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb56c0714d0 con 0x7fb56c09f6e0 2024-09-11T23:03:55.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.037+0000 7fb56a59c640 1 --2- 172.21.15.12:0/1618817261 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb56c09f6e0 0x7fb56c11e490 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb55c00c3d0 tx=0x7fb55c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:55.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.037+0000 7fb55affd640 1 -- 172.21.15.12:0/1618817261 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb55c017070 con 0x7fb56c09f6e0 2024-09-11T23:03:55.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.037+0000 7fb55affd640 1 -- 172.21.15.12:0/1618817261 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb55c005ce0 con 0x7fb56c09f6e0 2024-09-11T23:03:55.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.037+0000 7fb55affd640 1 -- 172.21.15.12:0/1618817261 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb55c0070d0 con 0x7fb56c09f6e0 2024-09-11T23:03:55.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.037+0000 7fb570f3f640 1 -- 172.21.15.12:0/1618817261 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb56c071740 con 0x7fb56c09f6e0 2024-09-11T23:03:55.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.037+0000 7fb570f3f640 1 -- 172.21.15.12:0/1618817261 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb56c072390 con 0x7fb56c09f6e0 2024-09-11T23:03:55.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.037+0000 7fb570f3f640 1 -- 172.21.15.12:0/1618817261 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb56c073200 con 0x7fb56c09f6e0 2024-09-11T23:03:55.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.037+0000 7fb55affd640 1 -- 172.21.15.12:0/1618817261 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb55c01a070 con 0x7fb56c09f6e0 2024-09-11T23:03:55.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.037+0000 7fb55affd640 1 --2- 172.21.15.12:0/1618817261 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fb54c035db0 0x7fb54c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:55.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.037+0000 7fb55affd640 1 -- 172.21.15.12:0/1618817261 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3439+0+0 (secure 0 0 0) 0x7fb55c047a70 con 0x7fb56c09f6e0 2024-09-11T23:03:55.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.041+0000 7fb569d9b640 1 --2- 172.21.15.12:0/1618817261 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fb54c035db0 0x7fb54c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:55.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.041+0000 7fb569d9b640 1 --2- 172.21.15.12:0/1618817261 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fb54c035db0 0x7fb54c038270 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb5600af000 tx=0x7fb5600a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:55.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.045+0000 7fb55affd640 1 -- 172.21.15.12:0/1618817261 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb55c019e10 con 0x7fb56c09f6e0 2024-09-11T23:03:55.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.241+0000 7fb570f3f640 1 -- 172.21.15.12:0/1618817261 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb56c06bc60 con 0x7fb56c09f6e0 2024-09-11T23:03:55.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.241+0000 7fb55affd640 1 -- 172.21.15.12:0/1618817261 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+3569 (secure 0 0 0) 0x7fb55c047e20 con 0x7fb56c09f6e0 2024-09-11T23:03:55.247 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:03:55.247 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":7,"btime":"2024-09-11T23:03:34:638819+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4139,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6828/4176387551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":4176387551},{"type":"v1","addr":"172.21.15.12:6828","nonce":4176387551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:03:30.989250+0000","modified":"2024-09-11T23:03:34.002181+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4140":{"gid":4140,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6829/2850198678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6827","nonce":2850198678},{"type":"v1","addr":"172.21.15.12:6829","nonce":2850198678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4140,"qdb_cluster":[4140]},"id":1}]} 2024-09-11T23:03:55.247 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 7 2024-09-11T23:03:55.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.245+0000 7fb570f3f640 1 -- 172.21.15.12:0/1618817261 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fb54c035db0 msgr2=0x7fb54c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:55.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.245+0000 7fb570f3f640 1 --2- 172.21.15.12:0/1618817261 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fb54c035db0 0x7fb54c038270 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb5600af000 tx=0x7fb5600a7070 comp rx=0 tx=0).stop 2024-09-11T23:03:55.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.245+0000 7fb570f3f640 1 -- 172.21.15.12:0/1618817261 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb56c09f6e0 msgr2=0x7fb56c11e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:55.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.245+0000 7fb570f3f640 1 --2- 172.21.15.12:0/1618817261 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb56c09f6e0 0x7fb56c11e490 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb55c00c3d0 tx=0x7fb55c00c890 comp rx=0 tx=0).stop 2024-09-11T23:03:55.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.245+0000 7fb570f3f640 1 -- 172.21.15.12:0/1618817261 shutdown_connections 2024-09-11T23:03:55.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.245+0000 7fb570f3f640 1 --2- 172.21.15.12:0/1618817261 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fb54c035db0 0x7fb54c038270 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:55.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.245+0000 7fb570f3f640 1 --2- 172.21.15.12:0/1618817261 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb56c09f6e0 0x7fb56c11e490 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:55.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.245+0000 7fb570f3f640 1 -- 172.21.15.12:0/1618817261 >> 172.21.15.12:0/1618817261 conn(0x7fb56c0a8450 msgr2=0x7fb56c0a14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:55.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.245+0000 7fb570f3f640 1 -- 172.21.15.12:0/1618817261 shutdown_connections 2024-09-11T23:03:55.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.245+0000 7fb570f3f640 1 -- 172.21.15.12:0/1618817261 wait complete. 2024-09-11T23:03:55.266 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:03:55.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.385+0000 7f3a0e2a2640 1 Processor -- start 2024-09-11T23:03:55.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.385+0000 7f3a0e2a2640 1 -- start start 2024-09-11T23:03:55.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.389+0000 7f3a0e2a2640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3a0809f6e0 0x7f3a0813cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:55.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.389+0000 7f3a0e2a2640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a0809e930 con 0x7f3a08137e60 2024-09-11T23:03:55.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.389+0000 7f3a0e2a2640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f3a081379e0 con 0x7f3a0809f6e0 2024-09-11T23:03:55.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.389+0000 7f3a077fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3a0809f6e0 0x7f3a0813cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:55.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.389+0000 7f3a07fff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f3a08137e60 0x7f3a08138240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:33718/0 (socket says 172.21.15.12:33718) 2024-09-11T23:03:55.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.389+0000 7f3a077fe640 1 --2- 172.21.15.12:0/2165522167 >> v2:172.21.15.12:3300/0 conn(0x7f3a0809f6e0 0x7f3a0813cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57818/0 (socket says 172.21.15.12:57818) 2024-09-11T23:03:55.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.389+0000 7f3a07fff640 1 -- 172.21.15.12:0/2165522167 learned_addr learned my addr 172.21.15.12:0/2165522167 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:03:55.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.389+0000 7f3a077fe640 1 -- 172.21.15.12:0/2165522167 >> v1:172.21.15.12:6789/0 conn(0x7f3a08137e60 legacy=0x7f3a08138240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:55.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.389+0000 7f3a077fe640 1 -- 172.21.15.12:0/2165522167 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a0809d910 con 0x7f3a0809f6e0 2024-09-11T23:03:55.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.389+0000 7f3a06ffd640 1 -- 172.21.15.12:0/2165522167 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3485957226 0 0) 0x7f3a0809e930 con 0x7f3a08137e60 2024-09-11T23:03:55.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.389+0000 7f3a077fe640 1 --2- 172.21.15.12:0/2165522167 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a0809f6e0 0x7f3a0813cc60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f39f8009d90 tx=0x7f39f801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3351ee7d42b9e0b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:55.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.389+0000 7f3a06ffd640 1 -- 172.21.15.12:0/2165522167 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39f80b2070 con 0x7f3a0809f6e0 2024-09-11T23:03:55.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.389+0000 7f3a06ffd640 1 -- 172.21.15.12:0/2165522167 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39f80a5900 con 0x7f3a0809f6e0 2024-09-11T23:03:55.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.389+0000 7f3a06ffd640 1 -- 172.21.15.12:0/2165522167 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39f80a5c00 con 0x7f3a0809f6e0 2024-09-11T23:03:55.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.393+0000 7f3a0e2a2640 1 -- 172.21.15.12:0/2165522167 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a0809f6e0 msgr2=0x7f3a0813cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:55.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.393+0000 7f3a0e2a2640 1 --2- 172.21.15.12:0/2165522167 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a0809f6e0 0x7f3a0813cc60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f39f8009d90 tx=0x7f39f801c970 comp rx=0 tx=0).stop 2024-09-11T23:03:55.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.393+0000 7f3a0e2a2640 1 -- 172.21.15.12:0/2165522167 shutdown_connections 2024-09-11T23:03:55.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.393+0000 7f3a0e2a2640 1 --2- 172.21.15.12:0/2165522167 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a0809f6e0 0x7f3a0813cc60 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:55.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.393+0000 7f3a0e2a2640 1 -- 172.21.15.12:0/2165522167 >> 172.21.15.12:0/2165522167 conn(0x7f3a080a8450 msgr2=0x7f3a080a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:55.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.393+0000 7f3a0e2a2640 1 -- 172.21.15.12:0/2165522167 shutdown_connections 2024-09-11T23:03:55.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.393+0000 7f3a0e2a2640 1 -- 172.21.15.12:0/2165522167 wait complete. 2024-09-11T23:03:55.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.393+0000 7f3a0e2a2640 1 Processor -- start 2024-09-11T23:03:55.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.393+0000 7f3a0e2a2640 1 -- start start 2024-09-11T23:03:55.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.393+0000 7f3a0e2a2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a0809f6e0 0x7f3a0811e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:55.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.393+0000 7f3a0e2a2640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3a0813fd50 con 0x7f3a0809f6e0 2024-09-11T23:03:55.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.393+0000 7f3a07fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a0809f6e0 0x7f3a0811e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:55.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.393+0000 7f3a07fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a0809f6e0 0x7f3a0811e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57832/0 (socket says 172.21.15.12:57832) 2024-09-11T23:03:55.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.393+0000 7f3a07fff640 1 -- 172.21.15.12:0/296453762 learned_addr learned my addr 172.21.15.12:0/296453762 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:55.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.393+0000 7f3a07fff640 1 -- 172.21.15.12:0/296453762 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a08073310 con 0x7f3a0809f6e0 2024-09-11T23:03:55.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.393+0000 7f3a07fff640 1 --2- 172.21.15.12:0/296453762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a0809f6e0 0x7f3a0811e820 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f39f000c450 tx=0x7f39f000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:55.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.393+0000 7f3a04ff9640 1 -- 172.21.15.12:0/296453762 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39f0005c20 con 0x7f3a0809f6e0 2024-09-11T23:03:55.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.393+0000 7f3a04ff9640 1 -- 172.21.15.12:0/296453762 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39f0005dc0 con 0x7f3a0809f6e0 2024-09-11T23:03:55.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.393+0000 7f3a0e2a2640 1 -- 172.21.15.12:0/296453762 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a080725c0 con 0x7f3a0809f6e0 2024-09-11T23:03:55.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.393+0000 7f3a04ff9640 1 -- 172.21.15.12:0/296453762 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39f00071a0 con 0x7f3a0809f6e0 2024-09-11T23:03:55.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.393+0000 7f3a0e2a2640 1 -- 172.21.15.12:0/296453762 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a08072090 con 0x7f3a0809f6e0 2024-09-11T23:03:55.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.393+0000 7f3a0e2a2640 1 -- 172.21.15.12:0/296453762 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a080714d0 con 0x7f3a0809f6e0 2024-09-11T23:03:55.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.393+0000 7f3a04ff9640 1 -- 172.21.15.12:0/296453762 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f39f0007400 con 0x7f3a0809f6e0 2024-09-11T23:03:55.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.393+0000 7f3a04ff9640 1 --2- 172.21.15.12:0/296453762 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f39e8035d60 0x7f39e8038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:55.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.393+0000 7f3a04ff9640 1 -- 172.21.15.12:0/296453762 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3439+0+0 (secure 0 0 0) 0x7f39f0048340 con 0x7f3a0809f6e0 2024-09-11T23:03:55.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.393+0000 7f3a077fe640 1 --2- 172.21.15.12:0/296453762 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f39e8035d60 0x7f39e8038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:55.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.397+0000 7f3a077fe640 1 --2- 172.21.15.12:0/296453762 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f39e8035d60 0x7f39e8038220 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f39f80af000 tx=0x7f39f80a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:55.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.401+0000 7f3a04ff9640 1 -- 172.21.15.12:0/296453762 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f39f00182b0 con 0x7f3a0809f6e0 2024-09-11T23:03:55.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.588+0000 7f3a0e2a2640 1 -- 172.21.15.12:0/296453762 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3a0811ed60 con 0x7f3a0809f6e0 2024-09-11T23:03:55.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.592+0000 7f3a04ff9640 1 -- 172.21.15.12:0/296453762 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+3569 (secure 0 0 0) 0x7f39f001bca0 con 0x7f3a0809f6e0 2024-09-11T23:03:55.598 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:03:55.598 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":7,"btime":"2024-09-11T23:03:34:638819+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4139,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6828/4176387551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":4176387551},{"type":"v1","addr":"172.21.15.12:6828","nonce":4176387551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:03:30.989250+0000","modified":"2024-09-11T23:03:34.002181+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4140},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4140":{"gid":4140,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6829/2850198678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6827","nonce":2850198678},{"type":"v1","addr":"172.21.15.12:6829","nonce":2850198678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4140,"qdb_cluster":[4140]},"id":1}]} 2024-09-11T23:03:55.598 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 7 2024-09-11T23:03:55.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.596+0000 7f3a0e2a2640 1 -- 172.21.15.12:0/296453762 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f39e8035d60 msgr2=0x7f39e8038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:55.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.596+0000 7f3a0e2a2640 1 --2- 172.21.15.12:0/296453762 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f39e8035d60 0x7f39e8038220 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f39f80af000 tx=0x7f39f80a7070 comp rx=0 tx=0).stop 2024-09-11T23:03:55.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.596+0000 7f3a0e2a2640 1 -- 172.21.15.12:0/296453762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a0809f6e0 msgr2=0x7f3a0811e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:55.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.596+0000 7f3a0e2a2640 1 --2- 172.21.15.12:0/296453762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a0809f6e0 0x7f3a0811e820 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f39f000c450 tx=0x7f39f000c910 comp rx=0 tx=0).stop 2024-09-11T23:03:55.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.596+0000 7f3a0e2a2640 1 -- 172.21.15.12:0/296453762 shutdown_connections 2024-09-11T23:03:55.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.596+0000 7f3a0e2a2640 1 --2- 172.21.15.12:0/296453762 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f39e8035d60 0x7f39e8038220 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:55.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.596+0000 7f3a0e2a2640 1 --2- 172.21.15.12:0/296453762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a0809f6e0 0x7f3a0811e820 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:55.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.596+0000 7f3a0e2a2640 1 -- 172.21.15.12:0/296453762 >> 172.21.15.12:0/296453762 conn(0x7f3a080a8450 msgr2=0x7f3a080a1430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:55.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.596+0000 7f3a0e2a2640 1 -- 172.21.15.12:0/296453762 shutdown_connections 2024-09-11T23:03:55.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.596+0000 7f3a0e2a2640 1 -- 172.21.15.12:0/296453762 wait complete. 2024-09-11T23:03:55.616 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:03:55.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.732+0000 7fd24d1da640 1 Processor -- start 2024-09-11T23:03:55.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.732+0000 7fd24d1da640 1 -- start start 2024-09-11T23:03:55.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.732+0000 7fd24d1da640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd2480a0bc0 0x7fd24813ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:55.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.732+0000 7fd24d1da640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd248139d60 con 0x7fd24813a220 2024-09-11T23:03:55.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.732+0000 7fd24d1da640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fd248072c90 con 0x7fd2480a0bc0 2024-09-11T23:03:55.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.736+0000 7fd246d9d640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd24813a220 0x7fd24813a600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:33724/0 (socket says 172.21.15.12:33724) 2024-09-11T23:03:55.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.736+0000 7fd246d9d640 1 -- 172.21.15.12:0/2589680155 learned_addr learned my addr 172.21.15.12:0/2589680155 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:03:55.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.736+0000 7fd24659c640 1 --2- 172.21.15.12:0/2589680155 >> v2:172.21.15.12:3300/0 conn(0x7fd2480a0bc0 0x7fd24813ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:55.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.736+0000 7fd24659c640 1 -- 172.21.15.12:0/2589680155 >> v1:172.21.15.12:6789/0 conn(0x7fd24813a220 legacy=0x7fd24813a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:55.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.736+0000 7fd24659c640 1 -- 172.21.15.12:0/2589680155 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd24809fc10 con 0x7fd2480a0bc0 2024-09-11T23:03:55.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.736+0000 7fd24659c640 1 --2- 172.21.15.12:0/2589680155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2480a0bc0 0x7fd24813ef70 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd248139f30 tx=0x7fd23c01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3b7940163d05278 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:55.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.736+0000 7fd245d9b640 1 -- 172.21.15.12:0/2589680155 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd23c0b0070 con 0x7fd2480a0bc0 2024-09-11T23:03:55.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.736+0000 7fd245d9b640 1 -- 172.21.15.12:0/2589680155 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd23c0ab400 con 0x7fd2480a0bc0 2024-09-11T23:03:55.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.736+0000 7fd245d9b640 1 -- 172.21.15.12:0/2589680155 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd23c0ab700 con 0x7fd2480a0bc0 2024-09-11T23:03:55.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.736+0000 7fd24d1da640 1 -- 172.21.15.12:0/2589680155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2480a0bc0 msgr2=0x7fd24813ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:55.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.736+0000 7fd24d1da640 1 --2- 172.21.15.12:0/2589680155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2480a0bc0 0x7fd24813ef70 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd248139f30 tx=0x7fd23c01c390 comp rx=0 tx=0).stop 2024-09-11T23:03:55.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.736+0000 7fd24d1da640 1 -- 172.21.15.12:0/2589680155 shutdown_connections 2024-09-11T23:03:55.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.736+0000 7fd24d1da640 1 --2- 172.21.15.12:0/2589680155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2480a0bc0 0x7fd24813ef70 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:55.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.736+0000 7fd24d1da640 1 -- 172.21.15.12:0/2589680155 >> 172.21.15.12:0/2589680155 conn(0x7fd2480a8450 msgr2=0x7fd2480a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:55.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.736+0000 7fd24d1da640 1 -- 172.21.15.12:0/2589680155 shutdown_connections 2024-09-11T23:03:55.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.736+0000 7fd24d1da640 1 -- 172.21.15.12:0/2589680155 wait complete. 2024-09-11T23:03:55.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.740+0000 7fd24d1da640 1 Processor -- start 2024-09-11T23:03:55.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.740+0000 7fd24d1da640 1 -- start start 2024-09-11T23:03:55.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.740+0000 7fd24d1da640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2480a0bc0 0x7fd24809a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:55.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.740+0000 7fd24d1da640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd248142060 con 0x7fd2480a0bc0 2024-09-11T23:03:55.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.740+0000 7fd246d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2480a0bc0 0x7fd24809a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:55.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.740+0000 7fd246d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2480a0bc0 0x7fd24809a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57848/0 (socket says 172.21.15.12:57848) 2024-09-11T23:03:55.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.740+0000 7fd246d9d640 1 -- 172.21.15.12:0/3509079811 learned_addr learned my addr 172.21.15.12:0/3509079811 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:55.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.740+0000 7fd246d9d640 1 -- 172.21.15.12:0/3509079811 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd24813eb60 con 0x7fd2480a0bc0 2024-09-11T23:03:55.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.740+0000 7fd246d9d640 1 --2- 172.21.15.12:0/3509079811 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2480a0bc0 0x7fd24809a9d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd24000cb20 tx=0x7fd24000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:55.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.740+0000 7fd22f7fe640 1 -- 172.21.15.12:0/3509079811 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd240017070 con 0x7fd2480a0bc0 2024-09-11T23:03:55.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.740+0000 7fd22f7fe640 1 -- 172.21.15.12:0/3509079811 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd24000abf0 con 0x7fd2480a0bc0 2024-09-11T23:03:55.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.740+0000 7fd22f7fe640 1 -- 172.21.15.12:0/3509079811 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd240012400 con 0x7fd2480a0bc0 2024-09-11T23:03:55.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.740+0000 7fd24d1da640 1 -- 172.21.15.12:0/3509079811 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2480a6690 con 0x7fd2480a0bc0 2024-09-11T23:03:55.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.740+0000 7fd24d1da640 1 -- 172.21.15.12:0/3509079811 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd24809d350 con 0x7fd2480a0bc0 2024-09-11T23:03:55.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.740+0000 7fd22f7fe640 1 -- 172.21.15.12:0/3509079811 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd24001a070 con 0x7fd2480a0bc0 2024-09-11T23:03:55.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.740+0000 7fd24d1da640 1 -- 172.21.15.12:0/3509079811 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2480008e0 con 0x7fd2480a0bc0 2024-09-11T23:03:55.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.740+0000 7fd22f7fe640 1 --2- 172.21.15.12:0/3509079811 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fd234035db0 0x7fd234038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:55.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.740+0000 7fd22f7fe640 1 -- 172.21.15.12:0/3509079811 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3439+0+0 (secure 0 0 0) 0x7fd2400483a0 con 0x7fd2480a0bc0 2024-09-11T23:03:55.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.740+0000 7fd24659c640 1 --2- 172.21.15.12:0/3509079811 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fd234035db0 0x7fd234038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:55.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.740+0000 7fd24659c640 1 --2- 172.21.15.12:0/3509079811 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fd234035db0 0x7fd234038270 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd23c0ad000 tx=0x7fd23c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:55.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.744+0000 7fd22f7fe640 1 -- 172.21.15.12:0/3509079811 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd2400113a0 con 0x7fd2480a0bc0 2024-09-11T23:03:55.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.904+0000 7fd24d1da640 1 -- 172.21.15.12:0/3509079811 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd24809c860 con 0x7fd2480a0bc0 2024-09-11T23:03:55.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.908+0000 7fd22f7fe640 1 -- 172.21.15.12:0/3509079811 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+10675 (secure 0 0 0) 0x7fd240037b70 con 0x7fd2480a0bc0 2024-09-11T23:03:55.912 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:03:55.912 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":16,"fsid":"8be14356-3340-4500-91a2-4cbc6b511f65","created":"2024-09-11T23:03:10.620234+0000","modified":"2024-09-11T23:03:32.629844+0000","last_up_change":"2024-09-11T23:03:22.359028+0000","last_in_change":"2024-09-11T23:03:11.545817+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:03:23.587068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:03:28.893298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:03:29.993656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"153b72a1-40b1-400d-93ea-333e733f9bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6817","nonce":3680911937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6819","nonce":3680911937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6823","nonce":3680911937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6821","nonce":3680911937}]},"public_addr":"172.21.15.12:6817/3680911937","cluster_addr":"172.21.15.12:6819/3680911937","heartbeat_back_addr":"172.21.15.12:6823/3680911937","heartbeat_front_addr":"172.21.15.12:6821/3680911937","state":["exists","up"]},{"osd":1,"uuid":"94669e49-ee4f-4acf-9e25-e94374dda8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6801","nonce":236825163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6803","nonce":236825163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6807","nonce":236825163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6805","nonce":236825163}]},"public_addr":"172.21.15.12:6801/236825163","cluster_addr":"172.21.15.12:6803/236825163","heartbeat_back_addr":"172.21.15.12:6807/236825163","heartbeat_front_addr":"172.21.15.12:6805/236825163","state":["exists","up"]},{"osd":2,"uuid":"826dae4d-8888-4ec5-8f00-425b3be93814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6809","nonce":3263521655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6811","nonce":3263521655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6815","nonce":3263521655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6813","nonce":3263521655}]},"public_addr":"172.21.15.12:6809/3263521655","cluster_addr":"172.21.15.12:6811/3263521655","heartbeat_back_addr":"172.21.15.12:6815/3263521655","heartbeat_front_addr":"172.21.15.12:6813/3263521655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:19.398518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.761524+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.904997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:03:55.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.908+0000 7fd24d1da640 1 -- 172.21.15.12:0/3509079811 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fd234035db0 msgr2=0x7fd234038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:55.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.908+0000 7fd24d1da640 1 --2- 172.21.15.12:0/3509079811 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fd234035db0 0x7fd234038270 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd23c0ad000 tx=0x7fd23c008040 comp rx=0 tx=0).stop 2024-09-11T23:03:55.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.908+0000 7fd24d1da640 1 -- 172.21.15.12:0/3509079811 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2480a0bc0 msgr2=0x7fd24809a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:55.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.908+0000 7fd24d1da640 1 --2- 172.21.15.12:0/3509079811 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2480a0bc0 0x7fd24809a9d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd24000cb20 tx=0x7fd24000a060 comp rx=0 tx=0).stop 2024-09-11T23:03:55.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.908+0000 7fd24d1da640 1 -- 172.21.15.12:0/3509079811 shutdown_connections 2024-09-11T23:03:55.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.908+0000 7fd24d1da640 1 --2- 172.21.15.12:0/3509079811 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fd234035db0 0x7fd234038270 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:55.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.908+0000 7fd24d1da640 1 --2- 172.21.15.12:0/3509079811 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2480a0bc0 0x7fd24809a9d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:55.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.908+0000 7fd24d1da640 1 -- 172.21.15.12:0/3509079811 >> 172.21.15.12:0/3509079811 conn(0x7fd2480a8450 msgr2=0x7fd2480a3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:55.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.908+0000 7fd24d1da640 1 -- 172.21.15.12:0/3509079811 shutdown_connections 2024-09-11T23:03:55.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:55.908+0000 7fd24d1da640 1 -- 172.21.15.12:0/3509079811 wait complete. 2024-09-11T23:03:55.930 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-11T23:03:56.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.036+0000 7f5e0d9e0640 1 Processor -- start 2024-09-11T23:03:56.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.036+0000 7f5e0d9e0640 1 -- start start 2024-09-11T23:03:56.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.036+0000 7f5e0d9e0640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5e08136da0 0x7f5e08137180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:56.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.036+0000 7f5e0d9e0640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e080a1e90 con 0x7f5e0809ac20 2024-09-11T23:03:56.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.036+0000 7f5e0d9e0640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f5e081376c0 con 0x7f5e08136da0 2024-09-11T23:03:56.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.036+0000 7f5e06ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5e08136da0 0x7f5e08137180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:56.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.036+0000 7f5e06ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5e08136da0 0x7f5e08137180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57852/0 (socket says 172.21.15.12:57852) 2024-09-11T23:03:56.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.036+0000 7f5e06ffd640 1 -- 172.21.15.12:0/1518030393 learned_addr learned my addr 172.21.15.12:0/1518030393 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:56.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.036+0000 7f5e06ffd640 1 -- 172.21.15.12:0/1518030393 >> v1:172.21.15.12:6789/0 conn(0x7f5e0809ac20 legacy=0x7f5e080a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:56.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.036+0000 7f5e06ffd640 1 -- 172.21.15.12:0/1518030393 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e080a0650 con 0x7f5e08136da0 2024-09-11T23:03:56.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.040+0000 7f5e06ffd640 1 --2- 172.21.15.12:0/1518030393 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e08136da0 0x7f5e08137180 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5e00009e50 tx=0x7f5e0001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2570dffc153f5c8c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:56.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.040+0000 7f5e05ffb640 1 -- 172.21.15.12:0/1518030393 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e00009200 con 0x7f5e08136da0 2024-09-11T23:03:56.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.040+0000 7f5e05ffb640 1 -- 172.21.15.12:0/1518030393 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e000a5680 con 0x7f5e08136da0 2024-09-11T23:03:56.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.040+0000 7f5e05ffb640 1 -- 172.21.15.12:0/1518030393 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e000a5980 con 0x7f5e08136da0 2024-09-11T23:03:56.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.040+0000 7f5e0d9e0640 1 -- 172.21.15.12:0/1518030393 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e08136da0 msgr2=0x7f5e08137180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:56.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.040+0000 7f5e0d9e0640 1 --2- 172.21.15.12:0/1518030393 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e08136da0 0x7f5e08137180 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5e00009e50 tx=0x7f5e0001ca30 comp rx=0 tx=0).stop 2024-09-11T23:03:56.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.040+0000 7f5e0d9e0640 1 -- 172.21.15.12:0/1518030393 shutdown_connections 2024-09-11T23:03:56.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.040+0000 7f5e0d9e0640 1 --2- 172.21.15.12:0/1518030393 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e08136da0 0x7f5e08137180 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:56.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.040+0000 7f5e0d9e0640 1 -- 172.21.15.12:0/1518030393 >> 172.21.15.12:0/1518030393 conn(0x7f5e080a82f0 msgr2=0x7f5e080a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:56.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.040+0000 7f5e0d9e0640 1 -- 172.21.15.12:0/1518030393 shutdown_connections 2024-09-11T23:03:56.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.040+0000 7f5e0d9e0640 1 -- 172.21.15.12:0/1518030393 wait complete. 2024-09-11T23:03:56.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.040+0000 7f5e0d9e0640 1 Processor -- start 2024-09-11T23:03:56.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.040+0000 7f5e0d9e0640 1 -- start start 2024-09-11T23:03:56.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.040+0000 7f5e0d9e0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e0809ac20 0x7f5e08138480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:56.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.040+0000 7f5e0d9e0640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5e0813ee20 con 0x7f5e0809ac20 2024-09-11T23:03:56.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.040+0000 7f5e06ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e0809ac20 0x7f5e08138480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:56.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.040+0000 7f5e06ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e0809ac20 0x7f5e08138480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57854/0 (socket says 172.21.15.12:57854) 2024-09-11T23:03:56.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.040+0000 7f5e06ffd640 1 -- 172.21.15.12:0/964247197 learned_addr learned my addr 172.21.15.12:0/964247197 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:56.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.044+0000 7f5e06ffd640 1 -- 172.21.15.12:0/964247197 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e0813bf20 con 0x7f5e0809ac20 2024-09-11T23:03:56.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.044+0000 7f5e06ffd640 1 --2- 172.21.15.12:0/964247197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e0809ac20 0x7f5e08138480 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5e0001a660 tx=0x7f5e000197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:56.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.044+0000 7f5dfffff640 1 -- 172.21.15.12:0/964247197 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e000ba070 con 0x7f5e0809ac20 2024-09-11T23:03:56.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.044+0000 7f5dfffff640 1 -- 172.21.15.12:0/964247197 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e000b4440 con 0x7f5e0809ac20 2024-09-11T23:03:56.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.044+0000 7f5e0d9e0640 1 -- 172.21.15.12:0/964247197 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e0813a3c0 con 0x7f5e0809ac20 2024-09-11T23:03:56.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.044+0000 7f5dfffff640 1 -- 172.21.15.12:0/964247197 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e000b4760 con 0x7f5e0809ac20 2024-09-11T23:03:56.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.044+0000 7f5e0d9e0640 1 -- 172.21.15.12:0/964247197 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e0813a0e0 con 0x7f5e0809ac20 2024-09-11T23:03:56.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.044+0000 7f5e0d9e0640 1 -- 172.21.15.12:0/964247197 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e08134930 con 0x7f5e0809ac20 2024-09-11T23:03:56.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.044+0000 7f5dfffff640 1 -- 172.21.15.12:0/964247197 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5e000c5060 con 0x7f5e0809ac20 2024-09-11T23:03:56.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.044+0000 7f5dfffff640 1 --2- 172.21.15.12:0/964247197 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f5dec035db0 0x7f5dec038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:56.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.044+0000 7f5dfffff640 1 -- 172.21.15.12:0/964247197 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3439+0+0 (secure 0 0 0) 0x7f5e000e4ae0 con 0x7f5e0809ac20 2024-09-11T23:03:56.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.044+0000 7f5e067fc640 1 --2- 172.21.15.12:0/964247197 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f5dec035db0 0x7f5dec038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:56.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.044+0000 7f5e067fc640 1 --2- 172.21.15.12:0/964247197 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f5dec035db0 0x7f5dec038270 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5df0000f70 tx=0x7f5df0007a40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:56.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.048+0000 7f5dfffff640 1 -- 172.21.15.12:0/964247197 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5e00016620 con 0x7f5e0809ac20 2024-09-11T23:03:56.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.244+0000 7f5e0d9e0640 1 -- 172.21.15.12:0/964247197 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f5e08073870 con 0x7f5e0809ac20 2024-09-11T23:03:56.249 INFO:tasks.ceph.mon.a.smithi012.stderr:2024-09-11T23:03:56.244+0000 7fd71c996640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T23:03:56.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.244+0000 7f5dfffff640 1 -- 172.21.15.12:0/964247197 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) ==== 161+0+0 (secure 0 0 0) 0x7f5e000b3590 con 0x7f5e0809ac20 2024-09-11T23:03:56.251 INFO:teuthology.orchestra.run.smithi012.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T23:03:56.258 INFO:tasks.ceph.mds.b.smithi012.stderr: -1299> 2024-09-11T23:03:36.589+0000 7fef6baf9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T23:03:56.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.256+0000 7f5e0d9e0640 1 -- 172.21.15.12:0/964247197 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f5dec035db0 msgr2=0x7f5dec038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:56.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.256+0000 7f5e0d9e0640 1 --2- 172.21.15.12:0/964247197 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f5dec035db0 0x7f5dec038270 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5df0000f70 tx=0x7f5df0007a40 comp rx=0 tx=0).stop 2024-09-11T23:03:56.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.256+0000 7f5e0d9e0640 1 -- 172.21.15.12:0/964247197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e0809ac20 msgr2=0x7f5e08138480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:56.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.256+0000 7f5e0d9e0640 1 --2- 172.21.15.12:0/964247197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e0809ac20 0x7f5e08138480 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5e0001a660 tx=0x7f5e000197d0 comp rx=0 tx=0).stop 2024-09-11T23:03:56.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.256+0000 7f5e0d9e0640 1 -- 172.21.15.12:0/964247197 shutdown_connections 2024-09-11T23:03:56.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.256+0000 7f5e0d9e0640 1 --2- 172.21.15.12:0/964247197 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f5dec035db0 0x7f5dec038270 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:56.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.256+0000 7f5e0d9e0640 1 --2- 172.21.15.12:0/964247197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e0809ac20 0x7f5e08138480 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:56.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.256+0000 7f5e0d9e0640 1 -- 172.21.15.12:0/964247197 >> 172.21.15.12:0/964247197 conn(0x7f5e080a82f0 msgr2=0x7f5e080a5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:56.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.256+0000 7f5e0d9e0640 1 -- 172.21.15.12:0/964247197 shutdown_connections 2024-09-11T23:03:56.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.256+0000 7f5e0d9e0640 1 -- 172.21.15.12:0/964247197 wait complete. 2024-09-11T23:03:56.277 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-11T23:03:56.293 INFO:tasks.ceph.mds.b.smithi012.stdout:starting mds.b at 2024-09-11T23:03:56.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.396+0000 7f05c9c10640 1 Processor -- start 2024-09-11T23:03:56.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.396+0000 7f05c9c10640 1 -- start start 2024-09-11T23:03:56.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.396+0000 7f05c9c10640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f05c413e4a0 0x7f05c413e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:56.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.396+0000 7f05c9c10640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05c413edc0 con 0x7f05c40a19b0 2024-09-11T23:03:56.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.396+0000 7f05c9c10640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f05c413de40 con 0x7f05c413e4a0 2024-09-11T23:03:56.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.396+0000 7f05c37fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f05c413e4a0 0x7f05c413e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:56.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.396+0000 7f05c2ffd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f05c40a19b0 0x7f05c40a36a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:33742/0 (socket says 172.21.15.12:33742) 2024-09-11T23:03:56.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.396+0000 7f05c2ffd640 1 -- 172.21.15.12:0/3913827933 learned_addr learned my addr 172.21.15.12:0/3913827933 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:03:56.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.396+0000 7f05c37fe640 1 -- 172.21.15.12:0/3913827933 >> v1:172.21.15.12:6789/0 conn(0x7f05c40a19b0 legacy=0x7f05c40a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:56.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.396+0000 7f05c37fe640 1 -- 172.21.15.12:0/3913827933 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05c413e070 con 0x7f05c413e4a0 2024-09-11T23:03:56.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.396+0000 7f05c27fc640 1 -- 172.21.15.12:0/3913827933 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 19680658 0 0) 0x7f05c413edc0 con 0x7f05c40a19b0 2024-09-11T23:03:56.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.400+0000 7f05c37fe640 1 --2- 172.21.15.12:0/3913827933 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05c413e4a0 0x7f05c413e880 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f05ac009740 tx=0x7f05ac01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2550005bb94f9685 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:56.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.400+0000 7f05c27fc640 1 -- 172.21.15.12:0/3913827933 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05ac0b0070 con 0x7f05c413e4a0 2024-09-11T23:03:56.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.400+0000 7f05c27fc640 1 -- 172.21.15.12:0/3913827933 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05ac0ab530 con 0x7f05c413e4a0 2024-09-11T23:03:56.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.400+0000 7f05c27fc640 1 -- 172.21.15.12:0/3913827933 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05ac0ab830 con 0x7f05c413e4a0 2024-09-11T23:03:56.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.400+0000 7f05c9c10640 1 -- 172.21.15.12:0/3913827933 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05c413e4a0 msgr2=0x7f05c413e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:56.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.400+0000 7f05c9c10640 1 --2- 172.21.15.12:0/3913827933 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05c413e4a0 0x7f05c413e880 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f05ac009740 tx=0x7f05ac01c390 comp rx=0 tx=0).stop 2024-09-11T23:03:56.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.400+0000 7f05c9c10640 1 -- 172.21.15.12:0/3913827933 shutdown_connections 2024-09-11T23:03:56.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.400+0000 7f05c9c10640 1 --2- 172.21.15.12:0/3913827933 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05c413e4a0 0x7f05c413e880 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:56.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.400+0000 7f05c9c10640 1 -- 172.21.15.12:0/3913827933 >> 172.21.15.12:0/3913827933 conn(0x7f05c40a82f0 msgr2=0x7f05c40a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:56.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.400+0000 7f05c9c10640 1 -- 172.21.15.12:0/3913827933 shutdown_connections 2024-09-11T23:03:56.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.400+0000 7f05c9c10640 1 -- 172.21.15.12:0/3913827933 wait complete. 2024-09-11T23:03:56.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.400+0000 7f05c9c10640 1 Processor -- start 2024-09-11T23:03:56.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.400+0000 7f05c9c10640 1 -- start start 2024-09-11T23:03:56.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.400+0000 7f05c9c10640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05c40a19b0 0x7f05c41d27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:56.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.400+0000 7f05c9c10640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f05c4146360 con 0x7f05c40a19b0 2024-09-11T23:03:56.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.404+0000 7f05c37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05c40a19b0 0x7f05c41d27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:56.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.404+0000 7f05c37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05c40a19b0 0x7f05c41d27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57882/0 (socket says 172.21.15.12:57882) 2024-09-11T23:03:56.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.404+0000 7f05c37fe640 1 -- 172.21.15.12:0/2664384615 learned_addr learned my addr 172.21.15.12:0/2664384615 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:56.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.404+0000 7f05c37fe640 1 -- 172.21.15.12:0/2664384615 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05c41434e0 con 0x7f05c40a19b0 2024-09-11T23:03:56.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.404+0000 7f05c37fe640 1 --2- 172.21.15.12:0/2664384615 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05c40a19b0 0x7f05c41d27f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f05ac019fc0 tx=0x7f05ac01abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:56.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.404+0000 7f05bbfff640 1 -- 172.21.15.12:0/2664384615 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05ac0b0040 con 0x7f05c40a19b0 2024-09-11T23:03:56.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.404+0000 7f05bbfff640 1 -- 172.21.15.12:0/2664384615 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05ac0abe40 con 0x7f05c40a19b0 2024-09-11T23:03:56.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.404+0000 7f05c9c10640 1 -- 172.21.15.12:0/2664384615 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05c413c270 con 0x7f05c40a19b0 2024-09-11T23:03:56.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.404+0000 7f05bbfff640 1 -- 172.21.15.12:0/2664384615 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05ac0041a0 con 0x7f05c40a19b0 2024-09-11T23:03:56.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.404+0000 7f05c9c10640 1 -- 172.21.15.12:0/2664384615 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05c41d24e0 con 0x7f05c40a19b0 2024-09-11T23:03:56.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.404+0000 7f05bbfff640 1 -- 172.21.15.12:0/2664384615 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f05ac004340 con 0x7f05c40a19b0 2024-09-11T23:03:56.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.404+0000 7f05c9c10640 1 -- 172.21.15.12:0/2664384615 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05c4073880 con 0x7f05c40a19b0 2024-09-11T23:03:56.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.404+0000 7f05bbfff640 1 --2- 172.21.15.12:0/2664384615 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f05a4035db0 0x7f05a4038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:56.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.404+0000 7f05bbfff640 1 -- 172.21.15.12:0/2664384615 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3525+0+0 (secure 0 0 0) 0x7f05ac0e3450 con 0x7f05c40a19b0 2024-09-11T23:03:56.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.404+0000 7f05c2ffd640 1 --2- 172.21.15.12:0/2664384615 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f05a4035db0 0x7f05a4038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:56.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.404+0000 7f05c2ffd640 1 --2- 172.21.15.12:0/2664384615 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f05a4035db0 0x7f05a4038270 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f05b4007fd0 tx=0x7f05b4007920 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:56.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.408+0000 7f05bbfff640 1 -- 172.21.15.12:0/2664384615 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f05ac016010 con 0x7f05c40a19b0 2024-09-11T23:03:56.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:56.600+0000 7f05c9c10640 1 -- 172.21.15.12:0/2664384615 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f05c406bc60 con 0x7f05c40a19b0 2024-09-11T23:03:57.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.248+0000 7f05bbfff640 1 -- 172.21.15.12:0/2664384615 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) ==== 104+0+0 (secure 0 0 0) 0x7f05ac0c05c0 con 0x7f05c40a19b0 2024-09-11T23:03:57.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.252+0000 7f05c9c10640 1 -- 172.21.15.12:0/2664384615 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f05a4035db0 msgr2=0x7f05a4038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:57.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.252+0000 7f05c9c10640 1 --2- 172.21.15.12:0/2664384615 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f05a4035db0 0x7f05a4038270 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f05b4007fd0 tx=0x7f05b4007920 comp rx=0 tx=0).stop 2024-09-11T23:03:57.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.252+0000 7f05c9c10640 1 -- 172.21.15.12:0/2664384615 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05c40a19b0 msgr2=0x7f05c41d27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:57.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.252+0000 7f05c9c10640 1 --2- 172.21.15.12:0/2664384615 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05c40a19b0 0x7f05c41d27f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f05ac019fc0 tx=0x7f05ac01abd0 comp rx=0 tx=0).stop 2024-09-11T23:03:57.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.252+0000 7f05c9c10640 1 -- 172.21.15.12:0/2664384615 shutdown_connections 2024-09-11T23:03:57.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.252+0000 7f05c9c10640 1 --2- 172.21.15.12:0/2664384615 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f05a4035db0 0x7f05a4038270 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:57.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.252+0000 7f05c9c10640 1 --2- 172.21.15.12:0/2664384615 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05c40a19b0 0x7f05c41d27f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:57.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.252+0000 7f05c9c10640 1 -- 172.21.15.12:0/2664384615 >> 172.21.15.12:0/2664384615 conn(0x7f05c40a82f0 msgr2=0x7f05c413aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:57.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.252+0000 7f05c9c10640 1 -- 172.21.15.12:0/2664384615 shutdown_connections 2024-09-11T23:03:57.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.252+0000 7f05c9c10640 1 -- 172.21.15.12:0/2664384615 wait complete. 2024-09-11T23:03:57.277 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-11T23:03:57.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.448+0000 7f9e5643a640 1 Processor -- start 2024-09-11T23:03:57.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.448+0000 7f9e5643a640 1 -- start start 2024-09-11T23:03:57.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.448+0000 7f9e5643a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9e500a3c90 0x7f9e500a4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:57.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.448+0000 7f9e5643a640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e500a09c0 con 0x7f9e500a38b0 2024-09-11T23:03:57.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.448+0000 7f9e5643a640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f9e500a1330 con 0x7f9e500a3c90 2024-09-11T23:03:57.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.448+0000 7f9e4f7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9e500a3c90 0x7f9e500a4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:57.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.448+0000 7f9e4ffff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f9e500a38b0 0x7f9e5009ad90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:33746/0 (socket says 172.21.15.12:33746) 2024-09-11T23:03:57.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.448+0000 7f9e4ffff640 1 -- 172.21.15.12:0/517031434 learned_addr learned my addr 172.21.15.12:0/517031434 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:03:57.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.448+0000 7f9e4effd640 1 -- 172.21.15.12:0/517031434 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2722373693 0 0) 0x7f9e500a09c0 con 0x7f9e500a38b0 2024-09-11T23:03:57.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.448+0000 7f9e4effd640 1 -- 172.21.15.12:0/517031434 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e3c005740 con 0x7f9e500a38b0 2024-09-11T23:03:57.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.448+0000 7f9e4f7fe640 1 -- 172.21.15.12:0/517031434 >> v1:172.21.15.12:6789/0 conn(0x7f9e500a38b0 legacy=0x7f9e5009ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:57.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.448+0000 7f9e4f7fe640 1 -- 172.21.15.12:0/517031434 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e500a1ef0 con 0x7f9e500a3c90 2024-09-11T23:03:57.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.452+0000 7f9e4f7fe640 1 --2- 172.21.15.12:0/517031434 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e500a3c90 0x7f9e500a4100 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9e40009740 tx=0x7f9e4001c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bd55f185b57b6d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:57.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.452+0000 7f9e4effd640 1 -- 172.21.15.12:0/517031434 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e400b0070 con 0x7f9e500a3c90 2024-09-11T23:03:57.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.452+0000 7f9e4effd640 1 -- 172.21.15.12:0/517031434 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e400ab530 con 0x7f9e500a3c90 2024-09-11T23:03:57.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.452+0000 7f9e4effd640 1 -- 172.21.15.12:0/517031434 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e400ab810 con 0x7f9e500a3c90 2024-09-11T23:03:57.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.452+0000 7f9e5643a640 1 -- 172.21.15.12:0/517031434 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e500a3c90 msgr2=0x7f9e500a4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:57.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.452+0000 7f9e5643a640 1 --2- 172.21.15.12:0/517031434 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e500a3c90 0x7f9e500a4100 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9e40009740 tx=0x7f9e4001c390 comp rx=0 tx=0).stop 2024-09-11T23:03:57.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.452+0000 7f9e5643a640 1 -- 172.21.15.12:0/517031434 shutdown_connections 2024-09-11T23:03:57.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.452+0000 7f9e5643a640 1 --2- 172.21.15.12:0/517031434 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e500a3c90 0x7f9e500a4100 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:57.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.452+0000 7f9e5643a640 1 -- 172.21.15.12:0/517031434 >> 172.21.15.12:0/517031434 conn(0x7f9e500a85b0 msgr2=0x7f9e500a49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:57.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.452+0000 7f9e5643a640 1 -- 172.21.15.12:0/517031434 shutdown_connections 2024-09-11T23:03:57.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.452+0000 7f9e5643a640 1 -- 172.21.15.12:0/517031434 wait complete. 2024-09-11T23:03:57.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.452+0000 7f9e5643a640 1 Processor -- start 2024-09-11T23:03:57.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.452+0000 7f9e5643a640 1 -- start start 2024-09-11T23:03:57.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.452+0000 7f9e5643a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e500a38b0 0x7f9e5006ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:57.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.452+0000 7f9e5643a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9e5009ff40 con 0x7f9e500a38b0 2024-09-11T23:03:57.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.452+0000 7f9e4ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e500a38b0 0x7f9e5006ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:57.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.452+0000 7f9e4ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e500a38b0 0x7f9e5006ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57898/0 (socket says 172.21.15.12:57898) 2024-09-11T23:03:57.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.452+0000 7f9e4ffff640 1 -- 172.21.15.12:0/1490472946 learned_addr learned my addr 172.21.15.12:0/1490472946 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:57.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.452+0000 7f9e4ffff640 1 -- 172.21.15.12:0/1490472946 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e5013aab0 con 0x7f9e500a38b0 2024-09-11T23:03:57.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.456+0000 7f9e4ffff640 1 --2- 172.21.15.12:0/1490472946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e500a38b0 0x7f9e5006ecd0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9e3800c3d0 tx=0x7f9e3800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:57.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.456+0000 7f9e4cff9640 1 -- 172.21.15.12:0/1490472946 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e38017070 con 0x7f9e500a38b0 2024-09-11T23:03:57.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.456+0000 7f9e4cff9640 1 -- 172.21.15.12:0/1490472946 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e38005ce0 con 0x7f9e500a38b0 2024-09-11T23:03:57.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.456+0000 7f9e4cff9640 1 -- 172.21.15.12:0/1490472946 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e380070d0 con 0x7f9e500a38b0 2024-09-11T23:03:57.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.456+0000 7f9e5643a640 1 -- 172.21.15.12:0/1490472946 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e5006f210 con 0x7f9e500a38b0 2024-09-11T23:03:57.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.456+0000 7f9e5643a640 1 -- 172.21.15.12:0/1490472946 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e5012fa50 con 0x7f9e500a38b0 2024-09-11T23:03:57.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.456+0000 7f9e4cff9640 1 -- 172.21.15.12:0/1490472946 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9e3801a070 con 0x7f9e500a38b0 2024-09-11T23:03:57.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.456+0000 7f9e5643a640 1 -- 172.21.15.12:0/1490472946 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e50139e60 con 0x7f9e500a38b0 2024-09-11T23:03:57.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.456+0000 7f9e4cff9640 1 --2- 172.21.15.12:0/1490472946 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f9e30035db0 0x7f9e30038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:57.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.456+0000 7f9e4cff9640 1 -- 172.21.15.12:0/1490472946 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3525+0+0 (secure 0 0 0) 0x7f9e38047ae0 con 0x7f9e500a38b0 2024-09-11T23:03:57.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.456+0000 7f9e4f7fe640 1 --2- 172.21.15.12:0/1490472946 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f9e30035db0 0x7f9e30038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:57.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.456+0000 7f9e4f7fe640 1 --2- 172.21.15.12:0/1490472946 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f9e30035db0 0x7f9e30038270 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9e400ad000 tx=0x7f9e40008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:57.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.460+0000 7f9e4cff9640 1 -- 172.21.15.12:0/1490472946 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9e38019e10 con 0x7f9e500a38b0 2024-09-11T23:03:57.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:57.632+0000 7f9e5643a640 1 -- 172.21.15.12:0/1490472946 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9e50138f50 con 0x7f9e500a38b0 2024-09-11T23:03:58.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.596+0000 7f9e4cff9640 1 -- 172.21.15.12:0/1490472946 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v18) ==== 181+0+0 (secure 0 0 0) 0x7f9e38010b90 con 0x7f9e500a38b0 2024-09-11T23:03:58.604 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' removed 2024-09-11T23:03:58.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.600+0000 7f9e5643a640 1 -- 172.21.15.12:0/1490472946 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f9e30035db0 msgr2=0x7f9e30038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:58.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.600+0000 7f9e5643a640 1 --2- 172.21.15.12:0/1490472946 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f9e30035db0 0x7f9e30038270 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9e400ad000 tx=0x7f9e40008040 comp rx=0 tx=0).stop 2024-09-11T23:03:58.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.600+0000 7f9e5643a640 1 -- 172.21.15.12:0/1490472946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e500a38b0 msgr2=0x7f9e5006ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:58.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.600+0000 7f9e5643a640 1 --2- 172.21.15.12:0/1490472946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e500a38b0 0x7f9e5006ecd0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9e3800c3d0 tx=0x7f9e3800c890 comp rx=0 tx=0).stop 2024-09-11T23:03:58.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.600+0000 7f9e5643a640 1 -- 172.21.15.12:0/1490472946 shutdown_connections 2024-09-11T23:03:58.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.600+0000 7f9e5643a640 1 --2- 172.21.15.12:0/1490472946 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f9e30035db0 0x7f9e30038270 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:58.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.600+0000 7f9e5643a640 1 --2- 172.21.15.12:0/1490472946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e500a38b0 0x7f9e5006ecd0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:58.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.600+0000 7f9e5643a640 1 -- 172.21.15.12:0/1490472946 >> 172.21.15.12:0/1490472946 conn(0x7f9e500a85b0 msgr2=0x7f9e5013b610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:58.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.600+0000 7f9e5643a640 1 -- 172.21.15.12:0/1490472946 shutdown_connections 2024-09-11T23:03:58.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.600+0000 7f9e5643a640 1 -- 172.21.15.12:0/1490472946 wait complete. 2024-09-11T23:03:58.632 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-11T23:03:58.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.760+0000 7f21509cf640 1 Processor -- start 2024-09-11T23:03:58.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.760+0000 7f21509cf640 1 -- start start 2024-09-11T23:03:58.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.760+0000 7f21509cf640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f214c0a17f0 0x7f214c13ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:58.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.760+0000 7f21509cf640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f214c0a1e30 con 0x7f214c13a090 2024-09-11T23:03:58.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.760+0000 7f21509cf640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f214c0a10a0 con 0x7f214c0a17f0 2024-09-11T23:03:58.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.760+0000 7f2149d9b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f214c0a17f0 0x7f214c13ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:58.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.760+0000 7f214a59c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f214c13a090 0x7f214c13a470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:33756/0 (socket says 172.21.15.12:33756) 2024-09-11T23:03:58.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.760+0000 7f214a59c640 1 -- 172.21.15.12:0/582416146 learned_addr learned my addr 172.21.15.12:0/582416146 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:03:58.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.760+0000 7f214959a640 1 -- 172.21.15.12:0/582416146 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2209794579 0 0) 0x7f214c0a1e30 con 0x7f214c13a090 2024-09-11T23:03:58.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.760+0000 7f214959a640 1 -- 172.21.15.12:0/582416146 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2138003530 con 0x7f214c13a090 2024-09-11T23:03:58.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.760+0000 7f2149d9b640 1 -- 172.21.15.12:0/582416146 >> v1:172.21.15.12:6789/0 conn(0x7f214c13a090 legacy=0x7f214c13a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:58.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.760+0000 7f2149d9b640 1 -- 172.21.15.12:0/582416146 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f214c09f380 con 0x7f214c0a17f0 2024-09-11T23:03:58.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.764+0000 7f2149d9b640 1 --2- 172.21.15.12:0/582416146 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f214c0a17f0 0x7f214c13ef10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2134009740 tx=0x7f213401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e84f93fa5fbdb657 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:58.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.764+0000 7f214959a640 1 -- 172.21.15.12:0/582416146 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21340b0070 con 0x7f214c0a17f0 2024-09-11T23:03:58.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.764+0000 7f214959a640 1 -- 172.21.15.12:0/582416146 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21340ab530 con 0x7f214c0a17f0 2024-09-11T23:03:58.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.764+0000 7f214959a640 1 -- 172.21.15.12:0/582416146 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21340ab810 con 0x7f214c0a17f0 2024-09-11T23:03:58.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.764+0000 7f21509cf640 1 -- 172.21.15.12:0/582416146 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f214c0a17f0 msgr2=0x7f214c13ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:58.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.764+0000 7f21509cf640 1 --2- 172.21.15.12:0/582416146 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f214c0a17f0 0x7f214c13ef10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2134009740 tx=0x7f213401c390 comp rx=0 tx=0).stop 2024-09-11T23:03:58.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.764+0000 7f21509cf640 1 -- 172.21.15.12:0/582416146 shutdown_connections 2024-09-11T23:03:58.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.764+0000 7f21509cf640 1 --2- 172.21.15.12:0/582416146 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f214c0a17f0 0x7f214c13ef10 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:58.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.764+0000 7f21509cf640 1 -- 172.21.15.12:0/582416146 >> 172.21.15.12:0/582416146 conn(0x7f214c06da30 msgr2=0x7f214c06de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:58.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.764+0000 7f21509cf640 1 -- 172.21.15.12:0/582416146 shutdown_connections 2024-09-11T23:03:58.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.764+0000 7f21509cf640 1 -- 172.21.15.12:0/582416146 wait complete. 2024-09-11T23:03:58.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.764+0000 7f21509cf640 1 Processor -- start 2024-09-11T23:03:58.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.768+0000 7f21509cf640 1 -- start start 2024-09-11T23:03:58.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.768+0000 7f21509cf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f214c0a17f0 0x7f214c0a5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:58.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.768+0000 7f21509cf640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f214c141df0 con 0x7f214c0a17f0 2024-09-11T23:03:58.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.768+0000 7f214a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f214c0a17f0 0x7f214c0a5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:58.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.768+0000 7f214a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f214c0a17f0 0x7f214c0a5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57922/0 (socket says 172.21.15.12:57922) 2024-09-11T23:03:58.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.768+0000 7f214a59c640 1 -- 172.21.15.12:0/201576330 learned_addr learned my addr 172.21.15.12:0/201576330 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:58.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.768+0000 7f214a59c640 1 -- 172.21.15.12:0/201576330 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f214c0a5330 con 0x7f214c0a17f0 2024-09-11T23:03:58.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.768+0000 7f214a59c640 1 --2- 172.21.15.12:0/201576330 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f214c0a17f0 0x7f214c0a5cf0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f213c00cb40 tx=0x7f213c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:58.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.768+0000 7f2142ffd640 1 -- 172.21.15.12:0/201576330 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f213c017070 con 0x7f214c0a17f0 2024-09-11T23:03:58.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.768+0000 7f2142ffd640 1 -- 172.21.15.12:0/201576330 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f213c00abf0 con 0x7f214c0a17f0 2024-09-11T23:03:58.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.768+0000 7f2142ffd640 1 -- 172.21.15.12:0/201576330 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f213c012400 con 0x7f214c0a17f0 2024-09-11T23:03:58.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.768+0000 7f21509cf640 1 -- 172.21.15.12:0/201576330 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f214c0a6b80 con 0x7f214c0a17f0 2024-09-11T23:03:58.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.768+0000 7f21509cf640 1 -- 172.21.15.12:0/201576330 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f214c0a7b30 con 0x7f214c0a17f0 2024-09-11T23:03:58.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.768+0000 7f2142ffd640 1 -- 172.21.15.12:0/201576330 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f213c01a070 con 0x7f214c0a17f0 2024-09-11T23:03:58.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.768+0000 7f2142ffd640 1 --2- 172.21.15.12:0/201576330 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f212c035db0 0x7f212c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:58.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.768+0000 7f21509cf640 1 -- 172.21.15.12:0/201576330 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f214c0008e0 con 0x7f214c0a17f0 2024-09-11T23:03:58.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.768+0000 7f2142ffd640 1 -- 172.21.15.12:0/201576330 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3087+0+0 (secure 0 0 0) 0x7f213c048220 con 0x7f214c0a17f0 2024-09-11T23:03:58.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.768+0000 7f2149d9b640 1 --2- 172.21.15.12:0/201576330 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f212c035db0 0x7f212c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:58.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.768+0000 7f2149d9b640 1 --2- 172.21.15.12:0/201576330 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f212c035db0 0x7f212c038270 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f21340ad000 tx=0x7f21340a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:58.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.776+0000 7f2142ffd640 1 -- 172.21.15.12:0/201576330 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f213c01a520 con 0x7f214c0a17f0 2024-09-11T23:03:58.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:58.940+0000 7f21509cf640 1 -- 172.21.15.12:0/201576330 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f214c13a090 con 0x7f214c0a17f0 2024-09-11T23:03:59.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.600+0000 7f2142ffd640 1 -- 172.21.15.12:0/201576330 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v19) ==== 169+0+0 (secure 0 0 0) 0x7f213c0078c0 con 0x7f214c0a17f0 2024-09-11T23:03:59.604 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' removed 2024-09-11T23:03:59.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.604+0000 7f21509cf640 1 -- 172.21.15.12:0/201576330 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f212c035db0 msgr2=0x7f212c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:59.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.604+0000 7f21509cf640 1 --2- 172.21.15.12:0/201576330 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f212c035db0 0x7f212c038270 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f21340ad000 tx=0x7f21340a6000 comp rx=0 tx=0).stop 2024-09-11T23:03:59.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.604+0000 7f21509cf640 1 -- 172.21.15.12:0/201576330 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f214c0a17f0 msgr2=0x7f214c0a5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:59.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.604+0000 7f21509cf640 1 --2- 172.21.15.12:0/201576330 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f214c0a17f0 0x7f214c0a5cf0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f213c00cb40 tx=0x7f213c00a060 comp rx=0 tx=0).stop 2024-09-11T23:03:59.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.604+0000 7f21509cf640 1 -- 172.21.15.12:0/201576330 shutdown_connections 2024-09-11T23:03:59.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.604+0000 7f21509cf640 1 --2- 172.21.15.12:0/201576330 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f212c035db0 0x7f212c038270 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:59.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.604+0000 7f21509cf640 1 --2- 172.21.15.12:0/201576330 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f214c0a17f0 0x7f214c0a5cf0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:59.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.604+0000 7f21509cf640 1 -- 172.21.15.12:0/201576330 >> 172.21.15.12:0/201576330 conn(0x7f214c06da30 msgr2=0x7f214c09c280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:59.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.604+0000 7f21509cf640 1 -- 172.21.15.12:0/201576330 shutdown_connections 2024-09-11T23:03:59.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.604+0000 7f21509cf640 1 -- 172.21.15.12:0/201576330 wait complete. 2024-09-11T23:03:59.639 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-11T23:03:59.639 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-11T23:03:59.639 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-11T23:03:59.639 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:03:59.639 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-11T23:03:59.640 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-11T23:03:59.640 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-11T23:03:59.640 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:03:59.651 INFO:tasks.ceph.mds.b:Stopped 2024-09-11T23:03:59.652 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-11T23:03:59.653 INFO:tasks.ceph.mds.a:Stopped 2024-09-11T23:03:59.653 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-11T23:03:59.697 INFO:tasks.ceph.mds.b:Started 2024-09-11T23:03:59.697 DEBUG:teuthology.parallel:result is None 2024-09-11T23:03:59.698 INFO:tasks.ceph.mds.a:Started 2024-09-11T23:03:59.698 DEBUG:teuthology.parallel:result is None 2024-09-11T23:03:59.698 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-11T23:03:59.763 INFO:tasks.ceph.mds.a.smithi012.stdout:starting mds.a at 2024-09-11T23:03:59.769 INFO:tasks.ceph.mds.b.smithi012.stdout:starting mds.b at 2024-09-11T23:03:59.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.812+0000 7fe04db2e640 1 Processor -- start 2024-09-11T23:03:59.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.812+0000 7fe04db2e640 1 -- start start 2024-09-11T23:03:59.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.812+0000 7fe04db2e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe0480a0bb0 0x7fe04813cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:59.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.812+0000 7fe04db2e640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe048073d70 con 0x7fe048137db0 2024-09-11T23:03:59.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.812+0000 7fe04db2e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fe04809ff80 con 0x7fe0480a0bb0 2024-09-11T23:03:59.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.812+0000 7fe046ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe0480a0bb0 0x7fe04813cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:59.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.812+0000 7fe0477fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe048137db0 0x7fe048138190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:33780/0 (socket says 172.21.15.12:33780) 2024-09-11T23:03:59.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.812+0000 7fe0477fe640 1 -- 172.21.15.12:0/2200960411 learned_addr learned my addr 172.21.15.12:0/2200960411 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:03:59.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.812+0000 7fe046ffd640 1 -- 172.21.15.12:0/2200960411 >> v1:172.21.15.12:6789/0 conn(0x7fe048137db0 legacy=0x7fe048138190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:59.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.812+0000 7fe046ffd640 1 -- 172.21.15.12:0/2200960411 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe04809fc00 con 0x7fe0480a0bb0 2024-09-11T23:03:59.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.812+0000 7fe0467fc640 1 -- 172.21.15.12:0/2200960411 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2174994631 0 0) 0x7fe048073d70 con 0x7fe048137db0 2024-09-11T23:03:59.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.816+0000 7fe046ffd640 1 --2- 172.21.15.12:0/2200960411 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0480a0bb0 0x7fe04813cc70 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe03c009740 tx=0x7fe03c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6487b8db02d52fab server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:59.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.816+0000 7fe0467fc640 1 -- 172.21.15.12:0/2200960411 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe03c0b0070 con 0x7fe0480a0bb0 2024-09-11T23:03:59.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.816+0000 7fe0467fc640 1 -- 172.21.15.12:0/2200960411 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe03c0ab530 con 0x7fe0480a0bb0 2024-09-11T23:03:59.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.816+0000 7fe0467fc640 1 -- 172.21.15.12:0/2200960411 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe03c0ab830 con 0x7fe0480a0bb0 2024-09-11T23:03:59.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.816+0000 7fe04db2e640 1 -- 172.21.15.12:0/2200960411 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0480a0bb0 msgr2=0x7fe04813cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:03:59.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.816+0000 7fe04db2e640 1 --2- 172.21.15.12:0/2200960411 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0480a0bb0 0x7fe04813cc70 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe03c009740 tx=0x7fe03c01c420 comp rx=0 tx=0).stop 2024-09-11T23:03:59.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.816+0000 7fe04db2e640 1 -- 172.21.15.12:0/2200960411 shutdown_connections 2024-09-11T23:03:59.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.816+0000 7fe04db2e640 1 --2- 172.21.15.12:0/2200960411 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0480a0bb0 0x7fe04813cc70 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:03:59.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.816+0000 7fe04db2e640 1 -- 172.21.15.12:0/2200960411 >> 172.21.15.12:0/2200960411 conn(0x7fe04809aba0 msgr2=0x7fe04809afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:03:59.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.816+0000 7fe04db2e640 1 -- 172.21.15.12:0/2200960411 shutdown_connections 2024-09-11T23:03:59.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.816+0000 7fe04db2e640 1 -- 172.21.15.12:0/2200960411 wait complete. 2024-09-11T23:03:59.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.816+0000 7fe04db2e640 1 Processor -- start 2024-09-11T23:03:59.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.816+0000 7fe04db2e640 1 -- start start 2024-09-11T23:03:59.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.820+0000 7fe04db2e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0480a0bb0 0x7fe0480a1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:59.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.820+0000 7fe04db2e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe0480739b0 con 0x7fe0480a0bb0 2024-09-11T23:03:59.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.820+0000 7fe0477fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0480a0bb0 0x7fe0480a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:59.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.820+0000 7fe0477fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0480a0bb0 0x7fe0480a1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57990/0 (socket says 172.21.15.12:57990) 2024-09-11T23:03:59.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.820+0000 7fe0477fe640 1 -- 172.21.15.12:0/2058440015 learned_addr learned my addr 172.21.15.12:0/2058440015 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:03:59.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.820+0000 7fe0477fe640 1 -- 172.21.15.12:0/2058440015 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0480a8f80 con 0x7fe0480a0bb0 2024-09-11T23:03:59.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.820+0000 7fe0477fe640 1 --2- 172.21.15.12:0/2058440015 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0480a0bb0 0x7fe0480a1580 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe03800c450 tx=0x7fe03800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:59.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.820+0000 7fe02ffff640 1 -- 172.21.15.12:0/2058440015 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe038005c20 con 0x7fe0480a0bb0 2024-09-11T23:03:59.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.820+0000 7fe02ffff640 1 -- 172.21.15.12:0/2058440015 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe038005dc0 con 0x7fe0480a0bb0 2024-09-11T23:03:59.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.820+0000 7fe04db2e640 1 -- 172.21.15.12:0/2058440015 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0480a5380 con 0x7fe0480a0bb0 2024-09-11T23:03:59.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.820+0000 7fe02ffff640 1 -- 172.21.15.12:0/2058440015 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0380071a0 con 0x7fe0480a0bb0 2024-09-11T23:03:59.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.820+0000 7fe04db2e640 1 -- 172.21.15.12:0/2058440015 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0480a3d60 con 0x7fe0480a0bb0 2024-09-11T23:03:59.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.820+0000 7fe04db2e640 1 -- 172.21.15.12:0/2058440015 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0480a3480 con 0x7fe0480a0bb0 2024-09-11T23:03:59.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.820+0000 7fe02ffff640 1 -- 172.21.15.12:0/2058440015 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe038007400 con 0x7fe0480a0bb0 2024-09-11T23:03:59.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.820+0000 7fe02ffff640 1 --2- 172.21.15.12:0/2058440015 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fe034035d60 0x7fe034038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:03:59.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.820+0000 7fe02ffff640 1 -- 172.21.15.12:0/2058440015 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 2673+0+0 (secure 0 0 0) 0x7fe038048060 con 0x7fe0480a0bb0 2024-09-11T23:03:59.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.820+0000 7fe046ffd640 1 --2- 172.21.15.12:0/2058440015 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fe034035d60 0x7fe034038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:03:59.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.820+0000 7fe046ffd640 1 --2- 172.21.15.12:0/2058440015 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fe034035d60 0x7fe034038220 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe03c0ad000 tx=0x7fe03c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:03:59.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:03:59.824+0000 7fe02ffff640 1 -- 172.21.15.12:0/2058440015 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe0380182b0 con 0x7fe0480a0bb0 2024-09-11T23:04:00.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.012+0000 7fe04db2e640 1 -- 172.21.15.12:0/2058440015 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fe0480a57c0 con 0x7fe0480a0bb0 2024-09-11T23:04:00.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.616+0000 7fe02ffff640 1 -- 172.21.15.12:0/2058440015 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v21) ==== 97+0+0 (secure 0 0 0) 0x7fe03801bca0 con 0x7fe0480a0bb0 2024-09-11T23:04:00.621 INFO:teuthology.orchestra.run.smithi012.stderr: removed all blocklist entries 2024-09-11T23:04:00.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.620+0000 7fe04db2e640 1 -- 172.21.15.12:0/2058440015 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fe034035d60 msgr2=0x7fe034038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:00.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.620+0000 7fe04db2e640 1 --2- 172.21.15.12:0/2058440015 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fe034035d60 0x7fe034038220 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe03c0ad000 tx=0x7fe03c008040 comp rx=0 tx=0).stop 2024-09-11T23:04:00.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.620+0000 7fe04db2e640 1 -- 172.21.15.12:0/2058440015 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0480a0bb0 msgr2=0x7fe0480a1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:00.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.620+0000 7fe04db2e640 1 --2- 172.21.15.12:0/2058440015 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0480a0bb0 0x7fe0480a1580 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe03800c450 tx=0x7fe03800c910 comp rx=0 tx=0).stop 2024-09-11T23:04:00.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.620+0000 7fe04db2e640 1 -- 172.21.15.12:0/2058440015 shutdown_connections 2024-09-11T23:04:00.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.620+0000 7fe04db2e640 1 --2- 172.21.15.12:0/2058440015 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fe034035d60 0x7fe034038220 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:00.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.620+0000 7fe04db2e640 1 --2- 172.21.15.12:0/2058440015 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0480a0bb0 0x7fe0480a1580 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:00.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.620+0000 7fe04db2e640 1 -- 172.21.15.12:0/2058440015 >> 172.21.15.12:0/2058440015 conn(0x7fe04809aba0 msgr2=0x7fe048070190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:00.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.620+0000 7fe04db2e640 1 -- 172.21.15.12:0/2058440015 shutdown_connections 2024-09-11T23:04:00.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.620+0000 7fe04db2e640 1 -- 172.21.15.12:0/2058440015 wait complete. 2024-09-11T23:04:00.648 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-11T23:04:00.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.768+0000 7f03654b9640 1 Processor -- start 2024-09-11T23:04:00.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.768+0000 7f03654b9640 1 -- start start 2024-09-11T23:04:00.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.768+0000 7f03654b9640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f03600a0bc0 0x7f036013ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:00.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.768+0000 7f03654b9640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0360139d60 con 0x7f036013a220 2024-09-11T23:04:00.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.768+0000 7f03654b9640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f0360072c90 con 0x7f03600a0bc0 2024-09-11T23:04:00.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.768+0000 7f035e7fc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f03600a0bc0 0x7f036013ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:00.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.768+0000 7f035e7fc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f03600a0bc0 0x7f036013ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58000/0 (socket says 172.21.15.12:58000) 2024-09-11T23:04:00.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.768+0000 7f035e7fc640 1 -- 172.21.15.12:0/3626787341 learned_addr learned my addr 172.21.15.12:0/3626787341 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:00.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.768+0000 7f035e7fc640 1 -- 172.21.15.12:0/3626787341 >> v1:172.21.15.12:6789/0 conn(0x7f036013a220 legacy=0x7f036013a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:00.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.768+0000 7f035e7fc640 1 -- 172.21.15.12:0/3626787341 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f036009fc10 con 0x7f03600a0bc0 2024-09-11T23:04:00.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.768+0000 7f035e7fc640 1 --2- 172.21.15.12:0/3626787341 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03600a0bc0 0x7f036013ef70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0360139f30 tx=0x7f035401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f27f4ac03c0fe806 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:00.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.768+0000 7f035dffb640 1 -- 172.21.15.12:0/3626787341 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03540b0070 con 0x7f03600a0bc0 2024-09-11T23:04:00.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.768+0000 7f035dffb640 1 -- 172.21.15.12:0/3626787341 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03540ab400 con 0x7f03600a0bc0 2024-09-11T23:04:00.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.768+0000 7f035dffb640 1 -- 172.21.15.12:0/3626787341 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03540ab700 con 0x7f03600a0bc0 2024-09-11T23:04:00.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.768+0000 7f03654b9640 1 -- 172.21.15.12:0/3626787341 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03600a0bc0 msgr2=0x7f036013ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:00.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.768+0000 7f03654b9640 1 --2- 172.21.15.12:0/3626787341 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03600a0bc0 0x7f036013ef70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0360139f30 tx=0x7f035401c430 comp rx=0 tx=0).stop 2024-09-11T23:04:00.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.768+0000 7f03654b9640 1 -- 172.21.15.12:0/3626787341 shutdown_connections 2024-09-11T23:04:00.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.768+0000 7f03654b9640 1 --2- 172.21.15.12:0/3626787341 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03600a0bc0 0x7f036013ef70 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:00.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.768+0000 7f03654b9640 1 -- 172.21.15.12:0/3626787341 >> 172.21.15.12:0/3626787341 conn(0x7f03600a8450 msgr2=0x7f03600a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:00.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.768+0000 7f03654b9640 1 -- 172.21.15.12:0/3626787341 shutdown_connections 2024-09-11T23:04:00.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.768+0000 7f03654b9640 1 -- 172.21.15.12:0/3626787341 wait complete. 2024-09-11T23:04:00.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.772+0000 7f03654b9640 1 Processor -- start 2024-09-11T23:04:00.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.772+0000 7f03654b9640 1 -- start start 2024-09-11T23:04:00.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.772+0000 7f03654b9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03600a0bc0 0x7f0360133780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:00.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.772+0000 7f03654b9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0360142060 con 0x7f03600a0bc0 2024-09-11T23:04:00.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.772+0000 7f035effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03600a0bc0 0x7f0360133780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:00.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.772+0000 7f035effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03600a0bc0 0x7f0360133780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58016/0 (socket says 172.21.15.12:58016) 2024-09-11T23:04:00.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.772+0000 7f035effd640 1 -- 172.21.15.12:0/514295903 learned_addr learned my addr 172.21.15.12:0/514295903 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:00.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.772+0000 7f035effd640 1 -- 172.21.15.12:0/514295903 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f036009e030 con 0x7f03600a0bc0 2024-09-11T23:04:00.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.772+0000 7f035effd640 1 --2- 172.21.15.12:0/514295903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03600a0bc0 0x7f0360133780 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f035000c480 tx=0x7f035000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:00.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.772+0000 7f03477fe640 1 -- 172.21.15.12:0/514295903 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0350005150 con 0x7f03600a0bc0 2024-09-11T23:04:00.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.772+0000 7f03477fe640 1 -- 172.21.15.12:0/514295903 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03500052f0 con 0x7f03600a0bc0 2024-09-11T23:04:00.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.772+0000 7f03654b9640 1 -- 172.21.15.12:0/514295903 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f036009d5b0 con 0x7f03600a0bc0 2024-09-11T23:04:00.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.772+0000 7f03477fe640 1 -- 172.21.15.12:0/514295903 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0350007030 con 0x7f03600a0bc0 2024-09-11T23:04:00.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.772+0000 7f03654b9640 1 -- 172.21.15.12:0/514295903 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f036009d2a0 con 0x7f03600a0bc0 2024-09-11T23:04:00.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.772+0000 7f03654b9640 1 -- 172.21.15.12:0/514295903 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f036009d7d0 con 0x7f03600a0bc0 2024-09-11T23:04:00.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.772+0000 7f03477fe640 1 -- 172.21.15.12:0/514295903 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0350019020 con 0x7f03600a0bc0 2024-09-11T23:04:00.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.772+0000 7f03477fe640 1 --2- 172.21.15.12:0/514295903 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f034c035db0 0x7f034c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:00.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.772+0000 7f03477fe640 1 -- 172.21.15.12:0/514295903 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 2587+0+0 (secure 0 0 0) 0x7f0350047570 con 0x7f03600a0bc0 2024-09-11T23:04:00.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.772+0000 7f035e7fc640 1 --2- 172.21.15.12:0/514295903 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f034c035db0 0x7f034c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:00.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.772+0000 7f035e7fc640 1 --2- 172.21.15.12:0/514295903 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f034c035db0 0x7f034c038270 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f036013ad10 tx=0x7f03540a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:00.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.776+0000 7f03477fe640 1 -- 172.21.15.12:0/514295903 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f035001a560 con 0x7f03600a0bc0 2024-09-11T23:04:01.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.996+0000 7f03654b9640 1 -- 172.21.15.12:0/514295903 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f036006bc60 con 0x7f03600a0bc0 2024-09-11T23:04:01.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:00.996+0000 7f03477fe640 1 -- 172.21.15.12:0/514295903 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) ==== 80+0+3875 (secure 0 0 0) 0x7f035001a780 con 0x7f03600a0bc0 2024-09-11T23:04:01.002 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:04:01.002 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T23:04:01.003 INFO:teuthology.orchestra.run.smithi012.stdout: "auth_dump": [ 2024-09-11T23:04:01.003 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:04:01.003 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.a", 2024-09-11T23:04:01.003 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCgIeJmhYe5CRAAlzmzDPKc12SodkPehqtl6w==", 2024-09-11T23:04:01.003 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-11T23:04:01.003 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2024-09-11T23:04:01.003 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2024-09-11T23:04:01.003 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2024-09-11T23:04:01.003 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-09-11T23:04:01.003 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:04:01.003 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:01.003 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:04:01.003 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.b", 2024-09-11T23:04:01.004 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCgIeJmnvKREhAAp9c3Qvihpy4qTm50E9U26Q==", 2024-09-11T23:04:01.004 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-11T23:04:01.004 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2024-09-11T23:04:01.004 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2024-09-11T23:04:01.004 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2024-09-11T23:04:01.004 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-09-11T23:04:01.004 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:04:01.004 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:01.004 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:04:01.004 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.0", 2024-09-11T23:04:01.004 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCiIeJmy2qOLxAARUVUTFfFVrdRIhNhThjbTw==", 2024-09-11T23:04:01.004 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-11T23:04:01.004 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2024-09-11T23:04:01.004 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2024-09-11T23:04:01.005 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-09-11T23:04:01.005 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:04:01.005 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:01.005 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:04:01.005 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.1", 2024-09-11T23:04:01.005 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCmIeJmuc99HxAA0QxYJ1hvAsHb4uZPlh9GdA==", 2024-09-11T23:04:01.005 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-11T23:04:01.005 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2024-09-11T23:04:01.005 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2024-09-11T23:04:01.005 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-09-11T23:04:01.005 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:04:01.005 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:01.005 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:04:01.005 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.2", 2024-09-11T23:04:01.006 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCpIeJmBDhCMBAAipbJzeGy0AughJ+PfcX8ZA==", 2024-09-11T23:04:01.006 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-11T23:04:01.006 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2024-09-11T23:04:01.006 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2024-09-11T23:04:01.006 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-09-11T23:04:01.006 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:04:01.006 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:01.006 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:04:01.006 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.0", 2024-09-11T23:04:01.006 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCgIeJmTz6nGhAAveLcJxI+RD0GsD9nnR2S/w==", 2024-09-11T23:04:01.006 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-11T23:04:01.006 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2024-09-11T23:04:01.006 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow r", 2024-09-11T23:04:01.006 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow rw", 2024-09-11T23:04:01.007 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rwx" 2024-09-11T23:04:01.007 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:04:01.007 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:01.007 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:04:01.007 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.1", 2024-09-11T23:04:01.007 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCgIeJmkfu2HxAAKhML2j7GrGF1q/7cuNJtSA==", 2024-09-11T23:04:01.007 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-11T23:04:01.007 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2024-09-11T23:04:01.007 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow r", 2024-09-11T23:04:01.007 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow rw", 2024-09-11T23:04:01.007 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rwx" 2024-09-11T23:04:01.007 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:04:01.007 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:01.008 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:04:01.008 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.admin", 2024-09-11T23:04:01.008 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCfIeJml/f1MBAAdf0RuoLeBB0rcTxgaS2N3w==", 2024-09-11T23:04:01.008 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-11T23:04:01.008 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2024-09-11T23:04:01.008 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2024-09-11T23:04:01.008 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2024-09-11T23:04:01.008 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-09-11T23:04:01.008 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:04:01.008 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:01.008 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:04:01.008 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.bootstrap-mds", 2024-09-11T23:04:01.008 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCuIeJmC1b+JBAAfScc8iOWYSiQUGfwgw4gpQ==", 2024-09-11T23:04:01.008 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-11T23:04:01.009 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile bootstrap-mds" 2024-09-11T23:04:01.009 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:04:01.009 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:01.009 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:04:01.009 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.bootstrap-mgr", 2024-09-11T23:04:01.009 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCuIeJmN1/+JBAAexqJJJIietXWY+5YExZ8kQ==", 2024-09-11T23:04:01.009 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-11T23:04:01.009 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-11T23:04:01.009 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:04:01.009 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:01.009 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:04:01.009 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.bootstrap-osd", 2024-09-11T23:04:01.009 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCuIeJmzGf+JBAAXX15SVzFKE/6GvzlqiUe5A==", 2024-09-11T23:04:01.009 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-11T23:04:01.010 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile bootstrap-osd" 2024-09-11T23:04:01.010 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:04:01.010 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:01.010 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:04:01.010 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.bootstrap-rbd", 2024-09-11T23:04:01.010 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCuIeJmAnD+JBAA1Xeddmmq78cZjn2l3YH2xw==", 2024-09-11T23:04:01.010 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-11T23:04:01.010 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-11T23:04:01.010 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:04:01.010 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:01.010 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:04:01.010 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-11T23:04:01.010 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCuIeJmT3j+JBAAj6v0UW321P6KGp3Zznw80A==", 2024-09-11T23:04:01.010 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-11T23:04:01.010 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-11T23:04:01.011 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:04:01.011 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:01.011 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:04:01.011 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.bootstrap-rgw", 2024-09-11T23:04:01.011 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCuIeJmeoD+JBAAQrkyJoX8iTSp64K5kLLISA==", 2024-09-11T23:04:01.011 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-11T23:04:01.011 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-11T23:04:01.011 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:04:01.011 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:01.012 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:04:01.012 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.x", 2024-09-11T23:04:01.012 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCgIeJmgNCCBBAAS9gR6zgZL5ZX8chT2/0RUw==", 2024-09-11T23:04:01.012 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-11T23:04:01.012 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2024-09-11T23:04:01.012 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2024-09-11T23:04:01.012 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-09-11T23:04:01.012 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:04:01.012 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:04:01.012 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T23:04:01.012 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T23:04:01.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.000+0000 7f03654b9640 1 -- 172.21.15.12:0/514295903 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f034c035db0 msgr2=0x7f034c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:01.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.000+0000 7f03654b9640 1 --2- 172.21.15.12:0/514295903 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f034c035db0 0x7f034c038270 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f036013ad10 tx=0x7f03540a6000 comp rx=0 tx=0).stop 2024-09-11T23:04:01.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.000+0000 7f03654b9640 1 -- 172.21.15.12:0/514295903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03600a0bc0 msgr2=0x7f0360133780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:01.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.000+0000 7f03654b9640 1 --2- 172.21.15.12:0/514295903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03600a0bc0 0x7f0360133780 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f035000c480 tx=0x7f035000c940 comp rx=0 tx=0).stop 2024-09-11T23:04:01.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.000+0000 7f03654b9640 1 -- 172.21.15.12:0/514295903 shutdown_connections 2024-09-11T23:04:01.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.000+0000 7f03654b9640 1 --2- 172.21.15.12:0/514295903 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f034c035db0 0x7f034c038270 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:01.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.000+0000 7f03654b9640 1 --2- 172.21.15.12:0/514295903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03600a0bc0 0x7f0360133780 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:01.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.000+0000 7f03654b9640 1 -- 172.21.15.12:0/514295903 >> 172.21.15.12:0/514295903 conn(0x7f03600a8450 msgr2=0x7f03600a3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:01.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.000+0000 7f03654b9640 1 -- 172.21.15.12:0/514295903 shutdown_connections 2024-09-11T23:04:01.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.000+0000 7f03654b9640 1 -- 172.21.15.12:0/514295903 wait complete. 2024-09-11T23:04:01.022 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-11T23:04:01.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.140+0000 7fdc4701f640 1 Processor -- start 2024-09-11T23:04:01.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.140+0000 7fdc4701f640 1 -- start start 2024-09-11T23:04:01.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.140+0000 7fdc4701f640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdc4013a200 0x7fdc4013a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:01.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.140+0000 7fdc4701f640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc400a1c00 con 0x7fdc4009fc40 2024-09-11T23:04:01.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.140+0000 7fdc4701f640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fdc400a0e40 con 0x7fdc4013a200 2024-09-11T23:04:01.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.140+0000 7fdc44dbb640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdc4013a200 0x7fdc4013a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:01.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.140+0000 7fdc44dbb640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdc4013a200 0x7fdc4013a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58018/0 (socket says 172.21.15.12:58018) 2024-09-11T23:04:01.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.140+0000 7fdc3ffff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fdc4009fc40 0x7fdc4009d9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:33796/0 (socket says 172.21.15.12:33796) 2024-09-11T23:04:01.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.140+0000 7fdc44dbb640 1 -- 172.21.15.12:0/1229321988 learned_addr learned my addr 172.21.15.12:0/1229321988 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:01.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.140+0000 7fdc44dbb640 1 -- 172.21.15.12:0/1229321988 >> v1:172.21.15.12:6789/0 conn(0x7fdc4009fc40 legacy=0x7fdc4009d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:01.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.140+0000 7fdc44dbb640 1 -- 172.21.15.12:0/1229321988 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc4013ab20 con 0x7fdc4013a200 2024-09-11T23:04:01.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.140+0000 7fdc44dbb640 1 --2- 172.21.15.12:0/1229321988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc4013a200 0x7fdc4013a5e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fdc300097f0 tx=0x7fdc3001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=633158ad6ca5d6ff server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:01.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.140+0000 7fdc3f7fe640 1 -- 172.21.15.12:0/1229321988 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc300b0070 con 0x7fdc4013a200 2024-09-11T23:04:01.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.140+0000 7fdc3f7fe640 1 -- 172.21.15.12:0/1229321988 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc300ab530 con 0x7fdc4013a200 2024-09-11T23:04:01.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.140+0000 7fdc3f7fe640 1 -- 172.21.15.12:0/1229321988 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc300ab830 con 0x7fdc4013a200 2024-09-11T23:04:01.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.140+0000 7fdc4701f640 1 -- 172.21.15.12:0/1229321988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc4013a200 msgr2=0x7fdc4013a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:01.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.140+0000 7fdc4701f640 1 --2- 172.21.15.12:0/1229321988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc4013a200 0x7fdc4013a5e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fdc300097f0 tx=0x7fdc3001c450 comp rx=0 tx=0).stop 2024-09-11T23:04:01.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.140+0000 7fdc4701f640 1 -- 172.21.15.12:0/1229321988 shutdown_connections 2024-09-11T23:04:01.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.140+0000 7fdc4701f640 1 --2- 172.21.15.12:0/1229321988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc4013a200 0x7fdc4013a5e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:01.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.140+0000 7fdc4701f640 1 -- 172.21.15.12:0/1229321988 >> 172.21.15.12:0/1229321988 conn(0x7fdc4006da30 msgr2=0x7fdc4006de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:01.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.140+0000 7fdc4701f640 1 -- 172.21.15.12:0/1229321988 shutdown_connections 2024-09-11T23:04:01.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.140+0000 7fdc4701f640 1 -- 172.21.15.12:0/1229321988 wait complete. 2024-09-11T23:04:01.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.140+0000 7fdc4701f640 1 Processor -- start 2024-09-11T23:04:01.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.140+0000 7fdc4701f640 1 -- start start 2024-09-11T23:04:01.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.144+0000 7fdc4701f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc4013a200 0x7fdc400a55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:01.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.144+0000 7fdc4701f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fdc400a17c0 con 0x7fdc4013a200 2024-09-11T23:04:01.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.144+0000 7fdc44dbb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc4013a200 0x7fdc400a55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:01.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.144+0000 7fdc44dbb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc4013a200 0x7fdc400a55f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58034/0 (socket says 172.21.15.12:58034) 2024-09-11T23:04:01.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.144+0000 7fdc44dbb640 1 -- 172.21.15.12:0/575795244 learned_addr learned my addr 172.21.15.12:0/575795244 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:01.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.144+0000 7fdc44dbb640 1 -- 172.21.15.12:0/575795244 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc401d1a50 con 0x7fdc4013a200 2024-09-11T23:04:01.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.144+0000 7fdc44dbb640 1 --2- 172.21.15.12:0/575795244 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc4013a200 0x7fdc400a55f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fdc3001a080 tx=0x7fdc3001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:01.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.144+0000 7fdc3d7fa640 1 -- 172.21.15.12:0/575795244 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc300ba020 con 0x7fdc4013a200 2024-09-11T23:04:01.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.144+0000 7fdc3d7fa640 1 -- 172.21.15.12:0/575795244 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc300b6420 con 0x7fdc4013a200 2024-09-11T23:04:01.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.144+0000 7fdc3d7fa640 1 -- 172.21.15.12:0/575795244 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc300b0040 con 0x7fdc4013a200 2024-09-11T23:04:01.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.144+0000 7fdc4701f640 1 -- 172.21.15.12:0/575795244 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc400a6670 con 0x7fdc4013a200 2024-09-11T23:04:01.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.144+0000 7fdc4701f640 1 -- 172.21.15.12:0/575795244 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc400a6360 con 0x7fdc4013a200 2024-09-11T23:04:01.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.144+0000 7fdc4701f640 1 -- 172.21.15.12:0/575795244 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc400a0530 con 0x7fdc4013a200 2024-09-11T23:04:01.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.144+0000 7fdc3d7fa640 1 -- 172.21.15.12:0/575795244 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdc300bd020 con 0x7fdc4013a200 2024-09-11T23:04:01.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.144+0000 7fdc3d7fa640 1 --2- 172.21.15.12:0/575795244 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fdc24035db0 0x7fdc24038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:01.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.144+0000 7fdc3d7fa640 1 -- 172.21.15.12:0/575795244 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 2587+0+0 (secure 0 0 0) 0x7fdc300a4e00 con 0x7fdc4013a200 2024-09-11T23:04:01.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.144+0000 7fdc3ffff640 1 --2- 172.21.15.12:0/575795244 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fdc24035db0 0x7fdc24038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:01.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.144+0000 7fdc3ffff640 1 --2- 172.21.15.12:0/575795244 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fdc24035db0 0x7fdc24038270 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdc38001d00 tx=0x7fdc38007dd0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:01.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.148+0000 7fdc3d7fa640 1 -- 172.21.15.12:0/575795244 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fdc300c4030 con 0x7fdc4013a200 2024-09-11T23:04:01.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.376+0000 7fdc4701f640 1 -- 172.21.15.12:0/575795244 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7fdc4013a660 con 0x7fdc4013a200 2024-09-11T23:04:01.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.380+0000 7fdc3d7fa640 1 -- 172.21.15.12:0/575795244 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) ==== 90+0+0 (secure 0 0 0) 0x7fdc300160d0 con 0x7fdc4013a200 2024-09-11T23:04:01.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.380+0000 7fdc4701f640 1 -- 172.21.15.12:0/575795244 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fdc24035db0 msgr2=0x7fdc24038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:01.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.380+0000 7fdc4701f640 1 --2- 172.21.15.12:0/575795244 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fdc24035db0 0x7fdc24038270 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdc38001d00 tx=0x7fdc38007dd0 comp rx=0 tx=0).stop 2024-09-11T23:04:01.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.380+0000 7fdc4701f640 1 -- 172.21.15.12:0/575795244 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc4013a200 msgr2=0x7fdc400a55f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:01.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.380+0000 7fdc4701f640 1 --2- 172.21.15.12:0/575795244 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc4013a200 0x7fdc400a55f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fdc3001a080 tx=0x7fdc3001ac90 comp rx=0 tx=0).stop 2024-09-11T23:04:01.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.380+0000 7fdc4701f640 1 -- 172.21.15.12:0/575795244 shutdown_connections 2024-09-11T23:04:01.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.380+0000 7fdc4701f640 1 --2- 172.21.15.12:0/575795244 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fdc24035db0 0x7fdc24038270 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:01.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.380+0000 7fdc4701f640 1 --2- 172.21.15.12:0/575795244 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc4013a200 0x7fdc400a55f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:01.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.380+0000 7fdc4701f640 1 -- 172.21.15.12:0/575795244 >> 172.21.15.12:0/575795244 conn(0x7fdc4006da30 msgr2=0x7fdc40137370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:01.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.380+0000 7fdc4701f640 1 -- 172.21.15.12:0/575795244 shutdown_connections 2024-09-11T23:04:01.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.380+0000 7fdc4701f640 1 -- 172.21.15.12:0/575795244 wait complete. 2024-09-11T23:04:01.403 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-11T23:04:01.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.512+0000 7f46e198e640 1 Processor -- start 2024-09-11T23:04:01.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.512+0000 7f46e198e640 1 -- start start 2024-09-11T23:04:01.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.512+0000 7f46e198e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f46dc1341a0 0x7f46dc134c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:01.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.512+0000 7f46e198e640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46dc1346a0 con 0x7f46dc1348a0 2024-09-11T23:04:01.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.512+0000 7f46e198e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f46dc09d420 con 0x7f46dc1341a0 2024-09-11T23:04:01.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.512+0000 7f46da7fc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f46dc1341a0 0x7f46dc134c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:01.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.512+0000 7f46da7fc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f46dc1341a0 0x7f46dc134c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58038/0 (socket says 172.21.15.12:58038) 2024-09-11T23:04:01.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.512+0000 7f46daffd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f46dc1348a0 0x7f46dc137790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:33804/0 (socket says 172.21.15.12:33804) 2024-09-11T23:04:01.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.512+0000 7f46da7fc640 1 -- 172.21.15.12:0/3900729947 learned_addr learned my addr 172.21.15.12:0/3900729947 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:01.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.512+0000 7f46da7fc640 1 -- 172.21.15.12:0/3900729947 >> v1:172.21.15.12:6789/0 conn(0x7f46dc1348a0 legacy=0x7f46dc137790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:01.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.512+0000 7f46da7fc640 1 -- 172.21.15.12:0/3900729947 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46dc09ede0 con 0x7f46dc1341a0 2024-09-11T23:04:01.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.516+0000 7f46da7fc640 1 --2- 172.21.15.12:0/3900729947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46dc1341a0 0x7f46dc134c80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f46cc009e80 tx=0x7f46cc01ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7392e5f39475e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:01.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.516+0000 7f46d9ffb640 1 -- 172.21.15.12:0/3900729947 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46cc009200 con 0x7f46dc1341a0 2024-09-11T23:04:01.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.516+0000 7f46d9ffb640 1 -- 172.21.15.12:0/3900729947 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46cc0a5570 con 0x7f46dc1341a0 2024-09-11T23:04:01.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.516+0000 7f46d9ffb640 1 -- 172.21.15.12:0/3900729947 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46cc0a5870 con 0x7f46dc1341a0 2024-09-11T23:04:01.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.516+0000 7f46e198e640 1 -- 172.21.15.12:0/3900729947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46dc1341a0 msgr2=0x7f46dc134c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:01.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.516+0000 7f46e198e640 1 --2- 172.21.15.12:0/3900729947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46dc1341a0 0x7f46dc134c80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f46cc009e80 tx=0x7f46cc01ca10 comp rx=0 tx=0).stop 2024-09-11T23:04:01.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.516+0000 7f46e198e640 1 -- 172.21.15.12:0/3900729947 shutdown_connections 2024-09-11T23:04:01.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.516+0000 7f46e198e640 1 --2- 172.21.15.12:0/3900729947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46dc1341a0 0x7f46dc134c80 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:01.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.516+0000 7f46e198e640 1 -- 172.21.15.12:0/3900729947 >> 172.21.15.12:0/3900729947 conn(0x7f46dc070ba0 msgr2=0x7f46dc072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:01.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.516+0000 7f46e198e640 1 -- 172.21.15.12:0/3900729947 shutdown_connections 2024-09-11T23:04:01.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.516+0000 7f46e198e640 1 -- 172.21.15.12:0/3900729947 wait complete. 2024-09-11T23:04:01.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.516+0000 7f46e198e640 1 Processor -- start 2024-09-11T23:04:01.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.516+0000 7f46e198e640 1 -- start start 2024-09-11T23:04:01.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.516+0000 7f46e198e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46dc1341a0 0x7f46dc0a3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:01.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.516+0000 7f46e198e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f46dc13fcb0 con 0x7f46dc1341a0 2024-09-11T23:04:01.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.516+0000 7f46daffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46dc1341a0 0x7f46dc0a3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:01.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.516+0000 7f46daffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46dc1341a0 0x7f46dc0a3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58044/0 (socket says 172.21.15.12:58044) 2024-09-11T23:04:01.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.516+0000 7f46daffd640 1 -- 172.21.15.12:0/2859344463 learned_addr learned my addr 172.21.15.12:0/2859344463 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:01.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.516+0000 7f46daffd640 1 -- 172.21.15.12:0/2859344463 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46dc0a1cd0 con 0x7f46dc1341a0 2024-09-11T23:04:01.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.516+0000 7f46daffd640 1 --2- 172.21.15.12:0/2859344463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46dc1341a0 0x7f46dc0a3240 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f46c400c3a0 tx=0x7f46c400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:01.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.516+0000 7f46d3fff640 1 -- 172.21.15.12:0/2859344463 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46c4007410 con 0x7f46dc1341a0 2024-09-11T23:04:01.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.516+0000 7f46d3fff640 1 -- 172.21.15.12:0/2859344463 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46c40075b0 con 0x7f46dc1341a0 2024-09-11T23:04:01.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.516+0000 7f46e198e640 1 -- 172.21.15.12:0/2859344463 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46dc13d660 con 0x7f46dc1341a0 2024-09-11T23:04:01.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.516+0000 7f46d3fff640 1 -- 172.21.15.12:0/2859344463 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46c4004920 con 0x7f46dc1341a0 2024-09-11T23:04:01.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.516+0000 7f46e198e640 1 -- 172.21.15.12:0/2859344463 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46dc0a2db0 con 0x7f46dc1341a0 2024-09-11T23:04:01.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.520+0000 7f46d3fff640 1 -- 172.21.15.12:0/2859344463 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f46c401a020 con 0x7f46dc1341a0 2024-09-11T23:04:01.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.520+0000 7f46e198e640 1 -- 172.21.15.12:0/2859344463 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46dc0008e0 con 0x7f46dc1341a0 2024-09-11T23:04:01.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.520+0000 7f46d3fff640 1 --2- 172.21.15.12:0/2859344463 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f46bc035db0 0x7f46bc038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:01.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.520+0000 7f46d3fff640 1 -- 172.21.15.12:0/2859344463 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 2587+0+0 (secure 0 0 0) 0x7f46c4047b10 con 0x7f46dc1341a0 2024-09-11T23:04:01.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.520+0000 7f46da7fc640 1 --2- 172.21.15.12:0/2859344463 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f46bc035db0 0x7f46bc038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:01.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.520+0000 7f46da7fc640 1 --2- 172.21.15.12:0/2859344463 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f46bc035db0 0x7f46bc038270 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f46cc0ae000 tx=0x7f46cc0a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:01.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.524+0000 7f46d3fff640 1 -- 172.21.15.12:0/2859344463 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f46c401bc30 con 0x7f46dc1341a0 2024-09-11T23:04:01.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.768+0000 7f46e198e640 1 -- 172.21.15.12:0/2859344463 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f46dc0a27e0 con 0x7f46dc1341a0 2024-09-11T23:04:01.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.772+0000 7f46d3fff640 1 -- 172.21.15.12:0/2859344463 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) ==== 90+0+0 (secure 0 0 0) 0x7f46c4019d50 con 0x7f46dc1341a0 2024-09-11T23:04:01.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.776+0000 7f46e198e640 1 -- 172.21.15.12:0/2859344463 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f46bc035db0 msgr2=0x7f46bc038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:01.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.776+0000 7f46e198e640 1 --2- 172.21.15.12:0/2859344463 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f46bc035db0 0x7f46bc038270 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f46cc0ae000 tx=0x7f46cc0a7070 comp rx=0 tx=0).stop 2024-09-11T23:04:01.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.776+0000 7f46e198e640 1 -- 172.21.15.12:0/2859344463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46dc1341a0 msgr2=0x7f46dc0a3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:01.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.776+0000 7f46e198e640 1 --2- 172.21.15.12:0/2859344463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46dc1341a0 0x7f46dc0a3240 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f46c400c3a0 tx=0x7f46c400c860 comp rx=0 tx=0).stop 2024-09-11T23:04:01.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.776+0000 7f46e198e640 1 -- 172.21.15.12:0/2859344463 shutdown_connections 2024-09-11T23:04:01.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.776+0000 7f46e198e640 1 --2- 172.21.15.12:0/2859344463 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f46bc035db0 0x7f46bc038270 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:01.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.776+0000 7f46e198e640 1 --2- 172.21.15.12:0/2859344463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46dc1341a0 0x7f46dc0a3240 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:01.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.776+0000 7f46e198e640 1 -- 172.21.15.12:0/2859344463 >> 172.21.15.12:0/2859344463 conn(0x7f46dc070ba0 msgr2=0x7f46dc130dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:01.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.776+0000 7f46e198e640 1 -- 172.21.15.12:0/2859344463 shutdown_connections 2024-09-11T23:04:01.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.776+0000 7f46e198e640 1 -- 172.21.15.12:0/2859344463 wait complete. 2024-09-11T23:04:01.792 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-11T23:04:01.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.908+0000 7fa879cae640 1 Processor -- start 2024-09-11T23:04:01.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.908+0000 7fa879cae640 1 -- start start 2024-09-11T23:04:01.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.912+0000 7fa879cae640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa8741381c0 0x7fa87413cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:01.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.912+0000 7fa879cae640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa87409d690 con 0x7fa874137de0 2024-09-11T23:04:01.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.912+0000 7fa879cae640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fa87409ea90 con 0x7fa8741381c0 2024-09-11T23:04:01.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.912+0000 7fa872ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa8741381c0 0x7fa87413cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:01.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.912+0000 7fa8737fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa874137de0 0x7fa87409f190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:33818/0 (socket says 172.21.15.12:33818) 2024-09-11T23:04:01.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.912+0000 7fa872ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa8741381c0 0x7fa87413cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58050/0 (socket says 172.21.15.12:58050) 2024-09-11T23:04:01.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.912+0000 7fa8737fe640 1 -- 172.21.15.12:0/330101248 learned_addr learned my addr 172.21.15.12:0/330101248 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:04:01.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.912+0000 7fa8727fc640 1 -- 172.21.15.12:0/330101248 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3471714782 0 0) 0x7fa87409d690 con 0x7fa874137de0 2024-09-11T23:04:01.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.912+0000 7fa872ffd640 1 -- 172.21.15.12:0/330101248 >> v1:172.21.15.12:6789/0 conn(0x7fa874137de0 legacy=0x7fa87409f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:01.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.912+0000 7fa872ffd640 1 -- 172.21.15.12:0/330101248 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa87409cf00 con 0x7fa8741381c0 2024-09-11T23:04:01.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.912+0000 7fa872ffd640 1 --2- 172.21.15.12:0/330101248 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8741381c0 0x7fa87413cbc0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa864009d90 tx=0x7fa86401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4623e16ca2f3267 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:01.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.912+0000 7fa8727fc640 1 -- 172.21.15.12:0/330101248 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8640b2070 con 0x7fa8741381c0 2024-09-11T23:04:01.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.912+0000 7fa8727fc640 1 -- 172.21.15.12:0/330101248 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8640a5760 con 0x7fa8741381c0 2024-09-11T23:04:01.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.912+0000 7fa8727fc640 1 -- 172.21.15.12:0/330101248 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8640a5a60 con 0x7fa8741381c0 2024-09-11T23:04:01.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.912+0000 7fa879cae640 1 -- 172.21.15.12:0/330101248 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8741381c0 msgr2=0x7fa87413cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:01.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.912+0000 7fa879cae640 1 --2- 172.21.15.12:0/330101248 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8741381c0 0x7fa87413cbc0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa864009d90 tx=0x7fa86401c8e0 comp rx=0 tx=0).stop 2024-09-11T23:04:01.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.912+0000 7fa879cae640 1 -- 172.21.15.12:0/330101248 shutdown_connections 2024-09-11T23:04:01.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.912+0000 7fa879cae640 1 --2- 172.21.15.12:0/330101248 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8741381c0 0x7fa87413cbc0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:01.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.912+0000 7fa879cae640 1 -- 172.21.15.12:0/330101248 >> 172.21.15.12:0/330101248 conn(0x7fa8740a82f0 msgr2=0x7fa8740a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:01.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.916+0000 7fa879cae640 1 -- 172.21.15.12:0/330101248 shutdown_connections 2024-09-11T23:04:01.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.916+0000 7fa879cae640 1 -- 172.21.15.12:0/330101248 wait complete. 2024-09-11T23:04:01.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.916+0000 7fa879cae640 1 Processor -- start 2024-09-11T23:04:01.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.916+0000 7fa879cae640 1 -- start start 2024-09-11T23:04:01.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.916+0000 7fa879cae640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa874137de0 0x7fa87406fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:01.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.916+0000 7fa879cae640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa874137860 con 0x7fa874137de0 2024-09-11T23:04:01.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.916+0000 7fa8737fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa874137de0 0x7fa87406fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:01.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.916+0000 7fa8737fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa874137de0 0x7fa87406fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58066/0 (socket says 172.21.15.12:58066) 2024-09-11T23:04:01.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.916+0000 7fa8737fe640 1 -- 172.21.15.12:0/683738695 learned_addr learned my addr 172.21.15.12:0/683738695 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:01.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.916+0000 7fa8737fe640 1 -- 172.21.15.12:0/683738695 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa874071b60 con 0x7fa874137de0 2024-09-11T23:04:01.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.916+0000 7fa8737fe640 1 --2- 172.21.15.12:0/683738695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa874137de0 0x7fa87406fbe0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa85c00c390 tx=0x7fa85c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:01.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.916+0000 7fa86bfff640 1 -- 172.21.15.12:0/683738695 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa85c007410 con 0x7fa874137de0 2024-09-11T23:04:01.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.916+0000 7fa86bfff640 1 -- 172.21.15.12:0/683738695 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa85c0075d0 con 0x7fa874137de0 2024-09-11T23:04:01.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.916+0000 7fa879cae640 1 -- 172.21.15.12:0/683738695 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa874137410 con 0x7fa874137de0 2024-09-11T23:04:01.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.916+0000 7fa86bfff640 1 -- 172.21.15.12:0/683738695 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa85c004960 con 0x7fa874137de0 2024-09-11T23:04:01.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.916+0000 7fa879cae640 1 -- 172.21.15.12:0/683738695 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8740736c0 con 0x7fa874137de0 2024-09-11T23:04:01.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.916+0000 7fa879cae640 1 -- 172.21.15.12:0/683738695 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa87409f190 con 0x7fa874137de0 2024-09-11T23:04:01.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.916+0000 7fa86bfff640 1 -- 172.21.15.12:0/683738695 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa85c011070 con 0x7fa874137de0 2024-09-11T23:04:01.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.916+0000 7fa86bfff640 1 --2- 172.21.15.12:0/683738695 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fa854035db0 0x7fa854038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:01.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.916+0000 7fa86bfff640 1 -- 172.21.15.12:0/683738695 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 2587+0+0 (secure 0 0 0) 0x7fa85c047e90 con 0x7fa874137de0 2024-09-11T23:04:01.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.916+0000 7fa872ffd640 1 --2- 172.21.15.12:0/683738695 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fa854035db0 0x7fa854038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:01.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.916+0000 7fa872ffd640 1 --2- 172.21.15.12:0/683738695 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fa854035db0 0x7fa854038270 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa8640af000 tx=0x7fa8640a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:01.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:01.920+0000 7fa86bfff640 1 -- 172.21.15.12:0/683738695 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa85c004d90 con 0x7fa874137de0 2024-09-11T23:04:02.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.144+0000 7fa879cae640 1 -- 172.21.15.12:0/683738695 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7fa87409e730 con 0x7fa874137de0 2024-09-11T23:04:02.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.148+0000 7fa86bfff640 1 -- 172.21.15.12:0/683738695 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7fa85c0138e0 con 0x7fa874137de0 2024-09-11T23:04:02.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.148+0000 7fa879cae640 1 -- 172.21.15.12:0/683738695 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fa854035db0 msgr2=0x7fa854038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:02.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.148+0000 7fa879cae640 1 --2- 172.21.15.12:0/683738695 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fa854035db0 0x7fa854038270 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa8640af000 tx=0x7fa8640a7070 comp rx=0 tx=0).stop 2024-09-11T23:04:02.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.148+0000 7fa879cae640 1 -- 172.21.15.12:0/683738695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa874137de0 msgr2=0x7fa87406fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:02.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.148+0000 7fa879cae640 1 --2- 172.21.15.12:0/683738695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa874137de0 0x7fa87406fbe0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa85c00c390 tx=0x7fa85c00c850 comp rx=0 tx=0).stop 2024-09-11T23:04:02.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.148+0000 7fa879cae640 1 -- 172.21.15.12:0/683738695 shutdown_connections 2024-09-11T23:04:02.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.148+0000 7fa879cae640 1 --2- 172.21.15.12:0/683738695 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fa854035db0 0x7fa854038270 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:02.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.148+0000 7fa879cae640 1 --2- 172.21.15.12:0/683738695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa874137de0 0x7fa87406fbe0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:02.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.148+0000 7fa879cae640 1 -- 172.21.15.12:0/683738695 >> 172.21.15.12:0/683738695 conn(0x7fa8740a82f0 msgr2=0x7fa874136440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:02.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.148+0000 7fa879cae640 1 -- 172.21.15.12:0/683738695 shutdown_connections 2024-09-11T23:04:02.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.148+0000 7fa879cae640 1 -- 172.21.15.12:0/683738695 wait complete. 2024-09-11T23:04:02.169 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-11T23:04:02.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.288+0000 7f03b9ea3640 1 Processor -- start 2024-09-11T23:04:02.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.288+0000 7f03b9ea3640 1 -- start start 2024-09-11T23:04:02.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.288+0000 7f03b9ea3640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f03b40a8110 0x7f03b413ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:02.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.288+0000 7f03b9ea3640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03b40a4e40 con 0x7f03b40a71c0 2024-09-11T23:04:02.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.288+0000 7f03b9ea3640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f03b40a6af0 con 0x7f03b40a8110 2024-09-11T23:04:02.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.288+0000 7f03abfff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f03b40a8110 0x7f03b413ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:02.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.288+0000 7f03b37fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f03b40a71c0 0x7f03b40a75a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:33824/0 (socket says 172.21.15.12:33824) 2024-09-11T23:04:02.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.288+0000 7f03b37fe640 1 -- 172.21.15.12:0/1997673298 learned_addr learned my addr 172.21.15.12:0/1997673298 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:04:02.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.288+0000 7f03abfff640 1 -- 172.21.15.12:0/1997673298 >> v1:172.21.15.12:6789/0 conn(0x7f03b40a71c0 legacy=0x7f03b40a75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:02.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.288+0000 7f03abfff640 1 -- 172.21.15.12:0/1997673298 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03b40a3f50 con 0x7f03b40a8110 2024-09-11T23:04:02.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.292+0000 7f03abfff640 1 --2- 172.21.15.12:0/1997673298 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03b40a8110 0x7f03b413ef50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f039c009740 tx=0x7f039c01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42ebf95a18d27a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:02.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.292+0000 7f03b2ffd640 1 -- 172.21.15.12:0/1997673298 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f039c0b0070 con 0x7f03b40a8110 2024-09-11T23:04:02.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.292+0000 7f03b2ffd640 1 -- 172.21.15.12:0/1997673298 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f039c0ab530 con 0x7f03b40a8110 2024-09-11T23:04:02.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.292+0000 7f03b2ffd640 1 -- 172.21.15.12:0/1997673298 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f039c0ab830 con 0x7f03b40a8110 2024-09-11T23:04:02.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.292+0000 7f03b9ea3640 1 -- 172.21.15.12:0/1997673298 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03b40a8110 msgr2=0x7f03b413ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:02.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.292+0000 7f03b9ea3640 1 --2- 172.21.15.12:0/1997673298 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03b40a8110 0x7f03b413ef50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f039c009740 tx=0x7f039c01c390 comp rx=0 tx=0).stop 2024-09-11T23:04:02.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.292+0000 7f03b9ea3640 1 -- 172.21.15.12:0/1997673298 shutdown_connections 2024-09-11T23:04:02.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.292+0000 7f03b9ea3640 1 --2- 172.21.15.12:0/1997673298 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03b40a8110 0x7f03b413ef50 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:02.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.292+0000 7f03b9ea3640 1 -- 172.21.15.12:0/1997673298 >> 172.21.15.12:0/1997673298 conn(0x7f03b40ac4f0 msgr2=0x7f03b40ac900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:02.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.292+0000 7f03b9ea3640 1 -- 172.21.15.12:0/1997673298 shutdown_connections 2024-09-11T23:04:02.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.292+0000 7f03b9ea3640 1 -- 172.21.15.12:0/1997673298 wait complete. 2024-09-11T23:04:02.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.292+0000 7f03b9ea3640 1 Processor -- start 2024-09-11T23:04:02.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.296+0000 7f03b9ea3640 1 -- start start 2024-09-11T23:04:02.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.296+0000 7f03b9ea3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03b40a71c0 0x7f03b40a1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:02.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.296+0000 7f03b9ea3640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f03b406dd50 con 0x7f03b40a71c0 2024-09-11T23:04:02.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.296+0000 7f03b37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03b40a71c0 0x7f03b40a1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:02.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.296+0000 7f03b37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03b40a71c0 0x7f03b40a1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58082/0 (socket says 172.21.15.12:58082) 2024-09-11T23:04:02.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.296+0000 7f03b37fe640 1 -- 172.21.15.12:0/997493231 learned_addr learned my addr 172.21.15.12:0/997493231 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:02.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.296+0000 7f03b37fe640 1 -- 172.21.15.12:0/997493231 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03b40a1760 con 0x7f03b40a71c0 2024-09-11T23:04:02.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.296+0000 7f03b37fe640 1 --2- 172.21.15.12:0/997493231 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03b40a71c0 0x7f03b40a1020 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f03a400c480 tx=0x7f03a400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:02.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.296+0000 7f03b0ff9640 1 -- 172.21.15.12:0/997493231 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03a4017070 con 0x7f03b40a71c0 2024-09-11T23:04:02.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.296+0000 7f03b0ff9640 1 -- 172.21.15.12:0/997493231 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03a4005c20 con 0x7f03b40a71c0 2024-09-11T23:04:02.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.296+0000 7f03b9ea3640 1 -- 172.21.15.12:0/997493231 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03b40a1a80 con 0x7f03b40a71c0 2024-09-11T23:04:02.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.296+0000 7f03b0ff9640 1 -- 172.21.15.12:0/997493231 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03a4007070 con 0x7f03b40a71c0 2024-09-11T23:04:02.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.296+0000 7f03b9ea3640 1 -- 172.21.15.12:0/997493231 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03b409f5e0 con 0x7f03b40a71c0 2024-09-11T23:04:02.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.296+0000 7f03b0ff9640 1 -- 172.21.15.12:0/997493231 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f03a401a070 con 0x7f03b40a71c0 2024-09-11T23:04:02.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.296+0000 7f03b9ea3640 1 -- 172.21.15.12:0/997493231 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03b40a1560 con 0x7f03b40a71c0 2024-09-11T23:04:02.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.296+0000 7f03b0ff9640 1 --2- 172.21.15.12:0/997493231 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f0394035db0 0x7f0394038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:02.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.296+0000 7f03b0ff9640 1 -- 172.21.15.12:0/997493231 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 2587+0+0 (secure 0 0 0) 0x7f03a40475b0 con 0x7f03b40a71c0 2024-09-11T23:04:02.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.296+0000 7f03abfff640 1 --2- 172.21.15.12:0/997493231 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f0394035db0 0x7f0394038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:02.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.296+0000 7f03abfff640 1 --2- 172.21.15.12:0/997493231 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f0394035db0 0x7f0394038270 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f039c0ad000 tx=0x7f039c0a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:02.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.300+0000 7f03b0ff9640 1 -- 172.21.15.12:0/997493231 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f03a401a760 con 0x7f03b40a71c0 2024-09-11T23:04:02.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.524+0000 7f03b9ea3640 1 -- 172.21.15.12:0/997493231 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f03b409ed00 con 0x7f03b40a71c0 2024-09-11T23:04:02.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.524+0000 7f03b0ff9640 1 -- 172.21.15.12:0/997493231 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7f03a4007210 con 0x7f03b40a71c0 2024-09-11T23:04:02.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.528+0000 7f03b9ea3640 1 -- 172.21.15.12:0/997493231 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f0394035db0 msgr2=0x7f0394038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:02.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.528+0000 7f03b9ea3640 1 --2- 172.21.15.12:0/997493231 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f0394035db0 0x7f0394038270 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f039c0ad000 tx=0x7f039c0a6000 comp rx=0 tx=0).stop 2024-09-11T23:04:02.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.528+0000 7f03b9ea3640 1 -- 172.21.15.12:0/997493231 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03b40a71c0 msgr2=0x7f03b40a1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:02.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.528+0000 7f03b9ea3640 1 --2- 172.21.15.12:0/997493231 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03b40a71c0 0x7f03b40a1020 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f03a400c480 tx=0x7f03a400c940 comp rx=0 tx=0).stop 2024-09-11T23:04:02.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.528+0000 7f03b9ea3640 1 -- 172.21.15.12:0/997493231 shutdown_connections 2024-09-11T23:04:02.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.528+0000 7f03b9ea3640 1 --2- 172.21.15.12:0/997493231 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f0394035db0 0x7f0394038270 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:02.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.528+0000 7f03b9ea3640 1 --2- 172.21.15.12:0/997493231 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03b40a71c0 0x7f03b40a1020 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:02.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.528+0000 7f03b9ea3640 1 -- 172.21.15.12:0/997493231 >> 172.21.15.12:0/997493231 conn(0x7f03b40ac4f0 msgr2=0x7f03b40aaa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:02.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.528+0000 7f03b9ea3640 1 -- 172.21.15.12:0/997493231 shutdown_connections 2024-09-11T23:04:02.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.528+0000 7f03b9ea3640 1 -- 172.21.15.12:0/997493231 wait complete. 2024-09-11T23:04:02.547 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-11T23:04:02.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.668+0000 7fbfaa8e7640 1 Processor -- start 2024-09-11T23:04:02.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.668+0000 7fbfaa8e7640 1 -- start start 2024-09-11T23:04:02.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.668+0000 7fbfaa8e7640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbfa4136da0 0x7fbfa4137180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:02.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.668+0000 7fbfaa8e7640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfa40a1e90 con 0x7fbfa409ac20 2024-09-11T23:04:02.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.668+0000 7fbfaa8e7640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fbfa41376c0 con 0x7fbfa4136da0 2024-09-11T23:04:02.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.668+0000 7fbfa3fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbfa4136da0 0x7fbfa4137180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:02.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.668+0000 7fbfa37fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fbfa409ac20 0x7fbfa40a36a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:33826/0 (socket says 172.21.15.12:33826) 2024-09-11T23:04:02.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.668+0000 7fbfa37fe640 1 -- 172.21.15.12:0/825457857 learned_addr learned my addr 172.21.15.12:0/825457857 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:04:02.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.668+0000 7fbfa2ffd640 1 -- 172.21.15.12:0/825457857 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1354078087 0 0) 0x7fbfa40a1e90 con 0x7fbfa409ac20 2024-09-11T23:04:02.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.668+0000 7fbfa3fff640 1 -- 172.21.15.12:0/825457857 >> v1:172.21.15.12:6789/0 conn(0x7fbfa409ac20 legacy=0x7fbfa40a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:02.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.668+0000 7fbfa3fff640 1 -- 172.21.15.12:0/825457857 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfa40a0650 con 0x7fbfa4136da0 2024-09-11T23:04:02.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.672+0000 7fbfa3fff640 1 --2- 172.21.15.12:0/825457857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbfa4136da0 0x7fbfa4137180 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c009740 tx=0x7fbf9c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a66d5c0211b55d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:02.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.672+0000 7fbfa2ffd640 1 -- 172.21.15.12:0/825457857 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf9c0b0070 con 0x7fbfa4136da0 2024-09-11T23:04:02.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.672+0000 7fbfa2ffd640 1 -- 172.21.15.12:0/825457857 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf9c0ab530 con 0x7fbfa4136da0 2024-09-11T23:04:02.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.672+0000 7fbfa2ffd640 1 -- 172.21.15.12:0/825457857 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf9c0ab830 con 0x7fbfa4136da0 2024-09-11T23:04:02.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.672+0000 7fbfaa8e7640 1 -- 172.21.15.12:0/825457857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbfa4136da0 msgr2=0x7fbfa4137180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:02.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.672+0000 7fbfaa8e7640 1 --2- 172.21.15.12:0/825457857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbfa4136da0 0x7fbfa4137180 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c009740 tx=0x7fbf9c01c420 comp rx=0 tx=0).stop 2024-09-11T23:04:02.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.672+0000 7fbfaa8e7640 1 -- 172.21.15.12:0/825457857 shutdown_connections 2024-09-11T23:04:02.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.672+0000 7fbfaa8e7640 1 --2- 172.21.15.12:0/825457857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbfa4136da0 0x7fbfa4137180 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:02.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.672+0000 7fbfaa8e7640 1 -- 172.21.15.12:0/825457857 >> 172.21.15.12:0/825457857 conn(0x7fbfa40a82f0 msgr2=0x7fbfa40a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:02.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.672+0000 7fbfaa8e7640 1 -- 172.21.15.12:0/825457857 shutdown_connections 2024-09-11T23:04:02.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.672+0000 7fbfaa8e7640 1 -- 172.21.15.12:0/825457857 wait complete. 2024-09-11T23:04:02.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.672+0000 7fbfaa8e7640 1 Processor -- start 2024-09-11T23:04:02.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.672+0000 7fbfaa8e7640 1 -- start start 2024-09-11T23:04:02.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.672+0000 7fbfaa8e7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbfa409ac20 0x7fbfa41d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:02.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.672+0000 7fbfaa8e7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbfa413ee20 con 0x7fbfa409ac20 2024-09-11T23:04:02.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.672+0000 7fbfa3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbfa409ac20 0x7fbfa41d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:02.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.672+0000 7fbfa3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbfa409ac20 0x7fbfa41d1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58104/0 (socket says 172.21.15.12:58104) 2024-09-11T23:04:02.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.672+0000 7fbfa3fff640 1 -- 172.21.15.12:0/913051093 learned_addr learned my addr 172.21.15.12:0/913051093 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:02.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.672+0000 7fbfa3fff640 1 -- 172.21.15.12:0/913051093 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfa4071ad0 con 0x7fbfa409ac20 2024-09-11T23:04:02.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.672+0000 7fbfa3fff640 1 --2- 172.21.15.12:0/913051093 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbfa409ac20 0x7fbfa41d1f10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c01a050 tx=0x7fbf9c01ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:02.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.672+0000 7fbfa0ff9640 1 -- 172.21.15.12:0/913051093 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf9c0b0050 con 0x7fbfa409ac20 2024-09-11T23:04:02.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.672+0000 7fbfa0ff9640 1 -- 172.21.15.12:0/913051093 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf9c0b1040 con 0x7fbfa409ac20 2024-09-11T23:04:02.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.672+0000 7fbfaa8e7640 1 -- 172.21.15.12:0/913051093 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfa40710e0 con 0x7fbfa409ac20 2024-09-11T23:04:02.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.672+0000 7fbfa0ff9640 1 -- 172.21.15.12:0/913051093 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf9c0b5740 con 0x7fbfa409ac20 2024-09-11T23:04:02.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.676+0000 7fbfaa8e7640 1 -- 172.21.15.12:0/913051093 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfa4071380 con 0x7fbfa409ac20 2024-09-11T23:04:02.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.676+0000 7fbfaa8e7640 1 -- 172.21.15.12:0/913051093 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfa40738b0 con 0x7fbfa409ac20 2024-09-11T23:04:02.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.676+0000 7fbfa0ff9640 1 -- 172.21.15.12:0/913051093 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbf9c0be030 con 0x7fbfa409ac20 2024-09-11T23:04:02.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.676+0000 7fbfa0ff9640 1 --2- 172.21.15.12:0/913051093 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fbf84035db0 0x7fbf84038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:02.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.676+0000 7fbfa0ff9640 1 -- 172.21.15.12:0/913051093 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 2587+0+0 (secure 0 0 0) 0x7fbf9c0bc070 con 0x7fbfa409ac20 2024-09-11T23:04:02.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.676+0000 7fbfa37fe640 1 --2- 172.21.15.12:0/913051093 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fbf84035db0 0x7fbf84038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:02.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.676+0000 7fbfa37fe640 1 --2- 172.21.15.12:0/913051093 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fbf84035db0 0x7fbf84038270 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c007fd0 tx=0x7fbf8c007920 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:02.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.680+0000 7fbfa0ff9640 1 -- 172.21.15.12:0/913051093 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbf9c0c5020 con 0x7fbfa409ac20 2024-09-11T23:04:02.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.908+0000 7fbfaa8e7640 1 -- 172.21.15.12:0/913051093 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7fbfa406bc60 con 0x7fbfa409ac20 2024-09-11T23:04:02.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.912+0000 7fbfa0ff9640 1 -- 172.21.15.12:0/913051093 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) ==== 97+0+0 (secure 0 0 0) 0x7fbfa4071ad0 con 0x7fbfa409ac20 2024-09-11T23:04:02.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.916+0000 7fbfaa8e7640 1 -- 172.21.15.12:0/913051093 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fbf84035db0 msgr2=0x7fbf84038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:02.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.916+0000 7fbfaa8e7640 1 --2- 172.21.15.12:0/913051093 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fbf84035db0 0x7fbf84038270 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c007fd0 tx=0x7fbf8c007920 comp rx=0 tx=0).stop 2024-09-11T23:04:02.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.916+0000 7fbfaa8e7640 1 -- 172.21.15.12:0/913051093 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbfa409ac20 msgr2=0x7fbfa41d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:02.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.916+0000 7fbfaa8e7640 1 --2- 172.21.15.12:0/913051093 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbfa409ac20 0x7fbfa41d1f10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c01a050 tx=0x7fbf9c01ac60 comp rx=0 tx=0).stop 2024-09-11T23:04:02.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.916+0000 7fbfaa8e7640 1 -- 172.21.15.12:0/913051093 shutdown_connections 2024-09-11T23:04:02.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.916+0000 7fbfaa8e7640 1 --2- 172.21.15.12:0/913051093 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fbf84035db0 0x7fbf84038270 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:02.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.916+0000 7fbfaa8e7640 1 --2- 172.21.15.12:0/913051093 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbfa409ac20 0x7fbfa41d1f10 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:02.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.916+0000 7fbfaa8e7640 1 -- 172.21.15.12:0/913051093 >> 172.21.15.12:0/913051093 conn(0x7fbfa40a82f0 msgr2=0x7fbfa409e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:02.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.916+0000 7fbfaa8e7640 1 -- 172.21.15.12:0/913051093 shutdown_connections 2024-09-11T23:04:02.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:02.916+0000 7fbfaa8e7640 1 -- 172.21.15.12:0/913051093 wait complete. 2024-09-11T23:04:02.933 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-11T23:04:03.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.056+0000 7ff39e114640 1 Processor -- start 2024-09-11T23:04:03.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.056+0000 7ff39e114640 1 -- start start 2024-09-11T23:04:03.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.056+0000 7ff39e114640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff39809fc40 0x7ff39813ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:03.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.056+0000 7ff39e114640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3980a1c00 con 0x7ff39813a200 2024-09-11T23:04:03.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.056+0000 7ff39e114640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7ff3980a0e40 con 0x7ff39809fc40 2024-09-11T23:04:03.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.056+0000 7ff396ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff39809fc40 0x7ff39813ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:03.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.056+0000 7ff396ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff39809fc40 0x7ff39813ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58110/0 (socket says 172.21.15.12:58110) 2024-09-11T23:04:03.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.056+0000 7ff396ffd640 1 -- 172.21.15.12:0/3219826975 learned_addr learned my addr 172.21.15.12:0/3219826975 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:03.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.056+0000 7ff3977fe640 1 --1- 172.21.15.12:0/3219826975 >> v1:172.21.15.12:6789/0 conn(0x7ff39813a200 0x7ff39813a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:33842/0 (socket says 172.21.15.12:33842) 2024-09-11T23:04:03.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.056+0000 7ff396ffd640 1 -- 172.21.15.12:0/3219826975 >> v1:172.21.15.12:6789/0 conn(0x7ff39813a200 legacy=0x7ff39813a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:03.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.056+0000 7ff3967fc640 1 -- 172.21.15.12:0/3219826975 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4252276824 0 0) 0x7ff3980a1c00 con 0x7ff39813a200 2024-09-11T23:04:03.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.056+0000 7ff396ffd640 1 -- 172.21.15.12:0/3219826975 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff39809f350 con 0x7ff39809fc40 2024-09-11T23:04:03.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.060+0000 7ff396ffd640 1 --2- 172.21.15.12:0/3219826975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff39809fc40 0x7ff39813ef80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff38c0097f0 tx=0x7ff38c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9faf88cdfbc164e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:03.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.060+0000 7ff3967fc640 1 -- 172.21.15.12:0/3219826975 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff38c0b0070 con 0x7ff39809fc40 2024-09-11T23:04:03.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.060+0000 7ff3967fc640 1 -- 172.21.15.12:0/3219826975 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff38c0ab530 con 0x7ff39809fc40 2024-09-11T23:04:03.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.060+0000 7ff3967fc640 1 -- 172.21.15.12:0/3219826975 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff38c0ab830 con 0x7ff39809fc40 2024-09-11T23:04:03.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.060+0000 7ff39e114640 1 -- 172.21.15.12:0/3219826975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff39809fc40 msgr2=0x7ff39813ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:03.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.060+0000 7ff39e114640 1 --2- 172.21.15.12:0/3219826975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff39809fc40 0x7ff39813ef80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff38c0097f0 tx=0x7ff38c01c450 comp rx=0 tx=0).stop 2024-09-11T23:04:03.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.060+0000 7ff39e114640 1 -- 172.21.15.12:0/3219826975 shutdown_connections 2024-09-11T23:04:03.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.060+0000 7ff39e114640 1 --2- 172.21.15.12:0/3219826975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff39809fc40 0x7ff39813ef80 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:03.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.060+0000 7ff39e114640 1 -- 172.21.15.12:0/3219826975 >> 172.21.15.12:0/3219826975 conn(0x7ff39806da30 msgr2=0x7ff39806de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:03.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.060+0000 7ff39e114640 1 -- 172.21.15.12:0/3219826975 shutdown_connections 2024-09-11T23:04:03.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.060+0000 7ff39e114640 1 -- 172.21.15.12:0/3219826975 wait complete. 2024-09-11T23:04:03.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.060+0000 7ff39e114640 1 Processor -- start 2024-09-11T23:04:03.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.060+0000 7ff39e114640 1 -- start start 2024-09-11T23:04:03.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.064+0000 7ff39e114640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff39813a200 0x7ff3980a31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:03.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.064+0000 7ff39e114640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff398141ce0 con 0x7ff39813a200 2024-09-11T23:04:03.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.064+0000 7ff3977fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff39813a200 0x7ff3980a31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:03.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.064+0000 7ff3977fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff39813a200 0x7ff3980a31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58114/0 (socket says 172.21.15.12:58114) 2024-09-11T23:04:03.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.064+0000 7ff3977fe640 1 -- 172.21.15.12:0/1219549399 learned_addr learned my addr 172.21.15.12:0/1219549399 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:03.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.064+0000 7ff3977fe640 1 -- 172.21.15.12:0/1219549399 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3980ac200 con 0x7ff39813a200 2024-09-11T23:04:03.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.064+0000 7ff3977fe640 1 --2- 172.21.15.12:0/1219549399 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff39813a200 0x7ff3980a31b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff38800c420 tx=0x7ff38800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:03.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.064+0000 7ff37ffff640 1 -- 172.21.15.12:0/1219549399 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff388018070 con 0x7ff39813a200 2024-09-11T23:04:03.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.064+0000 7ff37ffff640 1 -- 172.21.15.12:0/1219549399 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3880074d0 con 0x7ff39813a200 2024-09-11T23:04:03.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.064+0000 7ff39e114640 1 -- 172.21.15.12:0/1219549399 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3980a46e0 con 0x7ff39813a200 2024-09-11T23:04:03.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.064+0000 7ff37ffff640 1 -- 172.21.15.12:0/1219549399 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff388004960 con 0x7ff39813a200 2024-09-11T23:04:03.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.064+0000 7ff39e114640 1 -- 172.21.15.12:0/1219549399 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3980a5f30 con 0x7ff39813a200 2024-09-11T23:04:03.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.064+0000 7ff37ffff640 1 -- 172.21.15.12:0/1219549399 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff38801b070 con 0x7ff39813a200 2024-09-11T23:04:03.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.064+0000 7ff39e114640 1 -- 172.21.15.12:0/1219549399 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff39813a660 con 0x7ff39813a200 2024-09-11T23:04:03.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.064+0000 7ff37ffff640 1 --2- 172.21.15.12:0/1219549399 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7ff384035db0 0x7ff384038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:03.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.064+0000 7ff37ffff640 1 -- 172.21.15.12:0/1219549399 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 2587+0+0 (secure 0 0 0) 0x7ff388047690 con 0x7ff39813a200 2024-09-11T23:04:03.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.064+0000 7ff396ffd640 1 --2- 172.21.15.12:0/1219549399 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7ff384035db0 0x7ff384038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:03.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.064+0000 7ff396ffd640 1 --2- 172.21.15.12:0/1219549399 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7ff384035db0 0x7ff384038270 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff38c0ad000 tx=0x7ff38c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:03.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.068+0000 7ff37ffff640 1 -- 172.21.15.12:0/1219549399 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff38801c9d0 con 0x7ff39813a200 2024-09-11T23:04:03.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.284+0000 7ff39e114640 1 -- 172.21.15.12:0/1219549399 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7ff3980ac3d0 con 0x7ff39813a200 2024-09-11T23:04:03.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.284+0000 7ff37ffff640 1 -- 172.21.15.12:0/1219549399 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7ff388004d90 con 0x7ff39813a200 2024-09-11T23:04:03.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.288+0000 7ff39e114640 1 -- 172.21.15.12:0/1219549399 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7ff384035db0 msgr2=0x7ff384038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:03.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.288+0000 7ff39e114640 1 --2- 172.21.15.12:0/1219549399 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7ff384035db0 0x7ff384038270 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff38c0ad000 tx=0x7ff38c008040 comp rx=0 tx=0).stop 2024-09-11T23:04:03.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.288+0000 7ff39e114640 1 -- 172.21.15.12:0/1219549399 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff39813a200 msgr2=0x7ff3980a31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:03.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.288+0000 7ff39e114640 1 --2- 172.21.15.12:0/1219549399 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff39813a200 0x7ff3980a31b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff38800c420 tx=0x7ff38800c8e0 comp rx=0 tx=0).stop 2024-09-11T23:04:03.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.288+0000 7ff39e114640 1 -- 172.21.15.12:0/1219549399 shutdown_connections 2024-09-11T23:04:03.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.288+0000 7ff39e114640 1 --2- 172.21.15.12:0/1219549399 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7ff384035db0 0x7ff384038270 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:03.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.288+0000 7ff39e114640 1 --2- 172.21.15.12:0/1219549399 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff39813a200 0x7ff3980a31b0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:03.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.288+0000 7ff39e114640 1 -- 172.21.15.12:0/1219549399 >> 172.21.15.12:0/1219549399 conn(0x7ff39806da30 msgr2=0x7ff39809c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:03.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.288+0000 7ff39e114640 1 -- 172.21.15.12:0/1219549399 shutdown_connections 2024-09-11T23:04:03.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.288+0000 7ff39e114640 1 -- 172.21.15.12:0/1219549399 wait complete. 2024-09-11T23:04:03.305 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-11T23:04:03.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.420+0000 7f835394c640 1 Processor -- start 2024-09-11T23:04:03.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.420+0000 7f835394c640 1 -- start start 2024-09-11T23:04:03.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.424+0000 7f835394c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f834c09f190 0x7f834c09f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:03.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.424+0000 7f835394c640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f834c0a14c0 con 0x7f834c09fab0 2024-09-11T23:04:03.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.424+0000 7f835394c640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f834c0a1760 con 0x7f834c09f190 2024-09-11T23:04:03.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.424+0000 7f83516e8640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f834c09f190 0x7f834c09f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:03.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.424+0000 7f8350ee7640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f834c09fab0 0x7f834c1364d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:33854/0 (socket says 172.21.15.12:33854) 2024-09-11T23:04:03.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.424+0000 7f8350ee7640 1 -- 172.21.15.12:0/3895944717 learned_addr learned my addr 172.21.15.12:0/3895944717 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:04:03.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.424+0000 7f8343fff640 1 -- 172.21.15.12:0/3895944717 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2635652505 0 0) 0x7f834c0a14c0 con 0x7f834c09fab0 2024-09-11T23:04:03.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.424+0000 7f8343fff640 1 -- 172.21.15.12:0/3895944717 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8338003450 con 0x7f834c09fab0 2024-09-11T23:04:03.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.424+0000 7f83516e8640 1 -- 172.21.15.12:0/3895944717 >> v1:172.21.15.12:6789/0 conn(0x7f834c09fab0 legacy=0x7f834c1364d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:03.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.424+0000 7f83516e8640 1 -- 172.21.15.12:0/3895944717 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f834c0a0d30 con 0x7f834c09f190 2024-09-11T23:04:03.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.424+0000 7f83516e8640 1 --2- 172.21.15.12:0/3895944717 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f834c09f190 0x7f834c09f570 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8348009d90 tx=0x7f834801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2111c39da66ecac server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:03.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.424+0000 7f8343fff640 1 -- 172.21.15.12:0/3895944717 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83480b2070 con 0x7f834c09f190 2024-09-11T23:04:03.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.424+0000 7f8343fff640 1 -- 172.21.15.12:0/3895944717 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83480a56e0 con 0x7f834c09f190 2024-09-11T23:04:03.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.424+0000 7f8343fff640 1 -- 172.21.15.12:0/3895944717 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83480a59e0 con 0x7f834c09f190 2024-09-11T23:04:03.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.428+0000 7f835394c640 1 -- 172.21.15.12:0/3895944717 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f834c09f190 msgr2=0x7f834c09f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:03.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.428+0000 7f835394c640 1 --2- 172.21.15.12:0/3895944717 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f834c09f190 0x7f834c09f570 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8348009d90 tx=0x7f834801c8e0 comp rx=0 tx=0).stop 2024-09-11T23:04:03.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.428+0000 7f835394c640 1 -- 172.21.15.12:0/3895944717 shutdown_connections 2024-09-11T23:04:03.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.428+0000 7f835394c640 1 --2- 172.21.15.12:0/3895944717 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f834c09f190 0x7f834c09f570 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:03.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.428+0000 7f835394c640 1 -- 172.21.15.12:0/3895944717 >> 172.21.15.12:0/3895944717 conn(0x7f834c0a8450 msgr2=0x7f834c0a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:03.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.428+0000 7f835394c640 1 -- 172.21.15.12:0/3895944717 shutdown_connections 2024-09-11T23:04:03.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.428+0000 7f835394c640 1 -- 172.21.15.12:0/3895944717 wait complete. 2024-09-11T23:04:03.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.428+0000 7f835394c640 1 Processor -- start 2024-09-11T23:04:03.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.428+0000 7f835394c640 1 -- start start 2024-09-11T23:04:03.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.428+0000 7f835394c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f834c09f190 0x7f834c071140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:03.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.428+0000 7f835394c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f834c0a0520 con 0x7f834c09f190 2024-09-11T23:04:03.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.428+0000 7f83516e8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f834c09f190 0x7f834c071140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:03.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.428+0000 7f83516e8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f834c09f190 0x7f834c071140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58132/0 (socket says 172.21.15.12:58132) 2024-09-11T23:04:03.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.428+0000 7f83516e8640 1 -- 172.21.15.12:0/2261595325 learned_addr learned my addr 172.21.15.12:0/2261595325 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:03.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.428+0000 7f83516e8640 1 -- 172.21.15.12:0/2261595325 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f834c120090 con 0x7f834c09f190 2024-09-11T23:04:03.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.428+0000 7f83516e8640 1 --2- 172.21.15.12:0/2261595325 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f834c09f190 0x7f834c071140 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f834801a510 tx=0x7f8348019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:03.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.428+0000 7f8341ffb640 1 -- 172.21.15.12:0/2261595325 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83480bd030 con 0x7f834c09f190 2024-09-11T23:04:03.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.428+0000 7f8341ffb640 1 -- 172.21.15.12:0/2261595325 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83480b8470 con 0x7f834c09f190 2024-09-11T23:04:03.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.428+0000 7f8341ffb640 1 -- 172.21.15.12:0/2261595325 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83480b2040 con 0x7f834c09f190 2024-09-11T23:04:03.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.428+0000 7f835394c640 1 -- 172.21.15.12:0/2261595325 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f834c11f610 con 0x7f834c09f190 2024-09-11T23:04:03.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.428+0000 7f835394c640 1 -- 172.21.15.12:0/2261595325 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f834c072da0 con 0x7f834c09f190 2024-09-11T23:04:03.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.432+0000 7f835394c640 1 -- 172.21.15.12:0/2261595325 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f834c09f570 con 0x7f834c09f190 2024-09-11T23:04:03.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.432+0000 7f8341ffb640 1 -- 172.21.15.12:0/2261595325 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f83480c0070 con 0x7f834c09f190 2024-09-11T23:04:03.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.432+0000 7f8341ffb640 1 --2- 172.21.15.12:0/2261595325 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f8330035db0 0x7f8330038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:03.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.432+0000 7f8341ffb640 1 -- 172.21.15.12:0/2261595325 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 2587+0+0 (secure 0 0 0) 0x7f83480be070 con 0x7f834c09f190 2024-09-11T23:04:03.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.432+0000 7f8350ee7640 1 --2- 172.21.15.12:0/2261595325 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f8330035db0 0x7f8330038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:03.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.432+0000 7f8350ee7640 1 --2- 172.21.15.12:0/2261595325 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f8330035db0 0x7f8330038270 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f833c007fd0 tx=0x7f833c007980 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:03.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.436+0000 7f8341ffb640 1 -- 172.21.15.12:0/2261595325 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f83480c7070 con 0x7f834c09f190 2024-09-11T23:04:03.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.596+0000 7f835394c640 1 -- 172.21.15.12:0/2261595325 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f834c09ee70 con 0x7f834c09f190 2024-09-11T23:04:03.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.596+0000 7f8341ffb640 1 -- 172.21.15.12:0/2261595325 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v21) ==== 84+0+65 (secure 0 0 0) 0x7f8348016560 con 0x7f834c09f190 2024-09-11T23:04:03.598 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:04:03.598 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2024-09-11T23:04:03.598 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:04:03.598 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 1, 2024-09-11T23:04:03.598 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": ".mgr" 2024-09-11T23:04:03.598 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:04:03.599 INFO:teuthology.orchestra.run.smithi012.stdout:] 2024-09-11T23:04:03.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.600+0000 7f835394c640 1 -- 172.21.15.12:0/2261595325 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f8330035db0 msgr2=0x7f8330038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:03.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.600+0000 7f835394c640 1 --2- 172.21.15.12:0/2261595325 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f8330035db0 0x7f8330038270 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f833c007fd0 tx=0x7f833c007980 comp rx=0 tx=0).stop 2024-09-11T23:04:03.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.600+0000 7f835394c640 1 -- 172.21.15.12:0/2261595325 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f834c09f190 msgr2=0x7f834c071140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:03.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.600+0000 7f835394c640 1 --2- 172.21.15.12:0/2261595325 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f834c09f190 0x7f834c071140 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f834801a510 tx=0x7f8348019680 comp rx=0 tx=0).stop 2024-09-11T23:04:03.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.600+0000 7f835394c640 1 -- 172.21.15.12:0/2261595325 shutdown_connections 2024-09-11T23:04:03.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.600+0000 7f835394c640 1 --2- 172.21.15.12:0/2261595325 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f8330035db0 0x7f8330038270 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:03.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.600+0000 7f835394c640 1 --2- 172.21.15.12:0/2261595325 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f834c09f190 0x7f834c071140 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:03.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.600+0000 7f835394c640 1 -- 172.21.15.12:0/2261595325 >> 172.21.15.12:0/2261595325 conn(0x7f834c0a8450 msgr2=0x7f834c09c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:03.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.600+0000 7f835394c640 1 -- 172.21.15.12:0/2261595325 shutdown_connections 2024-09-11T23:04:03.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.600+0000 7f835394c640 1 -- 172.21.15.12:0/2261595325 wait complete. 2024-09-11T23:04:03.615 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T23:04:03.616 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T23:04:03.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.740+0000 7fd241d6b640 1 Processor -- start 2024-09-11T23:04:03.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.740+0000 7fd241d6b640 1 -- start start 2024-09-11T23:04:03.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.740+0000 7fd241d6b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd23c132ef0 0x7fd23c0a0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:03.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.740+0000 7fd241d6b640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd23c132cf0 con 0x7fd23c1332d0 2024-09-11T23:04:03.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.740+0000 7fd241d6b640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fd23c0a4200 con 0x7fd23c132ef0 2024-09-11T23:04:03.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.740+0000 7fd23affd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd23c1332d0 0x7fd23c136070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:33856/0 (socket says 172.21.15.12:33856) 2024-09-11T23:04:03.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.740+0000 7fd23affd640 1 -- 172.21.15.12:0/615133540 learned_addr learned my addr 172.21.15.12:0/615133540 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:04:03.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.740+0000 7fd23b7fe640 1 --2- 172.21.15.12:0/615133540 >> v2:172.21.15.12:3300/0 conn(0x7fd23c132ef0 0x7fd23c0a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:03.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.740+0000 7fd23b7fe640 1 -- 172.21.15.12:0/615133540 >> v1:172.21.15.12:6789/0 conn(0x7fd23c1332d0 legacy=0x7fd23c136070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:03.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.740+0000 7fd23b7fe640 1 -- 172.21.15.12:0/615133540 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd23c0a0ec0 con 0x7fd23c132ef0 2024-09-11T23:04:03.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.744+0000 7fd23b7fe640 1 --2- 172.21.15.12:0/615133540 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd23c132ef0 0x7fd23c0a0620 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd23000a8e0 tx=0x7fd23001d7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edc290c94a58bcc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:03.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.744+0000 7fd23a7fc640 1 -- 172.21.15.12:0/615133540 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2300b3070 con 0x7fd23c132ef0 2024-09-11T23:04:03.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.744+0000 7fd23a7fc640 1 -- 172.21.15.12:0/615133540 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2300a6680 con 0x7fd23c132ef0 2024-09-11T23:04:03.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.744+0000 7fd23a7fc640 1 -- 172.21.15.12:0/615133540 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd23000b040 con 0x7fd23c132ef0 2024-09-11T23:04:03.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.744+0000 7fd241d6b640 1 -- 172.21.15.12:0/615133540 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd23c132ef0 msgr2=0x7fd23c0a0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:03.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.744+0000 7fd241d6b640 1 --2- 172.21.15.12:0/615133540 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd23c132ef0 0x7fd23c0a0620 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd23000a8e0 tx=0x7fd23001d7f0 comp rx=0 tx=0).stop 2024-09-11T23:04:03.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.744+0000 7fd241d6b640 1 -- 172.21.15.12:0/615133540 shutdown_connections 2024-09-11T23:04:03.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.744+0000 7fd241d6b640 1 --2- 172.21.15.12:0/615133540 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd23c132ef0 0x7fd23c0a0620 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:03.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.744+0000 7fd241d6b640 1 -- 172.21.15.12:0/615133540 >> 172.21.15.12:0/615133540 conn(0x7fd23c0a85b0 msgr2=0x7fd23c0a49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:03.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.744+0000 7fd241d6b640 1 -- 172.21.15.12:0/615133540 shutdown_connections 2024-09-11T23:04:03.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.744+0000 7fd241d6b640 1 -- 172.21.15.12:0/615133540 wait complete. 2024-09-11T23:04:03.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.744+0000 7fd241d6b640 1 Processor -- start 2024-09-11T23:04:03.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.744+0000 7fd241d6b640 1 -- start start 2024-09-11T23:04:03.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.744+0000 7fd241d6b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd23c132ef0 0x7fd23c06eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:03.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.744+0000 7fd241d6b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd23c136b50 con 0x7fd23c132ef0 2024-09-11T23:04:03.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.744+0000 7fd23b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd23c132ef0 0x7fd23c06eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:03.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.744+0000 7fd23b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd23c132ef0 0x7fd23c06eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58150/0 (socket says 172.21.15.12:58150) 2024-09-11T23:04:03.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.744+0000 7fd23b7fe640 1 -- 172.21.15.12:0/752889585 learned_addr learned my addr 172.21.15.12:0/752889585 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:03.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.744+0000 7fd23b7fe640 1 -- 172.21.15.12:0/752889585 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd23c1cc250 con 0x7fd23c132ef0 2024-09-11T23:04:03.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.748+0000 7fd23b7fe640 1 --2- 172.21.15.12:0/752889585 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd23c132ef0 0x7fd23c06eb50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd23000a8e0 tx=0x7fd23001a590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:03.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.748+0000 7fd223fff640 1 -- 172.21.15.12:0/752889585 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2300b3040 con 0x7fd23c132ef0 2024-09-11T23:04:03.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.748+0000 7fd223fff640 1 -- 172.21.15.12:0/752889585 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2300ae440 con 0x7fd23c132ef0 2024-09-11T23:04:03.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.748+0000 7fd241d6b640 1 -- 172.21.15.12:0/752889585 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd23c1cc4f0 con 0x7fd23c132ef0 2024-09-11T23:04:03.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.748+0000 7fd223fff640 1 -- 172.21.15.12:0/752889585 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2300ae720 con 0x7fd23c132ef0 2024-09-11T23:04:03.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.748+0000 7fd241d6b640 1 -- 172.21.15.12:0/752889585 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd23c139260 con 0x7fd23c132ef0 2024-09-11T23:04:03.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.748+0000 7fd223fff640 1 -- 172.21.15.12:0/752889585 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd2300be030 con 0x7fd23c132ef0 2024-09-11T23:04:03.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.748+0000 7fd241d6b640 1 -- 172.21.15.12:0/752889585 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd23c1322d0 con 0x7fd23c132ef0 2024-09-11T23:04:03.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.748+0000 7fd223fff640 1 --2- 172.21.15.12:0/752889585 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fd228035db0 0x7fd228038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:03.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.748+0000 7fd223fff640 1 -- 172.21.15.12:0/752889585 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 2587+0+0 (secure 0 0 0) 0x7fd2300bc070 con 0x7fd23c132ef0 2024-09-11T23:04:03.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.748+0000 7fd23affd640 1 --2- 172.21.15.12:0/752889585 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fd228035db0 0x7fd228038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:03.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.748+0000 7fd23affd640 1 --2- 172.21.15.12:0/752889585 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fd228035db0 0x7fd228038270 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd22c001610 tx=0x7fd22c007ad0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:03.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.752+0000 7fd223fff640 1 -- 172.21.15.12:0/752889585 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd2300c5020 con 0x7fd23c132ef0 2024-09-11T23:04:03.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:03.908+0000 7fd241d6b640 1 -- 172.21.15.12:0/752889585 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fd23c0a0620 con 0x7fd23c132ef0 2024-09-11T23:04:04.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.632+0000 7fd223fff640 1 -- 172.21.15.12:0/752889585 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v22) ==== 138+0+0 (secure 0 0 0) 0x7fd2300173e0 con 0x7fd23c132ef0 2024-09-11T23:04:04.632 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' created 2024-09-11T23:04:04.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.636+0000 7fd241d6b640 1 -- 172.21.15.12:0/752889585 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fd228035db0 msgr2=0x7fd228038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:04.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.636+0000 7fd241d6b640 1 --2- 172.21.15.12:0/752889585 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fd228035db0 0x7fd228038270 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd22c001610 tx=0x7fd22c007ad0 comp rx=0 tx=0).stop 2024-09-11T23:04:04.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.636+0000 7fd241d6b640 1 -- 172.21.15.12:0/752889585 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd23c132ef0 msgr2=0x7fd23c06eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:04.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.636+0000 7fd241d6b640 1 --2- 172.21.15.12:0/752889585 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd23c132ef0 0x7fd23c06eb50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd23000a8e0 tx=0x7fd23001a590 comp rx=0 tx=0).stop 2024-09-11T23:04:04.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.636+0000 7fd241d6b640 1 -- 172.21.15.12:0/752889585 shutdown_connections 2024-09-11T23:04:04.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.636+0000 7fd241d6b640 1 --2- 172.21.15.12:0/752889585 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fd228035db0 0x7fd228038270 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:04.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.636+0000 7fd241d6b640 1 --2- 172.21.15.12:0/752889585 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd23c132ef0 0x7fd23c06eb50 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:04.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.636+0000 7fd241d6b640 1 -- 172.21.15.12:0/752889585 >> 172.21.15.12:0/752889585 conn(0x7fd23c0a85b0 msgr2=0x7fd23c13b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:04.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.640+0000 7fd241d6b640 1 -- 172.21.15.12:0/752889585 shutdown_connections 2024-09-11T23:04:04.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.640+0000 7fd241d6b640 1 -- 172.21.15.12:0/752889585 wait complete. 2024-09-11T23:04:04.668 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T23:04:04.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.800+0000 7fc64e152640 1 Processor -- start 2024-09-11T23:04:04.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.800+0000 7fc64e152640 1 -- start start 2024-09-11T23:04:04.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.800+0000 7fc64e152640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc64813ad80 0x7fc64813d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:04.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.800+0000 7fc64e152640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6480a0e60 con 0x7fc648134c20 2024-09-11T23:04:04.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.800+0000 7fc64e152640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fc6480a3140 con 0x7fc64813ad80 2024-09-11T23:04:04.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.800+0000 7fc6477fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fc648134c20 0x7fc648135000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:52160/0 (socket says 172.21.15.12:52160) 2024-09-11T23:04:04.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.800+0000 7fc646ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc64813ad80 0x7fc64813d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:04.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.800+0000 7fc6477fe640 1 -- 172.21.15.12:0/693935331 learned_addr learned my addr 172.21.15.12:0/693935331 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:04:04.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.800+0000 7fc646ffd640 1 -- 172.21.15.12:0/693935331 >> v1:172.21.15.12:6789/0 conn(0x7fc648134c20 legacy=0x7fc648135000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:04.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.800+0000 7fc646ffd640 1 -- 172.21.15.12:0/693935331 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6480a4250 con 0x7fc64813ad80 2024-09-11T23:04:04.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.804+0000 7fc646ffd640 1 --2- 172.21.15.12:0/693935331 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc64813ad80 0x7fc64813d170 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc638009740 tx=0x7fc63801ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ccca06a093f0905 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:04.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.804+0000 7fc6467fc640 1 -- 172.21.15.12:0/693935331 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6380b5070 con 0x7fc64813ad80 2024-09-11T23:04:04.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.804+0000 7fc6467fc640 1 -- 172.21.15.12:0/693935331 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6380a8840 con 0x7fc64813ad80 2024-09-11T23:04:04.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.804+0000 7fc6467fc640 1 -- 172.21.15.12:0/693935331 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6380a8b40 con 0x7fc64813ad80 2024-09-11T23:04:04.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.804+0000 7fc64e152640 1 -- 172.21.15.12:0/693935331 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc64813ad80 msgr2=0x7fc64813d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:04.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.804+0000 7fc64e152640 1 --2- 172.21.15.12:0/693935331 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc64813ad80 0x7fc64813d170 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc638009740 tx=0x7fc63801ec10 comp rx=0 tx=0).stop 2024-09-11T23:04:04.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.804+0000 7fc64e152640 1 -- 172.21.15.12:0/693935331 shutdown_connections 2024-09-11T23:04:04.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.804+0000 7fc64e152640 1 --2- 172.21.15.12:0/693935331 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc64813ad80 0x7fc64813d170 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:04.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.804+0000 7fc64e152640 1 -- 172.21.15.12:0/693935331 >> 172.21.15.12:0/693935331 conn(0x7fc6480a6bd0 msgr2=0x7fc6480a6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:04.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.804+0000 7fc64e152640 1 -- 172.21.15.12:0/693935331 shutdown_connections 2024-09-11T23:04:04.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.804+0000 7fc64e152640 1 -- 172.21.15.12:0/693935331 wait complete. 2024-09-11T23:04:04.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.804+0000 7fc64e152640 1 Processor -- start 2024-09-11T23:04:04.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.804+0000 7fc64e152640 1 -- start start 2024-09-11T23:04:04.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.804+0000 7fc64e152640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc648134c20 0x7fc64809be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:04.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.804+0000 7fc64e152640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc6480a33e0 con 0x7fc648134c20 2024-09-11T23:04:04.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.804+0000 7fc6477fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc648134c20 0x7fc64809be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:04.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.804+0000 7fc6477fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc648134c20 0x7fc64809be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39658/0 (socket says 172.21.15.12:39658) 2024-09-11T23:04:04.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.804+0000 7fc6477fe640 1 -- 172.21.15.12:0/4105767240 learned_addr learned my addr 172.21.15.12:0/4105767240 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:04.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.808+0000 7fc6477fe640 1 -- 172.21.15.12:0/4105767240 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc64809db00 con 0x7fc648134c20 2024-09-11T23:04:04.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.808+0000 7fc6477fe640 1 --2- 172.21.15.12:0/4105767240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc648134c20 0x7fc64809be60 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc63c00c380 tx=0x7fc63c00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:04.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.808+0000 7fc62ffff640 1 -- 172.21.15.12:0/4105767240 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc63c017070 con 0x7fc648134c20 2024-09-11T23:04:04.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.808+0000 7fc62ffff640 1 -- 172.21.15.12:0/4105767240 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc63c005c20 con 0x7fc648134c20 2024-09-11T23:04:04.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.808+0000 7fc64e152640 1 -- 172.21.15.12:0/4105767240 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc64809f940 con 0x7fc648134c20 2024-09-11T23:04:04.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.808+0000 7fc62ffff640 1 -- 172.21.15.12:0/4105767240 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc63c0070d0 con 0x7fc648134c20 2024-09-11T23:04:04.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.808+0000 7fc64e152640 1 -- 172.21.15.12:0/4105767240 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6480a9350 con 0x7fc648134c20 2024-09-11T23:04:04.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.808+0000 7fc64e152640 1 -- 172.21.15.12:0/4105767240 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6480a7950 con 0x7fc648134c20 2024-09-11T23:04:04.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.808+0000 7fc62ffff640 1 -- 172.21.15.12:0/4105767240 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc63c01a070 con 0x7fc648134c20 2024-09-11T23:04:04.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.808+0000 7fc62ffff640 1 --2- 172.21.15.12:0/4105767240 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fc634035db0 0x7fc634038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:04.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.808+0000 7fc62ffff640 1 -- 172.21.15.12:0/4105767240 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 2957+0+0 (secure 0 0 0) 0x7fc63c047790 con 0x7fc648134c20 2024-09-11T23:04:04.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.808+0000 7fc646ffd640 1 --2- 172.21.15.12:0/4105767240 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fc634035db0 0x7fc634038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:04.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.808+0000 7fc646ffd640 1 --2- 172.21.15.12:0/4105767240 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fc634035db0 0x7fc634038270 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc6380b2000 tx=0x7fc6380aa070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:04.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.812+0000 7fc62ffff640 1 -- 172.21.15.12:0/4105767240 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc63c010700 con 0x7fc648134c20 2024-09-11T23:04:04.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:04.976+0000 7fc64e152640 1 -- 172.21.15.12:0/4105767240 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fc648134650 con 0x7fc648134c20 2024-09-11T23:04:05.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.632+0000 7fc62ffff640 1 -- 172.21.15.12:0/4105767240 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v23) ==== 170+0+0 (secure 0 0 0) 0x7fc63c007270 con 0x7fc648134c20 2024-09-11T23:04:05.635 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' created 2024-09-11T23:04:05.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.636+0000 7fc64e152640 1 -- 172.21.15.12:0/4105767240 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fc634035db0 msgr2=0x7fc634038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:05.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.636+0000 7fc64e152640 1 --2- 172.21.15.12:0/4105767240 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fc634035db0 0x7fc634038270 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc6380b2000 tx=0x7fc6380aa070 comp rx=0 tx=0).stop 2024-09-11T23:04:05.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.636+0000 7fc64e152640 1 -- 172.21.15.12:0/4105767240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc648134c20 msgr2=0x7fc64809be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:05.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.636+0000 7fc64e152640 1 --2- 172.21.15.12:0/4105767240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc648134c20 0x7fc64809be60 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc63c00c380 tx=0x7fc63c00c840 comp rx=0 tx=0).stop 2024-09-11T23:04:05.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.636+0000 7fc64e152640 1 -- 172.21.15.12:0/4105767240 shutdown_connections 2024-09-11T23:04:05.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.636+0000 7fc64e152640 1 --2- 172.21.15.12:0/4105767240 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fc634035db0 0x7fc634038270 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:05.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.636+0000 7fc64e152640 1 --2- 172.21.15.12:0/4105767240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc648134c20 0x7fc64809be60 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:05.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.636+0000 7fc64e152640 1 -- 172.21.15.12:0/4105767240 >> 172.21.15.12:0/4105767240 conn(0x7fc6480a6bd0 msgr2=0x7fc6480a99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:05.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.636+0000 7fc64e152640 1 -- 172.21.15.12:0/4105767240 shutdown_connections 2024-09-11T23:04:05.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.636+0000 7fc64e152640 1 -- 172.21.15.12:0/4105767240 wait complete. 2024-09-11T23:04:05.669 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T23:04:05.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.796+0000 7f6fe725e640 1 Processor -- start 2024-09-11T23:04:05.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.796+0000 7f6fe725e640 1 -- start start 2024-09-11T23:04:05.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.800+0000 7f6fe725e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6fe01381c0 0x7f6fe013cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:05.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.800+0000 7f6fe725e640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fe009d690 con 0x7f6fe0137de0 2024-09-11T23:04:05.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.800+0000 7f6fe725e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f6fe009ea90 con 0x7f6fe01381c0 2024-09-11T23:04:05.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.800+0000 7f6fdffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6fe01381c0 0x7f6fe013cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:05.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.800+0000 7f6fdffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6fe01381c0 0x7f6fe013cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39662/0 (socket says 172.21.15.12:39662) 2024-09-11T23:04:05.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.800+0000 7f6fdffff640 1 -- 172.21.15.12:0/2634977954 learned_addr learned my addr 172.21.15.12:0/2634977954 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:05.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.800+0000 7f6fe4ffa640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f6fe0137de0 0x7f6fe009f190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:52176/0 (socket says 172.21.15.12:52176) 2024-09-11T23:04:05.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.800+0000 7f6fdffff640 1 -- 172.21.15.12:0/2634977954 >> v1:172.21.15.12:6789/0 conn(0x7f6fe0137de0 legacy=0x7f6fe009f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:05.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.800+0000 7f6fdffff640 1 -- 172.21.15.12:0/2634977954 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fe009cf00 con 0x7f6fe01381c0 2024-09-11T23:04:05.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.800+0000 7f6fdffff640 1 --2- 172.21.15.12:0/2634977954 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6fe01381c0 0x7f6fe013cbc0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6fc80097f0 tx=0x7f6fc801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8a9d4c1a8fa4539 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:05.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.800+0000 7f6fdf7fe640 1 -- 172.21.15.12:0/2634977954 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fc80b2070 con 0x7f6fe01381c0 2024-09-11T23:04:05.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.800+0000 7f6fdf7fe640 1 -- 172.21.15.12:0/2634977954 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fc80a9070 con 0x7f6fe01381c0 2024-09-11T23:04:05.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.800+0000 7f6fdf7fe640 1 -- 172.21.15.12:0/2634977954 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fc80ad5b0 con 0x7f6fe01381c0 2024-09-11T23:04:05.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.800+0000 7f6fe725e640 1 -- 172.21.15.12:0/2634977954 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6fe01381c0 msgr2=0x7f6fe013cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:05.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.800+0000 7f6fe725e640 1 --2- 172.21.15.12:0/2634977954 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6fe01381c0 0x7f6fe013cbc0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6fc80097f0 tx=0x7f6fc801c450 comp rx=0 tx=0).stop 2024-09-11T23:04:05.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.804+0000 7f6fe725e640 1 -- 172.21.15.12:0/2634977954 shutdown_connections 2024-09-11T23:04:05.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.804+0000 7f6fe725e640 1 --2- 172.21.15.12:0/2634977954 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6fe01381c0 0x7f6fe013cbc0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:05.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.804+0000 7f6fe725e640 1 -- 172.21.15.12:0/2634977954 >> 172.21.15.12:0/2634977954 conn(0x7f6fe00a82f0 msgr2=0x7f6fe00a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:05.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.804+0000 7f6fe725e640 1 -- 172.21.15.12:0/2634977954 shutdown_connections 2024-09-11T23:04:05.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.804+0000 7f6fe725e640 1 -- 172.21.15.12:0/2634977954 wait complete. 2024-09-11T23:04:05.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.804+0000 7f6fe725e640 1 Processor -- start 2024-09-11T23:04:05.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.804+0000 7f6fe725e640 1 -- start start 2024-09-11T23:04:05.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.804+0000 7f6fe725e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6fe0137de0 0x7f6fe0072ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:05.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.804+0000 7f6fe725e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe0137860 con 0x7f6fe0137de0 2024-09-11T23:04:05.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.804+0000 7f6fe4ffa640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6fe0137de0 0x7f6fe0072ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:05.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.804+0000 7f6fe4ffa640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6fe0137de0 0x7f6fe0072ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39674/0 (socket says 172.21.15.12:39674) 2024-09-11T23:04:05.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.804+0000 7f6fe4ffa640 1 -- 172.21.15.12:0/1234587520 learned_addr learned my addr 172.21.15.12:0/1234587520 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:05.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.804+0000 7f6fe4ffa640 1 -- 172.21.15.12:0/1234587520 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fe00715c0 con 0x7f6fe0137de0 2024-09-11T23:04:05.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.804+0000 7f6fe4ffa640 1 --2- 172.21.15.12:0/1234587520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6fe0137de0 0x7f6fe0072ef0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6fd800c3b0 tx=0x7f6fd800c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:05.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.804+0000 7f6fdd7fa640 1 -- 172.21.15.12:0/1234587520 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fd8007410 con 0x7f6fe0137de0 2024-09-11T23:04:05.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.804+0000 7f6fdd7fa640 1 -- 172.21.15.12:0/1234587520 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fd80075b0 con 0x7f6fe0137de0 2024-09-11T23:04:05.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.804+0000 7f6fdd7fa640 1 -- 172.21.15.12:0/1234587520 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fd8004920 con 0x7f6fe0137de0 2024-09-11T23:04:05.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.804+0000 7f6fe725e640 1 -- 172.21.15.12:0/1234587520 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fe00723e0 con 0x7f6fe0137de0 2024-09-11T23:04:05.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.804+0000 7f6fe725e640 1 -- 172.21.15.12:0/1234587520 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fe00712b0 con 0x7f6fe0137de0 2024-09-11T23:04:05.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.804+0000 7f6fe725e640 1 -- 172.21.15.12:0/1234587520 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fe009f190 con 0x7f6fe0137de0 2024-09-11T23:04:05.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.808+0000 7f6fdd7fa640 1 -- 172.21.15.12:0/1234587520 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6fd801a020 con 0x7f6fe0137de0 2024-09-11T23:04:05.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.808+0000 7f6fdd7fa640 1 --2- 172.21.15.12:0/1234587520 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f6fc0035db0 0x7f6fc0038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:05.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.808+0000 7f6fdd7fa640 1 -- 172.21.15.12:0/1234587520 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 3339+0+0 (secure 0 0 0) 0x7f6fd8047d50 con 0x7f6fe0137de0 2024-09-11T23:04:05.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.808+0000 7f6fdffff640 1 --2- 172.21.15.12:0/1234587520 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f6fc0035db0 0x7f6fc0038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:05.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.808+0000 7f6fdffff640 1 --2- 172.21.15.12:0/1234587520 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f6fc0035db0 0x7f6fc0038270 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6fc80af000 tx=0x7f6fc80a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:05.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:05.812+0000 7f6fdd7fa640 1 -- 172.21.15.12:0/1234587520 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6fd801b9c0 con 0x7f6fe0137de0 2024-09-11T23:04:06.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.008+0000 7f6fe725e640 1 -- 172.21.15.12:0/1234587520 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f6fe009e730 con 0x7f6fe0137de0 2024-09-11T23:04:06.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.656+0000 7f6fdd7fa640 1 -- 172.21.15.12:0/1234587520 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) ==== 172+0+0 (secure 0 0 0) 0x7f6fd801bc20 con 0x7f6fe0137de0 2024-09-11T23:04:06.665 INFO:teuthology.orchestra.run.smithi012.stderr:new fs with metadata pool 4 and data pool 5 2024-09-11T23:04:06.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.668+0000 7f6fe725e640 1 -- 172.21.15.12:0/1234587520 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f6fc0035db0 msgr2=0x7f6fc0038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:06.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.668+0000 7f6fe725e640 1 --2- 172.21.15.12:0/1234587520 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f6fc0035db0 0x7f6fc0038270 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6fc80af000 tx=0x7f6fc80a7000 comp rx=0 tx=0).stop 2024-09-11T23:04:06.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.668+0000 7f6fe725e640 1 -- 172.21.15.12:0/1234587520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6fe0137de0 msgr2=0x7f6fe0072ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:06.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.668+0000 7f6fe725e640 1 --2- 172.21.15.12:0/1234587520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6fe0137de0 0x7f6fe0072ef0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6fd800c3b0 tx=0x7f6fd800c870 comp rx=0 tx=0).stop 2024-09-11T23:04:06.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.668+0000 7f6fe725e640 1 -- 172.21.15.12:0/1234587520 shutdown_connections 2024-09-11T23:04:06.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.668+0000 7f6fe725e640 1 --2- 172.21.15.12:0/1234587520 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f6fc0035db0 0x7f6fc0038270 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:06.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.668+0000 7f6fe725e640 1 --2- 172.21.15.12:0/1234587520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6fe0137de0 0x7f6fe0072ef0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:06.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.668+0000 7f6fe725e640 1 -- 172.21.15.12:0/1234587520 >> 172.21.15.12:0/1234587520 conn(0x7f6fe00a82f0 msgr2=0x7f6fe009fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:06.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.668+0000 7f6fe725e640 1 -- 172.21.15.12:0/1234587520 shutdown_connections 2024-09-11T23:04:06.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.668+0000 7f6fe725e640 1 -- 172.21.15.12:0/1234587520 wait complete. 2024-09-11T23:04:06.707 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:04:06.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.824+0000 7f2a136a1640 1 Processor -- start 2024-09-11T23:04:06.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.824+0000 7f2a136a1640 1 -- start start 2024-09-11T23:04:06.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.824+0000 7f2a136a1640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2a0c0a3ba0 0x7f2a0c13cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:06.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.824+0000 7f2a136a1640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a0c0a53f0 con 0x7f2a0c0a55f0 2024-09-11T23:04:06.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.824+0000 7f2a136a1640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f2a0c0a2020 con 0x7f2a0c0a3ba0 2024-09-11T23:04:06.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.824+0000 7f2a1143d640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f2a0c0a55f0 0x7f2a0c0a59d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:52184/0 (socket says 172.21.15.12:52184) 2024-09-11T23:04:06.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.824+0000 7f2a10c3c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2a0c0a3ba0 0x7f2a0c13cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:06.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.824+0000 7f2a1143d640 1 -- 172.21.15.12:0/1236623234 learned_addr learned my addr 172.21.15.12:0/1236623234 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:04:06.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.824+0000 7f2a10c3c640 1 -- 172.21.15.12:0/1236623234 >> v1:172.21.15.12:6789/0 conn(0x7f2a0c0a55f0 legacy=0x7f2a0c0a59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:06.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.824+0000 7f2a10c3c640 1 -- 172.21.15.12:0/1236623234 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a0c0a3160 con 0x7f2a0c0a3ba0 2024-09-11T23:04:06.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.824+0000 7f2a0bfff640 1 -- 172.21.15.12:0/1236623234 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3431497884 0 0) 0x7f2a0c0a53f0 con 0x7f2a0c0a55f0 2024-09-11T23:04:06.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.828+0000 7f2a10c3c640 1 --2- 172.21.15.12:0/1236623234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a0c0a3ba0 0x7f2a0c13cd20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f29fc009de0 tx=0x7f29fc01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a01a60a5c71badd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:06.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.828+0000 7f2a0bfff640 1 -- 172.21.15.12:0/1236623234 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29fc0b2070 con 0x7f2a0c0a3ba0 2024-09-11T23:04:06.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.828+0000 7f2a0bfff640 1 -- 172.21.15.12:0/1236623234 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29fc0a5690 con 0x7f2a0c0a3ba0 2024-09-11T23:04:06.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.828+0000 7f2a0bfff640 1 -- 172.21.15.12:0/1236623234 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29fc0a5990 con 0x7f2a0c0a3ba0 2024-09-11T23:04:06.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.828+0000 7f2a136a1640 1 -- 172.21.15.12:0/1236623234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a0c0a3ba0 msgr2=0x7f2a0c13cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:06.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.828+0000 7f2a136a1640 1 --2- 172.21.15.12:0/1236623234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a0c0a3ba0 0x7f2a0c13cd20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f29fc009de0 tx=0x7f29fc01c920 comp rx=0 tx=0).stop 2024-09-11T23:04:06.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.828+0000 7f2a136a1640 1 -- 172.21.15.12:0/1236623234 shutdown_connections 2024-09-11T23:04:06.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.828+0000 7f2a136a1640 1 --2- 172.21.15.12:0/1236623234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a0c0a3ba0 0x7f2a0c13cd20 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:06.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.828+0000 7f2a136a1640 1 -- 172.21.15.12:0/1236623234 >> 172.21.15.12:0/1236623234 conn(0x7f2a0c0aa2c0 msgr2=0x7f2a0c0aa6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:06.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.828+0000 7f2a136a1640 1 -- 172.21.15.12:0/1236623234 shutdown_connections 2024-09-11T23:04:06.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.828+0000 7f2a136a1640 1 -- 172.21.15.12:0/1236623234 wait complete. 2024-09-11T23:04:06.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.828+0000 7f2a136a1640 1 Processor -- start 2024-09-11T23:04:06.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.828+0000 7f2a136a1640 1 -- start start 2024-09-11T23:04:06.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.828+0000 7f2a136a1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a0c0a3ba0 0x7f2a0c13aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:06.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.828+0000 7f2a136a1640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2a0c0a1a80 con 0x7f2a0c0a3ba0 2024-09-11T23:04:06.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.828+0000 7f2a1143d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a0c0a3ba0 0x7f2a0c13aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:06.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.828+0000 7f2a1143d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a0c0a3ba0 0x7f2a0c13aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39686/0 (socket says 172.21.15.12:39686) 2024-09-11T23:04:06.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.828+0000 7f2a1143d640 1 -- 172.21.15.12:0/2872398506 learned_addr learned my addr 172.21.15.12:0/2872398506 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:06.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.828+0000 7f2a1143d640 1 -- 172.21.15.12:0/2872398506 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a0c1386d0 con 0x7f2a0c0a3ba0 2024-09-11T23:04:06.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.832+0000 7f2a1143d640 1 --2- 172.21.15.12:0/2872398506 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a0c0a3ba0 0x7f2a0c13aee0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2a0000c420 tx=0x7f2a0000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:06.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.832+0000 7f2a09ffb640 1 -- 172.21.15.12:0/2872398506 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a00018070 con 0x7f2a0c0a3ba0 2024-09-11T23:04:06.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.832+0000 7f2a09ffb640 1 -- 172.21.15.12:0/2872398506 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a000074d0 con 0x7f2a0c0a3ba0 2024-09-11T23:04:06.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.832+0000 7f2a136a1640 1 -- 172.21.15.12:0/2872398506 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a0c13a760 con 0x7f2a0c0a3ba0 2024-09-11T23:04:06.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.832+0000 7f2a09ffb640 1 -- 172.21.15.12:0/2872398506 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a00004960 con 0x7f2a0c0a3ba0 2024-09-11T23:04:06.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.832+0000 7f2a136a1640 1 -- 172.21.15.12:0/2872398506 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a0c1cf4c0 con 0x7f2a0c0a3ba0 2024-09-11T23:04:06.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.832+0000 7f2a09ffb640 1 -- 172.21.15.12:0/2872398506 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2a0001b070 con 0x7f2a0c0a3ba0 2024-09-11T23:04:06.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.832+0000 7f2a136a1640 1 -- 172.21.15.12:0/2872398506 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a0c1cf2e0 con 0x7f2a0c0a3ba0 2024-09-11T23:04:06.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.832+0000 7f2a09ffb640 1 --2- 172.21.15.12:0/2872398506 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f29f8035db0 0x7f29f8038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:06.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.832+0000 7f2a09ffb640 1 -- 172.21.15.12:0/2872398506 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 3439+0+0 (secure 0 0 0) 0x7f2a00047a90 con 0x7f2a0c0a3ba0 2024-09-11T23:04:06.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.832+0000 7f2a10c3c640 1 --2- 172.21.15.12:0/2872398506 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f29f8035db0 0x7f29f8038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:06.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.832+0000 7f2a10c3c640 1 --2- 172.21.15.12:0/2872398506 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f29f8035db0 0x7f29f8038270 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f29fc0af000 tx=0x7f29fc0a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:06.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:06.836+0000 7f2a09ffb640 1 -- 172.21.15.12:0/2872398506 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2a0c1cf2e0 con 0x7f2a0c0a3ba0 2024-09-11T23:04:07.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.000+0000 7f2a136a1640 1 -- 172.21.15.12:0/2872398506 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2a0c0737a0 con 0x7f2a0c0a3ba0 2024-09-11T23:04:07.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.000+0000 7f2a09ffb640 1 -- 172.21.15.12:0/2872398506 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+10688 (secure 0 0 0) 0x7f2a000119b0 con 0x7f2a0c0a3ba0 2024-09-11T23:04:07.003 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:04:07.004 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":24,"fsid":"8be14356-3340-4500-91a2-4cbc6b511f65","created":"2024-09-11T23:03:10.620234+0000","modified":"2024-09-11T23:04:06.012463+0000","last_up_change":"2024-09-11T23:03:22.359028+0000","last_in_change":"2024-09-11T23:03:11.545817+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:03:23.587068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:04:03.949125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-11T23:04:05.020777+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"153b72a1-40b1-400d-93ea-333e733f9bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6817","nonce":3680911937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6819","nonce":3680911937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6823","nonce":3680911937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6821","nonce":3680911937}]},"public_addr":"172.21.15.12:6817/3680911937","cluster_addr":"172.21.15.12:6819/3680911937","heartbeat_back_addr":"172.21.15.12:6823/3680911937","heartbeat_front_addr":"172.21.15.12:6821/3680911937","state":["exists","up"]},{"osd":1,"uuid":"94669e49-ee4f-4acf-9e25-e94374dda8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6801","nonce":236825163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6803","nonce":236825163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6807","nonce":236825163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6805","nonce":236825163}]},"public_addr":"172.21.15.12:6801/236825163","cluster_addr":"172.21.15.12:6803/236825163","heartbeat_back_addr":"172.21.15.12:6807/236825163","heartbeat_front_addr":"172.21.15.12:6805/236825163","state":["exists","up"]},{"osd":2,"uuid":"826dae4d-8888-4ec5-8f00-425b3be93814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6809","nonce":3263521655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6811","nonce":3263521655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6815","nonce":3263521655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6813","nonce":3263521655}]},"public_addr":"172.21.15.12:6809/3263521655","cluster_addr":"172.21.15.12:6811/3263521655","heartbeat_back_addr":"172.21.15.12:6815/3263521655","heartbeat_front_addr":"172.21.15.12:6813/3263521655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:19.398518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.761524+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.904997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:04:07.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.004+0000 7f2a136a1640 1 -- 172.21.15.12:0/2872398506 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f29f8035db0 msgr2=0x7f29f8038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:07.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.004+0000 7f2a136a1640 1 --2- 172.21.15.12:0/2872398506 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f29f8035db0 0x7f29f8038270 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f29fc0af000 tx=0x7f29fc0a7070 comp rx=0 tx=0).stop 2024-09-11T23:04:07.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.004+0000 7f2a136a1640 1 -- 172.21.15.12:0/2872398506 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a0c0a3ba0 msgr2=0x7f2a0c13aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:07.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.004+0000 7f2a136a1640 1 --2- 172.21.15.12:0/2872398506 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a0c0a3ba0 0x7f2a0c13aee0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2a0000c420 tx=0x7f2a0000c8e0 comp rx=0 tx=0).stop 2024-09-11T23:04:07.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.004+0000 7f2a136a1640 1 -- 172.21.15.12:0/2872398506 shutdown_connections 2024-09-11T23:04:07.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.004+0000 7f2a136a1640 1 --2- 172.21.15.12:0/2872398506 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f29f8035db0 0x7f29f8038270 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:07.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.004+0000 7f2a136a1640 1 --2- 172.21.15.12:0/2872398506 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a0c0a3ba0 0x7f2a0c13aee0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:07.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.004+0000 7f2a136a1640 1 -- 172.21.15.12:0/2872398506 >> 172.21.15.12:0/2872398506 conn(0x7f2a0c0aa2c0 msgr2=0x7f2a0c0715e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:07.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.004+0000 7f2a136a1640 1 -- 172.21.15.12:0/2872398506 shutdown_connections 2024-09-11T23:04:07.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.004+0000 7f2a136a1640 1 -- 172.21.15.12:0/2872398506 wait complete. 2024-09-11T23:04:07.024 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:04:07.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.144+0000 7fa2375e6640 1 Processor -- start 2024-09-11T23:04:07.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.144+0000 7fa2375e6640 1 -- start start 2024-09-11T23:04:07.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.144+0000 7fa2375e6640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa2300a3ba0 0x7fa23013cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:07.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.144+0000 7fa2375e6640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2300a53f0 con 0x7fa2300a55f0 2024-09-11T23:04:07.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.144+0000 7fa2375e6640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fa2300a2020 con 0x7fa2300a3ba0 2024-09-11T23:04:07.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.144+0000 7fa235382640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa2300a55f0 0x7fa2300a59d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:52200/0 (socket says 172.21.15.12:52200) 2024-09-11T23:04:07.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.144+0000 7fa235382640 1 -- 172.21.15.12:0/2149765957 learned_addr learned my addr 172.21.15.12:0/2149765957 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:04:07.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.144+0000 7fa234b81640 1 --2- 172.21.15.12:0/2149765957 >> v2:172.21.15.12:3300/0 conn(0x7fa2300a3ba0 0x7fa23013cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:07.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.144+0000 7fa227fff640 1 -- 172.21.15.12:0/2149765957 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1004316956 0 0) 0x7fa2300a53f0 con 0x7fa2300a55f0 2024-09-11T23:04:07.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.144+0000 7fa227fff640 1 -- 172.21.15.12:0/2149765957 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa21c003530 con 0x7fa2300a55f0 2024-09-11T23:04:07.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.144+0000 7fa234b81640 1 -- 172.21.15.12:0/2149765957 >> v1:172.21.15.12:6789/0 conn(0x7fa2300a55f0 legacy=0x7fa2300a59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:07.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.144+0000 7fa234b81640 1 -- 172.21.15.12:0/2149765957 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2300a3160 con 0x7fa2300a3ba0 2024-09-11T23:04:07.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.144+0000 7fa234b81640 1 --2- 172.21.15.12:0/2149765957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2300a3ba0 0x7fa23013cd20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa220009720 tx=0x7fa22001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5c72b8ef6e09294 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:07.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.144+0000 7fa227fff640 1 -- 172.21.15.12:0/2149765957 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2200b0070 con 0x7fa2300a3ba0 2024-09-11T23:04:07.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.144+0000 7fa227fff640 1 -- 172.21.15.12:0/2149765957 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2200ab530 con 0x7fa2300a3ba0 2024-09-11T23:04:07.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.144+0000 7fa227fff640 1 -- 172.21.15.12:0/2149765957 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2200ab810 con 0x7fa2300a3ba0 2024-09-11T23:04:07.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.148+0000 7fa2375e6640 1 -- 172.21.15.12:0/2149765957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2300a3ba0 msgr2=0x7fa23013cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:07.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.148+0000 7fa2375e6640 1 --2- 172.21.15.12:0/2149765957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2300a3ba0 0x7fa23013cd20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa220009720 tx=0x7fa22001c370 comp rx=0 tx=0).stop 2024-09-11T23:04:07.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.148+0000 7fa2375e6640 1 -- 172.21.15.12:0/2149765957 shutdown_connections 2024-09-11T23:04:07.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.148+0000 7fa2375e6640 1 --2- 172.21.15.12:0/2149765957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2300a3ba0 0x7fa23013cd20 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:07.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.148+0000 7fa2375e6640 1 -- 172.21.15.12:0/2149765957 >> 172.21.15.12:0/2149765957 conn(0x7fa2300aa2c0 msgr2=0x7fa2300aa6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:07.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.148+0000 7fa2375e6640 1 -- 172.21.15.12:0/2149765957 shutdown_connections 2024-09-11T23:04:07.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.148+0000 7fa2375e6640 1 -- 172.21.15.12:0/2149765957 wait complete. 2024-09-11T23:04:07.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.148+0000 7fa2375e6640 1 Processor -- start 2024-09-11T23:04:07.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.148+0000 7fa2375e6640 1 -- start start 2024-09-11T23:04:07.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.148+0000 7fa2375e6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2300a3ba0 0x7fa230139330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:07.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.148+0000 7fa2375e6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa2300a1a80 con 0x7fa2300a3ba0 2024-09-11T23:04:07.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.148+0000 7fa235382640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2300a3ba0 0x7fa230139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:07.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.148+0000 7fa235382640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2300a3ba0 0x7fa230139330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39702/0 (socket says 172.21.15.12:39702) 2024-09-11T23:04:07.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.148+0000 7fa235382640 1 -- 172.21.15.12:0/2205134412 learned_addr learned my addr 172.21.15.12:0/2205134412 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:07.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.148+0000 7fa235382640 1 -- 172.21.15.12:0/2205134412 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa230138970 con 0x7fa2300a3ba0 2024-09-11T23:04:07.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.148+0000 7fa235382640 1 --2- 172.21.15.12:0/2205134412 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2300a3ba0 0x7fa230139330 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa22c00c3d0 tx=0x7fa22c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:07.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.148+0000 7fa225ffb640 1 -- 172.21.15.12:0/2205134412 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa22c017070 con 0x7fa2300a3ba0 2024-09-11T23:04:07.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.148+0000 7fa225ffb640 1 -- 172.21.15.12:0/2205134412 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa22c005ce0 con 0x7fa2300a3ba0 2024-09-11T23:04:07.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.148+0000 7fa225ffb640 1 -- 172.21.15.12:0/2205134412 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa22c0070d0 con 0x7fa2300a3ba0 2024-09-11T23:04:07.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.148+0000 7fa2375e6640 1 -- 172.21.15.12:0/2205134412 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa23013a1c0 con 0x7fa2300a3ba0 2024-09-11T23:04:07.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.148+0000 7fa2375e6640 1 -- 172.21.15.12:0/2205134412 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2301cbc90 con 0x7fa2300a3ba0 2024-09-11T23:04:07.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.152+0000 7fa2375e6640 1 -- 172.21.15.12:0/2205134412 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2300008e0 con 0x7fa2300a3ba0 2024-09-11T23:04:07.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.152+0000 7fa225ffb640 1 -- 172.21.15.12:0/2205134412 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa22c01a070 con 0x7fa2300a3ba0 2024-09-11T23:04:07.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.152+0000 7fa225ffb640 1 --2- 172.21.15.12:0/2205134412 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fa214035db0 0x7fa214038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:07.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.152+0000 7fa225ffb640 1 -- 172.21.15.12:0/2205134412 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 3439+0+0 (secure 0 0 0) 0x7fa22c047a70 con 0x7fa2300a3ba0 2024-09-11T23:04:07.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.152+0000 7fa234b81640 1 --2- 172.21.15.12:0/2205134412 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fa214035db0 0x7fa214038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:07.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.152+0000 7fa234b81640 1 --2- 172.21.15.12:0/2205134412 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fa214035db0 0x7fa214038270 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa2200ad000 tx=0x7fa220008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:07.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.156+0000 7fa225ffb640 1 -- 172.21.15.12:0/2205134412 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa22c019e10 con 0x7fa2300a3ba0 2024-09-11T23:04:07.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.320+0000 7fa2375e6640 1 -- 172.21.15.12:0/2205134412 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa23013fa80 con 0x7fa2300a3ba0 2024-09-11T23:04:07.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.324+0000 7fa225ffb640 1 -- 172.21.15.12:0/2205134412 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+10688 (secure 0 0 0) 0x7fa22c047e20 con 0x7fa2300a3ba0 2024-09-11T23:04:07.325 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:04:07.325 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":24,"fsid":"8be14356-3340-4500-91a2-4cbc6b511f65","created":"2024-09-11T23:03:10.620234+0000","modified":"2024-09-11T23:04:06.012463+0000","last_up_change":"2024-09-11T23:03:22.359028+0000","last_in_change":"2024-09-11T23:03:11.545817+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:03:23.587068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:04:03.949125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-11T23:04:05.020777+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"153b72a1-40b1-400d-93ea-333e733f9bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6817","nonce":3680911937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6819","nonce":3680911937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6823","nonce":3680911937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6821","nonce":3680911937}]},"public_addr":"172.21.15.12:6817/3680911937","cluster_addr":"172.21.15.12:6819/3680911937","heartbeat_back_addr":"172.21.15.12:6823/3680911937","heartbeat_front_addr":"172.21.15.12:6821/3680911937","state":["exists","up"]},{"osd":1,"uuid":"94669e49-ee4f-4acf-9e25-e94374dda8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6801","nonce":236825163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6803","nonce":236825163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6807","nonce":236825163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6805","nonce":236825163}]},"public_addr":"172.21.15.12:6801/236825163","cluster_addr":"172.21.15.12:6803/236825163","heartbeat_back_addr":"172.21.15.12:6807/236825163","heartbeat_front_addr":"172.21.15.12:6805/236825163","state":["exists","up"]},{"osd":2,"uuid":"826dae4d-8888-4ec5-8f00-425b3be93814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6809","nonce":3263521655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6811","nonce":3263521655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6815","nonce":3263521655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6813","nonce":3263521655}]},"public_addr":"172.21.15.12:6809/3263521655","cluster_addr":"172.21.15.12:6811/3263521655","heartbeat_back_addr":"172.21.15.12:6815/3263521655","heartbeat_front_addr":"172.21.15.12:6813/3263521655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:19.398518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.761524+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.904997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:04:07.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.324+0000 7fa2375e6640 1 -- 172.21.15.12:0/2205134412 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fa214035db0 msgr2=0x7fa214038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:07.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.324+0000 7fa2375e6640 1 --2- 172.21.15.12:0/2205134412 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fa214035db0 0x7fa214038270 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa2200ad000 tx=0x7fa220008040 comp rx=0 tx=0).stop 2024-09-11T23:04:07.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.324+0000 7fa2375e6640 1 -- 172.21.15.12:0/2205134412 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2300a3ba0 msgr2=0x7fa230139330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:07.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.324+0000 7fa2375e6640 1 --2- 172.21.15.12:0/2205134412 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2300a3ba0 0x7fa230139330 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa22c00c3d0 tx=0x7fa22c00c890 comp rx=0 tx=0).stop 2024-09-11T23:04:07.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.324+0000 7fa2375e6640 1 -- 172.21.15.12:0/2205134412 shutdown_connections 2024-09-11T23:04:07.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.324+0000 7fa2375e6640 1 --2- 172.21.15.12:0/2205134412 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fa214035db0 0x7fa214038270 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:07.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.324+0000 7fa2375e6640 1 --2- 172.21.15.12:0/2205134412 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2300a3ba0 0x7fa230139330 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:07.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.324+0000 7fa2375e6640 1 -- 172.21.15.12:0/2205134412 >> 172.21.15.12:0/2205134412 conn(0x7fa2300aa2c0 msgr2=0x7fa230071350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:07.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.324+0000 7fa2375e6640 1 -- 172.21.15.12:0/2205134412 shutdown_connections 2024-09-11T23:04:07.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.324+0000 7fa2375e6640 1 -- 172.21.15.12:0/2205134412 wait complete. 2024-09-11T23:04:07.344 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-11T23:04:07.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.464+0000 7f5287b65640 1 Processor -- start 2024-09-11T23:04:07.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.464+0000 7f5287b65640 1 -- start start 2024-09-11T23:04:07.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.464+0000 7f5287b65640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f52801381c0 0x7f528013cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:07.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.464+0000 7f5287b65640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f528009d690 con 0x7f5280137de0 2024-09-11T23:04:07.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.464+0000 7f5287b65640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f528009ea90 con 0x7f52801381c0 2024-09-11T23:04:07.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.464+0000 7f5285100640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f52801381c0 0x7f528013cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:07.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.464+0000 7f5285901640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f5280137de0 0x7f528009f190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:52210/0 (socket says 172.21.15.12:52210) 2024-09-11T23:04:07.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.464+0000 7f5285901640 1 -- 172.21.15.12:0/3687708644 learned_addr learned my addr 172.21.15.12:0/3687708644 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:04:07.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.464+0000 7f5285100640 1 -- 172.21.15.12:0/3687708644 >> v1:172.21.15.12:6789/0 conn(0x7f5280137de0 legacy=0x7f528009f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:07.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.464+0000 7f5285100640 1 -- 172.21.15.12:0/3687708644 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f528009cf00 con 0x7f52801381c0 2024-09-11T23:04:07.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.468+0000 7f5285100640 1 --2- 172.21.15.12:0/3687708644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52801381c0 0x7f528013cbc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5274009740 tx=0x7f527401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=263183e0e0ccaade server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:07.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.468+0000 7f52848ff640 1 -- 172.21.15.12:0/3687708644 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52740b0070 con 0x7f52801381c0 2024-09-11T23:04:07.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.468+0000 7f52848ff640 1 -- 172.21.15.12:0/3687708644 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52740ab530 con 0x7f52801381c0 2024-09-11T23:04:07.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.468+0000 7f52848ff640 1 -- 172.21.15.12:0/3687708644 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52740ab830 con 0x7f52801381c0 2024-09-11T23:04:07.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.468+0000 7f5287b65640 1 -- 172.21.15.12:0/3687708644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52801381c0 msgr2=0x7f528013cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:07.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.468+0000 7f5287b65640 1 --2- 172.21.15.12:0/3687708644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52801381c0 0x7f528013cbc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5274009740 tx=0x7f527401c390 comp rx=0 tx=0).stop 2024-09-11T23:04:07.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.468+0000 7f5287b65640 1 -- 172.21.15.12:0/3687708644 shutdown_connections 2024-09-11T23:04:07.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.468+0000 7f5287b65640 1 --2- 172.21.15.12:0/3687708644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52801381c0 0x7f528013cbc0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:07.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.468+0000 7f5287b65640 1 -- 172.21.15.12:0/3687708644 >> 172.21.15.12:0/3687708644 conn(0x7f52800a82f0 msgr2=0x7f52800a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:07.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.468+0000 7f5287b65640 1 -- 172.21.15.12:0/3687708644 shutdown_connections 2024-09-11T23:04:07.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.468+0000 7f5287b65640 1 -- 172.21.15.12:0/3687708644 wait complete. 2024-09-11T23:04:07.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.468+0000 7f5287b65640 1 Processor -- start 2024-09-11T23:04:07.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.468+0000 7f5287b65640 1 -- start start 2024-09-11T23:04:07.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.468+0000 7f5287b65640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5280137de0 0x7f528006fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:07.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.468+0000 7f5287b65640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5280137860 con 0x7f5280137de0 2024-09-11T23:04:07.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.468+0000 7f5285901640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5280137de0 0x7f528006fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:07.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.468+0000 7f5285901640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5280137de0 0x7f528006fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39714/0 (socket says 172.21.15.12:39714) 2024-09-11T23:04:07.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.468+0000 7f5285901640 1 -- 172.21.15.12:0/3110100073 learned_addr learned my addr 172.21.15.12:0/3110100073 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:07.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.468+0000 7f5285901640 1 -- 172.21.15.12:0/3110100073 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f528011eaf0 con 0x7f5280137de0 2024-09-11T23:04:07.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.468+0000 7f5285901640 1 --2- 172.21.15.12:0/3110100073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5280137de0 0x7f528006fd40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f527000cb40 tx=0x7f527000cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:07.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.468+0000 7f527e7fc640 1 -- 172.21.15.12:0/3110100073 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5270017070 con 0x7f5280137de0 2024-09-11T23:04:07.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.468+0000 7f527e7fc640 1 -- 172.21.15.12:0/3110100073 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f527000ab30 con 0x7f5280137de0 2024-09-11T23:04:07.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.468+0000 7f527e7fc640 1 -- 172.21.15.12:0/3110100073 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f527000ae10 con 0x7f5280137de0 2024-09-11T23:04:07.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.468+0000 7f5287b65640 1 -- 172.21.15.12:0/3110100073 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5280072550 con 0x7f5280137de0 2024-09-11T23:04:07.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.468+0000 7f5287b65640 1 -- 172.21.15.12:0/3110100073 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5280071990 con 0x7f5280137de0 2024-09-11T23:04:07.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.472+0000 7f5287b65640 1 -- 172.21.15.12:0/3110100073 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5280071c70 con 0x7f5280137de0 2024-09-11T23:04:07.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.472+0000 7f527e7fc640 1 -- 172.21.15.12:0/3110100073 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f527001a070 con 0x7f5280137de0 2024-09-11T23:04:07.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.472+0000 7f527e7fc640 1 --2- 172.21.15.12:0/3110100073 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f526c035d60 0x7f526c038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:07.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.472+0000 7f527e7fc640 1 -- 172.21.15.12:0/3110100073 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 3439+0+0 (secure 0 0 0) 0x7f5270048370 con 0x7f5280137de0 2024-09-11T23:04:07.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.472+0000 7f5285100640 1 --2- 172.21.15.12:0/3110100073 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f526c035d60 0x7f526c038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:07.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.472+0000 7f5285100640 1 --2- 172.21.15.12:0/3110100073 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f526c035d60 0x7f526c038220 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f52740ad000 tx=0x7f52740a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:07.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.476+0000 7f527e7fc640 1 -- 172.21.15.12:0/3110100073 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5270010300 con 0x7f5280137de0 2024-09-11T23:04:07.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:07.680+0000 7f5287b65640 1 -- 172.21.15.12:0/3110100073 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f528009f190 con 0x7f5280137de0 2024-09-11T23:04:08.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.664+0000 7f527e7fc640 1 -- 172.21.15.12:0/3110100073 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) ==== 118+0+0 (secure 0 0 0) 0x7f52700078c0 con 0x7f5280137de0 2024-09-11T23:04:08.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.668+0000 7f5287b65640 1 -- 172.21.15.12:0/3110100073 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f526c035d60 msgr2=0x7f526c038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:08.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.668+0000 7f5287b65640 1 --2- 172.21.15.12:0/3110100073 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f526c035d60 0x7f526c038220 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f52740ad000 tx=0x7f52740a6000 comp rx=0 tx=0).stop 2024-09-11T23:04:08.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.668+0000 7f5287b65640 1 -- 172.21.15.12:0/3110100073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5280137de0 msgr2=0x7f528006fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:08.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.668+0000 7f5287b65640 1 --2- 172.21.15.12:0/3110100073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5280137de0 0x7f528006fd40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f527000cb40 tx=0x7f527000cf40 comp rx=0 tx=0).stop 2024-09-11T23:04:08.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.668+0000 7f5287b65640 1 -- 172.21.15.12:0/3110100073 shutdown_connections 2024-09-11T23:04:08.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.668+0000 7f5287b65640 1 --2- 172.21.15.12:0/3110100073 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f526c035d60 0x7f526c038220 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:08.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.668+0000 7f5287b65640 1 --2- 172.21.15.12:0/3110100073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5280137de0 0x7f528006fd40 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:08.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.668+0000 7f5287b65640 1 -- 172.21.15.12:0/3110100073 >> 172.21.15.12:0/3110100073 conn(0x7f52800a82f0 msgr2=0x7f528009fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:08.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.668+0000 7f5287b65640 1 -- 172.21.15.12:0/3110100073 shutdown_connections 2024-09-11T23:04:08.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.668+0000 7f5287b65640 1 -- 172.21.15.12:0/3110100073 wait complete. 2024-09-11T23:04:08.692 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-11T23:04:08.692 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-11T23:04:08.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.824+0000 7fbcdd1dc640 1 Processor -- start 2024-09-11T23:04:08.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.824+0000 7fbcdd1dc640 1 -- start start 2024-09-11T23:04:08.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.824+0000 7fbcdd1dc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbcd81381c0 0x7fbcd813cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:08.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.824+0000 7fbcdd1dc640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcd809d690 con 0x7fbcd8137de0 2024-09-11T23:04:08.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.824+0000 7fbcdd1dc640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fbcd809ea90 con 0x7fbcd81381c0 2024-09-11T23:04:08.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.824+0000 7fbcd659c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbcd81381c0 0x7fbcd813cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:08.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.824+0000 7fbcd659c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbcd81381c0 0x7fbcd813cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39726/0 (socket says 172.21.15.12:39726) 2024-09-11T23:04:08.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.824+0000 7fbcd659c640 1 -- 172.21.15.12:0/1912535193 learned_addr learned my addr 172.21.15.12:0/1912535193 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:08.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.824+0000 7fbcd659c640 1 -- 172.21.15.12:0/1912535193 >> v1:172.21.15.12:6789/0 conn(0x7fbcd8137de0 legacy=0x7fbcd809f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:08.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.824+0000 7fbcd659c640 1 -- 172.21.15.12:0/1912535193 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcd809cf00 con 0x7fbcd81381c0 2024-09-11T23:04:08.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.824+0000 7fbcd5d9b640 1 -- 172.21.15.12:0/1912535193 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1988509960 0 0) 0x7fbcd809d690 con 0x7fbcd8137de0 2024-09-11T23:04:08.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.828+0000 7fbcd659c640 1 --2- 172.21.15.12:0/1912535193 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcd81381c0 0x7fbcd813cbc0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbccc0097f0 tx=0x7fbccc01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4ca8e11c942bbc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:08.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.828+0000 7fbcd5d9b640 1 -- 172.21.15.12:0/1912535193 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbccc0b2070 con 0x7fbcd81381c0 2024-09-11T23:04:08.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.828+0000 7fbcd5d9b640 1 -- 172.21.15.12:0/1912535193 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbccc0a9070 con 0x7fbcd81381c0 2024-09-11T23:04:08.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.828+0000 7fbcd5d9b640 1 -- 172.21.15.12:0/1912535193 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbccc0ad5b0 con 0x7fbcd81381c0 2024-09-11T23:04:08.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.828+0000 7fbcdd1dc640 1 -- 172.21.15.12:0/1912535193 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcd81381c0 msgr2=0x7fbcd813cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:08.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.828+0000 7fbcdd1dc640 1 --2- 172.21.15.12:0/1912535193 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcd81381c0 0x7fbcd813cbc0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbccc0097f0 tx=0x7fbccc01c450 comp rx=0 tx=0).stop 2024-09-11T23:04:08.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.832+0000 7fbcdd1dc640 1 -- 172.21.15.12:0/1912535193 shutdown_connections 2024-09-11T23:04:08.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.832+0000 7fbcdd1dc640 1 --2- 172.21.15.12:0/1912535193 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcd81381c0 0x7fbcd813cbc0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:08.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.832+0000 7fbcdd1dc640 1 -- 172.21.15.12:0/1912535193 >> 172.21.15.12:0/1912535193 conn(0x7fbcd80a82f0 msgr2=0x7fbcd80a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:08.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.832+0000 7fbcdd1dc640 1 -- 172.21.15.12:0/1912535193 shutdown_connections 2024-09-11T23:04:08.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.832+0000 7fbcdd1dc640 1 -- 172.21.15.12:0/1912535193 wait complete. 2024-09-11T23:04:08.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.832+0000 7fbcdd1dc640 1 Processor -- start 2024-09-11T23:04:08.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.832+0000 7fbcdd1dc640 1 -- start start 2024-09-11T23:04:08.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.832+0000 7fbcdd1dc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcd8137de0 0x7fbcd806fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:08.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.832+0000 7fbcdd1dc640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd8137860 con 0x7fbcd8137de0 2024-09-11T23:04:08.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.832+0000 7fbcd6d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcd8137de0 0x7fbcd806fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:08.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.832+0000 7fbcd6d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcd8137de0 0x7fbcd806fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39732/0 (socket says 172.21.15.12:39732) 2024-09-11T23:04:08.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.832+0000 7fbcd6d9d640 1 -- 172.21.15.12:0/3016025925 learned_addr learned my addr 172.21.15.12:0/3016025925 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:08.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.832+0000 7fbcd6d9d640 1 -- 172.21.15.12:0/3016025925 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcd8071b60 con 0x7fbcd8137de0 2024-09-11T23:04:08.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.832+0000 7fbcd6d9d640 1 --2- 172.21.15.12:0/3016025925 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcd8137de0 0x7fbcd806fbe0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fbcc800c390 tx=0x7fbcc800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:08.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.832+0000 7fbcbf7fe640 1 -- 172.21.15.12:0/3016025925 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcc8005410 con 0x7fbcd8137de0 2024-09-11T23:04:08.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.832+0000 7fbcbf7fe640 1 -- 172.21.15.12:0/3016025925 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcc8007030 con 0x7fbcd8137de0 2024-09-11T23:04:08.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.832+0000 7fbcdd1dc640 1 -- 172.21.15.12:0/3016025925 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcd8137410 con 0x7fbcd8137de0 2024-09-11T23:04:08.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.832+0000 7fbcbf7fe640 1 -- 172.21.15.12:0/3016025925 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcc8007350 con 0x7fbcd8137de0 2024-09-11T23:04:08.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.832+0000 7fbcdd1dc640 1 -- 172.21.15.12:0/3016025925 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcd80736c0 con 0x7fbcd8137de0 2024-09-11T23:04:08.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.832+0000 7fbcdd1dc640 1 -- 172.21.15.12:0/3016025925 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcd809f190 con 0x7fbcd8137de0 2024-09-11T23:04:08.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.832+0000 7fbcbf7fe640 1 -- 172.21.15.12:0/3016025925 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbcc801a020 con 0x7fbcd8137de0 2024-09-11T23:04:08.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.836+0000 7fbcbf7fe640 1 --2- 172.21.15.12:0/3016025925 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fbcc4035db0 0x7fbcc4038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:08.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.836+0000 7fbcbf7fe640 1 -- 172.21.15.12:0/3016025925 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 3439+0+0 (secure 0 0 0) 0x7fbcc8047dc0 con 0x7fbcd8137de0 2024-09-11T23:04:08.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.836+0000 7fbcd659c640 1 --2- 172.21.15.12:0/3016025925 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fbcc4035db0 0x7fbcc4038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:08.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.836+0000 7fbcd659c640 1 --2- 172.21.15.12:0/3016025925 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fbcc4035db0 0x7fbcc4038270 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbccc0af000 tx=0x7fbccc0a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:08.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:08.840+0000 7fbcbf7fe640 1 -- 172.21.15.12:0/3016025925 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbcc8012a30 con 0x7fbcd8137de0 2024-09-11T23:04:09.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.040+0000 7fbcdd1dc640 1 -- 172.21.15.12:0/3016025925 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fbcd809e730 con 0x7fbcd8137de0 2024-09-11T23:04:09.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.672+0000 7fbcbf7fe640 1 -- 172.21.15.12:0/3016025925 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7fbcc8012cf0 con 0x7fbcd8137de0 2024-09-11T23:04:09.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.676+0000 7fbcdd1dc640 1 -- 172.21.15.12:0/3016025925 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fbcc4035db0 msgr2=0x7fbcc4038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:09.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.676+0000 7fbcdd1dc640 1 --2- 172.21.15.12:0/3016025925 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fbcc4035db0 0x7fbcc4038270 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbccc0af000 tx=0x7fbccc0a7000 comp rx=0 tx=0).stop 2024-09-11T23:04:09.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.676+0000 7fbcdd1dc640 1 -- 172.21.15.12:0/3016025925 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcd8137de0 msgr2=0x7fbcd806fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:09.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.676+0000 7fbcdd1dc640 1 --2- 172.21.15.12:0/3016025925 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcd8137de0 0x7fbcd806fbe0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fbcc800c390 tx=0x7fbcc800c850 comp rx=0 tx=0).stop 2024-09-11T23:04:09.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.676+0000 7fbcdd1dc640 1 -- 172.21.15.12:0/3016025925 shutdown_connections 2024-09-11T23:04:09.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.676+0000 7fbcdd1dc640 1 --2- 172.21.15.12:0/3016025925 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fbcc4035db0 0x7fbcc4038270 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:09.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.676+0000 7fbcdd1dc640 1 --2- 172.21.15.12:0/3016025925 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcd8137de0 0x7fbcd806fbe0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:09.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.676+0000 7fbcdd1dc640 1 -- 172.21.15.12:0/3016025925 >> 172.21.15.12:0/3016025925 conn(0x7fbcd80a82f0 msgr2=0x7fbcd8136440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:09.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.676+0000 7fbcdd1dc640 1 -- 172.21.15.12:0/3016025925 shutdown_connections 2024-09-11T23:04:09.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.676+0000 7fbcdd1dc640 1 -- 172.21.15.12:0/3016025925 wait complete. 2024-09-11T23:04:09.700 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-11T23:04:09.701 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:04:09.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.828+0000 7fa97a6bd640 1 Processor -- start 2024-09-11T23:04:09.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.828+0000 7fa97a6bd640 1 -- start start 2024-09-11T23:04:09.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.832+0000 7fa97a6bd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa97413a410 0x7fa9740a6af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:09.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.832+0000 7fa97a6bd640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9740a82a0 con 0x7fa9740a4b80 2024-09-11T23:04:09.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.832+0000 7fa97a6bd640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fa9740a3cb0 con 0x7fa97413a410 2024-09-11T23:04:09.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.832+0000 7fa973fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa97413a410 0x7fa9740a6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:09.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.832+0000 7fa9737fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa9740a4b80 0x7fa9740a7030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:52234/0 (socket says 172.21.15.12:52234) 2024-09-11T23:04:09.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.832+0000 7fa973fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa97413a410 0x7fa9740a6af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39746/0 (socket says 172.21.15.12:39746) 2024-09-11T23:04:09.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.832+0000 7fa9737fe640 1 -- 172.21.15.12:0/1465474693 learned_addr learned my addr 172.21.15.12:0/1465474693 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:04:09.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.832+0000 7fa973fff640 1 -- 172.21.15.12:0/1465474693 >> v1:172.21.15.12:6789/0 conn(0x7fa9740a4b80 legacy=0x7fa9740a7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:09.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.832+0000 7fa973fff640 1 -- 172.21.15.12:0/1465474693 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa974139fe0 con 0x7fa97413a410 2024-09-11T23:04:09.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.832+0000 7fa973fff640 1 --2- 172.21.15.12:0/1465474693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa97413a410 0x7fa9740a6af0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa964009d90 tx=0x7fa96401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa0b31bce1b2500 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:09.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.832+0000 7fa972ffd640 1 -- 172.21.15.12:0/1465474693 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9640b2070 con 0x7fa97413a410 2024-09-11T23:04:09.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.832+0000 7fa972ffd640 1 -- 172.21.15.12:0/1465474693 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9640a5760 con 0x7fa97413a410 2024-09-11T23:04:09.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.832+0000 7fa972ffd640 1 -- 172.21.15.12:0/1465474693 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9640a5a60 con 0x7fa97413a410 2024-09-11T23:04:09.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.832+0000 7fa97a6bd640 1 -- 172.21.15.12:0/1465474693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa97413a410 msgr2=0x7fa9740a6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:09.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.832+0000 7fa97a6bd640 1 --2- 172.21.15.12:0/1465474693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa97413a410 0x7fa9740a6af0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa964009d90 tx=0x7fa96401c8e0 comp rx=0 tx=0).stop 2024-09-11T23:04:09.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.832+0000 7fa97a6bd640 1 -- 172.21.15.12:0/1465474693 shutdown_connections 2024-09-11T23:04:09.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.832+0000 7fa97a6bd640 1 --2- 172.21.15.12:0/1465474693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa97413a410 0x7fa9740a6af0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:09.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.832+0000 7fa97a6bd640 1 -- 172.21.15.12:0/1465474693 >> 172.21.15.12:0/1465474693 conn(0x7fa9740ac2c0 msgr2=0x7fa9740ac6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:09.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.832+0000 7fa97a6bd640 1 -- 172.21.15.12:0/1465474693 shutdown_connections 2024-09-11T23:04:09.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.832+0000 7fa97a6bd640 1 -- 172.21.15.12:0/1465474693 wait complete. 2024-09-11T23:04:09.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.836+0000 7fa97a6bd640 1 Processor -- start 2024-09-11T23:04:09.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.836+0000 7fa97a6bd640 1 -- start start 2024-09-11T23:04:09.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.836+0000 7fa97a6bd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9740a4b80 0x7fa9740a1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:09.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.836+0000 7fa97a6bd640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa9740a7740 con 0x7fa9740a4b80 2024-09-11T23:04:09.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.836+0000 7fa973fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9740a4b80 0x7fa9740a1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:09.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.836+0000 7fa973fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9740a4b80 0x7fa9740a1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39752/0 (socket says 172.21.15.12:39752) 2024-09-11T23:04:09.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.836+0000 7fa973fff640 1 -- 172.21.15.12:0/2708565005 learned_addr learned my addr 172.21.15.12:0/2708565005 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:09.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.836+0000 7fa973fff640 1 -- 172.21.15.12:0/2708565005 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9740a0700 con 0x7fa9740a4b80 2024-09-11T23:04:09.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.836+0000 7fa973fff640 1 --2- 172.21.15.12:0/2708565005 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9740a4b80 0x7fa9740a1140 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa96401a510 tx=0x7fa964019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:09.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.836+0000 7fa970ff9640 1 -- 172.21.15.12:0/2708565005 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9640bd030 con 0x7fa9740a4b80 2024-09-11T23:04:09.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.836+0000 7fa970ff9640 1 -- 172.21.15.12:0/2708565005 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9640b85a0 con 0x7fa9740a4b80 2024-09-11T23:04:09.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.836+0000 7fa97a6bd640 1 -- 172.21.15.12:0/2708565005 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa97413f070 con 0x7fa9740a4b80 2024-09-11T23:04:09.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.836+0000 7fa970ff9640 1 -- 172.21.15.12:0/2708565005 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9640b2040 con 0x7fa9740a4b80 2024-09-11T23:04:09.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.836+0000 7fa97a6bd640 1 -- 172.21.15.12:0/2708565005 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9740a09c0 con 0x7fa9740a4b80 2024-09-11T23:04:09.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.836+0000 7fa97a6bd640 1 -- 172.21.15.12:0/2708565005 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9740a6af0 con 0x7fa9740a4b80 2024-09-11T23:04:09.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.836+0000 7fa970ff9640 1 -- 172.21.15.12:0/2708565005 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa9640c0070 con 0x7fa9740a4b80 2024-09-11T23:04:09.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.836+0000 7fa970ff9640 1 --2- 172.21.15.12:0/2708565005 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fa960035db0 0x7fa960038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:09.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.836+0000 7fa970ff9640 1 -- 172.21.15.12:0/2708565005 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 3439+0+0 (secure 0 0 0) 0x7fa9640be070 con 0x7fa9740a4b80 2024-09-11T23:04:09.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.836+0000 7fa9737fe640 1 --2- 172.21.15.12:0/2708565005 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fa960035db0 0x7fa960038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:09.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.836+0000 7fa9737fe640 1 --2- 172.21.15.12:0/2708565005 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fa960035db0 0x7fa960038270 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa968001610 tx=0x7fa968007ad0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:09.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:09.840+0000 7fa970ff9640 1 -- 172.21.15.12:0/2708565005 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa9640c7070 con 0x7fa9740a4b80 2024-09-11T23:04:10.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.040+0000 7fa97a6bd640 1 -- 172.21.15.12:0/2708565005 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa9740a2eb0 con 0x7fa9740a4b80 2024-09-11T23:04:10.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.040+0000 7fa970ff9640 1 -- 172.21.15.12:0/2708565005 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+3570 (secure 0 0 0) 0x7fa964016560 con 0x7fa9740a4b80 2024-09-11T23:04:10.042 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:04:10.042 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":16,"btime":"2024-09-11T23:04:09:670574+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4328,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6827/3738380591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":3738380591},{"type":"v1","addr":"172.21.15.12:6827","nonce":3738380591}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:04:06.012942+0000","modified":"2024-09-11T23:04:09.042274+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4329},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4329":{"gid":4329,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6829/514415350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":514415350},{"type":"v1","addr":"172.21.15.12:6829","nonce":514415350}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4329,"qdb_cluster":[4329]},"id":2}]} 2024-09-11T23:04:10.042 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 16 2024-09-11T23:04:10.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.044+0000 7fa97a6bd640 1 -- 172.21.15.12:0/2708565005 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fa960035db0 msgr2=0x7fa960038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:10.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.044+0000 7fa97a6bd640 1 --2- 172.21.15.12:0/2708565005 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fa960035db0 0x7fa960038270 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa968001610 tx=0x7fa968007ad0 comp rx=0 tx=0).stop 2024-09-11T23:04:10.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.044+0000 7fa97a6bd640 1 -- 172.21.15.12:0/2708565005 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9740a4b80 msgr2=0x7fa9740a1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:10.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.044+0000 7fa97a6bd640 1 --2- 172.21.15.12:0/2708565005 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9740a4b80 0x7fa9740a1140 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa96401a510 tx=0x7fa964019680 comp rx=0 tx=0).stop 2024-09-11T23:04:10.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.044+0000 7fa97a6bd640 1 -- 172.21.15.12:0/2708565005 shutdown_connections 2024-09-11T23:04:10.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.044+0000 7fa97a6bd640 1 --2- 172.21.15.12:0/2708565005 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fa960035db0 0x7fa960038270 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:10.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.044+0000 7fa97a6bd640 1 --2- 172.21.15.12:0/2708565005 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9740a4b80 0x7fa9740a1140 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:10.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.044+0000 7fa97a6bd640 1 -- 172.21.15.12:0/2708565005 >> 172.21.15.12:0/2708565005 conn(0x7fa9740ac2c0 msgr2=0x7fa9740ab750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:10.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.044+0000 7fa97a6bd640 1 -- 172.21.15.12:0/2708565005 shutdown_connections 2024-09-11T23:04:10.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.044+0000 7fa97a6bd640 1 -- 172.21.15.12:0/2708565005 wait complete. 2024-09-11T23:04:10.061 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:04:10.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.184+0000 7f028236b640 1 Processor -- start 2024-09-11T23:04:10.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.184+0000 7f028236b640 1 -- start start 2024-09-11T23:04:10.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.184+0000 7f028236b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f027c137e60 0x7f027c138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:10.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.184+0000 7f028236b640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f027c09e930 con 0x7f027c09f6e0 2024-09-11T23:04:10.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.184+0000 7f028236b640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f027c1379e0 con 0x7f027c137e60 2024-09-11T23:04:10.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.184+0000 7f027bfff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f027c137e60 0x7f027c138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:10.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.184+0000 7f027b7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f027c09f6e0 0x7f027c0a36a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:52250/0 (socket says 172.21.15.12:52250) 2024-09-11T23:04:10.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.184+0000 7f027b7fe640 1 -- 172.21.15.12:0/2617465938 learned_addr learned my addr 172.21.15.12:0/2617465938 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:04:10.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.184+0000 7f027bfff640 1 -- 172.21.15.12:0/2617465938 >> v1:172.21.15.12:6789/0 conn(0x7f027c09f6e0 legacy=0x7f027c0a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:10.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.184+0000 7f027bfff640 1 -- 172.21.15.12:0/2617465938 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f027c09d910 con 0x7f027c137e60 2024-09-11T23:04:10.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.188+0000 7f027bfff640 1 --2- 172.21.15.12:0/2617465938 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f027c137e60 0x7f027c138240 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f026c009740 tx=0x7f026c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25923a6cb02b12b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:10.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.188+0000 7f027affd640 1 -- 172.21.15.12:0/2617465938 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f026c0ab570 con 0x7f027c137e60 2024-09-11T23:04:10.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.188+0000 7f027affd640 1 -- 172.21.15.12:0/2617465938 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f026c0b0070 con 0x7f027c137e60 2024-09-11T23:04:10.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.188+0000 7f027affd640 1 -- 172.21.15.12:0/2617465938 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f026c0ab860 con 0x7f027c137e60 2024-09-11T23:04:10.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.188+0000 7f028236b640 1 -- 172.21.15.12:0/2617465938 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f027c137e60 msgr2=0x7f027c138240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:10.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.188+0000 7f028236b640 1 --2- 172.21.15.12:0/2617465938 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f027c137e60 0x7f027c138240 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f026c009740 tx=0x7f026c01c420 comp rx=0 tx=0).stop 2024-09-11T23:04:10.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.188+0000 7f028236b640 1 -- 172.21.15.12:0/2617465938 shutdown_connections 2024-09-11T23:04:10.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.188+0000 7f028236b640 1 --2- 172.21.15.12:0/2617465938 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f027c137e60 0x7f027c138240 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:10.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.188+0000 7f028236b640 1 -- 172.21.15.12:0/2617465938 >> 172.21.15.12:0/2617465938 conn(0x7f027c0a8450 msgr2=0x7f027c0a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:10.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.188+0000 7f028236b640 1 -- 172.21.15.12:0/2617465938 shutdown_connections 2024-09-11T23:04:10.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.188+0000 7f028236b640 1 -- 172.21.15.12:0/2617465938 wait complete. 2024-09-11T23:04:10.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.192+0000 7f028236b640 1 Processor -- start 2024-09-11T23:04:10.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.192+0000 7f028236b640 1 -- start start 2024-09-11T23:04:10.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.192+0000 7f028236b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f027c09f6e0 0x7f027c1d2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:10.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.192+0000 7f028236b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f027c13fe00 con 0x7f027c09f6e0 2024-09-11T23:04:10.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.192+0000 7f027bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f027c09f6e0 0x7f027c1d2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:10.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.192+0000 7f027bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f027c09f6e0 0x7f027c1d2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39776/0 (socket says 172.21.15.12:39776) 2024-09-11T23:04:10.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.192+0000 7f027bfff640 1 -- 172.21.15.12:0/274400333 learned_addr learned my addr 172.21.15.12:0/274400333 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:10.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.192+0000 7f027bfff640 1 -- 172.21.15.12:0/274400333 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f027c072820 con 0x7f027c09f6e0 2024-09-11T23:04:10.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.192+0000 7f027bfff640 1 --2- 172.21.15.12:0/274400333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f027c09f6e0 0x7f027c1d2090 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f026c019030 tx=0x7f026c01ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:10.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.192+0000 7f0278ff9640 1 -- 172.21.15.12:0/274400333 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f026c0bf410 con 0x7f027c09f6e0 2024-09-11T23:04:10.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.192+0000 7f0278ff9640 1 -- 172.21.15.12:0/274400333 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f026c0bf5d0 con 0x7f027c09f6e0 2024-09-11T23:04:10.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.192+0000 7f028236b640 1 -- 172.21.15.12:0/274400333 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f027c0a71f0 con 0x7f027c09f6e0 2024-09-11T23:04:10.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.192+0000 7f0278ff9640 1 -- 172.21.15.12:0/274400333 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f026c0bf8f0 con 0x7f027c09f6e0 2024-09-11T23:04:10.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.192+0000 7f028236b640 1 -- 172.21.15.12:0/274400333 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f027c09c5a0 con 0x7f027c09f6e0 2024-09-11T23:04:10.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.192+0000 7f028236b640 1 -- 172.21.15.12:0/274400333 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f027c0725c0 con 0x7f027c09f6e0 2024-09-11T23:04:10.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.192+0000 7f0278ff9640 1 -- 172.21.15.12:0/274400333 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f026c0bd020 con 0x7f027c09f6e0 2024-09-11T23:04:10.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.192+0000 7f0278ff9640 1 --2- 172.21.15.12:0/274400333 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f0268035db0 0x7f0268038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:10.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.192+0000 7f0278ff9640 1 -- 172.21.15.12:0/274400333 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 3439+0+0 (secure 0 0 0) 0x7f026c0e2f00 con 0x7f027c09f6e0 2024-09-11T23:04:10.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.192+0000 7f027b7fe640 1 --2- 172.21.15.12:0/274400333 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f0268035db0 0x7f0268038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:10.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.192+0000 7f027b7fe640 1 --2- 172.21.15.12:0/274400333 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f0268035db0 0x7f0268038270 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0270001610 tx=0x7f0270007ad0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:10.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.196+0000 7f0278ff9640 1 -- 172.21.15.12:0/274400333 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f026c016010 con 0x7f027c09f6e0 2024-09-11T23:04:10.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.360+0000 7f028236b640 1 -- 172.21.15.12:0/274400333 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f027c06bc60 con 0x7f027c09f6e0 2024-09-11T23:04:10.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.364+0000 7f0278ff9640 1 -- 172.21.15.12:0/274400333 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+10675 (secure 0 0 0) 0x7f026c0b5df0 con 0x7f027c09f6e0 2024-09-11T23:04:10.364 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:04:10.364 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":25,"fsid":"8be14356-3340-4500-91a2-4cbc6b511f65","created":"2024-09-11T23:03:10.620234+0000","modified":"2024-09-11T23:04:07.658713+0000","last_up_change":"2024-09-11T23:03:22.359028+0000","last_in_change":"2024-09-11T23:03:11.545817+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:03:23.587068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:04:03.949125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-11T23:04:05.020777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"153b72a1-40b1-400d-93ea-333e733f9bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6817","nonce":3680911937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6819","nonce":3680911937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6823","nonce":3680911937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6821","nonce":3680911937}]},"public_addr":"172.21.15.12:6817/3680911937","cluster_addr":"172.21.15.12:6819/3680911937","heartbeat_back_addr":"172.21.15.12:6823/3680911937","heartbeat_front_addr":"172.21.15.12:6821/3680911937","state":["exists","up"]},{"osd":1,"uuid":"94669e49-ee4f-4acf-9e25-e94374dda8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6801","nonce":236825163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6803","nonce":236825163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6807","nonce":236825163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6805","nonce":236825163}]},"public_addr":"172.21.15.12:6801/236825163","cluster_addr":"172.21.15.12:6803/236825163","heartbeat_back_addr":"172.21.15.12:6807/236825163","heartbeat_front_addr":"172.21.15.12:6805/236825163","state":["exists","up"]},{"osd":2,"uuid":"826dae4d-8888-4ec5-8f00-425b3be93814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6809","nonce":3263521655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6811","nonce":3263521655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6815","nonce":3263521655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6813","nonce":3263521655}]},"public_addr":"172.21.15.12:6809/3263521655","cluster_addr":"172.21.15.12:6811/3263521655","heartbeat_back_addr":"172.21.15.12:6815/3263521655","heartbeat_front_addr":"172.21.15.12:6813/3263521655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:19.398518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.761524+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.904997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:04:10.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.364+0000 7f028236b640 1 -- 172.21.15.12:0/274400333 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f0268035db0 msgr2=0x7f0268038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:10.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.364+0000 7f028236b640 1 --2- 172.21.15.12:0/274400333 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f0268035db0 0x7f0268038270 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0270001610 tx=0x7f0270007ad0 comp rx=0 tx=0).stop 2024-09-11T23:04:10.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.364+0000 7f028236b640 1 -- 172.21.15.12:0/274400333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f027c09f6e0 msgr2=0x7f027c1d2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:10.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.364+0000 7f028236b640 1 --2- 172.21.15.12:0/274400333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f027c09f6e0 0x7f027c1d2090 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f026c019030 tx=0x7f026c01ac60 comp rx=0 tx=0).stop 2024-09-11T23:04:10.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.364+0000 7f028236b640 1 -- 172.21.15.12:0/274400333 shutdown_connections 2024-09-11T23:04:10.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.364+0000 7f028236b640 1 --2- 172.21.15.12:0/274400333 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f0268035db0 0x7f0268038270 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:10.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.364+0000 7f028236b640 1 --2- 172.21.15.12:0/274400333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f027c09f6e0 0x7f027c1d2090 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:10.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.364+0000 7f028236b640 1 -- 172.21.15.12:0/274400333 >> 172.21.15.12:0/274400333 conn(0x7f027c0a8450 msgr2=0x7f027c134b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:10.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.364+0000 7f028236b640 1 -- 172.21.15.12:0/274400333 shutdown_connections 2024-09-11T23:04:10.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.364+0000 7f028236b640 1 -- 172.21.15.12:0/274400333 wait complete. 2024-09-11T23:04:10.384 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T23:04:10.384 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:04:10.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.508+0000 7fd021428640 1 Processor -- start 2024-09-11T23:04:10.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.508+0000 7fd021428640 1 -- start start 2024-09-11T23:04:10.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.508+0000 7fd021428640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd01c09f6e0 0x7fd01c13cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:10.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.508+0000 7fd021428640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd01c09e930 con 0x7fd01c137e60 2024-09-11T23:04:10.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.508+0000 7fd021428640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fd01c1379e0 con 0x7fd01c09f6e0 2024-09-11T23:04:10.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.508+0000 7fd01a7fc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd01c09f6e0 0x7fd01c13cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:10.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.508+0000 7fd01a7fc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd01c09f6e0 0x7fd01c13cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39788/0 (socket says 172.21.15.12:39788) 2024-09-11T23:04:10.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.508+0000 7fd01affd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd01c137e60 0x7fd01c138240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:52256/0 (socket says 172.21.15.12:52256) 2024-09-11T23:04:10.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.508+0000 7fd01a7fc640 1 -- 172.21.15.12:0/786458227 learned_addr learned my addr 172.21.15.12:0/786458227 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:10.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.512+0000 7fd01a7fc640 1 -- 172.21.15.12:0/786458227 >> v1:172.21.15.12:6789/0 conn(0x7fd01c137e60 legacy=0x7fd01c138240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:10.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.512+0000 7fd01a7fc640 1 -- 172.21.15.12:0/786458227 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd01c09d910 con 0x7fd01c09f6e0 2024-09-11T23:04:10.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.512+0000 7fd01a7fc640 1 --2- 172.21.15.12:0/786458227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd01c09f6e0 0x7fd01c13cc60 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd00c0097f0 tx=0x7fd00c01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b73f2c8c4c3741a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:10.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.512+0000 7fd019ffb640 1 -- 172.21.15.12:0/786458227 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd00c0aa590 con 0x7fd01c09f6e0 2024-09-11T23:04:10.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.512+0000 7fd019ffb640 1 -- 172.21.15.12:0/786458227 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd00c0af070 con 0x7fd01c09f6e0 2024-09-11T23:04:10.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.512+0000 7fd019ffb640 1 -- 172.21.15.12:0/786458227 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd00c0aa880 con 0x7fd01c09f6e0 2024-09-11T23:04:10.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.512+0000 7fd021428640 1 -- 172.21.15.12:0/786458227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd01c09f6e0 msgr2=0x7fd01c13cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:10.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.512+0000 7fd021428640 1 --2- 172.21.15.12:0/786458227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd01c09f6e0 0x7fd01c13cc60 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd00c0097f0 tx=0x7fd00c01c4e0 comp rx=0 tx=0).stop 2024-09-11T23:04:10.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.512+0000 7fd021428640 1 -- 172.21.15.12:0/786458227 shutdown_connections 2024-09-11T23:04:10.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.512+0000 7fd021428640 1 --2- 172.21.15.12:0/786458227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd01c09f6e0 0x7fd01c13cc60 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:10.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.512+0000 7fd021428640 1 -- 172.21.15.12:0/786458227 >> 172.21.15.12:0/786458227 conn(0x7fd01c0a8450 msgr2=0x7fd01c0a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:10.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.512+0000 7fd021428640 1 -- 172.21.15.12:0/786458227 shutdown_connections 2024-09-11T23:04:10.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.512+0000 7fd021428640 1 -- 172.21.15.12:0/786458227 wait complete. 2024-09-11T23:04:10.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.516+0000 7fd021428640 1 Processor -- start 2024-09-11T23:04:10.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.516+0000 7fd021428640 1 -- start start 2024-09-11T23:04:10.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.516+0000 7fd021428640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd01c09f6e0 0x7fd01c1d1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:10.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.516+0000 7fd021428640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd01c13fd50 con 0x7fd01c09f6e0 2024-09-11T23:04:10.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.516+0000 7fd01affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd01c09f6e0 0x7fd01c1d1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:10.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.516+0000 7fd01affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd01c09f6e0 0x7fd01c1d1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39804/0 (socket says 172.21.15.12:39804) 2024-09-11T23:04:10.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.516+0000 7fd01affd640 1 -- 172.21.15.12:0/1012834137 learned_addr learned my addr 172.21.15.12:0/1012834137 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:10.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.516+0000 7fd01affd640 1 -- 172.21.15.12:0/1012834137 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd01c071680 con 0x7fd01c09f6e0 2024-09-11T23:04:10.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.516+0000 7fd01affd640 1 --2- 172.21.15.12:0/1012834137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd01c09f6e0 0x7fd01c1d1f50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd01000c410 tx=0x7fd01000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:10.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.516+0000 7fd0037fe640 1 -- 172.21.15.12:0/1012834137 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd010007410 con 0x7fd01c09f6e0 2024-09-11T23:04:10.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.516+0000 7fd0037fe640 1 -- 172.21.15.12:0/1012834137 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0100075b0 con 0x7fd01c09f6e0 2024-09-11T23:04:10.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.516+0000 7fd0037fe640 1 -- 172.21.15.12:0/1012834137 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd010004920 con 0x7fd01c09f6e0 2024-09-11T23:04:10.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.516+0000 7fd021428640 1 -- 172.21.15.12:0/1012834137 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd01c070e10 con 0x7fd01c09f6e0 2024-09-11T23:04:10.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.516+0000 7fd021428640 1 -- 172.21.15.12:0/1012834137 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd01c070570 con 0x7fd01c09f6e0 2024-09-11T23:04:10.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.516+0000 7fd0037fe640 1 -- 172.21.15.12:0/1012834137 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd01001a020 con 0x7fd01c09f6e0 2024-09-11T23:04:10.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.516+0000 7fd021428640 1 -- 172.21.15.12:0/1012834137 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd01c071430 con 0x7fd01c09f6e0 2024-09-11T23:04:10.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.516+0000 7fd0037fe640 1 --2- 172.21.15.12:0/1012834137 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fd008035db0 0x7fd008038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:10.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.516+0000 7fd0037fe640 1 -- 172.21.15.12:0/1012834137 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 3439+0+0 (secure 0 0 0) 0x7fd010047e40 con 0x7fd01c09f6e0 2024-09-11T23:04:10.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.516+0000 7fd01a7fc640 1 --2- 172.21.15.12:0/1012834137 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fd008035db0 0x7fd008038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:10.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.516+0000 7fd01a7fc640 1 --2- 172.21.15.12:0/1012834137 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fd008035db0 0x7fd008038270 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd00c0ae000 tx=0x7fd00c0a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:10.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.520+0000 7fd0037fe640 1 -- 172.21.15.12:0/1012834137 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd01001bc00 con 0x7fd01c09f6e0 2024-09-11T23:04:10.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.680+0000 7fd021428640 1 -- 172.21.15.12:0/1012834137 --> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd01c0a12f0 con 0x7fd008035db0 2024-09-11T23:04:10.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.692+0000 7fd0037fe640 1 -- 172.21.15.12:0/1012834137 <== mgr.4099 v2:172.21.15.12:6824/2765460338 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245902 (secure 0 0 0) 0x7fd00c0af040 con 0x7fd008035db0 2024-09-11T23:04:10.698 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:04:10.705 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-11T23:04:10.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.696+0000 7fd021428640 1 -- 172.21.15.12:0/1012834137 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fd008035db0 msgr2=0x7fd008038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:10.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.696+0000 7fd021428640 1 --2- 172.21.15.12:0/1012834137 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fd008035db0 0x7fd008038270 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd00c0ae000 tx=0x7fd00c0a7000 comp rx=0 tx=0).stop 2024-09-11T23:04:10.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.696+0000 7fd021428640 1 -- 172.21.15.12:0/1012834137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd01c09f6e0 msgr2=0x7fd01c1d1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:10.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.696+0000 7fd021428640 1 --2- 172.21.15.12:0/1012834137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd01c09f6e0 0x7fd01c1d1f50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd01000c410 tx=0x7fd01000c8d0 comp rx=0 tx=0).stop 2024-09-11T23:04:10.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.696+0000 7fd021428640 1 -- 172.21.15.12:0/1012834137 shutdown_connections 2024-09-11T23:04:10.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.696+0000 7fd021428640 1 --2- 172.21.15.12:0/1012834137 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fd008035db0 0x7fd008038270 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:10.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.696+0000 7fd021428640 1 --2- 172.21.15.12:0/1012834137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd01c09f6e0 0x7fd01c1d1f50 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:10.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.696+0000 7fd021428640 1 -- 172.21.15.12:0/1012834137 >> 172.21.15.12:0/1012834137 conn(0x7fd01c0a8450 msgr2=0x7fd01c0a7260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:10.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.696+0000 7fd021428640 1 -- 172.21.15.12:0/1012834137 shutdown_connections 2024-09-11T23:04:10.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.696+0000 7fd021428640 1 -- 172.21.15.12:0/1012834137 wait complete. 2024-09-11T23:04:10.715 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":47,"stamp":"2024-09-11T23:04:09.525480+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":181,"num_write_kb":1908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":175,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":82944,"kb_used_data":1848,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283032576,"statfs":{"total":289910292480,"available":289825357824,"internally_reserved":0,"allocated":1892352,"data_stored":1399504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":82963791},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.891463"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.723185+0000","last_change":"2024-09-11T23:04:06.715428+0000","last_active":"2024-09-11T23:04:06.723185+0000","last_peered":"2024-09-11T23:04:06.723185+0000","last_clean":"2024-09-11T23:04:06.723185+0000","last_became_active":"2024-09-11T23:04:06.714924+0000","last_became_peered":"2024-09-11T23:04:06.714924+0000","last_unstale":"2024-09-11T23:04:06.723185+0000","last_undegraded":"2024-09-11T23:04:06.723185+0000","last_fullsized":"2024-09-11T23:04:06.723185+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:20.122819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.690026+0000","last_change":"2024-09-11T23:04:06.685927+0000","last_active":"2024-09-11T23:04:06.690026+0000","last_peered":"2024-09-11T23:04:06.690026+0000","last_clean":"2024-09-11T23:04:06.690026+0000","last_became_active":"2024-09-11T23:04:06.685180+0000","last_became_peered":"2024-09-11T23:04:06.685180+0000","last_unstale":"2024-09-11T23:04:06.690026+0000","last_undegraded":"2024-09-11T23:04:06.690026+0000","last_fullsized":"2024-09-11T23:04:06.690026+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:30.520036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.698275+0000","last_change":"2024-09-11T23:04:06.684617+0000","last_active":"2024-09-11T23:04:06.698275+0000","last_peered":"2024-09-11T23:04:06.698275+0000","last_clean":"2024-09-11T23:04:06.698275+0000","last_became_active":"2024-09-11T23:04:06.684259+0000","last_became_peered":"2024-09-11T23:04:06.684259+0000","last_unstale":"2024-09-11T23:04:06.698275+0000","last_undegraded":"2024-09-11T23:04:06.698275+0000","last_fullsized":"2024-09-11T23:04:06.698275+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:37.919920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.718354+0000","last_change":"2024-09-11T23:04:06.713352+0000","last_active":"2024-09-11T23:04:06.718354+0000","last_peered":"2024-09-11T23:04:06.718354+0000","last_clean":"2024-09-11T23:04:06.718354+0000","last_became_active":"2024-09-11T23:04:06.713042+0000","last_became_peered":"2024-09-11T23:04:06.713042+0000","last_unstale":"2024-09-11T23:04:06.718354+0000","last_undegraded":"2024-09-11T23:04:06.718354+0000","last_fullsized":"2024-09-11T23:04:06.718354+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:17.396948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.723107+0000","last_change":"2024-09-11T23:04:06.717172+0000","last_active":"2024-09-11T23:04:06.723107+0000","last_peered":"2024-09-11T23:04:06.723107+0000","last_clean":"2024-09-11T23:04:06.723107+0000","last_became_active":"2024-09-11T23:04:06.715369+0000","last_became_peered":"2024-09-11T23:04:06.715369+0000","last_unstale":"2024-09-11T23:04:06.723107+0000","last_undegraded":"2024-09-11T23:04:06.723107+0000","last_fullsized":"2024-09-11T23:04:06.723107+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:44.396966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.702755+0000","last_change":"2024-09-11T23:04:06.701056+0000","last_active":"2024-09-11T23:04:06.702755+0000","last_peered":"2024-09-11T23:04:06.702755+0000","last_clean":"2024-09-11T23:04:06.702755+0000","last_became_active":"2024-09-11T23:04:06.700749+0000","last_became_peered":"2024-09-11T23:04:06.700749+0000","last_unstale":"2024-09-11T23:04:06.702755+0000","last_undegraded":"2024-09-11T23:04:06.702755+0000","last_fullsized":"2024-09-11T23:04:06.702755+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:15.524857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.718823+0000","last_change":"2024-09-11T23:04:06.705566+0000","last_active":"2024-09-11T23:04:06.718823+0000","last_peered":"2024-09-11T23:04:06.718823+0000","last_clean":"2024-09-11T23:04:06.718823+0000","last_became_active":"2024-09-11T23:04:06.705263+0000","last_became_peered":"2024-09-11T23:04:06.705263+0000","last_unstale":"2024-09-11T23:04:06.718823+0000","last_undegraded":"2024-09-11T23:04:06.718823+0000","last_fullsized":"2024-09-11T23:04:06.718823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:04.408660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.719092+0000","last_change":"2024-09-11T23:04:06.710276+0000","last_active":"2024-09-11T23:04:06.719092+0000","last_peered":"2024-09-11T23:04:06.719092+0000","last_clean":"2024-09-11T23:04:06.719092+0000","last_became_active":"2024-09-11T23:04:06.705744+0000","last_became_peered":"2024-09-11T23:04:06.705744+0000","last_unstale":"2024-09-11T23:04:06.719092+0000","last_undegraded":"2024-09-11T23:04:06.719092+0000","last_fullsized":"2024-09-11T23:04:06.719092+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:24.914894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.698867+0000","last_change":"2024-09-11T23:04:06.696833+0000","last_active":"2024-09-11T23:04:06.698867+0000","last_peered":"2024-09-11T23:04:06.698867+0000","last_clean":"2024-09-11T23:04:06.698867+0000","last_became_active":"2024-09-11T23:04:06.693929+0000","last_became_peered":"2024-09-11T23:04:06.693929+0000","last_unstale":"2024-09-11T23:04:06.698867+0000","last_undegraded":"2024-09-11T23:04:06.698867+0000","last_fullsized":"2024-09-11T23:04:06.698867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:21.771096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.698661+0000","last_change":"2024-09-11T23:04:06.693836+0000","last_active":"2024-09-11T23:04:06.698661+0000","last_peered":"2024-09-11T23:04:06.698661+0000","last_clean":"2024-09-11T23:04:06.698661+0000","last_became_active":"2024-09-11T23:04:06.693522+0000","last_became_peered":"2024-09-11T23:04:06.693522+0000","last_unstale":"2024-09-11T23:04:06.698661+0000","last_undegraded":"2024-09-11T23:04:06.698661+0000","last_fullsized":"2024-09-11T23:04:06.698661+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:20.122819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.695414+0000","last_change":"2024-09-11T23:04:06.687985+0000","last_active":"2024-09-11T23:04:06.695414+0000","last_peered":"2024-09-11T23:04:06.695414+0000","last_clean":"2024-09-11T23:04:06.695414+0000","last_became_active":"2024-09-11T23:04:06.686766+0000","last_became_peered":"2024-09-11T23:04:06.686766+0000","last_unstale":"2024-09-11T23:04:06.695414+0000","last_undegraded":"2024-09-11T23:04:06.695414+0000","last_fullsized":"2024-09-11T23:04:06.695414+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:22.740697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.708290+0000","last_change":"2024-09-11T23:04:06.706973+0000","last_active":"2024-09-11T23:04:06.708290+0000","last_peered":"2024-09-11T23:04:06.708290+0000","last_clean":"2024-09-11T23:04:06.708290+0000","last_became_active":"2024-09-11T23:04:06.706176+0000","last_became_peered":"2024-09-11T23:04:06.706176+0000","last_unstale":"2024-09-11T23:04:06.708290+0000","last_undegraded":"2024-09-11T23:04:06.708290+0000","last_fullsized":"2024-09-11T23:04:06.708290+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:29.688943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.719025+0000","last_change":"2024-09-11T23:04:06.709463+0000","last_active":"2024-09-11T23:04:06.719025+0000","last_peered":"2024-09-11T23:04:06.719025+0000","last_clean":"2024-09-11T23:04:06.719025+0000","last_became_active":"2024-09-11T23:04:06.705450+0000","last_became_peered":"2024-09-11T23:04:06.705450+0000","last_unstale":"2024-09-11T23:04:06.719025+0000","last_undegraded":"2024-09-11T23:04:06.719025+0000","last_fullsized":"2024-09-11T23:04:06.719025+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:27.381482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.681567+0000","last_change":"2024-09-11T23:04:06.677327+0000","last_active":"2024-09-11T23:04:06.681567+0000","last_peered":"2024-09-11T23:04:06.681567+0000","last_clean":"2024-09-11T23:04:06.681567+0000","last_became_active":"2024-09-11T23:04:06.676751+0000","last_became_peered":"2024-09-11T23:04:06.676751+0000","last_unstale":"2024-09-11T23:04:06.681567+0000","last_undegraded":"2024-09-11T23:04:06.681567+0000","last_fullsized":"2024-09-11T23:04:06.681567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:39:45.792823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.674547+0000","last_change":"2024-09-11T23:04:06.671114+0000","last_active":"2024-09-11T23:04:06.674547+0000","last_peered":"2024-09-11T23:04:06.674547+0000","last_clean":"2024-09-11T23:04:06.674547+0000","last_became_active":"2024-09-11T23:04:06.670584+0000","last_became_peered":"2024-09-11T23:04:06.670584+0000","last_unstale":"2024-09-11T23:04:06.674547+0000","last_undegraded":"2024-09-11T23:04:06.674547+0000","last_fullsized":"2024-09-11T23:04:06.674547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:56.939119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.673669+0000","last_change":"2024-09-11T23:04:06.669439+0000","last_active":"2024-09-11T23:04:06.673669+0000","last_peered":"2024-09-11T23:04:06.673669+0000","last_clean":"2024-09-11T23:04:06.673669+0000","last_became_active":"2024-09-11T23:04:06.668908+0000","last_became_peered":"2024-09-11T23:04:06.668908+0000","last_unstale":"2024-09-11T23:04:06.673669+0000","last_undegraded":"2024-09-11T23:04:06.673669+0000","last_fullsized":"2024-09-11T23:04:06.673669+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:28.602375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.679136+0000","last_change":"2024-09-11T23:04:06.672149+0000","last_active":"2024-09-11T23:04:06.679136+0000","last_peered":"2024-09-11T23:04:06.679136+0000","last_clean":"2024-09-11T23:04:06.679136+0000","last_became_active":"2024-09-11T23:04:06.671562+0000","last_became_peered":"2024-09-11T23:04:06.671562+0000","last_unstale":"2024-09-11T23:04:06.679136+0000","last_undegraded":"2024-09-11T23:04:06.679136+0000","last_fullsized":"2024-09-11T23:04:06.679136+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:35.643341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.696344+0000","last_change":"2024-09-11T23:04:06.687114+0000","last_active":"2024-09-11T23:04:06.696344+0000","last_peered":"2024-09-11T23:04:06.696344+0000","last_clean":"2024-09-11T23:04:06.696344+0000","last_became_active":"2024-09-11T23:04:06.685454+0000","last_became_peered":"2024-09-11T23:04:06.685454+0000","last_unstale":"2024-09-11T23:04:06.696344+0000","last_undegraded":"2024-09-11T23:04:06.696344+0000","last_fullsized":"2024-09-11T23:04:06.696344+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:08.330530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.689603+0000","last_change":"2024-09-11T23:04:06.683524+0000","last_active":"2024-09-11T23:04:06.689603+0000","last_peered":"2024-09-11T23:04:06.689603+0000","last_clean":"2024-09-11T23:04:06.689603+0000","last_became_active":"2024-09-11T23:04:06.683204+0000","last_became_peered":"2024-09-11T23:04:06.683204+0000","last_unstale":"2024-09-11T23:04:06.689603+0000","last_undegraded":"2024-09-11T23:04:06.689603+0000","last_fullsized":"2024-09-11T23:04:06.689603+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:26.899091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.723336+0000","last_change":"2024-09-11T23:04:06.719818+0000","last_active":"2024-09-11T23:04:06.723336+0000","last_peered":"2024-09-11T23:04:06.723336+0000","last_clean":"2024-09-11T23:04:06.723336+0000","last_became_active":"2024-09-11T23:04:06.719542+0000","last_became_peered":"2024-09-11T23:04:06.719542+0000","last_unstale":"2024-09-11T23:04:06.723336+0000","last_undegraded":"2024-09-11T23:04:06.723336+0000","last_fullsized":"2024-09-11T23:04:06.723336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:28.481953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.674170+0000","last_change":"2024-09-11T23:04:06.669347+0000","last_active":"2024-09-11T23:04:06.674170+0000","last_peered":"2024-09-11T23:04:06.674170+0000","last_clean":"2024-09-11T23:04:06.674170+0000","last_became_active":"2024-09-11T23:04:06.668238+0000","last_became_peered":"2024-09-11T23:04:06.668238+0000","last_unstale":"2024-09-11T23:04:06.674170+0000","last_undegraded":"2024-09-11T23:04:06.674170+0000","last_fullsized":"2024-09-11T23:04:06.674170+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:58.051654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.722875+0000","last_change":"2024-09-11T23:04:06.714778+0000","last_active":"2024-09-11T23:04:06.722875+0000","last_peered":"2024-09-11T23:04:06.722875+0000","last_clean":"2024-09-11T23:04:06.722875+0000","last_became_active":"2024-09-11T23:04:06.713346+0000","last_became_peered":"2024-09-11T23:04:06.713346+0000","last_unstale":"2024-09-11T23:04:06.722875+0000","last_undegraded":"2024-09-11T23:04:06.722875+0000","last_fullsized":"2024-09-11T23:04:06.722875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:37.919920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.690296+0000","last_change":"2024-09-11T23:04:06.685259+0000","last_active":"2024-09-11T23:04:06.690296+0000","last_peered":"2024-09-11T23:04:06.690296+0000","last_clean":"2024-09-11T23:04:06.690296+0000","last_became_active":"2024-09-11T23:04:06.684976+0000","last_became_peered":"2024-09-11T23:04:06.684976+0000","last_unstale":"2024-09-11T23:04:06.690296+0000","last_undegraded":"2024-09-11T23:04:06.690296+0000","last_fullsized":"2024-09-11T23:04:06.690296+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:23.669133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.722986+0000","last_change":"2024-09-11T23:04:06.712898+0000","last_active":"2024-09-11T23:04:06.722986+0000","last_peered":"2024-09-11T23:04:06.722986+0000","last_clean":"2024-09-11T23:04:06.722986+0000","last_became_active":"2024-09-11T23:04:06.710001+0000","last_became_peered":"2024-09-11T23:04:06.710001+0000","last_unstale":"2024-09-11T23:04:06.722986+0000","last_undegraded":"2024-09-11T23:04:06.722986+0000","last_fullsized":"2024-09-11T23:04:06.722986+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:43.224582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.701454+0000","last_change":"2024-09-11T23:04:06.697160+0000","last_active":"2024-09-11T23:04:06.701454+0000","last_peered":"2024-09-11T23:04:06.701454+0000","last_clean":"2024-09-11T23:04:06.701454+0000","last_became_active":"2024-09-11T23:04:06.696547+0000","last_became_peered":"2024-09-11T23:04:06.696547+0000","last_unstale":"2024-09-11T23:04:06.701454+0000","last_undegraded":"2024-09-11T23:04:06.701454+0000","last_fullsized":"2024-09-11T23:04:06.701454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:03.729106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.679002+0000","last_change":"2024-09-11T23:04:06.675830+0000","last_active":"2024-09-11T23:04:06.679002+0000","last_peered":"2024-09-11T23:04:06.679002+0000","last_clean":"2024-09-11T23:04:06.679002+0000","last_became_active":"2024-09-11T23:04:06.675363+0000","last_became_peered":"2024-09-11T23:04:06.675363+0000","last_unstale":"2024-09-11T23:04:06.679002+0000","last_undegraded":"2024-09-11T23:04:06.679002+0000","last_fullsized":"2024-09-11T23:04:06.679002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:07.504986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.701542+0000","last_change":"2024-09-11T23:04:06.698474+0000","last_active":"2024-09-11T23:04:06.701542+0000","last_peered":"2024-09-11T23:04:06.701542+0000","last_clean":"2024-09-11T23:04:06.701542+0000","last_became_active":"2024-09-11T23:04:06.698107+0000","last_became_peered":"2024-09-11T23:04:06.698107+0000","last_unstale":"2024-09-11T23:04:06.701542+0000","last_undegraded":"2024-09-11T23:04:06.701542+0000","last_fullsized":"2024-09-11T23:04:06.701542+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:35.362304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.723173+0000","last_change":"2024-09-11T23:04:06.715247+0000","last_active":"2024-09-11T23:04:06.723173+0000","last_peered":"2024-09-11T23:04:06.723173+0000","last_clean":"2024-09-11T23:04:06.723173+0000","last_became_active":"2024-09-11T23:04:06.714940+0000","last_became_peered":"2024-09-11T23:04:06.714940+0000","last_unstale":"2024-09-11T23:04:06.723173+0000","last_undegraded":"2024-09-11T23:04:06.723173+0000","last_fullsized":"2024-09-11T23:04:06.723173+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:09.449459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.689904+0000","last_change":"2024-09-11T23:04:06.686389+0000","last_active":"2024-09-11T23:04:06.689904+0000","last_peered":"2024-09-11T23:04:06.689904+0000","last_clean":"2024-09-11T23:04:06.689904+0000","last_became_active":"2024-09-11T23:04:06.685840+0000","last_became_peered":"2024-09-11T23:04:06.685840+0000","last_unstale":"2024-09-11T23:04:06.689904+0000","last_undegraded":"2024-09-11T23:04:06.689904+0000","last_fullsized":"2024-09-11T23:04:06.689904+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:44.406275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.681590+0000","last_change":"2024-09-11T23:04:06.677559+0000","last_active":"2024-09-11T23:04:06.681590+0000","last_peered":"2024-09-11T23:04:06.681590+0000","last_clean":"2024-09-11T23:04:06.681590+0000","last_became_active":"2024-09-11T23:04:06.677063+0000","last_became_peered":"2024-09-11T23:04:06.677063+0000","last_unstale":"2024-09-11T23:04:06.681590+0000","last_undegraded":"2024-09-11T23:04:06.681590+0000","last_fullsized":"2024-09-11T23:04:06.681590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:54.612066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.719059+0000","last_change":"2024-09-11T23:04:06.713454+0000","last_active":"2024-09-11T23:04:06.719059+0000","last_peered":"2024-09-11T23:04:06.719059+0000","last_clean":"2024-09-11T23:04:06.719059+0000","last_became_active":"2024-09-11T23:04:06.713154+0000","last_became_peered":"2024-09-11T23:04:06.713154+0000","last_unstale":"2024-09-11T23:04:06.719059+0000","last_undegraded":"2024-09-11T23:04:06.719059+0000","last_fullsized":"2024-09-11T23:04:06.719059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:03.305862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.719116+0000","last_change":"2024-09-11T23:04:06.712635+0000","last_active":"2024-09-11T23:04:06.719116+0000","last_peered":"2024-09-11T23:04:06.719116+0000","last_clean":"2024-09-11T23:04:06.719116+0000","last_became_active":"2024-09-11T23:04:06.709497+0000","last_became_peered":"2024-09-11T23:04:06.709497+0000","last_unstale":"2024-09-11T23:04:06.719116+0000","last_undegraded":"2024-09-11T23:04:06.719116+0000","last_fullsized":"2024-09-11T23:04:06.719116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:15.406114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.688520+0000","last_change":"2024-09-11T23:04:06.677960+0000","last_active":"2024-09-11T23:04:06.688520+0000","last_peered":"2024-09-11T23:04:06.688520+0000","last_clean":"2024-09-11T23:04:06.688520+0000","last_became_active":"2024-09-11T23:04:06.677474+0000","last_became_peered":"2024-09-11T23:04:06.677474+0000","last_unstale":"2024-09-11T23:04:06.688520+0000","last_undegraded":"2024-09-11T23:04:06.688520+0000","last_fullsized":"2024-09-11T23:04:06.688520+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:19.852590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"24'4","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.695805+0000","last_change":"2024-09-11T23:04:05.691384+0000","last_active":"2024-09-11T23:04:06.695805+0000","last_peered":"2024-09-11T23:04:06.695805+0000","last_clean":"2024-09-11T23:04:06.695805+0000","last_became_active":"2024-09-11T23:04:05.691087+0000","last_became_peered":"2024-09-11T23:04:05.691087+0000","last_unstale":"2024-09-11T23:04:06.695805+0000","last_undegraded":"2024-09-11T23:04:06.695805+0000","last_fullsized":"2024-09-11T23:04:06.695805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:08.314652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.722798+0000","last_change":"2024-09-11T23:04:06.713579+0000","last_active":"2024-09-11T23:04:06.722798+0000","last_peered":"2024-09-11T23:04:06.722798+0000","last_clean":"2024-09-11T23:04:06.722798+0000","last_became_active":"2024-09-11T23:04:06.713265+0000","last_became_peered":"2024-09-11T23:04:06.713265+0000","last_unstale":"2024-09-11T23:04:06.722798+0000","last_undegraded":"2024-09-11T23:04:06.722798+0000","last_fullsized":"2024-09-11T23:04:06.722798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:35.870185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"24'1","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.684875+0000","last_change":"2024-09-11T23:04:05.679545+0000","last_active":"2024-09-11T23:04:06.684875+0000","last_peered":"2024-09-11T23:04:06.684875+0000","last_clean":"2024-09-11T23:04:06.684875+0000","last_became_active":"2024-09-11T23:04:05.679158+0000","last_became_peered":"2024-09-11T23:04:05.679158+0000","last_unstale":"2024-09-11T23:04:06.684875+0000","last_undegraded":"2024-09-11T23:04:06.684875+0000","last_fullsized":"2024-09-11T23:04:06.684875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:28.683198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.723315+0000","last_change":"2024-09-11T23:04:06.719391+0000","last_active":"2024-09-11T23:04:06.723315+0000","last_peered":"2024-09-11T23:04:06.723315+0000","last_clean":"2024-09-11T23:04:06.723315+0000","last_became_active":"2024-09-11T23:04:06.719033+0000","last_became_peered":"2024-09-11T23:04:06.719033+0000","last_unstale":"2024-09-11T23:04:06.723315+0000","last_undegraded":"2024-09-11T23:04:06.723315+0000","last_fullsized":"2024-09-11T23:04:06.723315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:35.362304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"24'2","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.687832+0000","last_change":"2024-09-11T23:04:05.678654+0000","last_active":"2024-09-11T23:04:06.687832+0000","last_peered":"2024-09-11T23:04:06.687832+0000","last_clean":"2024-09-11T23:04:06.687832+0000","last_became_active":"2024-09-11T23:04:05.678162+0000","last_became_peered":"2024-09-11T23:04:05.678162+0000","last_unstale":"2024-09-11T23:04:06.687832+0000","last_undegraded":"2024-09-11T23:04:06.687832+0000","last_fullsized":"2024-09-11T23:04:06.687832+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:35.297322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.701517+0000","last_change":"2024-09-11T23:04:06.696945+0000","last_active":"2024-09-11T23:04:06.701517+0000","last_peered":"2024-09-11T23:04:06.701517+0000","last_clean":"2024-09-11T23:04:06.701517+0000","last_became_active":"2024-09-11T23:04:06.694473+0000","last_became_peered":"2024-09-11T23:04:06.694473+0000","last_unstale":"2024-09-11T23:04:06.701517+0000","last_undegraded":"2024-09-11T23:04:06.701517+0000","last_fullsized":"2024-09-11T23:04:06.701517+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:29.557131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"24'2","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.719194+0000","last_change":"2024-09-11T23:04:05.698170+0000","last_active":"2024-09-11T23:04:06.719194+0000","last_peered":"2024-09-11T23:04:06.719194+0000","last_clean":"2024-09-11T23:04:06.719194+0000","last_became_active":"2024-09-11T23:04:05.697611+0000","last_became_peered":"2024-09-11T23:04:05.697611+0000","last_unstale":"2024-09-11T23:04:06.719194+0000","last_undegraded":"2024-09-11T23:04:06.719194+0000","last_fullsized":"2024-09-11T23:04:06.719194+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:58.741170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.698394+0000","last_change":"2024-09-11T23:04:06.692784+0000","last_active":"2024-09-11T23:04:06.698394+0000","last_peered":"2024-09-11T23:04:06.698394+0000","last_clean":"2024-09-11T23:04:06.698394+0000","last_became_active":"2024-09-11T23:04:06.692503+0000","last_became_peered":"2024-09-11T23:04:06.692503+0000","last_unstale":"2024-09-11T23:04:06.698394+0000","last_undegraded":"2024-09-11T23:04:06.698394+0000","last_fullsized":"2024-09-11T23:04:06.698394+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:09.449459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"24'1","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.717885+0000","last_change":"2024-09-11T23:04:05.698044+0000","last_active":"2024-09-11T23:04:06.717885+0000","last_peered":"2024-09-11T23:04:06.717885+0000","last_clean":"2024-09-11T23:04:06.717885+0000","last_became_active":"2024-09-11T23:04:05.697598+0000","last_became_peered":"2024-09-11T23:04:05.697598+0000","last_unstale":"2024-09-11T23:04:06.717885+0000","last_undegraded":"2024-09-11T23:04:06.717885+0000","last_fullsized":"2024-09-11T23:04:06.717885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:09.934021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.723064+0000","last_change":"2024-09-11T23:04:06.716812+0000","last_active":"2024-09-11T23:04:06.723064+0000","last_peered":"2024-09-11T23:04:06.723064+0000","last_clean":"2024-09-11T23:04:06.723064+0000","last_became_active":"2024-09-11T23:04:06.713435+0000","last_became_peered":"2024-09-11T23:04:06.713435+0000","last_unstale":"2024-09-11T23:04:06.723064+0000","last_undegraded":"2024-09-11T23:04:06.723064+0000","last_fullsized":"2024-09-11T23:04:06.723064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:06.608268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"24'1","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.716853+0000","last_change":"2024-09-11T23:04:05.682278+0000","last_active":"2024-09-11T23:04:06.716853+0000","last_peered":"2024-09-11T23:04:06.716853+0000","last_clean":"2024-09-11T23:04:06.716853+0000","last_became_active":"2024-09-11T23:04:05.681773+0000","last_became_peered":"2024-09-11T23:04:05.681773+0000","last_unstale":"2024-09-11T23:04:06.716853+0000","last_undegraded":"2024-09-11T23:04:06.716853+0000","last_fullsized":"2024-09-11T23:04:06.716853+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:25:24.236754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.707772+0000","last_change":"2024-09-11T23:04:06.704368+0000","last_active":"2024-09-11T23:04:06.707772+0000","last_peered":"2024-09-11T23:04:06.707772+0000","last_clean":"2024-09-11T23:04:06.707772+0000","last_became_active":"2024-09-11T23:04:06.702448+0000","last_became_peered":"2024-09-11T23:04:06.702448+0000","last_unstale":"2024-09-11T23:04:06.707772+0000","last_undegraded":"2024-09-11T23:04:06.707772+0000","last_fullsized":"2024-09-11T23:04:06.707772+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:55.596753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.658621+0000","last_change":"2024-09-11T23:04:05.676411+0000","last_active":"2024-09-11T23:04:06.658621+0000","last_peered":"2024-09-11T23:04:06.658621+0000","last_clean":"2024-09-11T23:04:06.658621+0000","last_became_active":"2024-09-11T23:04:05.676141+0000","last_became_peered":"2024-09-11T23:04:05.676141+0000","last_unstale":"2024-09-11T23:04:06.658621+0000","last_undegraded":"2024-09-11T23:04:06.658621+0000","last_fullsized":"2024-09-11T23:04:06.658621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:54.591008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.702711+0000","last_change":"2024-09-11T23:04:06.698683+0000","last_active":"2024-09-11T23:04:06.702711+0000","last_peered":"2024-09-11T23:04:06.702711+0000","last_clean":"2024-09-11T23:04:06.702711+0000","last_became_active":"2024-09-11T23:04:06.696961+0000","last_became_peered":"2024-09-11T23:04:06.696961+0000","last_unstale":"2024-09-11T23:04:06.702711+0000","last_undegraded":"2024-09-11T23:04:06.702711+0000","last_fullsized":"2024-09-11T23:04:06.702711+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:28.481953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.682059+0000","last_change":"2024-09-11T23:04:05.698310+0000","last_active":"2024-09-11T23:04:06.682059+0000","last_peered":"2024-09-11T23:04:06.682059+0000","last_clean":"2024-09-11T23:04:06.682059+0000","last_became_active":"2024-09-11T23:04:05.697692+0000","last_became_peered":"2024-09-11T23:04:05.697692+0000","last_unstale":"2024-09-11T23:04:06.682059+0000","last_undegraded":"2024-09-11T23:04:06.682059+0000","last_fullsized":"2024-09-11T23:04:06.682059+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:50.573034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.695846+0000","last_change":"2024-09-11T23:04:06.684609+0000","last_active":"2024-09-11T23:04:06.695846+0000","last_peered":"2024-09-11T23:04:06.695846+0000","last_clean":"2024-09-11T23:04:06.695846+0000","last_became_active":"2024-09-11T23:04:06.684305+0000","last_became_peered":"2024-09-11T23:04:06.684305+0000","last_unstale":"2024-09-11T23:04:06.695846+0000","last_undegraded":"2024-09-11T23:04:06.695846+0000","last_fullsized":"2024-09-11T23:04:06.695846+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:35.870185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.659645+0000","last_change":"2024-09-11T23:04:05.691815+0000","last_active":"2024-09-11T23:04:06.659645+0000","last_peered":"2024-09-11T23:04:06.659645+0000","last_clean":"2024-09-11T23:04:06.659645+0000","last_became_active":"2024-09-11T23:04:05.691045+0000","last_became_peered":"2024-09-11T23:04:05.691045+0000","last_unstale":"2024-09-11T23:04:06.659645+0000","last_undegraded":"2024-09-11T23:04:06.659645+0000","last_fullsized":"2024-09-11T23:04:06.659645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:16.391203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.723163+0000","last_change":"2024-09-11T23:04:06.716824+0000","last_active":"2024-09-11T23:04:06.723163+0000","last_peered":"2024-09-11T23:04:06.723163+0000","last_clean":"2024-09-11T23:04:06.723163+0000","last_became_active":"2024-09-11T23:04:06.714725+0000","last_became_peered":"2024-09-11T23:04:06.714725+0000","last_unstale":"2024-09-11T23:04:06.723163+0000","last_undegraded":"2024-09-11T23:04:06.723163+0000","last_fullsized":"2024-09-11T23:04:06.723163+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:21.771096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.659828+0000","last_change":"2024-09-11T23:04:05.686997+0000","last_active":"2024-09-11T23:04:06.659828+0000","last_peered":"2024-09-11T23:04:06.659828+0000","last_clean":"2024-09-11T23:04:06.659828+0000","last_became_active":"2024-09-11T23:04:05.686566+0000","last_became_peered":"2024-09-11T23:04:05.686566+0000","last_unstale":"2024-09-11T23:04:06.659828+0000","last_undegraded":"2024-09-11T23:04:06.659828+0000","last_fullsized":"2024-09-11T23:04:06.659828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:47.384390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.711968+0000","last_change":"2024-09-11T23:04:06.710647+0000","last_active":"2024-09-11T23:04:06.711968+0000","last_peered":"2024-09-11T23:04:06.711968+0000","last_clean":"2024-09-11T23:04:06.711968+0000","last_became_active":"2024-09-11T23:04:06.708651+0000","last_became_peered":"2024-09-11T23:04:06.708651+0000","last_unstale":"2024-09-11T23:04:06.711968+0000","last_undegraded":"2024-09-11T23:04:06.711968+0000","last_fullsized":"2024-09-11T23:04:06.711968+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:45.660408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"24'3","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.710216+0000","last_change":"2024-09-11T23:04:05.697416+0000","last_active":"2024-09-11T23:04:06.710216+0000","last_peered":"2024-09-11T23:04:06.710216+0000","last_clean":"2024-09-11T23:04:06.710216+0000","last_became_active":"2024-09-11T23:04:05.697077+0000","last_became_peered":"2024-09-11T23:04:05.697077+0000","last_unstale":"2024-09-11T23:04:06.710216+0000","last_undegraded":"2024-09-11T23:04:06.710216+0000","last_fullsized":"2024-09-11T23:04:06.710216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:46.160155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.695442+0000","last_change":"2024-09-11T23:04:06.688538+0000","last_active":"2024-09-11T23:04:06.695442+0000","last_peered":"2024-09-11T23:04:06.695442+0000","last_clean":"2024-09-11T23:04:06.695442+0000","last_became_active":"2024-09-11T23:04:06.687277+0000","last_became_peered":"2024-09-11T23:04:06.687277+0000","last_unstale":"2024-09-11T23:04:06.695442+0000","last_undegraded":"2024-09-11T23:04:06.695442+0000","last_fullsized":"2024-09-11T23:04:06.695442+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:15.931019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"24'6","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.723360+0000","last_change":"2024-09-11T23:04:05.665705+0000","last_active":"2024-09-11T23:04:06.723360+0000","last_peered":"2024-09-11T23:04:06.723360+0000","last_clean":"2024-09-11T23:04:06.723360+0000","last_became_active":"2024-09-11T23:04:05.665160+0000","last_became_peered":"2024-09-11T23:04:05.665160+0000","last_unstale":"2024-09-11T23:04:06.723360+0000","last_undegraded":"2024-09-11T23:04:06.723360+0000","last_fullsized":"2024-09-11T23:04:06.723360+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:23.328322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.678334+0000","last_change":"2024-09-11T23:04:06.676365+0000","last_active":"2024-09-11T23:04:06.678334+0000","last_peered":"2024-09-11T23:04:06.678334+0000","last_clean":"2024-09-11T23:04:06.678334+0000","last_became_active":"2024-09-11T23:04:06.676088+0000","last_became_peered":"2024-09-11T23:04:06.676088+0000","last_unstale":"2024-09-11T23:04:06.678334+0000","last_undegraded":"2024-09-11T23:04:06.678334+0000","last_fullsized":"2024-09-11T23:04:06.678334+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:25:25.242499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"24'2","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.718965+0000","last_change":"2024-09-11T23:04:05.699157+0000","last_active":"2024-09-11T23:04:06.718965+0000","last_peered":"2024-09-11T23:04:06.718965+0000","last_clean":"2024-09-11T23:04:06.718965+0000","last_became_active":"2024-09-11T23:04:05.698847+0000","last_became_peered":"2024-09-11T23:04:05.698847+0000","last_unstale":"2024-09-11T23:04:06.718965+0000","last_undegraded":"2024-09-11T23:04:06.718965+0000","last_fullsized":"2024-09-11T23:04:06.718965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:06.499241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.701473+0000","last_change":"2024-09-11T23:04:06.694583+0000","last_active":"2024-09-11T23:04:06.701473+0000","last_peered":"2024-09-11T23:04:06.701473+0000","last_clean":"2024-09-11T23:04:06.701473+0000","last_became_active":"2024-09-11T23:04:06.693107+0000","last_became_peered":"2024-09-11T23:04:06.693107+0000","last_unstale":"2024-09-11T23:04:06.701473+0000","last_undegraded":"2024-09-11T23:04:06.701473+0000","last_fullsized":"2024-09-11T23:04:06.701473+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:23.140099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.680338+0000","last_change":"2024-09-11T23:04:05.687337+0000","last_active":"2024-09-11T23:04:06.680338+0000","last_peered":"2024-09-11T23:04:06.680338+0000","last_clean":"2024-09-11T23:04:06.680338+0000","last_became_active":"2024-09-11T23:04:05.682945+0000","last_became_peered":"2024-09-11T23:04:05.682945+0000","last_unstale":"2024-09-11T23:04:06.680338+0000","last_undegraded":"2024-09-11T23:04:06.680338+0000","last_fullsized":"2024-09-11T23:04:06.680338+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:26.375737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.719139+0000","last_change":"2024-09-11T23:04:06.713080+0000","last_active":"2024-09-11T23:04:06.719139+0000","last_peered":"2024-09-11T23:04:06.719139+0000","last_clean":"2024-09-11T23:04:06.719139+0000","last_became_active":"2024-09-11T23:04:06.709883+0000","last_became_peered":"2024-09-11T23:04:06.709883+0000","last_unstale":"2024-09-11T23:04:06.719139+0000","last_undegraded":"2024-09-11T23:04:06.719139+0000","last_fullsized":"2024-09-11T23:04:06.719139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:22.823363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.687579+0000","last_change":"2024-09-11T23:04:05.681735+0000","last_active":"2024-09-11T23:04:06.687579+0000","last_peered":"2024-09-11T23:04:06.687579+0000","last_clean":"2024-09-11T23:04:06.687579+0000","last_became_active":"2024-09-11T23:04:05.680901+0000","last_became_peered":"2024-09-11T23:04:05.680901+0000","last_unstale":"2024-09-11T23:04:06.687579+0000","last_undegraded":"2024-09-11T23:04:06.687579+0000","last_fullsized":"2024-09-11T23:04:06.687579+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:44.789703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.701441+0000","last_change":"2024-09-11T23:04:06.697201+0000","last_active":"2024-09-11T23:04:06.701441+0000","last_peered":"2024-09-11T23:04:06.701441+0000","last_clean":"2024-09-11T23:04:06.701441+0000","last_became_active":"2024-09-11T23:04:06.693545+0000","last_became_peered":"2024-09-11T23:04:06.693545+0000","last_unstale":"2024-09-11T23:04:06.701441+0000","last_undegraded":"2024-09-11T23:04:06.701441+0000","last_fullsized":"2024-09-11T23:04:06.701441+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:34.905678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"24'8","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.704156+0000","last_change":"2024-09-11T23:04:05.676019+0000","last_active":"2024-09-11T23:04:06.704156+0000","last_peered":"2024-09-11T23:04:06.704156+0000","last_clean":"2024-09-11T23:04:06.704156+0000","last_became_active":"2024-09-11T23:04:05.675048+0000","last_became_peered":"2024-09-11T23:04:05.675048+0000","last_unstale":"2024-09-11T23:04:06.704156+0000","last_undegraded":"2024-09-11T23:04:06.704156+0000","last_fullsized":"2024-09-11T23:04:06.704156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:58.741170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.723060+0000","last_change":"2024-09-11T23:04:06.716914+0000","last_active":"2024-09-11T23:04:06.723060+0000","last_peered":"2024-09-11T23:04:06.723060+0000","last_clean":"2024-09-11T23:04:06.723060+0000","last_became_active":"2024-09-11T23:04:06.714902+0000","last_became_peered":"2024-09-11T23:04:06.714902+0000","last_unstale":"2024-09-11T23:04:06.723060+0000","last_undegraded":"2024-09-11T23:04:06.723060+0000","last_fullsized":"2024-09-11T23:04:06.723060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:29.557131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"24'1","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.710513+0000","last_change":"2024-09-11T23:04:05.683657+0000","last_active":"2024-09-11T23:04:06.710513+0000","last_peered":"2024-09-11T23:04:06.710513+0000","last_clean":"2024-09-11T23:04:06.710513+0000","last_became_active":"2024-09-11T23:04:05.676386+0000","last_became_peered":"2024-09-11T23:04:05.676386+0000","last_unstale":"2024-09-11T23:04:06.710513+0000","last_undegraded":"2024-09-11T23:04:06.710513+0000","last_fullsized":"2024-09-11T23:04:06.710513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:02.300117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.701474+0000","last_change":"2024-09-11T23:04:06.698095+0000","last_active":"2024-09-11T23:04:06.701474+0000","last_peered":"2024-09-11T23:04:06.701474+0000","last_clean":"2024-09-11T23:04:06.701474+0000","last_became_active":"2024-09-11T23:04:06.696510+0000","last_became_peered":"2024-09-11T23:04:06.696510+0000","last_unstale":"2024-09-11T23:04:06.701474+0000","last_undegraded":"2024-09-11T23:04:06.701474+0000","last_fullsized":"2024-09-11T23:04:06.701474+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:44.396966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"24'2","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.718925+0000","last_change":"2024-09-11T23:04:05.698364+0000","last_active":"2024-09-11T23:04:06.718925+0000","last_peered":"2024-09-11T23:04:06.718925+0000","last_clean":"2024-09-11T23:04:06.718925+0000","last_became_active":"2024-09-11T23:04:05.698064+0000","last_became_peered":"2024-09-11T23:04:05.698064+0000","last_unstale":"2024-09-11T23:04:06.718925+0000","last_undegraded":"2024-09-11T23:04:06.718925+0000","last_fullsized":"2024-09-11T23:04:06.718925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:23.533289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.698835+0000","last_change":"2024-09-11T23:04:06.696752+0000","last_active":"2024-09-11T23:04:06.698835+0000","last_peered":"2024-09-11T23:04:06.698835+0000","last_clean":"2024-09-11T23:04:06.698835+0000","last_became_active":"2024-09-11T23:04:06.694077+0000","last_became_peered":"2024-09-11T23:04:06.694077+0000","last_unstale":"2024-09-11T23:04:06.698835+0000","last_undegraded":"2024-09-11T23:04:06.698835+0000","last_fullsized":"2024-09-11T23:04:06.698835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:06.608268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"24'1","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.702077+0000","last_change":"2024-09-11T23:04:05.683741+0000","last_active":"2024-09-11T23:04:06.702077+0000","last_peered":"2024-09-11T23:04:06.702077+0000","last_clean":"2024-09-11T23:04:06.702077+0000","last_became_active":"2024-09-11T23:04:05.679708+0000","last_became_peered":"2024-09-11T23:04:05.679708+0000","last_unstale":"2024-09-11T23:04:06.702077+0000","last_undegraded":"2024-09-11T23:04:06.702077+0000","last_fullsized":"2024-09-11T23:04:06.702077+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:42.218837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.723007+0000","last_change":"2024-09-11T23:04:06.715395+0000","last_active":"2024-09-11T23:04:06.723007+0000","last_peered":"2024-09-11T23:04:06.723007+0000","last_clean":"2024-09-11T23:04:06.723007+0000","last_became_active":"2024-09-11T23:04:06.713555+0000","last_became_peered":"2024-09-11T23:04:06.713555+0000","last_unstale":"2024-09-11T23:04:06.723007+0000","last_undegraded":"2024-09-11T23:04:06.723007+0000","last_fullsized":"2024-09-11T23:04:06.723007+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:23.140099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.655968+0000","last_change":"2024-09-11T23:04:05.685369+0000","last_active":"2024-09-11T23:04:06.655968+0000","last_peered":"2024-09-11T23:04:06.655968+0000","last_clean":"2024-09-11T23:04:06.655968+0000","last_became_active":"2024-09-11T23:04:05.684862+0000","last_became_peered":"2024-09-11T23:04:05.684862+0000","last_unstale":"2024-09-11T23:04:06.655968+0000","last_undegraded":"2024-09-11T23:04:06.655968+0000","last_fullsized":"2024-09-11T23:04:06.655968+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:23.376347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.723132+0000","last_change":"2024-09-11T23:04:06.717057+0000","last_active":"2024-09-11T23:04:06.723132+0000","last_peered":"2024-09-11T23:04:06.723132+0000","last_clean":"2024-09-11T23:04:06.723132+0000","last_became_active":"2024-09-11T23:04:06.715112+0000","last_became_peered":"2024-09-11T23:04:06.715112+0000","last_unstale":"2024-09-11T23:04:06.723132+0000","last_undegraded":"2024-09-11T23:04:06.723132+0000","last_fullsized":"2024-09-11T23:04:06.723132+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:03.729106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"24'2","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.686218+0000","last_change":"2024-09-11T23:04:05.679072+0000","last_active":"2024-09-11T23:04:06.686218+0000","last_peered":"2024-09-11T23:04:06.686218+0000","last_clean":"2024-09-11T23:04:06.686218+0000","last_became_active":"2024-09-11T23:04:05.678770+0000","last_became_peered":"2024-09-11T23:04:05.678770+0000","last_unstale":"2024-09-11T23:04:06.686218+0000","last_undegraded":"2024-09-11T23:04:06.686218+0000","last_fullsized":"2024-09-11T23:04:06.686218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:14.519112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.723086+0000","last_change":"2024-09-11T23:04:06.717074+0000","last_active":"2024-09-11T23:04:06.723086+0000","last_peered":"2024-09-11T23:04:06.723086+0000","last_clean":"2024-09-11T23:04:06.723086+0000","last_became_active":"2024-09-11T23:04:06.714778+0000","last_became_peered":"2024-09-11T23:04:06.714778+0000","last_unstale":"2024-09-11T23:04:06.723086+0000","last_undegraded":"2024-09-11T23:04:06.723086+0000","last_fullsized":"2024-09-11T23:04:06.723086+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:34.905678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.694406+0000","last_change":"2024-09-11T23:04:05.699052+0000","last_active":"2024-09-11T23:04:06.694406+0000","last_peered":"2024-09-11T23:04:06.694406+0000","last_clean":"2024-09-11T23:04:06.694406+0000","last_became_active":"2024-09-11T23:04:05.698769+0000","last_became_peered":"2024-09-11T23:04:05.698769+0000","last_unstale":"2024-09-11T23:04:06.694406+0000","last_undegraded":"2024-09-11T23:04:06.694406+0000","last_fullsized":"2024-09-11T23:04:06.694406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:23.328322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.723137+0000","last_change":"2024-09-11T23:04:06.717549+0000","last_active":"2024-09-11T23:04:06.723137+0000","last_peered":"2024-09-11T23:04:06.723137+0000","last_clean":"2024-09-11T23:04:06.723137+0000","last_became_active":"2024-09-11T23:04:06.715314+0000","last_became_peered":"2024-09-11T23:04:06.715314+0000","last_unstale":"2024-09-11T23:04:06.723137+0000","last_undegraded":"2024-09-11T23:04:06.723137+0000","last_fullsized":"2024-09-11T23:04:06.723137+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:38.436208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.680499+0000","last_change":"2024-09-11T23:04:05.675845+0000","last_active":"2024-09-11T23:04:06.680499+0000","last_peered":"2024-09-11T23:04:06.680499+0000","last_clean":"2024-09-11T23:04:06.680499+0000","last_became_active":"2024-09-11T23:04:05.675385+0000","last_became_peered":"2024-09-11T23:04:05.675385+0000","last_unstale":"2024-09-11T23:04:06.680499+0000","last_undegraded":"2024-09-11T23:04:06.680499+0000","last_fullsized":"2024-09-11T23:04:06.680499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:23.909149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.701485+0000","last_change":"2024-09-11T23:04:06.698306+0000","last_active":"2024-09-11T23:04:06.701485+0000","last_peered":"2024-09-11T23:04:06.701485+0000","last_clean":"2024-09-11T23:04:06.701485+0000","last_became_active":"2024-09-11T23:04:06.696900+0000","last_became_peered":"2024-09-11T23:04:06.696900+0000","last_unstale":"2024-09-11T23:04:06.701485+0000","last_undegraded":"2024-09-11T23:04:06.701485+0000","last_fullsized":"2024-09-11T23:04:06.701485+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:38.436208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.680247+0000","last_change":"2024-09-11T23:04:05.684243+0000","last_active":"2024-09-11T23:04:06.680247+0000","last_peered":"2024-09-11T23:04:06.680247+0000","last_clean":"2024-09-11T23:04:06.680247+0000","last_became_active":"2024-09-11T23:04:05.683873+0000","last_became_peered":"2024-09-11T23:04:05.683873+0000","last_unstale":"2024-09-11T23:04:06.680247+0000","last_undegraded":"2024-09-11T23:04:06.680247+0000","last_fullsized":"2024-09-11T23:04:06.680247+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:23.533289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.723360+0000","last_change":"2024-09-11T23:04:06.719857+0000","last_active":"2024-09-11T23:04:06.723360+0000","last_peered":"2024-09-11T23:04:06.723360+0000","last_clean":"2024-09-11T23:04:06.723360+0000","last_became_active":"2024-09-11T23:04:06.719587+0000","last_became_peered":"2024-09-11T23:04:06.719587+0000","last_unstale":"2024-09-11T23:04:06.723360+0000","last_undegraded":"2024-09-11T23:04:06.723360+0000","last_fullsized":"2024-09-11T23:04:06.723360+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:24.382092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"24'2","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.698208+0000","last_change":"2024-09-11T23:04:05.676729+0000","last_active":"2024-09-11T23:04:06.698208+0000","last_peered":"2024-09-11T23:04:06.698208+0000","last_clean":"2024-09-11T23:04:06.698208+0000","last_became_active":"2024-09-11T23:04:05.675202+0000","last_became_peered":"2024-09-11T23:04:05.675202+0000","last_unstale":"2024-09-11T23:04:06.698208+0000","last_undegraded":"2024-09-11T23:04:06.698208+0000","last_fullsized":"2024-09-11T23:04:06.698208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:48.836399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.695898+0000","last_change":"2024-09-11T23:04:06.686514+0000","last_active":"2024-09-11T23:04:06.695898+0000","last_peered":"2024-09-11T23:04:06.695898+0000","last_clean":"2024-09-11T23:04:06.695898+0000","last_became_active":"2024-09-11T23:04:06.685618+0000","last_became_peered":"2024-09-11T23:04:06.685618+0000","last_unstale":"2024-09-11T23:04:06.695898+0000","last_undegraded":"2024-09-11T23:04:06.695898+0000","last_fullsized":"2024-09-11T23:04:06.695898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:02:46.658216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.659751+0000","last_change":"2024-09-11T23:04:05.679499+0000","last_active":"2024-09-11T23:04:06.659751+0000","last_peered":"2024-09-11T23:04:06.659751+0000","last_clean":"2024-09-11T23:04:06.659751+0000","last_became_active":"2024-09-11T23:04:05.679068+0000","last_became_peered":"2024-09-11T23:04:05.679068+0000","last_unstale":"2024-09-11T23:04:06.659751+0000","last_undegraded":"2024-09-11T23:04:06.659751+0000","last_fullsized":"2024-09-11T23:04:06.659751+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:14.200632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.695462+0000","last_change":"2024-09-11T23:04:06.688524+0000","last_active":"2024-09-11T23:04:06.695462+0000","last_peered":"2024-09-11T23:04:06.695462+0000","last_clean":"2024-09-11T23:04:06.695462+0000","last_became_active":"2024-09-11T23:04:06.687018+0000","last_became_peered":"2024-09-11T23:04:06.687018+0000","last_unstale":"2024-09-11T23:04:06.695462+0000","last_undegraded":"2024-09-11T23:04:06.695462+0000","last_fullsized":"2024-09-11T23:04:06.695462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:47.094581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.680511+0000","last_change":"2024-09-11T23:04:05.679667+0000","last_active":"2024-09-11T23:04:06.680511+0000","last_peered":"2024-09-11T23:04:06.680511+0000","last_clean":"2024-09-11T23:04:06.680511+0000","last_became_active":"2024-09-11T23:04:05.679188+0000","last_became_peered":"2024-09-11T23:04:05.679188+0000","last_unstale":"2024-09-11T23:04:06.680511+0000","last_undegraded":"2024-09-11T23:04:06.680511+0000","last_fullsized":"2024-09-11T23:04:06.680511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:14.400369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.687590+0000","last_change":"2024-09-11T23:04:06.679360+0000","last_active":"2024-09-11T23:04:06.687590+0000","last_peered":"2024-09-11T23:04:06.687590+0000","last_clean":"2024-09-11T23:04:06.687590+0000","last_became_active":"2024-09-11T23:04:06.678978+0000","last_became_peered":"2024-09-11T23:04:06.678978+0000","last_unstale":"2024-09-11T23:04:06.687590+0000","last_undegraded":"2024-09-11T23:04:06.687590+0000","last_fullsized":"2024-09-11T23:04:06.687590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:16.030112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.655682+0000","last_change":"2024-09-11T23:04:05.687057+0000","last_active":"2024-09-11T23:04:06.655682+0000","last_peered":"2024-09-11T23:04:06.655682+0000","last_clean":"2024-09-11T23:04:06.655682+0000","last_became_active":"2024-09-11T23:04:05.685211+0000","last_became_peered":"2024-09-11T23:04:05.685211+0000","last_unstale":"2024-09-11T23:04:06.655682+0000","last_undegraded":"2024-09-11T23:04:06.655682+0000","last_fullsized":"2024-09-11T23:04:06.655682+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:27.476208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.694344+0000","last_change":"2024-09-11T23:04:06.686422+0000","last_active":"2024-09-11T23:04:06.694344+0000","last_peered":"2024-09-11T23:04:06.694344+0000","last_clean":"2024-09-11T23:04:06.694344+0000","last_became_active":"2024-09-11T23:04:06.685598+0000","last_became_peered":"2024-09-11T23:04:06.685598+0000","last_unstale":"2024-09-11T23:04:06.694344+0000","last_undegraded":"2024-09-11T23:04:06.694344+0000","last_fullsized":"2024-09-11T23:04:06.694344+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:24.644506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.680331+0000","last_change":"2024-09-11T23:04:05.675851+0000","last_active":"2024-09-11T23:04:06.680331+0000","last_peered":"2024-09-11T23:04:06.680331+0000","last_clean":"2024-09-11T23:04:06.680331+0000","last_became_active":"2024-09-11T23:04:05.675385+0000","last_became_peered":"2024-09-11T23:04:05.675385+0000","last_unstale":"2024-09-11T23:04:06.680331+0000","last_undegraded":"2024-09-11T23:04:06.680331+0000","last_fullsized":"2024-09-11T23:04:06.680331+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:03.402915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.719162+0000","last_change":"2024-09-11T23:04:06.713330+0000","last_active":"2024-09-11T23:04:06.719162+0000","last_peered":"2024-09-11T23:04:06.719162+0000","last_clean":"2024-09-11T23:04:06.719162+0000","last_became_active":"2024-09-11T23:04:06.710243+0000","last_became_peered":"2024-09-11T23:04:06.710243+0000","last_unstale":"2024-09-11T23:04:06.719162+0000","last_undegraded":"2024-09-11T23:04:06.719162+0000","last_fullsized":"2024-09-11T23:04:06.719162+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:49.842144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.687711+0000","last_change":"2024-09-11T23:04:05.682955+0000","last_active":"2024-09-11T23:04:06.687711+0000","last_peered":"2024-09-11T23:04:06.687711+0000","last_clean":"2024-09-11T23:04:06.687711+0000","last_became_active":"2024-09-11T23:04:05.682511+0000","last_became_peered":"2024-09-11T23:04:05.682511+0000","last_unstale":"2024-09-11T23:04:06.687711+0000","last_undegraded":"2024-09-11T23:04:06.687711+0000","last_fullsized":"2024-09-11T23:04:06.687711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:31.741971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.702736+0000","last_change":"2024-09-11T23:04:06.698841+0000","last_active":"2024-09-11T23:04:06.702736+0000","last_peered":"2024-09-11T23:04:06.702736+0000","last_clean":"2024-09-11T23:04:06.702736+0000","last_became_active":"2024-09-11T23:04:06.698563+0000","last_became_peered":"2024-09-11T23:04:06.698563+0000","last_unstale":"2024-09-11T23:04:06.702736+0000","last_undegraded":"2024-09-11T23:04:06.702736+0000","last_fullsized":"2024-09-11T23:04:06.702736+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:24.382092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.652715+0000","last_change":"2024-09-11T23:04:05.682896+0000","last_active":"2024-09-11T23:04:06.652715+0000","last_peered":"2024-09-11T23:04:06.652715+0000","last_clean":"2024-09-11T23:04:06.652715+0000","last_became_active":"2024-09-11T23:04:05.678156+0000","last_became_peered":"2024-09-11T23:04:05.678156+0000","last_unstale":"2024-09-11T23:04:06.652715+0000","last_undegraded":"2024-09-11T23:04:06.652715+0000","last_fullsized":"2024-09-11T23:04:06.652715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:34.356559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.710531+0000","last_change":"2024-09-11T23:04:06.707162+0000","last_active":"2024-09-11T23:04:06.710531+0000","last_peered":"2024-09-11T23:04:06.710531+0000","last_clean":"2024-09-11T23:04:06.710531+0000","last_became_active":"2024-09-11T23:04:06.706725+0000","last_became_peered":"2024-09-11T23:04:06.706725+0000","last_unstale":"2024-09-11T23:04:06.710531+0000","last_undegraded":"2024-09-11T23:04:06.710531+0000","last_fullsized":"2024-09-11T23:04:06.710531+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:55.544030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.681387+0000","last_change":"2024-09-11T23:04:05.683920+0000","last_active":"2024-09-11T23:04:06.681387+0000","last_peered":"2024-09-11T23:04:06.681387+0000","last_clean":"2024-09-11T23:04:06.681387+0000","last_became_active":"2024-09-11T23:04:05.679246+0000","last_became_peered":"2024-09-11T23:04:05.679246+0000","last_unstale":"2024-09-11T23:04:06.681387+0000","last_undegraded":"2024-09-11T23:04:06.681387+0000","last_fullsized":"2024-09-11T23:04:06.681387+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:21.817618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":162,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.680421+0000","last_change":"2024-09-11T23:03:26.382905+0000","last_active":"2024-09-11T23:04:06.680421+0000","last_peered":"2024-09-11T23:04:06.680421+0000","last_clean":"2024-09-11T23:04:06.680421+0000","last_became_active":"2024-09-11T23:03:26.380590+0000","last_became_peered":"2024-09-11T23:03:26.380590+0000","last_unstale":"2024-09-11T23:04:06.680421+0000","last_undegraded":"2024-09-11T23:04:06.680421+0000","last_fullsized":"2024-09-11T23:04:06.680421+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:24.361793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:24.361793+0000","last_clean_scrub_stamp":"2024-09-11T23:03:24.361793+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:46.577063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738380,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":71442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738380,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":839680,"data_stored":664094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738380,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":827392,"data_stored":663968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:04:10.720 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:04:10.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.880+0000 7f4a928bc640 1 Processor -- start 2024-09-11T23:04:10.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.880+0000 7f4a928bc640 1 -- start start 2024-09-11T23:04:10.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.880+0000 7f4a928bc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4a8c0a2e00 0x7f4a8c13bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:10.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.880+0000 7f4a928bc640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a8c1369d0 con 0x7f4a8c136bf0 2024-09-11T23:04:10.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.880+0000 7f4a928bc640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f4a8c0a2170 con 0x7f4a8c0a2e00 2024-09-11T23:04:10.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.880+0000 7f4a8bfff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f4a8c136bf0 0x7f4a8c136fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:52262/0 (socket says 172.21.15.12:52262) 2024-09-11T23:04:10.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.880+0000 7f4a83fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4a8c0a2e00 0x7f4a8c13bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:10.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.880+0000 7f4a8bfff640 1 -- 172.21.15.12:0/340424352 learned_addr learned my addr 172.21.15.12:0/340424352 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:04:10.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.880+0000 7f4a8b7fe640 1 -- 172.21.15.12:0/340424352 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 942126672 0 0) 0x7f4a8c1369d0 con 0x7f4a8c136bf0 2024-09-11T23:04:10.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.880+0000 7f4a8b7fe640 1 -- 172.21.15.12:0/340424352 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a78003530 con 0x7f4a8c136bf0 2024-09-11T23:04:10.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.880+0000 7f4a83fff640 1 -- 172.21.15.12:0/340424352 >> v1:172.21.15.12:6789/0 conn(0x7f4a8c136bf0 legacy=0x7f4a8c136fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:10.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.880+0000 7f4a83fff640 1 -- 172.21.15.12:0/340424352 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a8c1376e0 con 0x7f4a8c0a2e00 2024-09-11T23:04:10.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.880+0000 7f4a83fff640 1 --2- 172.21.15.12:0/340424352 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a8c0a2e00 0x7f4a8c13bb70 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4a74009740 tx=0x7f4a7401c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dc0e3414e0ea2cb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:10.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.880+0000 7f4a8b7fe640 1 -- 172.21.15.12:0/340424352 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a740b0070 con 0x7f4a8c0a2e00 2024-09-11T23:04:10.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.880+0000 7f4a8b7fe640 1 -- 172.21.15.12:0/340424352 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a74004160 con 0x7f4a8c0a2e00 2024-09-11T23:04:10.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.880+0000 7f4a8b7fe640 1 -- 172.21.15.12:0/340424352 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a740044a0 con 0x7f4a8c0a2e00 2024-09-11T23:04:10.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.884+0000 7f4a928bc640 1 -- 172.21.15.12:0/340424352 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a8c0a2e00 msgr2=0x7f4a8c13bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:10.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.884+0000 7f4a928bc640 1 --2- 172.21.15.12:0/340424352 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a8c0a2e00 0x7f4a8c13bb70 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4a74009740 tx=0x7f4a7401c330 comp rx=0 tx=0).stop 2024-09-11T23:04:10.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.884+0000 7f4a928bc640 1 -- 172.21.15.12:0/340424352 shutdown_connections 2024-09-11T23:04:10.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.884+0000 7f4a928bc640 1 --2- 172.21.15.12:0/340424352 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a8c0a2e00 0x7f4a8c13bb70 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:10.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.884+0000 7f4a928bc640 1 -- 172.21.15.12:0/340424352 >> 172.21.15.12:0/340424352 conn(0x7f4a8c0a93a0 msgr2=0x7f4a8c0a58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:10.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.884+0000 7f4a928bc640 1 -- 172.21.15.12:0/340424352 shutdown_connections 2024-09-11T23:04:10.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.884+0000 7f4a928bc640 1 -- 172.21.15.12:0/340424352 wait complete. 2024-09-11T23:04:10.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.884+0000 7f4a928bc640 1 Processor -- start 2024-09-11T23:04:10.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.884+0000 7f4a928bc640 1 -- start start 2024-09-11T23:04:10.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.884+0000 7f4a928bc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a8c0a2e00 0x7f4a8c09a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:10.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.884+0000 7f4a928bc640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4a8c0a6300 con 0x7f4a8c0a2e00 2024-09-11T23:04:10.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.884+0000 7f4a8bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a8c0a2e00 0x7f4a8c09a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:10.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.884+0000 7f4a8bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a8c0a2e00 0x7f4a8c09a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39820/0 (socket says 172.21.15.12:39820) 2024-09-11T23:04:10.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.884+0000 7f4a8bfff640 1 -- 172.21.15.12:0/1427614406 learned_addr learned my addr 172.21.15.12:0/1427614406 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:10.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.884+0000 7f4a8bfff640 1 -- 172.21.15.12:0/1427614406 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a8c09cf60 con 0x7f4a8c0a2e00 2024-09-11T23:04:10.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.884+0000 7f4a8bfff640 1 --2- 172.21.15.12:0/1427614406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a8c0a2e00 0x7f4a8c09a9d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c00c3d0 tx=0x7f4a7c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:10.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.884+0000 7f4a897fa640 1 -- 172.21.15.12:0/1427614406 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a7c017070 con 0x7f4a8c0a2e00 2024-09-11T23:04:10.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.884+0000 7f4a897fa640 1 -- 172.21.15.12:0/1427614406 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a7c005ce0 con 0x7f4a8c0a2e00 2024-09-11T23:04:10.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.884+0000 7f4a897fa640 1 -- 172.21.15.12:0/1427614406 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a7c0070d0 con 0x7f4a8c0a2e00 2024-09-11T23:04:10.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.884+0000 7f4a928bc640 1 -- 172.21.15.12:0/1427614406 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a8c09e070 con 0x7f4a8c0a2e00 2024-09-11T23:04:10.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.884+0000 7f4a928bc640 1 -- 172.21.15.12:0/1427614406 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a8c135300 con 0x7f4a8c0a2e00 2024-09-11T23:04:10.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.884+0000 7f4a928bc640 1 -- 172.21.15.12:0/1427614406 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a8c0a3490 con 0x7f4a8c0a2e00 2024-09-11T23:04:10.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.884+0000 7f4a897fa640 1 -- 172.21.15.12:0/1427614406 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4a7c01a070 con 0x7f4a8c0a2e00 2024-09-11T23:04:10.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.884+0000 7f4a897fa640 1 --2- 172.21.15.12:0/1427614406 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f4a6c035db0 0x7f4a6c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:10.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.884+0000 7f4a897fa640 1 -- 172.21.15.12:0/1427614406 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 3439+0+0 (secure 0 0 0) 0x7f4a7c047a70 con 0x7f4a8c0a2e00 2024-09-11T23:04:10.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.884+0000 7f4a83fff640 1 --2- 172.21.15.12:0/1427614406 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f4a6c035db0 0x7f4a6c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:10.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.888+0000 7f4a83fff640 1 --2- 172.21.15.12:0/1427614406 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f4a6c035db0 0x7f4a6c038270 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4a740ad000 tx=0x7f4a740a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:10.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:10.892+0000 7f4a897fa640 1 -- 172.21.15.12:0/1427614406 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4a7c019e10 con 0x7f4a8c0a2e00 2024-09-11T23:04:11.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.052+0000 7f4a928bc640 1 -- 172.21.15.12:0/1427614406 --> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4a8c135850 con 0x7f4a6c035db0 2024-09-11T23:04:11.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.056+0000 7f4a897fa640 1 -- 172.21.15.12:0/1427614406 <== mgr.4099 v2:172.21.15.12:6824/2765460338 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245902 (secure 0 0 0) 0x7f4a740093e0 con 0x7f4a6c035db0 2024-09-11T23:04:11.060 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:04:11.063 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-11T23:04:11.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.060+0000 7f4a928bc640 1 -- 172.21.15.12:0/1427614406 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f4a6c035db0 msgr2=0x7f4a6c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:11.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.060+0000 7f4a928bc640 1 --2- 172.21.15.12:0/1427614406 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f4a6c035db0 0x7f4a6c038270 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4a740ad000 tx=0x7f4a740a6000 comp rx=0 tx=0).stop 2024-09-11T23:04:11.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.060+0000 7f4a928bc640 1 -- 172.21.15.12:0/1427614406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a8c0a2e00 msgr2=0x7f4a8c09a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:11.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.060+0000 7f4a928bc640 1 --2- 172.21.15.12:0/1427614406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a8c0a2e00 0x7f4a8c09a9d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c00c3d0 tx=0x7f4a7c00c890 comp rx=0 tx=0).stop 2024-09-11T23:04:11.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.060+0000 7f4a928bc640 1 -- 172.21.15.12:0/1427614406 shutdown_connections 2024-09-11T23:04:11.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.060+0000 7f4a928bc640 1 --2- 172.21.15.12:0/1427614406 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f4a6c035db0 0x7f4a6c038270 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:11.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.060+0000 7f4a928bc640 1 --2- 172.21.15.12:0/1427614406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a8c0a2e00 0x7f4a8c09a9d0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:11.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.060+0000 7f4a928bc640 1 -- 172.21.15.12:0/1427614406 >> 172.21.15.12:0/1427614406 conn(0x7f4a8c0a93a0 msgr2=0x7f4a8c0a7b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:11.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.060+0000 7f4a928bc640 1 -- 172.21.15.12:0/1427614406 shutdown_connections 2024-09-11T23:04:11.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.060+0000 7f4a928bc640 1 -- 172.21.15.12:0/1427614406 wait complete. 2024-09-11T23:04:11.080 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":47,"stamp":"2024-09-11T23:04:09.525480+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":181,"num_write_kb":1908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":175,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":82944,"kb_used_data":1848,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283032576,"statfs":{"total":289910292480,"available":289825357824,"internally_reserved":0,"allocated":1892352,"data_stored":1399504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":82963791},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.891463"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.723185+0000","last_change":"2024-09-11T23:04:06.715428+0000","last_active":"2024-09-11T23:04:06.723185+0000","last_peered":"2024-09-11T23:04:06.723185+0000","last_clean":"2024-09-11T23:04:06.723185+0000","last_became_active":"2024-09-11T23:04:06.714924+0000","last_became_peered":"2024-09-11T23:04:06.714924+0000","last_unstale":"2024-09-11T23:04:06.723185+0000","last_undegraded":"2024-09-11T23:04:06.723185+0000","last_fullsized":"2024-09-11T23:04:06.723185+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:20.122819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.690026+0000","last_change":"2024-09-11T23:04:06.685927+0000","last_active":"2024-09-11T23:04:06.690026+0000","last_peered":"2024-09-11T23:04:06.690026+0000","last_clean":"2024-09-11T23:04:06.690026+0000","last_became_active":"2024-09-11T23:04:06.685180+0000","last_became_peered":"2024-09-11T23:04:06.685180+0000","last_unstale":"2024-09-11T23:04:06.690026+0000","last_undegraded":"2024-09-11T23:04:06.690026+0000","last_fullsized":"2024-09-11T23:04:06.690026+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:30.520036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.698275+0000","last_change":"2024-09-11T23:04:06.684617+0000","last_active":"2024-09-11T23:04:06.698275+0000","last_peered":"2024-09-11T23:04:06.698275+0000","last_clean":"2024-09-11T23:04:06.698275+0000","last_became_active":"2024-09-11T23:04:06.684259+0000","last_became_peered":"2024-09-11T23:04:06.684259+0000","last_unstale":"2024-09-11T23:04:06.698275+0000","last_undegraded":"2024-09-11T23:04:06.698275+0000","last_fullsized":"2024-09-11T23:04:06.698275+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:37.919920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.718354+0000","last_change":"2024-09-11T23:04:06.713352+0000","last_active":"2024-09-11T23:04:06.718354+0000","last_peered":"2024-09-11T23:04:06.718354+0000","last_clean":"2024-09-11T23:04:06.718354+0000","last_became_active":"2024-09-11T23:04:06.713042+0000","last_became_peered":"2024-09-11T23:04:06.713042+0000","last_unstale":"2024-09-11T23:04:06.718354+0000","last_undegraded":"2024-09-11T23:04:06.718354+0000","last_fullsized":"2024-09-11T23:04:06.718354+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:17.396948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.723107+0000","last_change":"2024-09-11T23:04:06.717172+0000","last_active":"2024-09-11T23:04:06.723107+0000","last_peered":"2024-09-11T23:04:06.723107+0000","last_clean":"2024-09-11T23:04:06.723107+0000","last_became_active":"2024-09-11T23:04:06.715369+0000","last_became_peered":"2024-09-11T23:04:06.715369+0000","last_unstale":"2024-09-11T23:04:06.723107+0000","last_undegraded":"2024-09-11T23:04:06.723107+0000","last_fullsized":"2024-09-11T23:04:06.723107+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:44.396966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.702755+0000","last_change":"2024-09-11T23:04:06.701056+0000","last_active":"2024-09-11T23:04:06.702755+0000","last_peered":"2024-09-11T23:04:06.702755+0000","last_clean":"2024-09-11T23:04:06.702755+0000","last_became_active":"2024-09-11T23:04:06.700749+0000","last_became_peered":"2024-09-11T23:04:06.700749+0000","last_unstale":"2024-09-11T23:04:06.702755+0000","last_undegraded":"2024-09-11T23:04:06.702755+0000","last_fullsized":"2024-09-11T23:04:06.702755+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:15.524857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.718823+0000","last_change":"2024-09-11T23:04:06.705566+0000","last_active":"2024-09-11T23:04:06.718823+0000","last_peered":"2024-09-11T23:04:06.718823+0000","last_clean":"2024-09-11T23:04:06.718823+0000","last_became_active":"2024-09-11T23:04:06.705263+0000","last_became_peered":"2024-09-11T23:04:06.705263+0000","last_unstale":"2024-09-11T23:04:06.718823+0000","last_undegraded":"2024-09-11T23:04:06.718823+0000","last_fullsized":"2024-09-11T23:04:06.718823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:04.408660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.719092+0000","last_change":"2024-09-11T23:04:06.710276+0000","last_active":"2024-09-11T23:04:06.719092+0000","last_peered":"2024-09-11T23:04:06.719092+0000","last_clean":"2024-09-11T23:04:06.719092+0000","last_became_active":"2024-09-11T23:04:06.705744+0000","last_became_peered":"2024-09-11T23:04:06.705744+0000","last_unstale":"2024-09-11T23:04:06.719092+0000","last_undegraded":"2024-09-11T23:04:06.719092+0000","last_fullsized":"2024-09-11T23:04:06.719092+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:24.914894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.698867+0000","last_change":"2024-09-11T23:04:06.696833+0000","last_active":"2024-09-11T23:04:06.698867+0000","last_peered":"2024-09-11T23:04:06.698867+0000","last_clean":"2024-09-11T23:04:06.698867+0000","last_became_active":"2024-09-11T23:04:06.693929+0000","last_became_peered":"2024-09-11T23:04:06.693929+0000","last_unstale":"2024-09-11T23:04:06.698867+0000","last_undegraded":"2024-09-11T23:04:06.698867+0000","last_fullsized":"2024-09-11T23:04:06.698867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:21.771096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.698661+0000","last_change":"2024-09-11T23:04:06.693836+0000","last_active":"2024-09-11T23:04:06.698661+0000","last_peered":"2024-09-11T23:04:06.698661+0000","last_clean":"2024-09-11T23:04:06.698661+0000","last_became_active":"2024-09-11T23:04:06.693522+0000","last_became_peered":"2024-09-11T23:04:06.693522+0000","last_unstale":"2024-09-11T23:04:06.698661+0000","last_undegraded":"2024-09-11T23:04:06.698661+0000","last_fullsized":"2024-09-11T23:04:06.698661+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:20.122819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.695414+0000","last_change":"2024-09-11T23:04:06.687985+0000","last_active":"2024-09-11T23:04:06.695414+0000","last_peered":"2024-09-11T23:04:06.695414+0000","last_clean":"2024-09-11T23:04:06.695414+0000","last_became_active":"2024-09-11T23:04:06.686766+0000","last_became_peered":"2024-09-11T23:04:06.686766+0000","last_unstale":"2024-09-11T23:04:06.695414+0000","last_undegraded":"2024-09-11T23:04:06.695414+0000","last_fullsized":"2024-09-11T23:04:06.695414+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:22.740697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.708290+0000","last_change":"2024-09-11T23:04:06.706973+0000","last_active":"2024-09-11T23:04:06.708290+0000","last_peered":"2024-09-11T23:04:06.708290+0000","last_clean":"2024-09-11T23:04:06.708290+0000","last_became_active":"2024-09-11T23:04:06.706176+0000","last_became_peered":"2024-09-11T23:04:06.706176+0000","last_unstale":"2024-09-11T23:04:06.708290+0000","last_undegraded":"2024-09-11T23:04:06.708290+0000","last_fullsized":"2024-09-11T23:04:06.708290+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:29.688943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.719025+0000","last_change":"2024-09-11T23:04:06.709463+0000","last_active":"2024-09-11T23:04:06.719025+0000","last_peered":"2024-09-11T23:04:06.719025+0000","last_clean":"2024-09-11T23:04:06.719025+0000","last_became_active":"2024-09-11T23:04:06.705450+0000","last_became_peered":"2024-09-11T23:04:06.705450+0000","last_unstale":"2024-09-11T23:04:06.719025+0000","last_undegraded":"2024-09-11T23:04:06.719025+0000","last_fullsized":"2024-09-11T23:04:06.719025+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:27.381482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.681567+0000","last_change":"2024-09-11T23:04:06.677327+0000","last_active":"2024-09-11T23:04:06.681567+0000","last_peered":"2024-09-11T23:04:06.681567+0000","last_clean":"2024-09-11T23:04:06.681567+0000","last_became_active":"2024-09-11T23:04:06.676751+0000","last_became_peered":"2024-09-11T23:04:06.676751+0000","last_unstale":"2024-09-11T23:04:06.681567+0000","last_undegraded":"2024-09-11T23:04:06.681567+0000","last_fullsized":"2024-09-11T23:04:06.681567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:39:45.792823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.674547+0000","last_change":"2024-09-11T23:04:06.671114+0000","last_active":"2024-09-11T23:04:06.674547+0000","last_peered":"2024-09-11T23:04:06.674547+0000","last_clean":"2024-09-11T23:04:06.674547+0000","last_became_active":"2024-09-11T23:04:06.670584+0000","last_became_peered":"2024-09-11T23:04:06.670584+0000","last_unstale":"2024-09-11T23:04:06.674547+0000","last_undegraded":"2024-09-11T23:04:06.674547+0000","last_fullsized":"2024-09-11T23:04:06.674547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:56.939119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.673669+0000","last_change":"2024-09-11T23:04:06.669439+0000","last_active":"2024-09-11T23:04:06.673669+0000","last_peered":"2024-09-11T23:04:06.673669+0000","last_clean":"2024-09-11T23:04:06.673669+0000","last_became_active":"2024-09-11T23:04:06.668908+0000","last_became_peered":"2024-09-11T23:04:06.668908+0000","last_unstale":"2024-09-11T23:04:06.673669+0000","last_undegraded":"2024-09-11T23:04:06.673669+0000","last_fullsized":"2024-09-11T23:04:06.673669+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:28.602375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.679136+0000","last_change":"2024-09-11T23:04:06.672149+0000","last_active":"2024-09-11T23:04:06.679136+0000","last_peered":"2024-09-11T23:04:06.679136+0000","last_clean":"2024-09-11T23:04:06.679136+0000","last_became_active":"2024-09-11T23:04:06.671562+0000","last_became_peered":"2024-09-11T23:04:06.671562+0000","last_unstale":"2024-09-11T23:04:06.679136+0000","last_undegraded":"2024-09-11T23:04:06.679136+0000","last_fullsized":"2024-09-11T23:04:06.679136+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:35.643341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.696344+0000","last_change":"2024-09-11T23:04:06.687114+0000","last_active":"2024-09-11T23:04:06.696344+0000","last_peered":"2024-09-11T23:04:06.696344+0000","last_clean":"2024-09-11T23:04:06.696344+0000","last_became_active":"2024-09-11T23:04:06.685454+0000","last_became_peered":"2024-09-11T23:04:06.685454+0000","last_unstale":"2024-09-11T23:04:06.696344+0000","last_undegraded":"2024-09-11T23:04:06.696344+0000","last_fullsized":"2024-09-11T23:04:06.696344+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:08.330530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.689603+0000","last_change":"2024-09-11T23:04:06.683524+0000","last_active":"2024-09-11T23:04:06.689603+0000","last_peered":"2024-09-11T23:04:06.689603+0000","last_clean":"2024-09-11T23:04:06.689603+0000","last_became_active":"2024-09-11T23:04:06.683204+0000","last_became_peered":"2024-09-11T23:04:06.683204+0000","last_unstale":"2024-09-11T23:04:06.689603+0000","last_undegraded":"2024-09-11T23:04:06.689603+0000","last_fullsized":"2024-09-11T23:04:06.689603+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:26.899091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.723336+0000","last_change":"2024-09-11T23:04:06.719818+0000","last_active":"2024-09-11T23:04:06.723336+0000","last_peered":"2024-09-11T23:04:06.723336+0000","last_clean":"2024-09-11T23:04:06.723336+0000","last_became_active":"2024-09-11T23:04:06.719542+0000","last_became_peered":"2024-09-11T23:04:06.719542+0000","last_unstale":"2024-09-11T23:04:06.723336+0000","last_undegraded":"2024-09-11T23:04:06.723336+0000","last_fullsized":"2024-09-11T23:04:06.723336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:28.481953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.674170+0000","last_change":"2024-09-11T23:04:06.669347+0000","last_active":"2024-09-11T23:04:06.674170+0000","last_peered":"2024-09-11T23:04:06.674170+0000","last_clean":"2024-09-11T23:04:06.674170+0000","last_became_active":"2024-09-11T23:04:06.668238+0000","last_became_peered":"2024-09-11T23:04:06.668238+0000","last_unstale":"2024-09-11T23:04:06.674170+0000","last_undegraded":"2024-09-11T23:04:06.674170+0000","last_fullsized":"2024-09-11T23:04:06.674170+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:58.051654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.722875+0000","last_change":"2024-09-11T23:04:06.714778+0000","last_active":"2024-09-11T23:04:06.722875+0000","last_peered":"2024-09-11T23:04:06.722875+0000","last_clean":"2024-09-11T23:04:06.722875+0000","last_became_active":"2024-09-11T23:04:06.713346+0000","last_became_peered":"2024-09-11T23:04:06.713346+0000","last_unstale":"2024-09-11T23:04:06.722875+0000","last_undegraded":"2024-09-11T23:04:06.722875+0000","last_fullsized":"2024-09-11T23:04:06.722875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:37.919920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.690296+0000","last_change":"2024-09-11T23:04:06.685259+0000","last_active":"2024-09-11T23:04:06.690296+0000","last_peered":"2024-09-11T23:04:06.690296+0000","last_clean":"2024-09-11T23:04:06.690296+0000","last_became_active":"2024-09-11T23:04:06.684976+0000","last_became_peered":"2024-09-11T23:04:06.684976+0000","last_unstale":"2024-09-11T23:04:06.690296+0000","last_undegraded":"2024-09-11T23:04:06.690296+0000","last_fullsized":"2024-09-11T23:04:06.690296+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:23.669133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.722986+0000","last_change":"2024-09-11T23:04:06.712898+0000","last_active":"2024-09-11T23:04:06.722986+0000","last_peered":"2024-09-11T23:04:06.722986+0000","last_clean":"2024-09-11T23:04:06.722986+0000","last_became_active":"2024-09-11T23:04:06.710001+0000","last_became_peered":"2024-09-11T23:04:06.710001+0000","last_unstale":"2024-09-11T23:04:06.722986+0000","last_undegraded":"2024-09-11T23:04:06.722986+0000","last_fullsized":"2024-09-11T23:04:06.722986+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:43.224582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.701454+0000","last_change":"2024-09-11T23:04:06.697160+0000","last_active":"2024-09-11T23:04:06.701454+0000","last_peered":"2024-09-11T23:04:06.701454+0000","last_clean":"2024-09-11T23:04:06.701454+0000","last_became_active":"2024-09-11T23:04:06.696547+0000","last_became_peered":"2024-09-11T23:04:06.696547+0000","last_unstale":"2024-09-11T23:04:06.701454+0000","last_undegraded":"2024-09-11T23:04:06.701454+0000","last_fullsized":"2024-09-11T23:04:06.701454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:03.729106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.679002+0000","last_change":"2024-09-11T23:04:06.675830+0000","last_active":"2024-09-11T23:04:06.679002+0000","last_peered":"2024-09-11T23:04:06.679002+0000","last_clean":"2024-09-11T23:04:06.679002+0000","last_became_active":"2024-09-11T23:04:06.675363+0000","last_became_peered":"2024-09-11T23:04:06.675363+0000","last_unstale":"2024-09-11T23:04:06.679002+0000","last_undegraded":"2024-09-11T23:04:06.679002+0000","last_fullsized":"2024-09-11T23:04:06.679002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:07.504986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.701542+0000","last_change":"2024-09-11T23:04:06.698474+0000","last_active":"2024-09-11T23:04:06.701542+0000","last_peered":"2024-09-11T23:04:06.701542+0000","last_clean":"2024-09-11T23:04:06.701542+0000","last_became_active":"2024-09-11T23:04:06.698107+0000","last_became_peered":"2024-09-11T23:04:06.698107+0000","last_unstale":"2024-09-11T23:04:06.701542+0000","last_undegraded":"2024-09-11T23:04:06.701542+0000","last_fullsized":"2024-09-11T23:04:06.701542+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:35.362304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.723173+0000","last_change":"2024-09-11T23:04:06.715247+0000","last_active":"2024-09-11T23:04:06.723173+0000","last_peered":"2024-09-11T23:04:06.723173+0000","last_clean":"2024-09-11T23:04:06.723173+0000","last_became_active":"2024-09-11T23:04:06.714940+0000","last_became_peered":"2024-09-11T23:04:06.714940+0000","last_unstale":"2024-09-11T23:04:06.723173+0000","last_undegraded":"2024-09-11T23:04:06.723173+0000","last_fullsized":"2024-09-11T23:04:06.723173+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:09.449459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.689904+0000","last_change":"2024-09-11T23:04:06.686389+0000","last_active":"2024-09-11T23:04:06.689904+0000","last_peered":"2024-09-11T23:04:06.689904+0000","last_clean":"2024-09-11T23:04:06.689904+0000","last_became_active":"2024-09-11T23:04:06.685840+0000","last_became_peered":"2024-09-11T23:04:06.685840+0000","last_unstale":"2024-09-11T23:04:06.689904+0000","last_undegraded":"2024-09-11T23:04:06.689904+0000","last_fullsized":"2024-09-11T23:04:06.689904+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:44.406275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.681590+0000","last_change":"2024-09-11T23:04:06.677559+0000","last_active":"2024-09-11T23:04:06.681590+0000","last_peered":"2024-09-11T23:04:06.681590+0000","last_clean":"2024-09-11T23:04:06.681590+0000","last_became_active":"2024-09-11T23:04:06.677063+0000","last_became_peered":"2024-09-11T23:04:06.677063+0000","last_unstale":"2024-09-11T23:04:06.681590+0000","last_undegraded":"2024-09-11T23:04:06.681590+0000","last_fullsized":"2024-09-11T23:04:06.681590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:54.612066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.719059+0000","last_change":"2024-09-11T23:04:06.713454+0000","last_active":"2024-09-11T23:04:06.719059+0000","last_peered":"2024-09-11T23:04:06.719059+0000","last_clean":"2024-09-11T23:04:06.719059+0000","last_became_active":"2024-09-11T23:04:06.713154+0000","last_became_peered":"2024-09-11T23:04:06.713154+0000","last_unstale":"2024-09-11T23:04:06.719059+0000","last_undegraded":"2024-09-11T23:04:06.719059+0000","last_fullsized":"2024-09-11T23:04:06.719059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:03.305862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.719116+0000","last_change":"2024-09-11T23:04:06.712635+0000","last_active":"2024-09-11T23:04:06.719116+0000","last_peered":"2024-09-11T23:04:06.719116+0000","last_clean":"2024-09-11T23:04:06.719116+0000","last_became_active":"2024-09-11T23:04:06.709497+0000","last_became_peered":"2024-09-11T23:04:06.709497+0000","last_unstale":"2024-09-11T23:04:06.719116+0000","last_undegraded":"2024-09-11T23:04:06.719116+0000","last_fullsized":"2024-09-11T23:04:06.719116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:15.406114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.688520+0000","last_change":"2024-09-11T23:04:06.677960+0000","last_active":"2024-09-11T23:04:06.688520+0000","last_peered":"2024-09-11T23:04:06.688520+0000","last_clean":"2024-09-11T23:04:06.688520+0000","last_became_active":"2024-09-11T23:04:06.677474+0000","last_became_peered":"2024-09-11T23:04:06.677474+0000","last_unstale":"2024-09-11T23:04:06.688520+0000","last_undegraded":"2024-09-11T23:04:06.688520+0000","last_fullsized":"2024-09-11T23:04:06.688520+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:19.852590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"24'4","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.695805+0000","last_change":"2024-09-11T23:04:05.691384+0000","last_active":"2024-09-11T23:04:06.695805+0000","last_peered":"2024-09-11T23:04:06.695805+0000","last_clean":"2024-09-11T23:04:06.695805+0000","last_became_active":"2024-09-11T23:04:05.691087+0000","last_became_peered":"2024-09-11T23:04:05.691087+0000","last_unstale":"2024-09-11T23:04:06.695805+0000","last_undegraded":"2024-09-11T23:04:06.695805+0000","last_fullsized":"2024-09-11T23:04:06.695805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:08.314652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.722798+0000","last_change":"2024-09-11T23:04:06.713579+0000","last_active":"2024-09-11T23:04:06.722798+0000","last_peered":"2024-09-11T23:04:06.722798+0000","last_clean":"2024-09-11T23:04:06.722798+0000","last_became_active":"2024-09-11T23:04:06.713265+0000","last_became_peered":"2024-09-11T23:04:06.713265+0000","last_unstale":"2024-09-11T23:04:06.722798+0000","last_undegraded":"2024-09-11T23:04:06.722798+0000","last_fullsized":"2024-09-11T23:04:06.722798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:35.870185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"24'1","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.684875+0000","last_change":"2024-09-11T23:04:05.679545+0000","last_active":"2024-09-11T23:04:06.684875+0000","last_peered":"2024-09-11T23:04:06.684875+0000","last_clean":"2024-09-11T23:04:06.684875+0000","last_became_active":"2024-09-11T23:04:05.679158+0000","last_became_peered":"2024-09-11T23:04:05.679158+0000","last_unstale":"2024-09-11T23:04:06.684875+0000","last_undegraded":"2024-09-11T23:04:06.684875+0000","last_fullsized":"2024-09-11T23:04:06.684875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:28.683198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.723315+0000","last_change":"2024-09-11T23:04:06.719391+0000","last_active":"2024-09-11T23:04:06.723315+0000","last_peered":"2024-09-11T23:04:06.723315+0000","last_clean":"2024-09-11T23:04:06.723315+0000","last_became_active":"2024-09-11T23:04:06.719033+0000","last_became_peered":"2024-09-11T23:04:06.719033+0000","last_unstale":"2024-09-11T23:04:06.723315+0000","last_undegraded":"2024-09-11T23:04:06.723315+0000","last_fullsized":"2024-09-11T23:04:06.723315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:35.362304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"24'2","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.687832+0000","last_change":"2024-09-11T23:04:05.678654+0000","last_active":"2024-09-11T23:04:06.687832+0000","last_peered":"2024-09-11T23:04:06.687832+0000","last_clean":"2024-09-11T23:04:06.687832+0000","last_became_active":"2024-09-11T23:04:05.678162+0000","last_became_peered":"2024-09-11T23:04:05.678162+0000","last_unstale":"2024-09-11T23:04:06.687832+0000","last_undegraded":"2024-09-11T23:04:06.687832+0000","last_fullsized":"2024-09-11T23:04:06.687832+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:35.297322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.701517+0000","last_change":"2024-09-11T23:04:06.696945+0000","last_active":"2024-09-11T23:04:06.701517+0000","last_peered":"2024-09-11T23:04:06.701517+0000","last_clean":"2024-09-11T23:04:06.701517+0000","last_became_active":"2024-09-11T23:04:06.694473+0000","last_became_peered":"2024-09-11T23:04:06.694473+0000","last_unstale":"2024-09-11T23:04:06.701517+0000","last_undegraded":"2024-09-11T23:04:06.701517+0000","last_fullsized":"2024-09-11T23:04:06.701517+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:29.557131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"24'2","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.719194+0000","last_change":"2024-09-11T23:04:05.698170+0000","last_active":"2024-09-11T23:04:06.719194+0000","last_peered":"2024-09-11T23:04:06.719194+0000","last_clean":"2024-09-11T23:04:06.719194+0000","last_became_active":"2024-09-11T23:04:05.697611+0000","last_became_peered":"2024-09-11T23:04:05.697611+0000","last_unstale":"2024-09-11T23:04:06.719194+0000","last_undegraded":"2024-09-11T23:04:06.719194+0000","last_fullsized":"2024-09-11T23:04:06.719194+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:58.741170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.698394+0000","last_change":"2024-09-11T23:04:06.692784+0000","last_active":"2024-09-11T23:04:06.698394+0000","last_peered":"2024-09-11T23:04:06.698394+0000","last_clean":"2024-09-11T23:04:06.698394+0000","last_became_active":"2024-09-11T23:04:06.692503+0000","last_became_peered":"2024-09-11T23:04:06.692503+0000","last_unstale":"2024-09-11T23:04:06.698394+0000","last_undegraded":"2024-09-11T23:04:06.698394+0000","last_fullsized":"2024-09-11T23:04:06.698394+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:09.449459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"24'1","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.717885+0000","last_change":"2024-09-11T23:04:05.698044+0000","last_active":"2024-09-11T23:04:06.717885+0000","last_peered":"2024-09-11T23:04:06.717885+0000","last_clean":"2024-09-11T23:04:06.717885+0000","last_became_active":"2024-09-11T23:04:05.697598+0000","last_became_peered":"2024-09-11T23:04:05.697598+0000","last_unstale":"2024-09-11T23:04:06.717885+0000","last_undegraded":"2024-09-11T23:04:06.717885+0000","last_fullsized":"2024-09-11T23:04:06.717885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:09.934021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.723064+0000","last_change":"2024-09-11T23:04:06.716812+0000","last_active":"2024-09-11T23:04:06.723064+0000","last_peered":"2024-09-11T23:04:06.723064+0000","last_clean":"2024-09-11T23:04:06.723064+0000","last_became_active":"2024-09-11T23:04:06.713435+0000","last_became_peered":"2024-09-11T23:04:06.713435+0000","last_unstale":"2024-09-11T23:04:06.723064+0000","last_undegraded":"2024-09-11T23:04:06.723064+0000","last_fullsized":"2024-09-11T23:04:06.723064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:06.608268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"24'1","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.716853+0000","last_change":"2024-09-11T23:04:05.682278+0000","last_active":"2024-09-11T23:04:06.716853+0000","last_peered":"2024-09-11T23:04:06.716853+0000","last_clean":"2024-09-11T23:04:06.716853+0000","last_became_active":"2024-09-11T23:04:05.681773+0000","last_became_peered":"2024-09-11T23:04:05.681773+0000","last_unstale":"2024-09-11T23:04:06.716853+0000","last_undegraded":"2024-09-11T23:04:06.716853+0000","last_fullsized":"2024-09-11T23:04:06.716853+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:25:24.236754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.707772+0000","last_change":"2024-09-11T23:04:06.704368+0000","last_active":"2024-09-11T23:04:06.707772+0000","last_peered":"2024-09-11T23:04:06.707772+0000","last_clean":"2024-09-11T23:04:06.707772+0000","last_became_active":"2024-09-11T23:04:06.702448+0000","last_became_peered":"2024-09-11T23:04:06.702448+0000","last_unstale":"2024-09-11T23:04:06.707772+0000","last_undegraded":"2024-09-11T23:04:06.707772+0000","last_fullsized":"2024-09-11T23:04:06.707772+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:55.596753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.658621+0000","last_change":"2024-09-11T23:04:05.676411+0000","last_active":"2024-09-11T23:04:06.658621+0000","last_peered":"2024-09-11T23:04:06.658621+0000","last_clean":"2024-09-11T23:04:06.658621+0000","last_became_active":"2024-09-11T23:04:05.676141+0000","last_became_peered":"2024-09-11T23:04:05.676141+0000","last_unstale":"2024-09-11T23:04:06.658621+0000","last_undegraded":"2024-09-11T23:04:06.658621+0000","last_fullsized":"2024-09-11T23:04:06.658621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:54.591008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.702711+0000","last_change":"2024-09-11T23:04:06.698683+0000","last_active":"2024-09-11T23:04:06.702711+0000","last_peered":"2024-09-11T23:04:06.702711+0000","last_clean":"2024-09-11T23:04:06.702711+0000","last_became_active":"2024-09-11T23:04:06.696961+0000","last_became_peered":"2024-09-11T23:04:06.696961+0000","last_unstale":"2024-09-11T23:04:06.702711+0000","last_undegraded":"2024-09-11T23:04:06.702711+0000","last_fullsized":"2024-09-11T23:04:06.702711+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:28.481953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.682059+0000","last_change":"2024-09-11T23:04:05.698310+0000","last_active":"2024-09-11T23:04:06.682059+0000","last_peered":"2024-09-11T23:04:06.682059+0000","last_clean":"2024-09-11T23:04:06.682059+0000","last_became_active":"2024-09-11T23:04:05.697692+0000","last_became_peered":"2024-09-11T23:04:05.697692+0000","last_unstale":"2024-09-11T23:04:06.682059+0000","last_undegraded":"2024-09-11T23:04:06.682059+0000","last_fullsized":"2024-09-11T23:04:06.682059+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:50.573034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.695846+0000","last_change":"2024-09-11T23:04:06.684609+0000","last_active":"2024-09-11T23:04:06.695846+0000","last_peered":"2024-09-11T23:04:06.695846+0000","last_clean":"2024-09-11T23:04:06.695846+0000","last_became_active":"2024-09-11T23:04:06.684305+0000","last_became_peered":"2024-09-11T23:04:06.684305+0000","last_unstale":"2024-09-11T23:04:06.695846+0000","last_undegraded":"2024-09-11T23:04:06.695846+0000","last_fullsized":"2024-09-11T23:04:06.695846+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:35.870185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.659645+0000","last_change":"2024-09-11T23:04:05.691815+0000","last_active":"2024-09-11T23:04:06.659645+0000","last_peered":"2024-09-11T23:04:06.659645+0000","last_clean":"2024-09-11T23:04:06.659645+0000","last_became_active":"2024-09-11T23:04:05.691045+0000","last_became_peered":"2024-09-11T23:04:05.691045+0000","last_unstale":"2024-09-11T23:04:06.659645+0000","last_undegraded":"2024-09-11T23:04:06.659645+0000","last_fullsized":"2024-09-11T23:04:06.659645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:16.391203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.723163+0000","last_change":"2024-09-11T23:04:06.716824+0000","last_active":"2024-09-11T23:04:06.723163+0000","last_peered":"2024-09-11T23:04:06.723163+0000","last_clean":"2024-09-11T23:04:06.723163+0000","last_became_active":"2024-09-11T23:04:06.714725+0000","last_became_peered":"2024-09-11T23:04:06.714725+0000","last_unstale":"2024-09-11T23:04:06.723163+0000","last_undegraded":"2024-09-11T23:04:06.723163+0000","last_fullsized":"2024-09-11T23:04:06.723163+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:21.771096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.659828+0000","last_change":"2024-09-11T23:04:05.686997+0000","last_active":"2024-09-11T23:04:06.659828+0000","last_peered":"2024-09-11T23:04:06.659828+0000","last_clean":"2024-09-11T23:04:06.659828+0000","last_became_active":"2024-09-11T23:04:05.686566+0000","last_became_peered":"2024-09-11T23:04:05.686566+0000","last_unstale":"2024-09-11T23:04:06.659828+0000","last_undegraded":"2024-09-11T23:04:06.659828+0000","last_fullsized":"2024-09-11T23:04:06.659828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:47.384390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.711968+0000","last_change":"2024-09-11T23:04:06.710647+0000","last_active":"2024-09-11T23:04:06.711968+0000","last_peered":"2024-09-11T23:04:06.711968+0000","last_clean":"2024-09-11T23:04:06.711968+0000","last_became_active":"2024-09-11T23:04:06.708651+0000","last_became_peered":"2024-09-11T23:04:06.708651+0000","last_unstale":"2024-09-11T23:04:06.711968+0000","last_undegraded":"2024-09-11T23:04:06.711968+0000","last_fullsized":"2024-09-11T23:04:06.711968+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:45.660408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"24'3","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.710216+0000","last_change":"2024-09-11T23:04:05.697416+0000","last_active":"2024-09-11T23:04:06.710216+0000","last_peered":"2024-09-11T23:04:06.710216+0000","last_clean":"2024-09-11T23:04:06.710216+0000","last_became_active":"2024-09-11T23:04:05.697077+0000","last_became_peered":"2024-09-11T23:04:05.697077+0000","last_unstale":"2024-09-11T23:04:06.710216+0000","last_undegraded":"2024-09-11T23:04:06.710216+0000","last_fullsized":"2024-09-11T23:04:06.710216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:46.160155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.695442+0000","last_change":"2024-09-11T23:04:06.688538+0000","last_active":"2024-09-11T23:04:06.695442+0000","last_peered":"2024-09-11T23:04:06.695442+0000","last_clean":"2024-09-11T23:04:06.695442+0000","last_became_active":"2024-09-11T23:04:06.687277+0000","last_became_peered":"2024-09-11T23:04:06.687277+0000","last_unstale":"2024-09-11T23:04:06.695442+0000","last_undegraded":"2024-09-11T23:04:06.695442+0000","last_fullsized":"2024-09-11T23:04:06.695442+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:15.931019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"24'6","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.723360+0000","last_change":"2024-09-11T23:04:05.665705+0000","last_active":"2024-09-11T23:04:06.723360+0000","last_peered":"2024-09-11T23:04:06.723360+0000","last_clean":"2024-09-11T23:04:06.723360+0000","last_became_active":"2024-09-11T23:04:05.665160+0000","last_became_peered":"2024-09-11T23:04:05.665160+0000","last_unstale":"2024-09-11T23:04:06.723360+0000","last_undegraded":"2024-09-11T23:04:06.723360+0000","last_fullsized":"2024-09-11T23:04:06.723360+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:23.328322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.678334+0000","last_change":"2024-09-11T23:04:06.676365+0000","last_active":"2024-09-11T23:04:06.678334+0000","last_peered":"2024-09-11T23:04:06.678334+0000","last_clean":"2024-09-11T23:04:06.678334+0000","last_became_active":"2024-09-11T23:04:06.676088+0000","last_became_peered":"2024-09-11T23:04:06.676088+0000","last_unstale":"2024-09-11T23:04:06.678334+0000","last_undegraded":"2024-09-11T23:04:06.678334+0000","last_fullsized":"2024-09-11T23:04:06.678334+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:25:25.242499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"24'2","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.718965+0000","last_change":"2024-09-11T23:04:05.699157+0000","last_active":"2024-09-11T23:04:06.718965+0000","last_peered":"2024-09-11T23:04:06.718965+0000","last_clean":"2024-09-11T23:04:06.718965+0000","last_became_active":"2024-09-11T23:04:05.698847+0000","last_became_peered":"2024-09-11T23:04:05.698847+0000","last_unstale":"2024-09-11T23:04:06.718965+0000","last_undegraded":"2024-09-11T23:04:06.718965+0000","last_fullsized":"2024-09-11T23:04:06.718965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:06.499241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.701473+0000","last_change":"2024-09-11T23:04:06.694583+0000","last_active":"2024-09-11T23:04:06.701473+0000","last_peered":"2024-09-11T23:04:06.701473+0000","last_clean":"2024-09-11T23:04:06.701473+0000","last_became_active":"2024-09-11T23:04:06.693107+0000","last_became_peered":"2024-09-11T23:04:06.693107+0000","last_unstale":"2024-09-11T23:04:06.701473+0000","last_undegraded":"2024-09-11T23:04:06.701473+0000","last_fullsized":"2024-09-11T23:04:06.701473+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:23.140099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.680338+0000","last_change":"2024-09-11T23:04:05.687337+0000","last_active":"2024-09-11T23:04:06.680338+0000","last_peered":"2024-09-11T23:04:06.680338+0000","last_clean":"2024-09-11T23:04:06.680338+0000","last_became_active":"2024-09-11T23:04:05.682945+0000","last_became_peered":"2024-09-11T23:04:05.682945+0000","last_unstale":"2024-09-11T23:04:06.680338+0000","last_undegraded":"2024-09-11T23:04:06.680338+0000","last_fullsized":"2024-09-11T23:04:06.680338+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:26.375737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.719139+0000","last_change":"2024-09-11T23:04:06.713080+0000","last_active":"2024-09-11T23:04:06.719139+0000","last_peered":"2024-09-11T23:04:06.719139+0000","last_clean":"2024-09-11T23:04:06.719139+0000","last_became_active":"2024-09-11T23:04:06.709883+0000","last_became_peered":"2024-09-11T23:04:06.709883+0000","last_unstale":"2024-09-11T23:04:06.719139+0000","last_undegraded":"2024-09-11T23:04:06.719139+0000","last_fullsized":"2024-09-11T23:04:06.719139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:22.823363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.687579+0000","last_change":"2024-09-11T23:04:05.681735+0000","last_active":"2024-09-11T23:04:06.687579+0000","last_peered":"2024-09-11T23:04:06.687579+0000","last_clean":"2024-09-11T23:04:06.687579+0000","last_became_active":"2024-09-11T23:04:05.680901+0000","last_became_peered":"2024-09-11T23:04:05.680901+0000","last_unstale":"2024-09-11T23:04:06.687579+0000","last_undegraded":"2024-09-11T23:04:06.687579+0000","last_fullsized":"2024-09-11T23:04:06.687579+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:44.789703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.701441+0000","last_change":"2024-09-11T23:04:06.697201+0000","last_active":"2024-09-11T23:04:06.701441+0000","last_peered":"2024-09-11T23:04:06.701441+0000","last_clean":"2024-09-11T23:04:06.701441+0000","last_became_active":"2024-09-11T23:04:06.693545+0000","last_became_peered":"2024-09-11T23:04:06.693545+0000","last_unstale":"2024-09-11T23:04:06.701441+0000","last_undegraded":"2024-09-11T23:04:06.701441+0000","last_fullsized":"2024-09-11T23:04:06.701441+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:34.905678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"24'8","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.704156+0000","last_change":"2024-09-11T23:04:05.676019+0000","last_active":"2024-09-11T23:04:06.704156+0000","last_peered":"2024-09-11T23:04:06.704156+0000","last_clean":"2024-09-11T23:04:06.704156+0000","last_became_active":"2024-09-11T23:04:05.675048+0000","last_became_peered":"2024-09-11T23:04:05.675048+0000","last_unstale":"2024-09-11T23:04:06.704156+0000","last_undegraded":"2024-09-11T23:04:06.704156+0000","last_fullsized":"2024-09-11T23:04:06.704156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:58.741170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.723060+0000","last_change":"2024-09-11T23:04:06.716914+0000","last_active":"2024-09-11T23:04:06.723060+0000","last_peered":"2024-09-11T23:04:06.723060+0000","last_clean":"2024-09-11T23:04:06.723060+0000","last_became_active":"2024-09-11T23:04:06.714902+0000","last_became_peered":"2024-09-11T23:04:06.714902+0000","last_unstale":"2024-09-11T23:04:06.723060+0000","last_undegraded":"2024-09-11T23:04:06.723060+0000","last_fullsized":"2024-09-11T23:04:06.723060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:29.557131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"24'1","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.710513+0000","last_change":"2024-09-11T23:04:05.683657+0000","last_active":"2024-09-11T23:04:06.710513+0000","last_peered":"2024-09-11T23:04:06.710513+0000","last_clean":"2024-09-11T23:04:06.710513+0000","last_became_active":"2024-09-11T23:04:05.676386+0000","last_became_peered":"2024-09-11T23:04:05.676386+0000","last_unstale":"2024-09-11T23:04:06.710513+0000","last_undegraded":"2024-09-11T23:04:06.710513+0000","last_fullsized":"2024-09-11T23:04:06.710513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:02.300117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.701474+0000","last_change":"2024-09-11T23:04:06.698095+0000","last_active":"2024-09-11T23:04:06.701474+0000","last_peered":"2024-09-11T23:04:06.701474+0000","last_clean":"2024-09-11T23:04:06.701474+0000","last_became_active":"2024-09-11T23:04:06.696510+0000","last_became_peered":"2024-09-11T23:04:06.696510+0000","last_unstale":"2024-09-11T23:04:06.701474+0000","last_undegraded":"2024-09-11T23:04:06.701474+0000","last_fullsized":"2024-09-11T23:04:06.701474+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:44.396966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"24'2","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.718925+0000","last_change":"2024-09-11T23:04:05.698364+0000","last_active":"2024-09-11T23:04:06.718925+0000","last_peered":"2024-09-11T23:04:06.718925+0000","last_clean":"2024-09-11T23:04:06.718925+0000","last_became_active":"2024-09-11T23:04:05.698064+0000","last_became_peered":"2024-09-11T23:04:05.698064+0000","last_unstale":"2024-09-11T23:04:06.718925+0000","last_undegraded":"2024-09-11T23:04:06.718925+0000","last_fullsized":"2024-09-11T23:04:06.718925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:23.533289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.698835+0000","last_change":"2024-09-11T23:04:06.696752+0000","last_active":"2024-09-11T23:04:06.698835+0000","last_peered":"2024-09-11T23:04:06.698835+0000","last_clean":"2024-09-11T23:04:06.698835+0000","last_became_active":"2024-09-11T23:04:06.694077+0000","last_became_peered":"2024-09-11T23:04:06.694077+0000","last_unstale":"2024-09-11T23:04:06.698835+0000","last_undegraded":"2024-09-11T23:04:06.698835+0000","last_fullsized":"2024-09-11T23:04:06.698835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:06.608268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"24'1","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.702077+0000","last_change":"2024-09-11T23:04:05.683741+0000","last_active":"2024-09-11T23:04:06.702077+0000","last_peered":"2024-09-11T23:04:06.702077+0000","last_clean":"2024-09-11T23:04:06.702077+0000","last_became_active":"2024-09-11T23:04:05.679708+0000","last_became_peered":"2024-09-11T23:04:05.679708+0000","last_unstale":"2024-09-11T23:04:06.702077+0000","last_undegraded":"2024-09-11T23:04:06.702077+0000","last_fullsized":"2024-09-11T23:04:06.702077+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:42.218837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.723007+0000","last_change":"2024-09-11T23:04:06.715395+0000","last_active":"2024-09-11T23:04:06.723007+0000","last_peered":"2024-09-11T23:04:06.723007+0000","last_clean":"2024-09-11T23:04:06.723007+0000","last_became_active":"2024-09-11T23:04:06.713555+0000","last_became_peered":"2024-09-11T23:04:06.713555+0000","last_unstale":"2024-09-11T23:04:06.723007+0000","last_undegraded":"2024-09-11T23:04:06.723007+0000","last_fullsized":"2024-09-11T23:04:06.723007+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:23.140099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.655968+0000","last_change":"2024-09-11T23:04:05.685369+0000","last_active":"2024-09-11T23:04:06.655968+0000","last_peered":"2024-09-11T23:04:06.655968+0000","last_clean":"2024-09-11T23:04:06.655968+0000","last_became_active":"2024-09-11T23:04:05.684862+0000","last_became_peered":"2024-09-11T23:04:05.684862+0000","last_unstale":"2024-09-11T23:04:06.655968+0000","last_undegraded":"2024-09-11T23:04:06.655968+0000","last_fullsized":"2024-09-11T23:04:06.655968+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:23.376347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.723132+0000","last_change":"2024-09-11T23:04:06.717057+0000","last_active":"2024-09-11T23:04:06.723132+0000","last_peered":"2024-09-11T23:04:06.723132+0000","last_clean":"2024-09-11T23:04:06.723132+0000","last_became_active":"2024-09-11T23:04:06.715112+0000","last_became_peered":"2024-09-11T23:04:06.715112+0000","last_unstale":"2024-09-11T23:04:06.723132+0000","last_undegraded":"2024-09-11T23:04:06.723132+0000","last_fullsized":"2024-09-11T23:04:06.723132+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:03.729106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"24'2","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.686218+0000","last_change":"2024-09-11T23:04:05.679072+0000","last_active":"2024-09-11T23:04:06.686218+0000","last_peered":"2024-09-11T23:04:06.686218+0000","last_clean":"2024-09-11T23:04:06.686218+0000","last_became_active":"2024-09-11T23:04:05.678770+0000","last_became_peered":"2024-09-11T23:04:05.678770+0000","last_unstale":"2024-09-11T23:04:06.686218+0000","last_undegraded":"2024-09-11T23:04:06.686218+0000","last_fullsized":"2024-09-11T23:04:06.686218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:14.519112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.723086+0000","last_change":"2024-09-11T23:04:06.717074+0000","last_active":"2024-09-11T23:04:06.723086+0000","last_peered":"2024-09-11T23:04:06.723086+0000","last_clean":"2024-09-11T23:04:06.723086+0000","last_became_active":"2024-09-11T23:04:06.714778+0000","last_became_peered":"2024-09-11T23:04:06.714778+0000","last_unstale":"2024-09-11T23:04:06.723086+0000","last_undegraded":"2024-09-11T23:04:06.723086+0000","last_fullsized":"2024-09-11T23:04:06.723086+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:34.905678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.694406+0000","last_change":"2024-09-11T23:04:05.699052+0000","last_active":"2024-09-11T23:04:06.694406+0000","last_peered":"2024-09-11T23:04:06.694406+0000","last_clean":"2024-09-11T23:04:06.694406+0000","last_became_active":"2024-09-11T23:04:05.698769+0000","last_became_peered":"2024-09-11T23:04:05.698769+0000","last_unstale":"2024-09-11T23:04:06.694406+0000","last_undegraded":"2024-09-11T23:04:06.694406+0000","last_fullsized":"2024-09-11T23:04:06.694406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:23.328322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.723137+0000","last_change":"2024-09-11T23:04:06.717549+0000","last_active":"2024-09-11T23:04:06.723137+0000","last_peered":"2024-09-11T23:04:06.723137+0000","last_clean":"2024-09-11T23:04:06.723137+0000","last_became_active":"2024-09-11T23:04:06.715314+0000","last_became_peered":"2024-09-11T23:04:06.715314+0000","last_unstale":"2024-09-11T23:04:06.723137+0000","last_undegraded":"2024-09-11T23:04:06.723137+0000","last_fullsized":"2024-09-11T23:04:06.723137+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:38.436208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.680499+0000","last_change":"2024-09-11T23:04:05.675845+0000","last_active":"2024-09-11T23:04:06.680499+0000","last_peered":"2024-09-11T23:04:06.680499+0000","last_clean":"2024-09-11T23:04:06.680499+0000","last_became_active":"2024-09-11T23:04:05.675385+0000","last_became_peered":"2024-09-11T23:04:05.675385+0000","last_unstale":"2024-09-11T23:04:06.680499+0000","last_undegraded":"2024-09-11T23:04:06.680499+0000","last_fullsized":"2024-09-11T23:04:06.680499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:23.909149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.701485+0000","last_change":"2024-09-11T23:04:06.698306+0000","last_active":"2024-09-11T23:04:06.701485+0000","last_peered":"2024-09-11T23:04:06.701485+0000","last_clean":"2024-09-11T23:04:06.701485+0000","last_became_active":"2024-09-11T23:04:06.696900+0000","last_became_peered":"2024-09-11T23:04:06.696900+0000","last_unstale":"2024-09-11T23:04:06.701485+0000","last_undegraded":"2024-09-11T23:04:06.701485+0000","last_fullsized":"2024-09-11T23:04:06.701485+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:38.436208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.680247+0000","last_change":"2024-09-11T23:04:05.684243+0000","last_active":"2024-09-11T23:04:06.680247+0000","last_peered":"2024-09-11T23:04:06.680247+0000","last_clean":"2024-09-11T23:04:06.680247+0000","last_became_active":"2024-09-11T23:04:05.683873+0000","last_became_peered":"2024-09-11T23:04:05.683873+0000","last_unstale":"2024-09-11T23:04:06.680247+0000","last_undegraded":"2024-09-11T23:04:06.680247+0000","last_fullsized":"2024-09-11T23:04:06.680247+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:23.533289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.723360+0000","last_change":"2024-09-11T23:04:06.719857+0000","last_active":"2024-09-11T23:04:06.723360+0000","last_peered":"2024-09-11T23:04:06.723360+0000","last_clean":"2024-09-11T23:04:06.723360+0000","last_became_active":"2024-09-11T23:04:06.719587+0000","last_became_peered":"2024-09-11T23:04:06.719587+0000","last_unstale":"2024-09-11T23:04:06.723360+0000","last_undegraded":"2024-09-11T23:04:06.723360+0000","last_fullsized":"2024-09-11T23:04:06.723360+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:24.382092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"24'2","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.698208+0000","last_change":"2024-09-11T23:04:05.676729+0000","last_active":"2024-09-11T23:04:06.698208+0000","last_peered":"2024-09-11T23:04:06.698208+0000","last_clean":"2024-09-11T23:04:06.698208+0000","last_became_active":"2024-09-11T23:04:05.675202+0000","last_became_peered":"2024-09-11T23:04:05.675202+0000","last_unstale":"2024-09-11T23:04:06.698208+0000","last_undegraded":"2024-09-11T23:04:06.698208+0000","last_fullsized":"2024-09-11T23:04:06.698208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:48.836399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.695898+0000","last_change":"2024-09-11T23:04:06.686514+0000","last_active":"2024-09-11T23:04:06.695898+0000","last_peered":"2024-09-11T23:04:06.695898+0000","last_clean":"2024-09-11T23:04:06.695898+0000","last_became_active":"2024-09-11T23:04:06.685618+0000","last_became_peered":"2024-09-11T23:04:06.685618+0000","last_unstale":"2024-09-11T23:04:06.695898+0000","last_undegraded":"2024-09-11T23:04:06.695898+0000","last_fullsized":"2024-09-11T23:04:06.695898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:02:46.658216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.659751+0000","last_change":"2024-09-11T23:04:05.679499+0000","last_active":"2024-09-11T23:04:06.659751+0000","last_peered":"2024-09-11T23:04:06.659751+0000","last_clean":"2024-09-11T23:04:06.659751+0000","last_became_active":"2024-09-11T23:04:05.679068+0000","last_became_peered":"2024-09-11T23:04:05.679068+0000","last_unstale":"2024-09-11T23:04:06.659751+0000","last_undegraded":"2024-09-11T23:04:06.659751+0000","last_fullsized":"2024-09-11T23:04:06.659751+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:14.200632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.695462+0000","last_change":"2024-09-11T23:04:06.688524+0000","last_active":"2024-09-11T23:04:06.695462+0000","last_peered":"2024-09-11T23:04:06.695462+0000","last_clean":"2024-09-11T23:04:06.695462+0000","last_became_active":"2024-09-11T23:04:06.687018+0000","last_became_peered":"2024-09-11T23:04:06.687018+0000","last_unstale":"2024-09-11T23:04:06.695462+0000","last_undegraded":"2024-09-11T23:04:06.695462+0000","last_fullsized":"2024-09-11T23:04:06.695462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:47.094581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.680511+0000","last_change":"2024-09-11T23:04:05.679667+0000","last_active":"2024-09-11T23:04:06.680511+0000","last_peered":"2024-09-11T23:04:06.680511+0000","last_clean":"2024-09-11T23:04:06.680511+0000","last_became_active":"2024-09-11T23:04:05.679188+0000","last_became_peered":"2024-09-11T23:04:05.679188+0000","last_unstale":"2024-09-11T23:04:06.680511+0000","last_undegraded":"2024-09-11T23:04:06.680511+0000","last_fullsized":"2024-09-11T23:04:06.680511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:14.400369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.687590+0000","last_change":"2024-09-11T23:04:06.679360+0000","last_active":"2024-09-11T23:04:06.687590+0000","last_peered":"2024-09-11T23:04:06.687590+0000","last_clean":"2024-09-11T23:04:06.687590+0000","last_became_active":"2024-09-11T23:04:06.678978+0000","last_became_peered":"2024-09-11T23:04:06.678978+0000","last_unstale":"2024-09-11T23:04:06.687590+0000","last_undegraded":"2024-09-11T23:04:06.687590+0000","last_fullsized":"2024-09-11T23:04:06.687590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:16.030112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.655682+0000","last_change":"2024-09-11T23:04:05.687057+0000","last_active":"2024-09-11T23:04:06.655682+0000","last_peered":"2024-09-11T23:04:06.655682+0000","last_clean":"2024-09-11T23:04:06.655682+0000","last_became_active":"2024-09-11T23:04:05.685211+0000","last_became_peered":"2024-09-11T23:04:05.685211+0000","last_unstale":"2024-09-11T23:04:06.655682+0000","last_undegraded":"2024-09-11T23:04:06.655682+0000","last_fullsized":"2024-09-11T23:04:06.655682+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:27.476208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.694344+0000","last_change":"2024-09-11T23:04:06.686422+0000","last_active":"2024-09-11T23:04:06.694344+0000","last_peered":"2024-09-11T23:04:06.694344+0000","last_clean":"2024-09-11T23:04:06.694344+0000","last_became_active":"2024-09-11T23:04:06.685598+0000","last_became_peered":"2024-09-11T23:04:06.685598+0000","last_unstale":"2024-09-11T23:04:06.694344+0000","last_undegraded":"2024-09-11T23:04:06.694344+0000","last_fullsized":"2024-09-11T23:04:06.694344+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:24.644506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.680331+0000","last_change":"2024-09-11T23:04:05.675851+0000","last_active":"2024-09-11T23:04:06.680331+0000","last_peered":"2024-09-11T23:04:06.680331+0000","last_clean":"2024-09-11T23:04:06.680331+0000","last_became_active":"2024-09-11T23:04:05.675385+0000","last_became_peered":"2024-09-11T23:04:05.675385+0000","last_unstale":"2024-09-11T23:04:06.680331+0000","last_undegraded":"2024-09-11T23:04:06.680331+0000","last_fullsized":"2024-09-11T23:04:06.680331+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:03.402915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.719162+0000","last_change":"2024-09-11T23:04:06.713330+0000","last_active":"2024-09-11T23:04:06.719162+0000","last_peered":"2024-09-11T23:04:06.719162+0000","last_clean":"2024-09-11T23:04:06.719162+0000","last_became_active":"2024-09-11T23:04:06.710243+0000","last_became_peered":"2024-09-11T23:04:06.710243+0000","last_unstale":"2024-09-11T23:04:06.719162+0000","last_undegraded":"2024-09-11T23:04:06.719162+0000","last_fullsized":"2024-09-11T23:04:06.719162+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:49.842144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.687711+0000","last_change":"2024-09-11T23:04:05.682955+0000","last_active":"2024-09-11T23:04:06.687711+0000","last_peered":"2024-09-11T23:04:06.687711+0000","last_clean":"2024-09-11T23:04:06.687711+0000","last_became_active":"2024-09-11T23:04:05.682511+0000","last_became_peered":"2024-09-11T23:04:05.682511+0000","last_unstale":"2024-09-11T23:04:06.687711+0000","last_undegraded":"2024-09-11T23:04:06.687711+0000","last_fullsized":"2024-09-11T23:04:06.687711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:31.741971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.702736+0000","last_change":"2024-09-11T23:04:06.698841+0000","last_active":"2024-09-11T23:04:06.702736+0000","last_peered":"2024-09-11T23:04:06.702736+0000","last_clean":"2024-09-11T23:04:06.702736+0000","last_became_active":"2024-09-11T23:04:06.698563+0000","last_became_peered":"2024-09-11T23:04:06.698563+0000","last_unstale":"2024-09-11T23:04:06.702736+0000","last_undegraded":"2024-09-11T23:04:06.702736+0000","last_fullsized":"2024-09-11T23:04:06.702736+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:24.382092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.652715+0000","last_change":"2024-09-11T23:04:05.682896+0000","last_active":"2024-09-11T23:04:06.652715+0000","last_peered":"2024-09-11T23:04:06.652715+0000","last_clean":"2024-09-11T23:04:06.652715+0000","last_became_active":"2024-09-11T23:04:05.678156+0000","last_became_peered":"2024-09-11T23:04:05.678156+0000","last_unstale":"2024-09-11T23:04:06.652715+0000","last_undegraded":"2024-09-11T23:04:06.652715+0000","last_fullsized":"2024-09-11T23:04:06.652715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:34.356559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.710531+0000","last_change":"2024-09-11T23:04:06.707162+0000","last_active":"2024-09-11T23:04:06.710531+0000","last_peered":"2024-09-11T23:04:06.710531+0000","last_clean":"2024-09-11T23:04:06.710531+0000","last_became_active":"2024-09-11T23:04:06.706725+0000","last_became_peered":"2024-09-11T23:04:06.706725+0000","last_unstale":"2024-09-11T23:04:06.710531+0000","last_undegraded":"2024-09-11T23:04:06.710531+0000","last_fullsized":"2024-09-11T23:04:06.710531+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:05.632895+0000","last_clean_scrub_stamp":"2024-09-11T23:04:05.632895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:55.544030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.681387+0000","last_change":"2024-09-11T23:04:05.683920+0000","last_active":"2024-09-11T23:04:06.681387+0000","last_peered":"2024-09-11T23:04:06.681387+0000","last_clean":"2024-09-11T23:04:06.681387+0000","last_became_active":"2024-09-11T23:04:05.679246+0000","last_became_peered":"2024-09-11T23:04:05.679246+0000","last_unstale":"2024-09-11T23:04:06.681387+0000","last_undegraded":"2024-09-11T23:04:06.681387+0000","last_fullsized":"2024-09-11T23:04:06.681387+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:04.627150+0000","last_clean_scrub_stamp":"2024-09-11T23:04:04.627150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:21.817618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":162,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-11T23:04:06.680421+0000","last_change":"2024-09-11T23:03:26.382905+0000","last_active":"2024-09-11T23:04:06.680421+0000","last_peered":"2024-09-11T23:04:06.680421+0000","last_clean":"2024-09-11T23:04:06.680421+0000","last_became_active":"2024-09-11T23:03:26.380590+0000","last_became_peered":"2024-09-11T23:03:26.380590+0000","last_unstale":"2024-09-11T23:04:06.680421+0000","last_undegraded":"2024-09-11T23:04:06.680421+0000","last_fullsized":"2024-09-11T23:04:06.680421+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:24.361793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:24.361793+0000","last_clean_scrub_stamp":"2024-09-11T23:03:24.361793+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:46.577063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738380,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":71442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738380,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":839680,"data_stored":664094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738380,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":827392,"data_stored":663968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:04:11.084 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T23:04:11.084 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-11T23:04:11.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.264+0000 7f2aaf639640 1 Processor -- start 2024-09-11T23:04:11.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.264+0000 7f2aaf639640 1 -- start start 2024-09-11T23:04:11.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.264+0000 7f2aaf639640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2aa809f060 0x7f2aa813cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:11.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.264+0000 7f2aaf639640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2aa8134500 con 0x7f2aa8134720 2024-09-11T23:04:11.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.264+0000 7f2aaf639640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f2aa8135210 con 0x7f2aa809f060 2024-09-11T23:04:11.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.264+0000 7f2aacbd4640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2aa809f060 0x7f2aa813cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:11.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.264+0000 7f2aad3d5640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f2aa8134720 0x7f2aa8134b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:52274/0 (socket says 172.21.15.12:52274) 2024-09-11T23:04:11.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.264+0000 7f2aad3d5640 1 -- 172.21.15.12:0/1639294408 learned_addr learned my addr 172.21.15.12:0/1639294408 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:04:11.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.264+0000 7f2aacbd4640 1 -- 172.21.15.12:0/1639294408 >> v1:172.21.15.12:6789/0 conn(0x7f2aa8134720 legacy=0x7f2aa8134b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:11.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.264+0000 7f2aacbd4640 1 -- 172.21.15.12:0/1639294408 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aa81341f0 con 0x7f2aa809f060 2024-09-11T23:04:11.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.268+0000 7f2aacbd4640 1 --2- 172.21.15.12:0/1639294408 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2aa809f060 0x7f2aa813cb60 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2a98009740 tx=0x7f2a9801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=236a6000abe0a945 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:11.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.268+0000 7f2a9ffff640 1 -- 172.21.15.12:0/1639294408 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a980b0070 con 0x7f2aa809f060 2024-09-11T23:04:11.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.268+0000 7f2a9ffff640 1 -- 172.21.15.12:0/1639294408 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a980ab530 con 0x7f2aa809f060 2024-09-11T23:04:11.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.268+0000 7f2a9ffff640 1 -- 172.21.15.12:0/1639294408 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a980ab830 con 0x7f2aa809f060 2024-09-11T23:04:11.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.268+0000 7f2aaf639640 1 -- 172.21.15.12:0/1639294408 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2aa809f060 msgr2=0x7f2aa813cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:11.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.268+0000 7f2aaf639640 1 --2- 172.21.15.12:0/1639294408 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2aa809f060 0x7f2aa813cb60 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2a98009740 tx=0x7f2a9801c420 comp rx=0 tx=0).stop 2024-09-11T23:04:11.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.268+0000 7f2aaf639640 1 -- 172.21.15.12:0/1639294408 shutdown_connections 2024-09-11T23:04:11.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.268+0000 7f2aaf639640 1 --2- 172.21.15.12:0/1639294408 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2aa809f060 0x7f2aa813cb60 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:11.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.268+0000 7f2aaf639640 1 -- 172.21.15.12:0/1639294408 >> 172.21.15.12:0/1639294408 conn(0x7f2aa809a9d0 msgr2=0x7f2aa809cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:11.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.268+0000 7f2aaf639640 1 -- 172.21.15.12:0/1639294408 shutdown_connections 2024-09-11T23:04:11.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.268+0000 7f2aaf639640 1 -- 172.21.15.12:0/1639294408 wait complete. 2024-09-11T23:04:11.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.268+0000 7f2aaf639640 1 Processor -- start 2024-09-11T23:04:11.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.268+0000 7f2aaf639640 1 -- start start 2024-09-11T23:04:11.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.268+0000 7f2aaf639640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2aa809f060 0x7f2aa80a4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:11.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.268+0000 7f2aaf639640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2aa813f8c0 con 0x7f2aa809f060 2024-09-11T23:04:11.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.268+0000 7f2aad3d5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2aa809f060 0x7f2aa80a4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:11.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.268+0000 7f2aad3d5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2aa809f060 0x7f2aa80a4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39840/0 (socket says 172.21.15.12:39840) 2024-09-11T23:04:11.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.268+0000 7f2aad3d5640 1 -- 172.21.15.12:0/1087672702 learned_addr learned my addr 172.21.15.12:0/1087672702 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:11.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.268+0000 7f2aad3d5640 1 -- 172.21.15.12:0/1087672702 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aa80a58a0 con 0x7f2aa809f060 2024-09-11T23:04:11.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.272+0000 7f2aad3d5640 1 --2- 172.21.15.12:0/1087672702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2aa809f060 0x7f2aa80a4fb0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2aa400cb20 tx=0x7f2aa400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:11.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.272+0000 7f2a9dffb640 1 -- 172.21.15.12:0/1087672702 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2aa4017070 con 0x7f2aa809f060 2024-09-11T23:04:11.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.272+0000 7f2a9dffb640 1 -- 172.21.15.12:0/1087672702 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2aa400abf0 con 0x7f2aa809f060 2024-09-11T23:04:11.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.272+0000 7f2aaf639640 1 -- 172.21.15.12:0/1087672702 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2aa80a4570 con 0x7f2aa809f060 2024-09-11T23:04:11.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.272+0000 7f2a9dffb640 1 -- 172.21.15.12:0/1087672702 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2aa4012400 con 0x7f2aa809f060 2024-09-11T23:04:11.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.272+0000 7f2aaf639640 1 -- 172.21.15.12:0/1087672702 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2aa8071690 con 0x7f2aa809f060 2024-09-11T23:04:11.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.272+0000 7f2a9dffb640 1 -- 172.21.15.12:0/1087672702 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2aa401a070 con 0x7f2aa809f060 2024-09-11T23:04:11.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.272+0000 7f2aaf639640 1 -- 172.21.15.12:0/1087672702 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2aa80a4340 con 0x7f2aa809f060 2024-09-11T23:04:11.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.272+0000 7f2a9dffb640 1 --2- 172.21.15.12:0/1087672702 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f2a8c035db0 0x7f2a8c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:11.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.272+0000 7f2a9dffb640 1 -- 172.21.15.12:0/1087672702 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 3439+0+0 (secure 0 0 0) 0x7f2aa40483a0 con 0x7f2aa809f060 2024-09-11T23:04:11.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.272+0000 7f2aacbd4640 1 --2- 172.21.15.12:0/1087672702 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f2a8c035db0 0x7f2a8c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:11.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.272+0000 7f2aacbd4640 1 --2- 172.21.15.12:0/1087672702 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f2a8c035db0 0x7f2a8c038270 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2a980ad000 tx=0x7f2a980a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:11.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.276+0000 7f2a9dffb640 1 -- 172.21.15.12:0/1087672702 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2aa40113a0 con 0x7f2aa809f060 2024-09-11T23:04:11.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.500+0000 7f2aaf639640 1 -- 172.21.15.12:0/1087672702 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f2aa806be50 con 0x7f2aa809f060 2024-09-11T23:04:11.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.500+0000 7f2a9dffb640 1 -- 172.21.15.12:0/1087672702 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) ==== 190+0+147 (secure 0 0 0) 0x7f2aa401aa90 con 0x7f2aa809f060 2024-09-11T23:04:11.502 INFO:teuthology.orchestra.run.smithi012.stdout:[client.0] 2024-09-11T23:04:11.502 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCgIeJmTz6nGhAAveLcJxI+RD0GsD9nnR2S/w== 2024-09-11T23:04:11.502 INFO:teuthology.orchestra.run.smithi012.stdout: caps mds = "allow" 2024-09-11T23:04:11.502 INFO:teuthology.orchestra.run.smithi012.stdout: caps mon = "allow r" 2024-09-11T23:04:11.502 INFO:teuthology.orchestra.run.smithi012.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-11T23:04:11.503 INFO:teuthology.orchestra.run.smithi012.stderr:updated caps for client.0 2024-09-11T23:04:11.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.504+0000 7f2aaf639640 1 -- 172.21.15.12:0/1087672702 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f2a8c035db0 msgr2=0x7f2a8c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:11.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.504+0000 7f2aaf639640 1 --2- 172.21.15.12:0/1087672702 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f2a8c035db0 0x7f2a8c038270 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2a980ad000 tx=0x7f2a980a6000 comp rx=0 tx=0).stop 2024-09-11T23:04:11.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.504+0000 7f2aaf639640 1 -- 172.21.15.12:0/1087672702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2aa809f060 msgr2=0x7f2aa80a4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:11.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.504+0000 7f2aaf639640 1 --2- 172.21.15.12:0/1087672702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2aa809f060 0x7f2aa80a4fb0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2aa400cb20 tx=0x7f2aa400a060 comp rx=0 tx=0).stop 2024-09-11T23:04:11.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.504+0000 7f2aaf639640 1 -- 172.21.15.12:0/1087672702 shutdown_connections 2024-09-11T23:04:11.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.504+0000 7f2aaf639640 1 --2- 172.21.15.12:0/1087672702 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f2a8c035db0 0x7f2a8c038270 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:11.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.504+0000 7f2aaf639640 1 --2- 172.21.15.12:0/1087672702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2aa809f060 0x7f2aa80a4fb0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:11.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.504+0000 7f2aaf639640 1 -- 172.21.15.12:0/1087672702 >> 172.21.15.12:0/1087672702 conn(0x7f2aa809a9d0 msgr2=0x7f2aa812ff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:11.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.504+0000 7f2aaf639640 1 -- 172.21.15.12:0/1087672702 shutdown_connections 2024-09-11T23:04:11.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.504+0000 7f2aaf639640 1 -- 172.21.15.12:0/1087672702 wait complete. 2024-09-11T23:04:11.520 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:04:11.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.628+0000 7fa0ce913640 1 Processor -- start 2024-09-11T23:04:11.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.628+0000 7fa0ce913640 1 -- start start 2024-09-11T23:04:11.632 INFO:tasks.ceph.mds.b.smithi012.stderr:2024-09-11T23:04:11.628+0000 7f7f3436b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T23:04:11.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.628+0000 7fa0ce913640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa0c8137e60 0x7fa0c8138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:11.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.628+0000 7fa0ce913640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0c809e930 con 0x7fa0c809f6e0 2024-09-11T23:04:11.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.628+0000 7fa0ce913640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fa0c81379e0 con 0x7fa0c8137e60 2024-09-11T23:04:11.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.632+0000 7fa0c7fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa0c8137e60 0x7fa0c8138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:11.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.632+0000 7fa0c77fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa0c809f6e0 0x7fa0c80a36a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:52284/0 (socket says 172.21.15.12:52284) 2024-09-11T23:04:11.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.632+0000 7fa0c77fe640 1 -- 172.21.15.12:0/2423328328 learned_addr learned my addr 172.21.15.12:0/2423328328 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:04:11.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.632+0000 7fa0c7fff640 1 -- 172.21.15.12:0/2423328328 >> v1:172.21.15.12:6789/0 conn(0x7fa0c809f6e0 legacy=0x7fa0c80a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:11.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.632+0000 7fa0c7fff640 1 -- 172.21.15.12:0/2423328328 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0c809d910 con 0x7fa0c8137e60 2024-09-11T23:04:11.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.632+0000 7fa0c6ffd640 1 -- 172.21.15.12:0/2423328328 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4142707991 0 0) 0x7fa0c809e930 con 0x7fa0c809f6e0 2024-09-11T23:04:11.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.632+0000 7fa0c7fff640 1 --2- 172.21.15.12:0/2423328328 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0c8137e60 0x7fa0c8138240 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8009740 tx=0x7fa0b801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30a827e21d04e289 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:11.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.632+0000 7fa0c6ffd640 1 -- 172.21.15.12:0/2423328328 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0b80ab570 con 0x7fa0c8137e60 2024-09-11T23:04:11.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.632+0000 7fa0c6ffd640 1 -- 172.21.15.12:0/2423328328 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0b80b0070 con 0x7fa0c8137e60 2024-09-11T23:04:11.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.632+0000 7fa0c6ffd640 1 -- 172.21.15.12:0/2423328328 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0b80ab860 con 0x7fa0c8137e60 2024-09-11T23:04:11.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.632+0000 7fa0ce913640 1 -- 172.21.15.12:0/2423328328 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0c8137e60 msgr2=0x7fa0c8138240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:11.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.632+0000 7fa0ce913640 1 --2- 172.21.15.12:0/2423328328 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0c8137e60 0x7fa0c8138240 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8009740 tx=0x7fa0b801c420 comp rx=0 tx=0).stop 2024-09-11T23:04:11.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.632+0000 7fa0ce913640 1 -- 172.21.15.12:0/2423328328 shutdown_connections 2024-09-11T23:04:11.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.632+0000 7fa0ce913640 1 --2- 172.21.15.12:0/2423328328 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0c8137e60 0x7fa0c8138240 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:11.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.632+0000 7fa0ce913640 1 -- 172.21.15.12:0/2423328328 >> 172.21.15.12:0/2423328328 conn(0x7fa0c80a8450 msgr2=0x7fa0c80a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:11.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.632+0000 7fa0ce913640 1 -- 172.21.15.12:0/2423328328 shutdown_connections 2024-09-11T23:04:11.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.632+0000 7fa0ce913640 1 -- 172.21.15.12:0/2423328328 wait complete. 2024-09-11T23:04:11.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.636+0000 7fa0ce913640 1 Processor -- start 2024-09-11T23:04:11.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.636+0000 7fa0ce913640 1 -- start start 2024-09-11T23:04:11.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.636+0000 7fa0ce913640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0c809f6e0 0x7fa0c8133780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:11.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.636+0000 7fa0ce913640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c813fe00 con 0x7fa0c809f6e0 2024-09-11T23:04:11.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.636+0000 7fa0c7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0c809f6e0 0x7fa0c8133780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:11.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.636+0000 7fa0c7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0c809f6e0 0x7fa0c8133780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39846/0 (socket says 172.21.15.12:39846) 2024-09-11T23:04:11.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.636+0000 7fa0c7fff640 1 -- 172.21.15.12:0/125333862 learned_addr learned my addr 172.21.15.12:0/125333862 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:11.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.636+0000 7fa0c7fff640 1 -- 172.21.15.12:0/125333862 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0c8070860 con 0x7fa0c809f6e0 2024-09-11T23:04:11.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.636+0000 7fa0c7fff640 1 --2- 172.21.15.12:0/125333862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0c809f6e0 0x7fa0c8133780 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8019030 tx=0x7fa0b801ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:11.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.636+0000 7fa0c4ff9640 1 -- 172.21.15.12:0/125333862 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0b80abdd0 con 0x7fa0c809f6e0 2024-09-11T23:04:11.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.636+0000 7fa0c4ff9640 1 -- 172.21.15.12:0/125333862 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0b8004020 con 0x7fa0c809f6e0 2024-09-11T23:04:11.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.636+0000 7fa0ce913640 1 -- 172.21.15.12:0/125333862 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0c8070580 con 0x7fa0c809f6e0 2024-09-11T23:04:11.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.636+0000 7fa0c4ff9640 1 -- 172.21.15.12:0/125333862 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0b8004320 con 0x7fa0c809f6e0 2024-09-11T23:04:11.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.636+0000 7fa0ce913640 1 -- 172.21.15.12:0/125333862 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0c8073060 con 0x7fa0c809f6e0 2024-09-11T23:04:11.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.636+0000 7fa0c4ff9640 1 -- 172.21.15.12:0/125333862 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa0b8003620 con 0x7fa0c809f6e0 2024-09-11T23:04:11.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.636+0000 7fa0ce913640 1 -- 172.21.15.12:0/125333862 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0c80008e0 con 0x7fa0c809f6e0 2024-09-11T23:04:11.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.636+0000 7fa0c4ff9640 1 --2- 172.21.15.12:0/125333862 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fa0a8035db0 0x7fa0a8038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:11.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.636+0000 7fa0c4ff9640 1 -- 172.21.15.12:0/125333862 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 3439+0+0 (secure 0 0 0) 0x7fa0b80e2e80 con 0x7fa0c809f6e0 2024-09-11T23:04:11.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.636+0000 7fa0c77fe640 1 --2- 172.21.15.12:0/125333862 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fa0a8035db0 0x7fa0a8038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:11.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.636+0000 7fa0c77fe640 1 --2- 172.21.15.12:0/125333862 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fa0a8035db0 0x7fa0a8038270 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0007fd0 tx=0x7fa0b0007920 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:11.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.640+0000 7fa0c4ff9640 1 -- 172.21.15.12:0/125333862 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa0b8016010 con 0x7fa0c809f6e0 2024-09-11T23:04:11.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.832+0000 7fa0ce913640 1 -- 172.21.15.12:0/125333862 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa0c8071460 con 0x7fa0c809f6e0 2024-09-11T23:04:11.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.832+0000 7fa0c4ff9640 1 -- 172.21.15.12:0/125333862 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+3570 (secure 0 0 0) 0x7fa0b8003e30 con 0x7fa0c809f6e0 2024-09-11T23:04:11.834 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:04:11.834 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":16,"btime":"2024-09-11T23:04:09:670574+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4328,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6827/3738380591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":3738380591},{"type":"v1","addr":"172.21.15.12:6827","nonce":3738380591}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:04:06.012942+0000","modified":"2024-09-11T23:04:09.042274+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4329},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4329":{"gid":4329,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6829/514415350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":514415350},{"type":"v1","addr":"172.21.15.12:6829","nonce":514415350}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4329,"qdb_cluster":[4329]},"id":2}]} 2024-09-11T23:04:11.834 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 16 2024-09-11T23:04:11.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.832+0000 7fa0ce913640 1 -- 172.21.15.12:0/125333862 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fa0a8035db0 msgr2=0x7fa0a8038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:11.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.832+0000 7fa0ce913640 1 --2- 172.21.15.12:0/125333862 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fa0a8035db0 0x7fa0a8038270 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0007fd0 tx=0x7fa0b0007920 comp rx=0 tx=0).stop 2024-09-11T23:04:11.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.832+0000 7fa0ce913640 1 -- 172.21.15.12:0/125333862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0c809f6e0 msgr2=0x7fa0c8133780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:11.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.832+0000 7fa0ce913640 1 --2- 172.21.15.12:0/125333862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0c809f6e0 0x7fa0c8133780 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8019030 tx=0x7fa0b801ac60 comp rx=0 tx=0).stop 2024-09-11T23:04:11.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.832+0000 7fa0ce913640 1 -- 172.21.15.12:0/125333862 shutdown_connections 2024-09-11T23:04:11.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.832+0000 7fa0ce913640 1 --2- 172.21.15.12:0/125333862 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fa0a8035db0 0x7fa0a8038270 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:11.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.832+0000 7fa0ce913640 1 --2- 172.21.15.12:0/125333862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0c809f6e0 0x7fa0c8133780 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:11.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.832+0000 7fa0ce913640 1 -- 172.21.15.12:0/125333862 >> 172.21.15.12:0/125333862 conn(0x7fa0c80a8450 msgr2=0x7fa0c8134650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:11.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.832+0000 7fa0ce913640 1 -- 172.21.15.12:0/125333862 shutdown_connections 2024-09-11T23:04:11.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:11.836+0000 7fa0ce913640 1 -- 172.21.15.12:0/125333862 wait complete. 2024-09-11T23:04:12.051 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T23:04:06.012942+0000', 'modified': '2024-09-11T23:04:09.042274+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4329}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4329': {'gid': 4329, 'name': 'b', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.12:6829/514415350', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6828', 'nonce': 514415350}, {'type': 'v1', 'addr': '172.21.15.12:6829', 'nonce': 514415350}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4329, 'qdb_cluster': [4329]} 2024-09-11T23:04:12.052 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T23:04:12.052 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-11T23:04:12.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.180+0000 7fd82ceff640 1 Processor -- start 2024-09-11T23:04:12.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.180+0000 7fd82ceff640 1 -- start start 2024-09-11T23:04:12.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.180+0000 7fd82ceff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd828137f40 0x7fd828138320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:12.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.180+0000 7fd82ceff640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8280740a0 con 0x7fd8280a0c40 2024-09-11T23:04:12.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.180+0000 7fd82ceff640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fd8281378e0 con 0x7fd828137f40 2024-09-11T23:04:12.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.180+0000 7fd82659c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd828137f40 0x7fd828138320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:12.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.180+0000 7fd82659c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd828137f40 0x7fd828138320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39850/0 (socket says 172.21.15.12:39850) 2024-09-11T23:04:12.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.180+0000 7fd82659c640 1 -- 172.21.15.12:0/1198788232 learned_addr learned my addr 172.21.15.12:0/1198788232 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:12.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.180+0000 7fd825d9b640 1 --1- 172.21.15.12:0/1198788232 >> v1:172.21.15.12:6789/0 conn(0x7fd8280a0c40 0x7fd828070120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:52290/0 (socket says 172.21.15.12:52290) 2024-09-11T23:04:12.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.180+0000 7fd82659c640 1 -- 172.21.15.12:0/1198788232 >> v1:172.21.15.12:6789/0 conn(0x7fd8280a0c40 legacy=0x7fd828070120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:12.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.180+0000 7fd82559a640 1 -- 172.21.15.12:0/1198788232 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 969050838 0 0) 0x7fd8280740a0 con 0x7fd8280a0c40 2024-09-11T23:04:12.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.180+0000 7fd82659c640 1 -- 172.21.15.12:0/1198788232 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd828137b10 con 0x7fd828137f40 2024-09-11T23:04:12.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.184+0000 7fd82659c640 1 --2- 172.21.15.12:0/1198788232 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd828137f40 0x7fd828138320 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd820009e50 tx=0x7fd82001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2daa650fe4f918c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:12.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.184+0000 7fd82559a640 1 -- 172.21.15.12:0/1198788232 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd820009200 con 0x7fd828137f40 2024-09-11T23:04:12.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.184+0000 7fd82559a640 1 -- 172.21.15.12:0/1198788232 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8200a56a0 con 0x7fd828137f40 2024-09-11T23:04:12.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.184+0000 7fd82559a640 1 -- 172.21.15.12:0/1198788232 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8200a59a0 con 0x7fd828137f40 2024-09-11T23:04:12.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.184+0000 7fd82ceff640 1 -- 172.21.15.12:0/1198788232 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd828137f40 msgr2=0x7fd828138320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:12.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.184+0000 7fd82ceff640 1 --2- 172.21.15.12:0/1198788232 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd828137f40 0x7fd828138320 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd820009e50 tx=0x7fd82001ca30 comp rx=0 tx=0).stop 2024-09-11T23:04:12.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.184+0000 7fd82ceff640 1 -- 172.21.15.12:0/1198788232 shutdown_connections 2024-09-11T23:04:12.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.184+0000 7fd82ceff640 1 --2- 172.21.15.12:0/1198788232 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd828137f40 0x7fd828138320 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:12.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.184+0000 7fd82ceff640 1 -- 172.21.15.12:0/1198788232 >> 172.21.15.12:0/1198788232 conn(0x7fd82809aba0 msgr2=0x7fd82809afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:12.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.184+0000 7fd82ceff640 1 -- 172.21.15.12:0/1198788232 shutdown_connections 2024-09-11T23:04:12.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.184+0000 7fd82ceff640 1 -- 172.21.15.12:0/1198788232 wait complete. 2024-09-11T23:04:12.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.184+0000 7fd82ceff640 1 Processor -- start 2024-09-11T23:04:12.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.184+0000 7fd82ceff640 1 -- start start 2024-09-11T23:04:12.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.184+0000 7fd82ceff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8280a0c40 0x7fd8280a1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:12.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.184+0000 7fd82ceff640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd828073cc0 con 0x7fd8280a0c40 2024-09-11T23:04:12.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.184+0000 7fd82659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8280a0c40 0x7fd8280a1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:12.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.184+0000 7fd82659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8280a0c40 0x7fd8280a1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39856/0 (socket says 172.21.15.12:39856) 2024-09-11T23:04:12.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.184+0000 7fd82659c640 1 -- 172.21.15.12:0/3137699220 learned_addr learned my addr 172.21.15.12:0/3137699220 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:12.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.184+0000 7fd82659c640 1 -- 172.21.15.12:0/3137699220 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8280a8e00 con 0x7fd8280a0c40 2024-09-11T23:04:12.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.184+0000 7fd82659c640 1 --2- 172.21.15.12:0/3137699220 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8280a0c40 0x7fd8280a1530 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd8200af040 tx=0x7fd8200197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:12.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.184+0000 7fd81effd640 1 -- 172.21.15.12:0/3137699220 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8200bc070 con 0x7fd8280a0c40 2024-09-11T23:04:12.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.184+0000 7fd81effd640 1 -- 172.21.15.12:0/3137699220 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8200039a0 con 0x7fd8280a0c40 2024-09-11T23:04:12.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.184+0000 7fd81effd640 1 -- 172.21.15.12:0/3137699220 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd820003cc0 con 0x7fd8280a0c40 2024-09-11T23:04:12.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.184+0000 7fd82ceff640 1 -- 172.21.15.12:0/3137699220 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8280a3300 con 0x7fd8280a0c40 2024-09-11T23:04:12.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.184+0000 7fd82ceff640 1 -- 172.21.15.12:0/3137699220 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8280a4bc0 con 0x7fd8280a0c40 2024-09-11T23:04:12.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.188+0000 7fd81effd640 1 -- 172.21.15.12:0/3137699220 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd8200b8470 con 0x7fd8280a0c40 2024-09-11T23:04:12.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.188+0000 7fd81effd640 1 --2- 172.21.15.12:0/3137699220 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fd80c035e00 0x7fd80c0382c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:12.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.188+0000 7fd81effd640 1 -- 172.21.15.12:0/3137699220 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 3439+0+0 (secure 0 0 0) 0x7fd8200e37b0 con 0x7fd8280a0c40 2024-09-11T23:04:12.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.188+0000 7fd825d9b640 1 --2- 172.21.15.12:0/3137699220 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fd80c035e00 0x7fd80c0382c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:12.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.188+0000 7fd825d9b640 1 --2- 172.21.15.12:0/3137699220 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fd80c035e00 0x7fd80c0382c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd810000c10 tx=0x7fd810007a50 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:12.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.188+0000 7fd82ffbb000 1 Processor -- start 2024-09-11T23:04:12.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.188+0000 7fd82ffbb000 1 -- start start 2024-09-11T23:04:12.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.188+0000 7fd82ffbb000 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560305d76d30 0x560305d7fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:12.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.188+0000 7fd82ffbb000 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x560305c61b60 con 0x560305d76d30 2024-09-11T23:04:12.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.188+0000 7fd82659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560305d76d30 0x560305d7fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:12.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.188+0000 7fd82659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560305d76d30 0x560305d7fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39868/0 (socket says 172.21.15.12:39868) 2024-09-11T23:04:12.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.188+0000 7fd82659c640 1 -- 172.21.15.12:0/2568304284 learned_addr learned my addr 172.21.15.12:0/2568304284 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:12.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.188+0000 7fd82659c640 1 -- 172.21.15.12:0/2568304284 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560305b80e50 con 0x560305d76d30 2024-09-11T23:04:12.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.188+0000 7fd82659c640 1 --2- 172.21.15.12:0/2568304284 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560305d76d30 0x560305d7fb40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd8200a5fd0 tx=0x7fd8200b7670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b69c7690d9ebd1f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:12.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.188+0000 7fd817fff640 1 -- 172.21.15.12:0/2568304284 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8200b6440 con 0x560305d76d30 2024-09-11T23:04:12.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.188+0000 7fd817fff640 1 -- 172.21.15.12:0/2568304284 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8200e10d0 con 0x560305d76d30 2024-09-11T23:04:12.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.188+0000 7fd817fff640 1 -- 172.21.15.12:0/2568304284 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8200c04e0 con 0x560305d76d30 2024-09-11T23:04:12.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.192+0000 7fd82ffbb000 1 -- 172.21.15.12:0/2568304284 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560305d76d30 msgr2=0x560305d7fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:12.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.192+0000 7fd82ffbb000 1 --2- 172.21.15.12:0/2568304284 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560305d76d30 0x560305d7fb40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd8200a5fd0 tx=0x7fd8200b7670 comp rx=0 tx=0).stop 2024-09-11T23:04:12.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.192+0000 7fd82ffbb000 1 -- 172.21.15.12:0/2568304284 shutdown_connections 2024-09-11T23:04:12.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.192+0000 7fd82ffbb000 1 --2- 172.21.15.12:0/2568304284 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560305d76d30 0x560305d7fb40 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:12.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.192+0000 7fd82ffbb000 1 -- 172.21.15.12:0/2568304284 >> 172.21.15.12:0/2568304284 conn(0x560305d71680 msgr2=0x560305d76620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:12.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.192+0000 7fd82ffbb000 1 -- 172.21.15.12:0/2568304284 shutdown_connections 2024-09-11T23:04:12.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.192+0000 7fd82ffbb000 1 -- 172.21.15.12:0/2568304284 wait complete. 2024-09-11T23:04:12.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.192+0000 7fd82ffbb000 1 -- start start 2024-09-11T23:04:12.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.192+0000 7fd82ffbb000 1 Processor -- start 2024-09-11T23:04:12.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.192+0000 7fd82ffbb000 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560305d76d30 0x560305d7f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:12.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.192+0000 7fd82ffbb000 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x560305b6eed0 con 0x560305d76d30 2024-09-11T23:04:12.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.192+0000 7fd82ffbb000 10 client.0 _ll_register_callbacks cb 0x560305d65820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:04:12.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.192+0000 7fd82659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560305d76d30 0x560305d7f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:12.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.192+0000 7fd82659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560305d76d30 0x560305d7f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39880/0 (socket says 172.21.15.12:39880) 2024-09-11T23:04:12.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.192+0000 7fd82659c640 1 -- 172.21.15.12:0/1588897722 learned_addr learned my addr 172.21.15.12:0/1588897722 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:12.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.192+0000 7fd82659c640 1 -- 172.21.15.12:0/1588897722 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560305b6f120 con 0x560305d76d30 2024-09-11T23:04:12.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.192+0000 7fd82659c640 1 --2- 172.21.15.12:0/1588897722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560305d76d30 0x560305d7f580 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd820000f90 tx=0x7fd820009610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aed3cd9eeb7e4c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:12.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.192+0000 7fd8157fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-11T23:04:12.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.192+0000 7fd8157fa640 1 -- 172.21.15.12:0/1588897722 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8200d9070 con 0x560305d76d30 2024-09-11T23:04:12.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.192+0000 7fd8157fa640 1 -- 172.21.15.12:0/1588897722 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 3439+0+0 (secure 0 0 0) 0x7fd8200d0020 con 0x560305d76d30 2024-09-11T23:04:12.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.192+0000 7fd82ffbb000 1 -- 172.21.15.12:0/1588897722 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8200e10d0 con 0x560305d76d30 2024-09-11T23:04:12.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.192+0000 7fd8157fa640 1 -- 172.21.15.12:0/1588897722 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7fd8200b6440 con 0x560305d76d30 2024-09-11T23:04:12.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.192+0000 7fd82ffbb000 10 client.4400 fetch_fsmap learned FSMap version 16 2024-09-11T23:04:12.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.192+0000 7fd82ffbb000 1 -- 172.21.15.12:0/1588897722 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x560305b68450 con 0x560305d76d30 2024-09-11T23:04:12.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.192+0000 7fd8157fa640 1 -- 172.21.15.12:0/1588897722 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8200e10d0 con 0x560305d76d30 2024-09-11T23:04:12.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.192+0000 7fd8157fa640 1 -- 172.21.15.12:0/1588897722 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 16) ==== 2292+0+0 (secure 0 0 0) 0x7fd8200b7bf0 con 0x560305d76d30 2024-09-11T23:04:12.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.192+0000 7fd82ffbb000 10 client.4400 fetch_fsmap finished waiting for FSMap version 16 2024-09-11T23:04:12.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.192+0000 7fd82ffbb000 10 client.4400 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T23:04:12.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.192+0000 7fd82ffbb000 20 client.4400 populate_metadata read hostname 'smithi012' 2024-09-11T23:04:12.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.192+0000 7fd82ffbb000 1 --2- 172.21.15.12:0/1588897722 >> [v2:172.21.15.12:6828/514415350,v1:172.21.15.12:6829/514415350] conn(0x560305da4920 0x560305da2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:12.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.192+0000 7fd82ffbb000 4 client.4400 mds_command: new command op to 4329 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:04:12.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.192+0000 7fd82ffbb000 1 -- 172.21.15.12:0/1588897722 --> [v2:172.21.15.12:6828/514415350,v1:172.21.15.12:6829/514415350] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560305b62c00 con 0x560305da4920 2024-09-11T23:04:12.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.192+0000 7fd825d9b640 1 --2- 172.21.15.12:0/1588897722 >> [v2:172.21.15.12:6828/514415350,v1:172.21.15.12:6829/514415350] conn(0x560305da4920 0x560305da2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:12.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.192+0000 7fd8157fa640 10 client.4400 ms_handle_connect on v2:172.21.15.12:6828/514415350 2024-09-11T23:04:12.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.192+0000 7fd825d9b640 1 --2- 172.21.15.12:0/1588897722 >> [v2:172.21.15.12:6828/514415350,v1:172.21.15.12:6829/514415350] conn(0x560305da4920 0x560305da2ed0 crc :-1 s=READY pgs=6 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c60bd54f4db0165 server_cookie=bd11e0324ce7753a in_seq=0 out_seq=0 2024-09-11T23:04:12.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.192+0000 7fd8157fa640 1 -- 172.21.15.12:0/1588897722 <== mds.0 v2:172.21.15.12:6828/514415350 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560305b62c00 con 0x560305da4920 2024-09-11T23:04:12.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.192+0000 7fd8157fa640 10 client.4400 handle_command_reply: tid=0 2024-09-11T23:04:12.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.192+0000 7fd82ffbb000 1 client.4400 shutdown 2024-09-11T23:04:12.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.192+0000 7fd82ffbb000 1 -- 172.21.15.12:0/1588897722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560305d76d30 msgr2=0x560305d7f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:12.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.192+0000 7fd82ffbb000 1 --2- 172.21.15.12:0/1588897722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560305d76d30 0x560305d7f580 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd820000f90 tx=0x7fd820009610 comp rx=0 tx=0).stop 2024-09-11T23:04:12.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.192+0000 7fd82ffbb000 1 -- 172.21.15.12:0/1588897722 shutdown_connections 2024-09-11T23:04:12.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.192+0000 7fd82ffbb000 1 --2- 172.21.15.12:0/1588897722 >> [v2:172.21.15.12:6828/514415350,v1:172.21.15.12:6829/514415350] conn(0x560305da4920 0x560305da2ed0 crc :-1 s=READY pgs=6 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:12.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.192+0000 7fd82ffbb000 1 --2- 172.21.15.12:0/1588897722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560305d76d30 0x560305d7f580 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:12.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.192+0000 7fd82ffbb000 1 -- 172.21.15.12:0/1588897722 >> 172.21.15.12:0/1588897722 conn(0x560305d71680 msgr2=0x560305d76620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:12.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.192+0000 7fd8157fa640 0 client.4400 ms_handle_reset on v2:172.21.15.12:6828/514415350 2024-09-11T23:04:12.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.192+0000 7fd82ffbb000 1 -- 172.21.15.12:0/1588897722 shutdown_connections 2024-09-11T23:04:12.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.192+0000 7fd82ffbb000 1 -- 172.21.15.12:0/1588897722 wait complete. 2024-09-11T23:04:12.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.196+0000 7fd82ffbb000 20 client.4400 trim_cache size 0 max 16384 2024-09-11T23:04:12.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.212+0000 7fd82ffbb000 1 Processor -- start 2024-09-11T23:04:12.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.212+0000 7fd82ffbb000 1 -- start start 2024-09-11T23:04:12.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.212+0000 7fd82ffbb000 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560305d76d30 0x560305d7f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:12.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.212+0000 7fd82ffbb000 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd8281d55c0 con 0x560305d76d30 2024-09-11T23:04:12.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.212+0000 7fd82659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560305d76d30 0x560305d7f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:12.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.212+0000 7fd82659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560305d76d30 0x560305d7f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39888/0 (socket says 172.21.15.12:39888) 2024-09-11T23:04:12.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.212+0000 7fd82659c640 1 -- 172.21.15.12:0/1311492142 learned_addr learned my addr 172.21.15.12:0/1311492142 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:12.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.212+0000 7fd82659c640 1 -- 172.21.15.12:0/1311492142 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560305b4ffd0 con 0x560305d76d30 2024-09-11T23:04:12.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.212+0000 7fd82659c640 1 --2- 172.21.15.12:0/1311492142 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560305d76d30 0x560305d7f250 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd8200a5f60 tx=0x7fd8200d6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b86dea308e9f4de3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:12.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.212+0000 7fd8177fe640 1 -- 172.21.15.12:0/1311492142 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8200d9040 con 0x560305d76d30 2024-09-11T23:04:12.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.212+0000 7fd8177fe640 1 -- 172.21.15.12:0/1311492142 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8200c03b0 con 0x560305d76d30 2024-09-11T23:04:12.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.212+0000 7fd8177fe640 1 -- 172.21.15.12:0/1311492142 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8200e2150 con 0x560305d76d30 2024-09-11T23:04:12.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.212+0000 7fd82ffbb000 1 -- 172.21.15.12:0/1311492142 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560305d76d30 msgr2=0x560305d7f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:12.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.212+0000 7fd82ffbb000 1 --2- 172.21.15.12:0/1311492142 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560305d76d30 0x560305d7f250 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd8200a5f60 tx=0x7fd8200d6000 comp rx=0 tx=0).stop 2024-09-11T23:04:12.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.212+0000 7fd82ffbb000 1 -- 172.21.15.12:0/1311492142 shutdown_connections 2024-09-11T23:04:12.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.212+0000 7fd82ffbb000 1 --2- 172.21.15.12:0/1311492142 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560305d76d30 0x560305d7f250 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:12.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.212+0000 7fd82ffbb000 1 -- 172.21.15.12:0/1311492142 >> 172.21.15.12:0/1311492142 conn(0x560305d71680 msgr2=0x560305d7eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:12.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.212+0000 7fd82ffbb000 1 -- 172.21.15.12:0/1311492142 shutdown_connections 2024-09-11T23:04:12.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.216+0000 7fd82ffbb000 1 -- 172.21.15.12:0/1311492142 wait complete. 2024-09-11T23:04:12.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.216+0000 7fd82ffbb000 1 -- start start 2024-09-11T23:04:12.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.216+0000 7fd82ffbb000 1 Processor -- start 2024-09-11T23:04:12.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.216+0000 7fd82ffbb000 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560305d76d30 0x560305db1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:12.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.216+0000 7fd82ffbb000 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x560305bc8c70 con 0x560305d76d30 2024-09-11T23:04:12.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.216+0000 7fd82ffbb000 10 client.0 _ll_register_callbacks cb 0x7fd8200b7820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:04:12.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.216+0000 7fd82659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560305d76d30 0x560305db1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:12.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.216+0000 7fd82659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560305d76d30 0x560305db1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39894/0 (socket says 172.21.15.12:39894) 2024-09-11T23:04:12.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.216+0000 7fd82659c640 1 -- 172.21.15.12:0/382433419 learned_addr learned my addr 172.21.15.12:0/382433419 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:12.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.216+0000 7fd82659c640 1 -- 172.21.15.12:0/382433419 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560305c4b750 con 0x560305d76d30 2024-09-11T23:04:12.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.216+0000 7fd82659c640 1 --2- 172.21.15.12:0/382433419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560305d76d30 0x560305db1a00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd820000f90 tx=0x7fd820003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92ec999d8b026247 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:12.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.216+0000 7fd8157fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-11T23:04:12.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.216+0000 7fd8157fa640 1 -- 172.21.15.12:0/382433419 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8200fb070 con 0x560305d76d30 2024-09-11T23:04:12.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.216+0000 7fd8157fa640 1 -- 172.21.15.12:0/382433419 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 3439+0+0 (secure 0 0 0) 0x7fd8200d0040 con 0x560305d76d30 2024-09-11T23:04:12.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.216+0000 7fd82ffbb000 1 -- 172.21.15.12:0/382433419 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8200c03b0 con 0x560305d76d30 2024-09-11T23:04:12.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.216+0000 7fd8157fa640 1 -- 172.21.15.12:0/382433419 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7fd8200d9040 con 0x560305d76d30 2024-09-11T23:04:12.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.216+0000 7fd82ffbb000 10 client.4402 fetch_fsmap learned FSMap version 16 2024-09-11T23:04:12.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.216+0000 7fd82ffbb000 1 -- 172.21.15.12:0/382433419 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x560305b56a30 con 0x560305d76d30 2024-09-11T23:04:12.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.216+0000 7fd8157fa640 1 -- 172.21.15.12:0/382433419 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8200c03b0 con 0x560305d76d30 2024-09-11T23:04:12.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.216+0000 7fd8157fa640 1 -- 172.21.15.12:0/382433419 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 16) ==== 2292+0+0 (secure 0 0 0) 0x7fd8200ad7c0 con 0x560305d76d30 2024-09-11T23:04:12.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.216+0000 7fd82ffbb000 10 client.4402 fetch_fsmap finished waiting for FSMap version 16 2024-09-11T23:04:12.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.216+0000 7fd82ffbb000 10 client.4402 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T23:04:12.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.216+0000 7fd82ffbb000 20 client.4402 populate_metadata read hostname 'smithi012' 2024-09-11T23:04:12.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.216+0000 7fd82ffbb000 1 --2- 172.21.15.12:0/382433419 >> [v2:172.21.15.12:6828/514415350,v1:172.21.15.12:6829/514415350] conn(0x560305db2390 0x560305db2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:12.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.216+0000 7fd82ffbb000 4 client.4402 mds_command: new command op to 4329 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:04:12.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.216+0000 7fd82ffbb000 1 -- 172.21.15.12:0/382433419 --> [v2:172.21.15.12:6828/514415350,v1:172.21.15.12:6829/514415350] -- command(tid 0: {"prefix": "status"}) -- 0x560305d77480 con 0x560305db2390 2024-09-11T23:04:12.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.216+0000 7fd825d9b640 1 --2- 172.21.15.12:0/382433419 >> [v2:172.21.15.12:6828/514415350,v1:172.21.15.12:6829/514415350] conn(0x560305db2390 0x560305db2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:12.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.216+0000 7fd8157fa640 10 client.4402 ms_handle_connect on v2:172.21.15.12:6828/514415350 2024-09-11T23:04:12.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.216+0000 7fd825d9b640 1 --2- 172.21.15.12:0/382433419 >> [v2:172.21.15.12:6828/514415350,v1:172.21.15.12:6829/514415350] conn(0x560305db2390 0x560305db2770 crc :-1 s=READY pgs=7 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74bed16de45593cb server_cookie=5384402f5114387f in_seq=0 out_seq=0 2024-09-11T23:04:12.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.216+0000 7fd8157fa640 1 -- 172.21.15.12:0/382433419 <== mds.0 v2:172.21.15.12:6828/514415350 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x560305d77480 con 0x560305db2390 2024-09-11T23:04:12.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.216+0000 7fd8157fa640 10 client.4402 handle_command_reply: tid=0 2024-09-11T23:04:12.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.216+0000 7fd82ffbb000 1 client.4402 shutdown 2024-09-11T23:04:12.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.216+0000 7fd82ffbb000 1 -- 172.21.15.12:0/382433419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560305d76d30 msgr2=0x560305db1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:12.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.216+0000 7fd82ffbb000 1 --2- 172.21.15.12:0/382433419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560305d76d30 0x560305db1a00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd820000f90 tx=0x7fd820003f90 comp rx=0 tx=0).stop 2024-09-11T23:04:12.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.216+0000 7fd82ffbb000 1 -- 172.21.15.12:0/382433419 shutdown_connections 2024-09-11T23:04:12.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.216+0000 7fd82ffbb000 1 --2- 172.21.15.12:0/382433419 >> [v2:172.21.15.12:6828/514415350,v1:172.21.15.12:6829/514415350] conn(0x560305db2390 0x560305db2770 crc :-1 s=READY pgs=7 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:12.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.216+0000 7fd82ffbb000 1 --2- 172.21.15.12:0/382433419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560305d76d30 0x560305db1a00 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:12.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.216+0000 7fd82ffbb000 1 -- 172.21.15.12:0/382433419 >> 172.21.15.12:0/382433419 conn(0x560305d71680 msgr2=0x560305d7f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:12.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.216+0000 7fd8157fa640 0 client.4402 ms_handle_reset on v2:172.21.15.12:6828/514415350 2024-09-11T23:04:12.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.216+0000 7fd82ffbb000 1 -- 172.21.15.12:0/382433419 shutdown_connections 2024-09-11T23:04:12.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.216+0000 7fd82ffbb000 1 -- 172.21.15.12:0/382433419 wait complete. 2024-09-11T23:04:12.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.216+0000 7fd82ffbb000 20 client.4402 trim_cache size 0 max 16384 2024-09-11T23:04:12.223 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T23:04:12.223 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "8be14356-3340-4500-91a2-4cbc6b511f65", 2024-09-11T23:04:12.223 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 0, 2024-09-11T23:04:12.223 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4329, 2024-09-11T23:04:12.223 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-09-11T23:04:12.223 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-09-11T23:04:12.223 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-09-11T23:04:12.224 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 5.5598417600000003, 2024-09-11T23:04:12.224 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 16, 2024-09-11T23:04:12.224 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 25, 2024-09-11T23:04:12.224 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 25, 2024-09-11T23:04:12.224 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 12.447757392 2024-09-11T23:04:12.224 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T23:04:12.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.216+0000 7fd82ceff640 1 -- 172.21.15.12:0/3137699220 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fd80c035e00 msgr2=0x7fd80c0382c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:12.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.216+0000 7fd82ceff640 1 --2- 172.21.15.12:0/3137699220 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fd80c035e00 0x7fd80c0382c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd810000c10 tx=0x7fd810007a50 comp rx=0 tx=0).stop 2024-09-11T23:04:12.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.216+0000 7fd82ceff640 1 -- 172.21.15.12:0/3137699220 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8280a0c40 msgr2=0x7fd8280a1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:12.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.216+0000 7fd82ceff640 1 --2- 172.21.15.12:0/3137699220 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8280a0c40 0x7fd8280a1530 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd8200af040 tx=0x7fd8200197d0 comp rx=0 tx=0).stop 2024-09-11T23:04:12.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.216+0000 7fd82ceff640 1 -- 172.21.15.12:0/3137699220 shutdown_connections 2024-09-11T23:04:12.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.216+0000 7fd82ceff640 1 --2- 172.21.15.12:0/3137699220 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fd80c035e00 0x7fd80c0382c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:12.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.216+0000 7fd82ceff640 1 --2- 172.21.15.12:0/3137699220 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8280a0c40 0x7fd8280a1530 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:12.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.216+0000 7fd82ceff640 1 -- 172.21.15.12:0/3137699220 >> 172.21.15.12:0/3137699220 conn(0x7fd82809aba0 msgr2=0x7fd828131560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:12.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.216+0000 7fd82ceff640 1 -- 172.21.15.12:0/3137699220 shutdown_connections 2024-09-11T23:04:12.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.216+0000 7fd82ceff640 1 -- 172.21.15.12:0/3137699220 wait complete. 2024-09-11T23:04:12.235 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T23:04:12.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.348+0000 7f206d5e9640 1 Processor -- start 2024-09-11T23:04:12.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.348+0000 7f206d5e9640 1 -- start start 2024-09-11T23:04:12.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.348+0000 7f206d5e9640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f206813a410 0x7f20680a6af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:12.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.348+0000 7f206d5e9640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20680a82a0 con 0x7f20680a4b80 2024-09-11T23:04:12.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.348+0000 7f206d5e9640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f20680a3cb0 con 0x7f206813a410 2024-09-11T23:04:12.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.348+0000 7f2066ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f206813a410 0x7f20680a6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:12.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.348+0000 7f2066ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f206813a410 0x7f20680a6af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39904/0 (socket says 172.21.15.12:39904) 2024-09-11T23:04:12.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.348+0000 7f2066ffd640 1 -- 172.21.15.12:0/3052252221 learned_addr learned my addr 172.21.15.12:0/3052252221 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:12.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.348+0000 7f2066ffd640 1 -- 172.21.15.12:0/3052252221 >> v1:172.21.15.12:6789/0 conn(0x7f20680a4b80 legacy=0x7f20680a7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:12.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.348+0000 7f2066ffd640 1 -- 172.21.15.12:0/3052252221 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2068139fe0 con 0x7f206813a410 2024-09-11T23:04:12.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.348+0000 7f2066ffd640 1 --2- 172.21.15.12:0/3052252221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f206813a410 0x7f20680a6af0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f20580097f0 tx=0x7f205801c2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df83600756210e6d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:12.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.348+0000 7f20667fc640 1 -- 172.21.15.12:0/3052252221 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20580b0070 con 0x7f206813a410 2024-09-11T23:04:12.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.352+0000 7f20667fc640 1 -- 172.21.15.12:0/3052252221 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20580ab530 con 0x7f206813a410 2024-09-11T23:04:12.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.352+0000 7f20667fc640 1 -- 172.21.15.12:0/3052252221 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20580ab830 con 0x7f206813a410 2024-09-11T23:04:12.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.352+0000 7f206d5e9640 1 -- 172.21.15.12:0/3052252221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f206813a410 msgr2=0x7f20680a6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:12.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.352+0000 7f206d5e9640 1 --2- 172.21.15.12:0/3052252221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f206813a410 0x7f20680a6af0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f20580097f0 tx=0x7f205801c2e0 comp rx=0 tx=0).stop 2024-09-11T23:04:12.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.352+0000 7f206d5e9640 1 -- 172.21.15.12:0/3052252221 shutdown_connections 2024-09-11T23:04:12.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.352+0000 7f206d5e9640 1 --2- 172.21.15.12:0/3052252221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f206813a410 0x7f20680a6af0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:12.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.352+0000 7f206d5e9640 1 -- 172.21.15.12:0/3052252221 >> 172.21.15.12:0/3052252221 conn(0x7f20680ac2c0 msgr2=0x7f20680ac6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:12.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.352+0000 7f206d5e9640 1 -- 172.21.15.12:0/3052252221 shutdown_connections 2024-09-11T23:04:12.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.352+0000 7f206d5e9640 1 -- 172.21.15.12:0/3052252221 wait complete. 2024-09-11T23:04:12.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.352+0000 7f206d5e9640 1 Processor -- start 2024-09-11T23:04:12.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.352+0000 7f206d5e9640 1 -- start start 2024-09-11T23:04:12.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.352+0000 7f206d5e9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20680a4b80 0x7f20681d1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:12.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.352+0000 7f206d5e9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f20680a7740 con 0x7f20680a4b80 2024-09-11T23:04:12.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.352+0000 7f2066ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20680a4b80 0x7f20681d1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:12.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.352+0000 7f2066ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20680a4b80 0x7f20681d1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39906/0 (socket says 172.21.15.12:39906) 2024-09-11T23:04:12.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.352+0000 7f2066ffd640 1 -- 172.21.15.12:0/3441116627 learned_addr learned my addr 172.21.15.12:0/3441116627 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:12.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.352+0000 7f2066ffd640 1 -- 172.21.15.12:0/3441116627 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f206809b740 con 0x7f20680a4b80 2024-09-11T23:04:12.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.352+0000 7f2066ffd640 1 --2- 172.21.15.12:0/3441116627 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20680a4b80 0x7f20681d1c80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2058019f10 tx=0x7f205801ab20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:12.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.352+0000 7f205f7fe640 1 -- 172.21.15.12:0/3441116627 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20580ba020 con 0x7f20680a4b80 2024-09-11T23:04:12.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.352+0000 7f205f7fe640 1 -- 172.21.15.12:0/3441116627 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20580b6420 con 0x7f20680a4b80 2024-09-11T23:04:12.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.352+0000 7f206d5e9640 1 -- 172.21.15.12:0/3441116627 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f206813df40 con 0x7f20680a4b80 2024-09-11T23:04:12.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.352+0000 7f205f7fe640 1 -- 172.21.15.12:0/3441116627 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20580b0040 con 0x7f20680a4b80 2024-09-11T23:04:12.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.352+0000 7f206d5e9640 1 -- 172.21.15.12:0/3441116627 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f206809c560 con 0x7f20680a4b80 2024-09-11T23:04:12.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.356+0000 7f205f7fe640 1 -- 172.21.15.12:0/3441116627 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f20580bd020 con 0x7f20680a4b80 2024-09-11T23:04:12.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.356+0000 7f206d5e9640 1 -- 172.21.15.12:0/3441116627 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f206809b430 con 0x7f20680a4b80 2024-09-11T23:04:12.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.356+0000 7f205f7fe640 1 --2- 172.21.15.12:0/3441116627 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f204c035db0 0x7f204c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:12.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.356+0000 7f205f7fe640 1 -- 172.21.15.12:0/3441116627 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 3439+0+0 (secure 0 0 0) 0x7f20580a4e00 con 0x7f20680a4b80 2024-09-11T23:04:12.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.356+0000 7f205ffff640 1 --2- 172.21.15.12:0/3441116627 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f204c035db0 0x7f204c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:12.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.356+0000 7f205ffff640 1 --2- 172.21.15.12:0/3441116627 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f204c035db0 0x7f204c038270 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2050001790 tx=0x7f2050007a20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:12.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.360+0000 7f205f7fe640 1 -- 172.21.15.12:0/3441116627 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f20580c4030 con 0x7f20680a4b80 2024-09-11T23:04:12.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.548+0000 7f206d5e9640 1 -- 172.21.15.12:0/3441116627 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f20680a6af0 con 0x7f20680a4b80 2024-09-11T23:04:12.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.552+0000 7f205f7fe640 1 -- 172.21.15.12:0/3441116627 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) ==== 53+0+73 (secure 0 0 0) 0x7f2058015ff0 con 0x7f20680a4b80 2024-09-11T23:04:12.552 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T23:04:12.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.552+0000 7f206d5e9640 1 -- 172.21.15.12:0/3441116627 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f204c035db0 msgr2=0x7f204c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:12.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.552+0000 7f206d5e9640 1 --2- 172.21.15.12:0/3441116627 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f204c035db0 0x7f204c038270 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2050001790 tx=0x7f2050007a20 comp rx=0 tx=0).stop 2024-09-11T23:04:12.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.552+0000 7f206d5e9640 1 -- 172.21.15.12:0/3441116627 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20680a4b80 msgr2=0x7f20681d1c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:12.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.552+0000 7f206d5e9640 1 --2- 172.21.15.12:0/3441116627 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20680a4b80 0x7f20681d1c80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2058019f10 tx=0x7f205801ab20 comp rx=0 tx=0).stop 2024-09-11T23:04:12.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.552+0000 7f206d5e9640 1 -- 172.21.15.12:0/3441116627 shutdown_connections 2024-09-11T23:04:12.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.552+0000 7f206d5e9640 1 --2- 172.21.15.12:0/3441116627 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7f204c035db0 0x7f204c038270 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:12.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.552+0000 7f206d5e9640 1 --2- 172.21.15.12:0/3441116627 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20680a4b80 0x7f20681d1c80 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:12.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.552+0000 7f206d5e9640 1 -- 172.21.15.12:0/3441116627 >> 172.21.15.12:0/3441116627 conn(0x7f20680ac2c0 msgr2=0x7f20680aa460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:12.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.552+0000 7f206d5e9640 1 -- 172.21.15.12:0/3441116627 shutdown_connections 2024-09-11T23:04:12.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12.552+0000 7f206d5e9640 1 -- 172.21.15.12:0/3441116627 wait complete. 2024-09-11T23:04:12.570 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-11T23:04:12.570 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:04:12.570 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi012.front.sepia.ceph.com 2024-09-11T23:04:12.570 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T23:04:12.570 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T23:04:12.570 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-11T23:04:12.570 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T23:04:12.570 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:04:12.570 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:04:12.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:12.571 DEBUG:teuthology.orchestra.run.smithi012:> ip addr 2024-09-11T23:04:12.577 INFO:teuthology.orchestra.run.smithi012.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:04:12.577 INFO:teuthology.orchestra.run.smithi012.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:04:12.577 INFO:teuthology.orchestra.run.smithi012.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:04:12.577 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:04:12.577 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 ::1/128 scope host 2024-09-11T23:04:12.577 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:04:12.577 INFO:teuthology.orchestra.run.smithi012.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:04:12.577 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a4 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:04:12.577 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f0 2024-09-11T23:04:12.577 INFO:teuthology.orchestra.run.smithi012.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:04:12.578 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a5 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:04:12.578 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f1 2024-09-11T23:04:12.578 INFO:teuthology.orchestra.run.smithi012.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:04:12.578 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:ea brd ff:ff:ff:ff:ff:ff 2024-09-11T23:04:12.578 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f0 2024-09-11T23:04:12.578 INFO:teuthology.orchestra.run.smithi012.stdout: inet 172.21.15.12/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-11T23:04:12.578 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft 42488sec preferred_lft 42488sec 2024-09-11T23:04:12.578 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::ae1f:6bff:fef8:25ea/64 scope link 2024-09-11T23:04:12.578 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:04:12.578 INFO:teuthology.orchestra.run.smithi012.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:04:12.578 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:eb brd ff:ff:ff:ff:ff:ff 2024-09-11T23:04:12.578 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f1 2024-09-11T23:04:12.579 INFO:teuthology.orchestra.run.smithi012.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-11T23:04:12.579 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 02:42:d6:75:63:83 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:04:12.579 INFO:teuthology.orchestra.run.smithi012.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-11T23:04:12.579 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:04:12.579 INFO:teuthology.orchestra.run.smithi012.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:04:12.579 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-11T23:04:12.579 INFO:teuthology.orchestra.run.smithi012.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T23:04:12.579 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:04:12.579 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-11T23:04:12.579 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:04:12.579 INFO:teuthology.orchestra.run.smithi012.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:04:12.579 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:04:12.579 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-11T23:04:12.580 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:04:12.580 INFO:teuthology.orchestra.run.smithi012.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:04:12.580 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:04:12.580 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-11T23:04:12.580 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:04:12.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:12.580 DEBUG:teuthology.orchestra.run.smithi012:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:04:12.628 INFO:teuthology.orchestra.run.smithi012.stdout:1 2024-09-11T23:04:12.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:12.630 DEBUG:teuthology.orchestra.run.smithi012:> route 2024-09-11T23:04:12.679 INFO:teuthology.orchestra.run.smithi012.stdout:Kernel IP routing table 2024-09-11T23:04:12.679 INFO:teuthology.orchestra.run.smithi012.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:04:12.679 INFO:teuthology.orchestra.run.smithi012.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-11T23:04:12.679 INFO:teuthology.orchestra.run.smithi012.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-11T23:04:12.680 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-11T23:04:12.680 INFO:teuthology.orchestra.run.smithi012.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:04:12.680 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:04:12.680 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-09-11T23:04:12.680 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-11T23:04:12.681 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-11T23:04:12.681 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-11T23:04:12.681 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-09-11T23:04:12.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:04:12.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:04:12.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:12.797 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2024-09-11T23:04:12.844 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 1) 2024-09-11T23:04:12.844 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T23:04:12.844 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:04:12.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:12.845 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set brx.0 up 2024-09-11T23:04:12.901 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-11T23:04:12.901 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:04:12.901 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T23:04:12.949 INFO:teuthology.orchestra.run.smithi012.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:04:12.949 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:04:12.949 DEBUG:teuthology.orchestra.run.smithi012:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:04:13.000 DEBUG:teuthology.orchestra.run.smithi012:> sudo modprobe fuse 2024-09-11T23:04:13.058 DEBUG:teuthology.orchestra.run.smithi012:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:04:13.113 INFO:teuthology.orchestra.run.smithi012.stdout:/sys 2024-09-11T23:04:13.113 INFO:teuthology.orchestra.run.smithi012.stdout:/proc 2024-09-11T23:04:13.113 INFO:teuthology.orchestra.run.smithi012.stdout:/dev 2024-09-11T23:04:13.113 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/pts 2024-09-11T23:04:13.113 INFO:teuthology.orchestra.run.smithi012.stdout:/run 2024-09-11T23:04:13.113 INFO:teuthology.orchestra.run.smithi012.stdout:/ 2024-09-11T23:04:13.113 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/security 2024-09-11T23:04:13.113 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/shm 2024-09-11T23:04:13.113 INFO:teuthology.orchestra.run.smithi012.stdout:/run/lock 2024-09-11T23:04:13.114 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup 2024-09-11T23:04:13.114 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/pstore 2024-09-11T23:04:13.114 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/bpf 2024-09-11T23:04:13.114 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:04:13.114 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/hugepages 2024-09-11T23:04:13.114 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/mqueue 2024-09-11T23:04:13.114 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/debug 2024-09-11T23:04:13.114 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/tracing 2024-09-11T23:04:13.114 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/fs/nfsd 2024-09-11T23:04:13.114 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/fuse/connections 2024-09-11T23:04:13.114 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/config 2024-09-11T23:04:13.115 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:04:13.115 INFO:teuthology.orchestra.run.smithi012.stdout:/run/rpc_pipefs 2024-09-11T23:04:13.115 INFO:teuthology.orchestra.run.smithi012.stdout:/run/user/1000 2024-09-11T23:04:13.115 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph 2024-09-11T23:04:13.115 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:04:13.115 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:04:13.115 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:04:13.115 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns 2024-09-11T23:04:13.115 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:04:13.115 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:04:13.115 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:04:13.115 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:04:13.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:13.116 DEBUG:teuthology.orchestra.run.smithi012:> ls /sys/fs/fuse/connections 2024-09-11T23:04:13.164 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-11T23:04:13.165 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-11T23:04:13.209 DEBUG:teuthology.orchestra.run.smithi012:> sudo modprobe fuse 2024-09-11T23:04:13.225 DEBUG:teuthology.orchestra.run.smithi012:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:04:13.273 INFO:teuthology.orchestra.run.smithi012.stdout:/sys 2024-09-11T23:04:13.273 INFO:teuthology.orchestra.run.smithi012.stdout:/proc 2024-09-11T23:04:13.273 INFO:teuthology.orchestra.run.smithi012.stdout:/dev 2024-09-11T23:04:13.274 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/pts 2024-09-11T23:04:13.274 INFO:teuthology.orchestra.run.smithi012.stdout:/run 2024-09-11T23:04:13.274 INFO:teuthology.orchestra.run.smithi012.stdout:/ 2024-09-11T23:04:13.274 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/security 2024-09-11T23:04:13.274 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/shm 2024-09-11T23:04:13.274 INFO:teuthology.orchestra.run.smithi012.stdout:/run/lock 2024-09-11T23:04:13.274 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup 2024-09-11T23:04:13.274 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/pstore 2024-09-11T23:04:13.274 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/bpf 2024-09-11T23:04:13.274 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:04:13.274 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/hugepages 2024-09-11T23:04:13.274 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/mqueue 2024-09-11T23:04:13.275 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/debug 2024-09-11T23:04:13.275 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/tracing 2024-09-11T23:04:13.275 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/fs/nfsd 2024-09-11T23:04:13.276 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/fuse/connections 2024-09-11T23:04:13.276 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/config 2024-09-11T23:04:13.276 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:04:13.276 INFO:teuthology.orchestra.run.smithi012.stdout:/run/rpc_pipefs 2024-09-11T23:04:13.276 INFO:teuthology.orchestra.run.smithi012.stdout:/run/user/1000 2024-09-11T23:04:13.276 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph 2024-09-11T23:04:13.276 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:04:13.276 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:04:13.276 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:04:13.277 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns 2024-09-11T23:04:13.277 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:04:13.277 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:04:13.277 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:04:13.277 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:04:13.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:13.278 DEBUG:teuthology.orchestra.run.smithi012:> ls /sys/fs/fuse/connections 2024-09-11T23:04:13.289 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi012.stderr:2024-09-11T23:04:13.288+0000 7f8dfd631580 -1 init, newargv = 0x55e028b33080 newargc=15 2024-09-11T23:04:13.289 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi012.stderr:ceph-fuse[34896]: starting ceph client 2024-09-11T23:04:13.294 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi012.stderr:ceph-fuse[34896]: starting fuse 2024-09-11T23:04:14.395 DEBUG:teuthology.orchestra.run.smithi012:> sudo modprobe fuse 2024-09-11T23:04:14.413 DEBUG:teuthology.orchestra.run.smithi012:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:04:14.463 INFO:teuthology.orchestra.run.smithi012.stdout:/sys 2024-09-11T23:04:14.463 INFO:teuthology.orchestra.run.smithi012.stdout:/proc 2024-09-11T23:04:14.463 INFO:teuthology.orchestra.run.smithi012.stdout:/dev 2024-09-11T23:04:14.463 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/pts 2024-09-11T23:04:14.463 INFO:teuthology.orchestra.run.smithi012.stdout:/run 2024-09-11T23:04:14.464 INFO:teuthology.orchestra.run.smithi012.stdout:/ 2024-09-11T23:04:14.464 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/security 2024-09-11T23:04:14.464 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/shm 2024-09-11T23:04:14.464 INFO:teuthology.orchestra.run.smithi012.stdout:/run/lock 2024-09-11T23:04:14.464 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup 2024-09-11T23:04:14.464 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/pstore 2024-09-11T23:04:14.464 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/bpf 2024-09-11T23:04:14.464 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:04:14.464 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/hugepages 2024-09-11T23:04:14.464 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/mqueue 2024-09-11T23:04:14.464 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/debug 2024-09-11T23:04:14.464 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/tracing 2024-09-11T23:04:14.464 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/fs/nfsd 2024-09-11T23:04:14.465 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/fuse/connections 2024-09-11T23:04:14.465 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/config 2024-09-11T23:04:14.465 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:04:14.465 INFO:teuthology.orchestra.run.smithi012.stdout:/run/rpc_pipefs 2024-09-11T23:04:14.465 INFO:teuthology.orchestra.run.smithi012.stdout:/run/user/1000 2024-09-11T23:04:14.465 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph 2024-09-11T23:04:14.465 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:04:14.465 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:04:14.465 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:04:14.465 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns 2024-09-11T23:04:14.465 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:04:14.465 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:04:14.465 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:04:14.466 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:04:14.466 INFO:teuthology.orchestra.run.smithi012.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-11T23:04:14.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:14.467 DEBUG:teuthology.orchestra.run.smithi012:> ls /sys/fs/fuse/connections 2024-09-11T23:04:14.513 INFO:teuthology.orchestra.run.smithi012.stdout:45 2024-09-11T23:04:14.513 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-11T23:04:14.513 DEBUG:teuthology.orchestra.run.smithi012:> sudo stdin-killer -- python3 -c ' 2024-09-11T23:04:14.513 DEBUG:teuthology.orchestra.run.smithi012:> import glob 2024-09-11T23:04:14.513 DEBUG:teuthology.orchestra.run.smithi012:> import re 2024-09-11T23:04:14.514 DEBUG:teuthology.orchestra.run.smithi012:> import os 2024-09-11T23:04:14.514 DEBUG:teuthology.orchestra.run.smithi012:> import subprocess 2024-09-11T23:04:14.514 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:04:14.514 DEBUG:teuthology.orchestra.run.smithi012:> def _find_admin_socket(client_name): 2024-09-11T23:04:14.514 DEBUG:teuthology.orchestra.run.smithi012:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-11T23:04:14.514 DEBUG:teuthology.orchestra.run.smithi012:> files = glob.glob(asok_path) 2024-09-11T23:04:14.514 DEBUG:teuthology.orchestra.run.smithi012:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-11T23:04:14.514 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:04:14.514 DEBUG:teuthology.orchestra.run.smithi012:> # Given a non-glob path, it better be there 2024-09-11T23:04:14.514 DEBUG:teuthology.orchestra.run.smithi012:> if "*" not in asok_path: 2024-09-11T23:04:14.514 DEBUG:teuthology.orchestra.run.smithi012:> assert(len(files) == 1) 2024-09-11T23:04:14.514 DEBUG:teuthology.orchestra.run.smithi012:> return files[0] 2024-09-11T23:04:14.514 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:04:14.514 DEBUG:teuthology.orchestra.run.smithi012:> for f in files: 2024-09-11T23:04:14.515 DEBUG:teuthology.orchestra.run.smithi012:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T23:04:14.515 DEBUG:teuthology.orchestra.run.smithi012:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T23:04:14.515 DEBUG:teuthology.orchestra.run.smithi012:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T23:04:14.515 DEBUG:teuthology.orchestra.run.smithi012:> contents = proc_f.read() 2024-09-11T23:04:14.515 DEBUG:teuthology.orchestra.run.smithi012:> if mountpoint in contents: 2024-09-11T23:04:14.515 DEBUG:teuthology.orchestra.run.smithi012:> return f 2024-09-11T23:04:14.515 DEBUG:teuthology.orchestra.run.smithi012:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T23:04:14.515 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:04:14.515 DEBUG:teuthology.orchestra.run.smithi012:> print(_find_admin_socket("client.0")) 2024-09-11T23:04:14.515 DEBUG:teuthology.orchestra.run.smithi012:> ' 2024-09-11T23:04:14.642 INFO:teuthology.orchestra.run.smithi012.stdout:/var/run/ceph/ceph-client.0.34896.asok 2024-09-11T23:04:14.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:04:14.655 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.34896.asok 2024-09-11T23:04:14.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:14.655 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.34896.asok status 2024-09-11T23:04:14.815 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T23:04:14.815 INFO:teuthology.orchestra.run.smithi012.stdout: "metadata": { 2024-09-11T23:04:14.815 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-11T23:04:14.815 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T23:04:14.816 INFO:teuthology.orchestra.run.smithi012.stdout: "entity_id": "0", 2024-09-11T23:04:14.816 INFO:teuthology.orchestra.run.smithi012.stdout: "hostname": "smithi012", 2024-09-11T23:04:14.816 INFO:teuthology.orchestra.run.smithi012.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-11T23:04:14.816 INFO:teuthology.orchestra.run.smithi012.stdout: "pid": "34896", 2024-09-11T23:04:14.816 INFO:teuthology.orchestra.run.smithi012.stdout: "root": "/" 2024-09-11T23:04:14.816 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:14.816 INFO:teuthology.orchestra.run.smithi012.stdout: "dentry_count": 0, 2024-09-11T23:04:14.816 INFO:teuthology.orchestra.run.smithi012.stdout: "dentry_pinned_count": 0, 2024-09-11T23:04:14.816 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4408, 2024-09-11T23:04:14.816 INFO:teuthology.orchestra.run.smithi012.stdout: "inst": { 2024-09-11T23:04:14.817 INFO:teuthology.orchestra.run.smithi012.stdout: "name": { 2024-09-11T23:04:14.817 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "client", 2024-09-11T23:04:14.817 INFO:teuthology.orchestra.run.smithi012.stdout: "num": 4408 2024-09-11T23:04:14.817 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:14.817 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": { 2024-09-11T23:04:14.817 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T23:04:14.817 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "192.168.0.1:0", 2024-09-11T23:04:14.817 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 3959759667 2024-09-11T23:04:14.817 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:04:14.817 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:14.817 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": { 2024-09-11T23:04:14.817 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T23:04:14.818 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "192.168.0.1:0", 2024-09-11T23:04:14.818 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 3959759667 2024-09-11T23:04:14.818 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:14.818 INFO:teuthology.orchestra.run.smithi012.stdout: "inst_str": "client.4408 192.168.0.1:0/3959759667", 2024-09-11T23:04:14.818 INFO:teuthology.orchestra.run.smithi012.stdout: "addr_str": "192.168.0.1:0/3959759667", 2024-09-11T23:04:14.818 INFO:teuthology.orchestra.run.smithi012.stdout: "inode_count": 1, 2024-09-11T23:04:14.818 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_epoch": 16, 2024-09-11T23:04:14.818 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_epoch": 25, 2024-09-11T23:04:14.818 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_epoch_barrier": 0, 2024-09-11T23:04:14.818 INFO:teuthology.orchestra.run.smithi012.stdout: "blocklisted": false, 2024-09-11T23:04:14.819 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs" 2024-09-11T23:04:14.819 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T23:04:14.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:14.830 DEBUG:teuthology.orchestra.run.smithi012:> stat --file-system '--printf=%T 2024-09-11T23:04:14.830 DEBUG:teuthology.orchestra.run.smithi012:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-11T23:04:14.836 INFO:teuthology.orchestra.run.smithi012.stdout:fuseblk 2024-09-11T23:04:14.837 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-11T23:04:14.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:14.837 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:04:14.894 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T23:04:15.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.060+0000 7ff96099a640 1 Processor -- start 2024-09-11T23:04:15.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.060+0000 7ff96099a640 1 -- start start 2024-09-11T23:04:15.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.060+0000 7ff96099a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff95c0a4b80 0x7ff95c0a7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:15.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.060+0000 7ff96099a640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff95c0a82a0 con 0x7ff95c13a410 2024-09-11T23:04:15.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.060+0000 7ff96099a640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7ff95c0a3cb0 con 0x7ff95c0a4b80 2024-09-11T23:04:15.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.060+0000 7ff959d9b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff95c0a4b80 0x7ff95c0a7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:15.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.060+0000 7ff959d9b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff95c0a4b80 0x7ff95c0a7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60622/0 (socket says 172.21.15.12:60622) 2024-09-11T23:04:15.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.060+0000 7ff95a59c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff95c13a410 0x7ff95c0a6af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:49330/0 (socket says 172.21.15.12:49330) 2024-09-11T23:04:15.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.060+0000 7ff959d9b640 1 -- 172.21.15.12:0/2315700758 learned_addr learned my addr 172.21.15.12:0/2315700758 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:15.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.060+0000 7ff959d9b640 1 -- 172.21.15.12:0/2315700758 >> v1:172.21.15.12:6789/0 conn(0x7ff95c13a410 legacy=0x7ff95c0a6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:15.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.060+0000 7ff959d9b640 1 -- 172.21.15.12:0/2315700758 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff95c139fe0 con 0x7ff95c0a4b80 2024-09-11T23:04:15.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.064+0000 7ff959d9b640 1 --2- 172.21.15.12:0/2315700758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff95c0a4b80 0x7ff95c0a7200 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff9500097f0 tx=0x7ff95001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e2c07eee0cb5157 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:15.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.064+0000 7ff95959a640 1 -- 172.21.15.12:0/2315700758 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9500b2070 con 0x7ff95c0a4b80 2024-09-11T23:04:15.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.064+0000 7ff95959a640 1 -- 172.21.15.12:0/2315700758 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9500a9070 con 0x7ff95c0a4b80 2024-09-11T23:04:15.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.064+0000 7ff95959a640 1 -- 172.21.15.12:0/2315700758 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9500ad5b0 con 0x7ff95c0a4b80 2024-09-11T23:04:15.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.064+0000 7ff96099a640 1 -- 172.21.15.12:0/2315700758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff95c0a4b80 msgr2=0x7ff95c0a7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:15.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.064+0000 7ff96099a640 1 --2- 172.21.15.12:0/2315700758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff95c0a4b80 0x7ff95c0a7200 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff9500097f0 tx=0x7ff95001c450 comp rx=0 tx=0).stop 2024-09-11T23:04:15.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.064+0000 7ff96099a640 1 -- 172.21.15.12:0/2315700758 shutdown_connections 2024-09-11T23:04:15.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.064+0000 7ff96099a640 1 --2- 172.21.15.12:0/2315700758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff95c0a4b80 0x7ff95c0a7200 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:15.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.064+0000 7ff96099a640 1 -- 172.21.15.12:0/2315700758 >> 172.21.15.12:0/2315700758 conn(0x7ff95c0ac2c0 msgr2=0x7ff95c0ac6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:15.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.064+0000 7ff96099a640 1 -- 172.21.15.12:0/2315700758 shutdown_connections 2024-09-11T23:04:15.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.064+0000 7ff96099a640 1 -- 172.21.15.12:0/2315700758 wait complete. 2024-09-11T23:04:15.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.064+0000 7ff96099a640 1 Processor -- start 2024-09-11T23:04:15.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.064+0000 7ff96099a640 1 -- start start 2024-09-11T23:04:15.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.064+0000 7ff96099a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff95c0a4b80 0x7ff95c0a0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:15.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.064+0000 7ff96099a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff95c0a7740 con 0x7ff95c0a4b80 2024-09-11T23:04:15.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.064+0000 7ff95a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff95c0a4b80 0x7ff95c0a0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:15.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.064+0000 7ff95a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff95c0a4b80 0x7ff95c0a0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60624/0 (socket says 172.21.15.12:60624) 2024-09-11T23:04:15.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.064+0000 7ff95a59c640 1 -- 172.21.15.12:0/1964141194 learned_addr learned my addr 172.21.15.12:0/1964141194 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:15.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.064+0000 7ff95a59c640 1 -- 172.21.15.12:0/1964141194 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff95c0a1710 con 0x7ff95c0a4b80 2024-09-11T23:04:15.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.064+0000 7ff95a59c640 1 --2- 172.21.15.12:0/1964141194 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff95c0a4b80 0x7ff95c0a0fd0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff94c00c410 tx=0x7ff94c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:15.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.064+0000 7ff94affd640 1 -- 172.21.15.12:0/1964141194 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff94c007410 con 0x7ff95c0a4b80 2024-09-11T23:04:15.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.064+0000 7ff94affd640 1 -- 172.21.15.12:0/1964141194 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff94c0075b0 con 0x7ff95c0a4b80 2024-09-11T23:04:15.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.064+0000 7ff94affd640 1 -- 172.21.15.12:0/1964141194 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff94c004920 con 0x7ff95c0a4b80 2024-09-11T23:04:15.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.064+0000 7ff96099a640 1 -- 172.21.15.12:0/1964141194 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff95c0a1a30 con 0x7ff95c0a4b80 2024-09-11T23:04:15.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.064+0000 7ff96099a640 1 -- 172.21.15.12:0/1964141194 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff95c09f590 con 0x7ff95c0a4b80 2024-09-11T23:04:15.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.068+0000 7ff94affd640 1 -- 172.21.15.12:0/1964141194 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff94c01a020 con 0x7ff95c0a4b80 2024-09-11T23:04:15.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.068+0000 7ff96099a640 1 -- 172.21.15.12:0/1964141194 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff95c0a1510 con 0x7ff95c0a4b80 2024-09-11T23:04:15.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.068+0000 7ff94affd640 1 --2- 172.21.15.12:0/1964141194 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7ff93c035db0 0x7ff93c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:15.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.068+0000 7ff94affd640 1 -- 172.21.15.12:0/1964141194 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 3439+0+0 (secure 0 0 0) 0x7ff94c047e50 con 0x7ff95c0a4b80 2024-09-11T23:04:15.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.068+0000 7ff959d9b640 1 --2- 172.21.15.12:0/1964141194 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7ff93c035db0 0x7ff93c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:15.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.068+0000 7ff959d9b640 1 --2- 172.21.15.12:0/1964141194 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7ff93c035db0 0x7ff93c038270 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff9500af000 tx=0x7ff950008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:15.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.072+0000 7ff94affd640 1 -- 172.21.15.12:0/1964141194 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff94c01ae10 con 0x7ff95c0a4b80 2024-09-11T23:04:15.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.276+0000 7ff96099a640 1 -- 172.21.15.12:0/1964141194 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff95c09ecb0 con 0x7ff95c0a4b80 2024-09-11T23:04:15.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.276+0000 7ff94affd640 1 -- 172.21.15.12:0/1964141194 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) ==== 53+0+73 (secure 0 0 0) 0x7ff94c01b960 con 0x7ff95c0a4b80 2024-09-11T23:04:15.277 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T23:04:15.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.276+0000 7ff96099a640 1 -- 172.21.15.12:0/1964141194 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7ff93c035db0 msgr2=0x7ff93c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:15.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.276+0000 7ff96099a640 1 --2- 172.21.15.12:0/1964141194 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7ff93c035db0 0x7ff93c038270 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff9500af000 tx=0x7ff950008040 comp rx=0 tx=0).stop 2024-09-11T23:04:15.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.276+0000 7ff96099a640 1 -- 172.21.15.12:0/1964141194 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff95c0a4b80 msgr2=0x7ff95c0a0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:15.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.276+0000 7ff96099a640 1 --2- 172.21.15.12:0/1964141194 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff95c0a4b80 0x7ff95c0a0fd0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff94c00c410 tx=0x7ff94c00c8d0 comp rx=0 tx=0).stop 2024-09-11T23:04:15.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.276+0000 7ff96099a640 1 -- 172.21.15.12:0/1964141194 shutdown_connections 2024-09-11T23:04:15.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.276+0000 7ff96099a640 1 --2- 172.21.15.12:0/1964141194 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7ff93c035db0 0x7ff93c038270 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:15.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.276+0000 7ff96099a640 1 --2- 172.21.15.12:0/1964141194 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff95c0a4b80 0x7ff95c0a0fd0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:15.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.276+0000 7ff96099a640 1 -- 172.21.15.12:0/1964141194 >> 172.21.15.12:0/1964141194 conn(0x7ff95c0ac2c0 msgr2=0x7ff95c0aa560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:15.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.276+0000 7ff96099a640 1 -- 172.21.15.12:0/1964141194 shutdown_connections 2024-09-11T23:04:15.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15.276+0000 7ff96099a640 1 -- 172.21.15.12:0/1964141194 wait complete. 2024-09-11T23:04:15.297 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-11T23:04:15.297 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:04:15.298 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi012.front.sepia.ceph.com 2024-09-11T23:04:15.298 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-11T23:04:15.298 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-11T23:04:15.298 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-11T23:04:15.298 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T23:04:15.298 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:04:15.298 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:04:15.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:15.298 DEBUG:teuthology.orchestra.run.smithi012:> ip addr 2024-09-11T23:04:15.305 INFO:teuthology.orchestra.run.smithi012.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:04:15.305 INFO:teuthology.orchestra.run.smithi012.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:04:15.305 INFO:teuthology.orchestra.run.smithi012.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:04:15.306 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:04:15.306 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 ::1/128 scope host 2024-09-11T23:04:15.306 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:04:15.306 INFO:teuthology.orchestra.run.smithi012.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:04:15.306 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a4 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:04:15.306 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f0 2024-09-11T23:04:15.306 INFO:teuthology.orchestra.run.smithi012.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:04:15.307 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a5 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:04:15.307 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f1 2024-09-11T23:04:15.307 INFO:teuthology.orchestra.run.smithi012.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:04:15.307 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:ea brd ff:ff:ff:ff:ff:ff 2024-09-11T23:04:15.307 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f0 2024-09-11T23:04:15.307 INFO:teuthology.orchestra.run.smithi012.stdout: inet 172.21.15.12/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-11T23:04:15.308 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft 42486sec preferred_lft 42486sec 2024-09-11T23:04:15.308 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::ae1f:6bff:fef8:25ea/64 scope link 2024-09-11T23:04:15.308 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:04:15.308 INFO:teuthology.orchestra.run.smithi012.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:04:15.308 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:eb brd ff:ff:ff:ff:ff:ff 2024-09-11T23:04:15.308 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f1 2024-09-11T23:04:15.308 INFO:teuthology.orchestra.run.smithi012.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-11T23:04:15.309 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 02:42:d6:75:63:83 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:04:15.309 INFO:teuthology.orchestra.run.smithi012.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-11T23:04:15.309 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:04:15.309 INFO:teuthology.orchestra.run.smithi012.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:04:15.309 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-11T23:04:15.309 INFO:teuthology.orchestra.run.smithi012.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T23:04:15.309 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:04:15.309 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-11T23:04:15.310 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:04:15.310 INFO:teuthology.orchestra.run.smithi012.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:04:15.310 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:04:15.310 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-11T23:04:15.310 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:04:15.311 INFO:teuthology.orchestra.run.smithi012.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:04:15.311 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:04:15.311 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-11T23:04:15.311 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:04:15.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:15.312 DEBUG:teuthology.orchestra.run.smithi012:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:04:15.357 INFO:teuthology.orchestra.run.smithi012.stdout:1 2024-09-11T23:04:15.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:15.358 DEBUG:teuthology.orchestra.run.smithi012:> route 2024-09-11T23:04:15.405 INFO:teuthology.orchestra.run.smithi012.stdout:Kernel IP routing table 2024-09-11T23:04:15.405 INFO:teuthology.orchestra.run.smithi012.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:04:15.405 INFO:teuthology.orchestra.run.smithi012.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-11T23:04:15.405 INFO:teuthology.orchestra.run.smithi012.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-11T23:04:15.405 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-11T23:04:15.405 INFO:teuthology.orchestra.run.smithi012.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:04:15.406 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:04:15.406 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-09-11T23:04:15.406 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-11T23:04:15.406 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-11T23:04:15.406 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-11T23:04:15.406 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-09-11T23:04:15.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:04:15.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:04:15.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:15.528 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2024-09-11T23:04:15.534 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 1) 2024-09-11T23:04:15.534 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T23:04:15.535 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:04:15.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:15.535 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set brx.1 up 2024-09-11T23:04:15.588 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-11T23:04:15.588 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:04:15.589 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-11T23:04:15.637 INFO:teuthology.orchestra.run.smithi012.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:04:15.637 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:04:15.637 DEBUG:teuthology.orchestra.run.smithi012:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-11T23:04:15.685 DEBUG:teuthology.orchestra.run.smithi012:> sudo modprobe fuse 2024-09-11T23:04:15.749 DEBUG:teuthology.orchestra.run.smithi012:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:04:15.799 INFO:teuthology.orchestra.run.smithi012.stdout:/sys 2024-09-11T23:04:15.799 INFO:teuthology.orchestra.run.smithi012.stdout:/proc 2024-09-11T23:04:15.799 INFO:teuthology.orchestra.run.smithi012.stdout:/dev 2024-09-11T23:04:15.799 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/pts 2024-09-11T23:04:15.799 INFO:teuthology.orchestra.run.smithi012.stdout:/run 2024-09-11T23:04:15.799 INFO:teuthology.orchestra.run.smithi012.stdout:/ 2024-09-11T23:04:15.799 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/security 2024-09-11T23:04:15.799 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/shm 2024-09-11T23:04:15.799 INFO:teuthology.orchestra.run.smithi012.stdout:/run/lock 2024-09-11T23:04:15.799 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup 2024-09-11T23:04:15.800 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/pstore 2024-09-11T23:04:15.800 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/bpf 2024-09-11T23:04:15.800 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:04:15.800 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/hugepages 2024-09-11T23:04:15.800 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/mqueue 2024-09-11T23:04:15.800 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/debug 2024-09-11T23:04:15.800 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/tracing 2024-09-11T23:04:15.800 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/fs/nfsd 2024-09-11T23:04:15.800 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/fuse/connections 2024-09-11T23:04:15.800 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/config 2024-09-11T23:04:15.800 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:04:15.801 INFO:teuthology.orchestra.run.smithi012.stdout:/run/rpc_pipefs 2024-09-11T23:04:15.801 INFO:teuthology.orchestra.run.smithi012.stdout:/run/user/1000 2024-09-11T23:04:15.801 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph 2024-09-11T23:04:15.801 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:04:15.801 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:04:15.801 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:04:15.801 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns 2024-09-11T23:04:15.801 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:04:15.801 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:04:15.801 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:04:15.801 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:04:15.802 INFO:teuthology.orchestra.run.smithi012.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-11T23:04:15.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:15.803 DEBUG:teuthology.orchestra.run.smithi012:> ls /sys/fs/fuse/connections 2024-09-11T23:04:15.853 INFO:teuthology.orchestra.run.smithi012.stdout:45 2024-09-11T23:04:15.853 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [45] 2024-09-11T23:04:15.853 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-11T23:04:15.897 DEBUG:teuthology.orchestra.run.smithi012:> sudo modprobe fuse 2024-09-11T23:04:15.910 DEBUG:teuthology.orchestra.run.smithi012:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:04:15.957 INFO:teuthology.orchestra.run.smithi012.stdout:/sys 2024-09-11T23:04:15.957 INFO:teuthology.orchestra.run.smithi012.stdout:/proc 2024-09-11T23:04:15.957 INFO:teuthology.orchestra.run.smithi012.stdout:/dev 2024-09-11T23:04:15.957 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/pts 2024-09-11T23:04:15.957 INFO:teuthology.orchestra.run.smithi012.stdout:/run 2024-09-11T23:04:15.957 INFO:teuthology.orchestra.run.smithi012.stdout:/ 2024-09-11T23:04:15.957 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/security 2024-09-11T23:04:15.957 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/shm 2024-09-11T23:04:15.957 INFO:teuthology.orchestra.run.smithi012.stdout:/run/lock 2024-09-11T23:04:15.957 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup 2024-09-11T23:04:15.957 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/pstore 2024-09-11T23:04:15.957 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/bpf 2024-09-11T23:04:15.958 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:04:15.958 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/hugepages 2024-09-11T23:04:15.958 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/mqueue 2024-09-11T23:04:15.958 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/debug 2024-09-11T23:04:15.958 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/tracing 2024-09-11T23:04:15.958 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/fs/nfsd 2024-09-11T23:04:15.958 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/fuse/connections 2024-09-11T23:04:15.958 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/config 2024-09-11T23:04:15.958 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:04:15.958 INFO:teuthology.orchestra.run.smithi012.stdout:/run/rpc_pipefs 2024-09-11T23:04:15.958 INFO:teuthology.orchestra.run.smithi012.stdout:/run/user/1000 2024-09-11T23:04:15.958 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph 2024-09-11T23:04:15.958 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:04:15.959 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:04:15.959 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:04:15.959 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns 2024-09-11T23:04:15.959 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:04:15.959 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:04:15.959 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:04:15.959 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:04:15.959 INFO:teuthology.orchestra.run.smithi012.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-11T23:04:15.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:15.960 DEBUG:teuthology.orchestra.run.smithi012:> ls /sys/fs/fuse/connections 2024-09-11T23:04:15.981 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi012.stderr:2024-09-11T23:04:15.976+0000 7f7736b69580 -1 init, newargv = 0x564c1d3764b0 newargc=15 2024-09-11T23:04:15.981 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi012.stderr:ceph-fuse[35006]: starting ceph client 2024-09-11T23:04:15.985 INFO:teuthology.orchestra.run.smithi012.stdout:45 2024-09-11T23:04:15.985 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi012.stderr:ceph-fuse[35006]: starting fuse 2024-09-11T23:04:17.087 DEBUG:teuthology.orchestra.run.smithi012:> sudo modprobe fuse 2024-09-11T23:04:17.105 DEBUG:teuthology.orchestra.run.smithi012:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:04:17.159 INFO:teuthology.orchestra.run.smithi012.stdout:/sys 2024-09-11T23:04:17.159 INFO:teuthology.orchestra.run.smithi012.stdout:/proc 2024-09-11T23:04:17.159 INFO:teuthology.orchestra.run.smithi012.stdout:/dev 2024-09-11T23:04:17.159 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/pts 2024-09-11T23:04:17.160 INFO:teuthology.orchestra.run.smithi012.stdout:/run 2024-09-11T23:04:17.160 INFO:teuthology.orchestra.run.smithi012.stdout:/ 2024-09-11T23:04:17.160 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/security 2024-09-11T23:04:17.160 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/shm 2024-09-11T23:04:17.160 INFO:teuthology.orchestra.run.smithi012.stdout:/run/lock 2024-09-11T23:04:17.160 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup 2024-09-11T23:04:17.160 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/pstore 2024-09-11T23:04:17.160 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/bpf 2024-09-11T23:04:17.160 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:04:17.160 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/hugepages 2024-09-11T23:04:17.160 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/mqueue 2024-09-11T23:04:17.161 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/debug 2024-09-11T23:04:17.161 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/tracing 2024-09-11T23:04:17.161 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/fs/nfsd 2024-09-11T23:04:17.161 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/fuse/connections 2024-09-11T23:04:17.161 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/config 2024-09-11T23:04:17.162 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:04:17.162 INFO:teuthology.orchestra.run.smithi012.stdout:/run/rpc_pipefs 2024-09-11T23:04:17.162 INFO:teuthology.orchestra.run.smithi012.stdout:/run/user/1000 2024-09-11T23:04:17.162 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph 2024-09-11T23:04:17.162 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:04:17.162 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:04:17.162 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:04:17.162 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns 2024-09-11T23:04:17.162 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:04:17.162 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:04:17.162 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:04:17.163 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:04:17.163 INFO:teuthology.orchestra.run.smithi012.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-11T23:04:17.163 INFO:teuthology.orchestra.run.smithi012.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-11T23:04:17.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:17.164 DEBUG:teuthology.orchestra.run.smithi012:> ls /sys/fs/fuse/connections 2024-09-11T23:04:17.213 INFO:teuthology.orchestra.run.smithi012.stdout:45 2024-09-11T23:04:17.213 INFO:teuthology.orchestra.run.smithi012.stdout:46 2024-09-11T23:04:17.214 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45, 46] 2024-09-11T23:04:17.214 DEBUG:teuthology.orchestra.run.smithi012:> sudo stdin-killer -- python3 -c ' 2024-09-11T23:04:17.214 DEBUG:teuthology.orchestra.run.smithi012:> import glob 2024-09-11T23:04:17.214 DEBUG:teuthology.orchestra.run.smithi012:> import re 2024-09-11T23:04:17.215 DEBUG:teuthology.orchestra.run.smithi012:> import os 2024-09-11T23:04:17.215 DEBUG:teuthology.orchestra.run.smithi012:> import subprocess 2024-09-11T23:04:17.215 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:04:17.215 DEBUG:teuthology.orchestra.run.smithi012:> def _find_admin_socket(client_name): 2024-09-11T23:04:17.215 DEBUG:teuthology.orchestra.run.smithi012:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-11T23:04:17.215 DEBUG:teuthology.orchestra.run.smithi012:> files = glob.glob(asok_path) 2024-09-11T23:04:17.216 DEBUG:teuthology.orchestra.run.smithi012:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-11T23:04:17.216 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:04:17.216 DEBUG:teuthology.orchestra.run.smithi012:> # Given a non-glob path, it better be there 2024-09-11T23:04:17.216 DEBUG:teuthology.orchestra.run.smithi012:> if "*" not in asok_path: 2024-09-11T23:04:17.216 DEBUG:teuthology.orchestra.run.smithi012:> assert(len(files) == 1) 2024-09-11T23:04:17.216 DEBUG:teuthology.orchestra.run.smithi012:> return files[0] 2024-09-11T23:04:17.217 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:04:17.217 DEBUG:teuthology.orchestra.run.smithi012:> for f in files: 2024-09-11T23:04:17.217 DEBUG:teuthology.orchestra.run.smithi012:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T23:04:17.217 DEBUG:teuthology.orchestra.run.smithi012:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T23:04:17.217 DEBUG:teuthology.orchestra.run.smithi012:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T23:04:17.217 DEBUG:teuthology.orchestra.run.smithi012:> contents = proc_f.read() 2024-09-11T23:04:17.218 DEBUG:teuthology.orchestra.run.smithi012:> if mountpoint in contents: 2024-09-11T23:04:17.218 DEBUG:teuthology.orchestra.run.smithi012:> return f 2024-09-11T23:04:17.218 DEBUG:teuthology.orchestra.run.smithi012:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T23:04:17.218 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:04:17.218 DEBUG:teuthology.orchestra.run.smithi012:> print(_find_admin_socket("client.1")) 2024-09-11T23:04:17.218 DEBUG:teuthology.orchestra.run.smithi012:> ' 2024-09-11T23:04:17.339 INFO:teuthology.orchestra.run.smithi012.stdout:/var/run/ceph/ceph-client.1.35006.asok 2024-09-11T23:04:17.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:04:17.351 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.35006.asok 2024-09-11T23:04:17.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:17.351 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.35006.asok status 2024-09-11T23:04:17.513 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T23:04:17.514 INFO:teuthology.orchestra.run.smithi012.stdout: "metadata": { 2024-09-11T23:04:17.514 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-11T23:04:17.514 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T23:04:17.514 INFO:teuthology.orchestra.run.smithi012.stdout: "entity_id": "1", 2024-09-11T23:04:17.514 INFO:teuthology.orchestra.run.smithi012.stdout: "hostname": "smithi012", 2024-09-11T23:04:17.514 INFO:teuthology.orchestra.run.smithi012.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-11T23:04:17.514 INFO:teuthology.orchestra.run.smithi012.stdout: "pid": "35006", 2024-09-11T23:04:17.514 INFO:teuthology.orchestra.run.smithi012.stdout: "root": "/" 2024-09-11T23:04:17.514 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:17.514 INFO:teuthology.orchestra.run.smithi012.stdout: "dentry_count": 0, 2024-09-11T23:04:17.514 INFO:teuthology.orchestra.run.smithi012.stdout: "dentry_pinned_count": 0, 2024-09-11T23:04:17.514 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4414, 2024-09-11T23:04:17.515 INFO:teuthology.orchestra.run.smithi012.stdout: "inst": { 2024-09-11T23:04:17.515 INFO:teuthology.orchestra.run.smithi012.stdout: "name": { 2024-09-11T23:04:17.515 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "client", 2024-09-11T23:04:17.515 INFO:teuthology.orchestra.run.smithi012.stdout: "num": 4414 2024-09-11T23:04:17.515 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:17.515 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": { 2024-09-11T23:04:17.515 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T23:04:17.515 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "192.168.0.2:0", 2024-09-11T23:04:17.515 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 3440998345 2024-09-11T23:04:17.515 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:04:17.515 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:17.515 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": { 2024-09-11T23:04:17.515 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T23:04:17.516 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "192.168.0.2:0", 2024-09-11T23:04:17.516 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 3440998345 2024-09-11T23:04:17.516 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:17.516 INFO:teuthology.orchestra.run.smithi012.stdout: "inst_str": "client.4414 192.168.0.2:0/3440998345", 2024-09-11T23:04:17.516 INFO:teuthology.orchestra.run.smithi012.stdout: "addr_str": "192.168.0.2:0/3440998345", 2024-09-11T23:04:17.516 INFO:teuthology.orchestra.run.smithi012.stdout: "inode_count": 1, 2024-09-11T23:04:17.516 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_epoch": 16, 2024-09-11T23:04:17.516 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_epoch": 25, 2024-09-11T23:04:17.516 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_epoch_barrier": 0, 2024-09-11T23:04:17.516 INFO:teuthology.orchestra.run.smithi012.stdout: "blocklisted": false, 2024-09-11T23:04:17.516 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs" 2024-09-11T23:04:17.516 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T23:04:17.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:17.527 DEBUG:teuthology.orchestra.run.smithi012:> stat --file-system '--printf=%T 2024-09-11T23:04:17.527 DEBUG:teuthology.orchestra.run.smithi012:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-11T23:04:17.534 INFO:teuthology.orchestra.run.smithi012.stdout:fuseblk 2024-09-11T23:04:17.534 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-11T23:04:17.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:17.534 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-11T23:04:17.589 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable stats 2024-09-11T23:04:17.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:17.772+0000 7fb710610640 1 Processor -- start 2024-09-11T23:04:17.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:17.772+0000 7fb710610640 1 -- start start 2024-09-11T23:04:17.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:17.772+0000 7fb710610640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb7081381c0 0x7fb70813cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:17.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:17.772+0000 7fb710610640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb70809d690 con 0x7fb708137de0 2024-09-11T23:04:17.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:17.772+0000 7fb710610640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fb70809ea90 con 0x7fb7081381c0 2024-09-11T23:04:17.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:17.776+0000 7fb70e3ac640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fb708137de0 0x7fb70809f190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:49340/0 (socket says 172.21.15.12:49340) 2024-09-11T23:04:17.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:17.776+0000 7fb70e3ac640 1 -- 172.21.15.12:0/3467320362 learned_addr learned my addr 172.21.15.12:0/3467320362 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:04:17.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:17.776+0000 7fb70dbab640 1 --2- 172.21.15.12:0/3467320362 >> v2:172.21.15.12:3300/0 conn(0x7fb7081381c0 0x7fb70813cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:17.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:17.776+0000 7fb70dbab640 1 -- 172.21.15.12:0/3467320362 >> v1:172.21.15.12:6789/0 conn(0x7fb708137de0 legacy=0x7fb70809f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:17.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:17.776+0000 7fb70dbab640 1 -- 172.21.15.12:0/3467320362 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb70809cf00 con 0x7fb7081381c0 2024-09-11T23:04:17.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:17.776+0000 7fb70dbab640 1 --2- 172.21.15.12:0/3467320362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7081381c0 0x7fb70813cbc0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb704009d90 tx=0x7fb70401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87cd07a52c2ffb89 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:17.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:17.776+0000 7fb70d3aa640 1 -- 172.21.15.12:0/3467320362 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7040b2070 con 0x7fb7081381c0 2024-09-11T23:04:17.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:17.776+0000 7fb70d3aa640 1 -- 172.21.15.12:0/3467320362 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7040a5760 con 0x7fb7081381c0 2024-09-11T23:04:17.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:17.776+0000 7fb70d3aa640 1 -- 172.21.15.12:0/3467320362 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7040a5a60 con 0x7fb7081381c0 2024-09-11T23:04:17.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:17.776+0000 7fb710610640 1 -- 172.21.15.12:0/3467320362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7081381c0 msgr2=0x7fb70813cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:17.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:17.776+0000 7fb710610640 1 --2- 172.21.15.12:0/3467320362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7081381c0 0x7fb70813cbc0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb704009d90 tx=0x7fb70401c8e0 comp rx=0 tx=0).stop 2024-09-11T23:04:17.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:17.776+0000 7fb710610640 1 -- 172.21.15.12:0/3467320362 shutdown_connections 2024-09-11T23:04:17.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:17.776+0000 7fb710610640 1 --2- 172.21.15.12:0/3467320362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7081381c0 0x7fb70813cbc0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:17.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:17.776+0000 7fb710610640 1 -- 172.21.15.12:0/3467320362 >> 172.21.15.12:0/3467320362 conn(0x7fb7080a82f0 msgr2=0x7fb7080a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:17.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:17.776+0000 7fb710610640 1 -- 172.21.15.12:0/3467320362 shutdown_connections 2024-09-11T23:04:17.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:17.776+0000 7fb710610640 1 -- 172.21.15.12:0/3467320362 wait complete. 2024-09-11T23:04:17.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:17.780+0000 7fb710610640 1 Processor -- start 2024-09-11T23:04:17.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:17.780+0000 7fb710610640 1 -- start start 2024-09-11T23:04:17.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:17.780+0000 7fb710610640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb708137de0 0x7fb70806fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:17.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:17.780+0000 7fb710610640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb708137860 con 0x7fb708137de0 2024-09-11T23:04:17.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:17.780+0000 7fb70e3ac640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb708137de0 0x7fb70806fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:17.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:17.780+0000 7fb70e3ac640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb708137de0 0x7fb70806fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60650/0 (socket says 172.21.15.12:60650) 2024-09-11T23:04:17.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:17.780+0000 7fb70e3ac640 1 -- 172.21.15.12:0/510170540 learned_addr learned my addr 172.21.15.12:0/510170540 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:17.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:17.780+0000 7fb70e3ac640 1 -- 172.21.15.12:0/510170540 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb70811eaf0 con 0x7fb708137de0 2024-09-11T23:04:17.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:17.780+0000 7fb70e3ac640 1 --2- 172.21.15.12:0/510170540 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb708137de0 0x7fb70806fd40 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc00c380 tx=0x7fb6fc00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:17.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:17.780+0000 7fb6faffd640 1 -- 172.21.15.12:0/510170540 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6fc017070 con 0x7fb708137de0 2024-09-11T23:04:17.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:17.780+0000 7fb6faffd640 1 -- 172.21.15.12:0/510170540 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6fc005c20 con 0x7fb708137de0 2024-09-11T23:04:17.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:17.780+0000 7fb710610640 1 -- 172.21.15.12:0/510170540 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb708072550 con 0x7fb708137de0 2024-09-11T23:04:17.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:17.780+0000 7fb6faffd640 1 -- 172.21.15.12:0/510170540 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6fc0070d0 con 0x7fb708137de0 2024-09-11T23:04:17.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:17.780+0000 7fb710610640 1 -- 172.21.15.12:0/510170540 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb708071990 con 0x7fb708137de0 2024-09-11T23:04:17.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:17.780+0000 7fb710610640 1 -- 172.21.15.12:0/510170540 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb708071c70 con 0x7fb708137de0 2024-09-11T23:04:17.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:17.780+0000 7fb6faffd640 1 -- 172.21.15.12:0/510170540 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb6fc01a070 con 0x7fb708137de0 2024-09-11T23:04:17.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:17.780+0000 7fb6faffd640 1 --2- 172.21.15.12:0/510170540 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fb6ec035db0 0x7fb6ec038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:17.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:17.780+0000 7fb6faffd640 1 -- 172.21.15.12:0/510170540 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 3439+0+0 (secure 0 0 0) 0x7fb6fc0478d0 con 0x7fb708137de0 2024-09-11T23:04:17.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:17.780+0000 7fb70dbab640 1 --2- 172.21.15.12:0/510170540 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fb6ec035db0 0x7fb6ec038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:17.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:17.784+0000 7fb70dbab640 1 --2- 172.21.15.12:0/510170540 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fb6ec035db0 0x7fb6ec038270 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb7040af000 tx=0x7fb7040a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:17.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:17.788+0000 7fb6faffd640 1 -- 172.21.15.12:0/510170540 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb6fc01b3b0 con 0x7fb708137de0 2024-09-11T23:04:17.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:17.988+0000 7fb710610640 1 -- 172.21.15.12:0/510170540 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "stats"} v 0) -- 0x7fb70809f190 con 0x7fb708137de0 2024-09-11T23:04:18.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:18.580+0000 7fb6faffd640 1 -- 172.21.15.12:0/510170540 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "stats"}]=0 v6) ==== 84+0+0 (secure 0 0 0) 0x7fb6fc011360 con 0x7fb708137de0 2024-09-11T23:04:18.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:18.584+0000 7fb710610640 1 -- 172.21.15.12:0/510170540 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fb6ec035db0 msgr2=0x7fb6ec038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:18.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:18.584+0000 7fb710610640 1 --2- 172.21.15.12:0/510170540 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fb6ec035db0 0x7fb6ec038270 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb7040af000 tx=0x7fb7040a7070 comp rx=0 tx=0).stop 2024-09-11T23:04:18.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:18.584+0000 7fb710610640 1 -- 172.21.15.12:0/510170540 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb708137de0 msgr2=0x7fb70806fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:18.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:18.584+0000 7fb710610640 1 --2- 172.21.15.12:0/510170540 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb708137de0 0x7fb70806fd40 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc00c380 tx=0x7fb6fc00c840 comp rx=0 tx=0).stop 2024-09-11T23:04:18.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:18.584+0000 7fb710610640 1 -- 172.21.15.12:0/510170540 shutdown_connections 2024-09-11T23:04:18.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:18.584+0000 7fb710610640 1 --2- 172.21.15.12:0/510170540 >> [v2:172.21.15.12:6824/2765460338,v1:172.21.15.12:6825/2765460338] conn(0x7fb6ec035db0 0x7fb6ec038270 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:18.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:18.584+0000 7fb710610640 1 --2- 172.21.15.12:0/510170540 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb708137de0 0x7fb70806fd40 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:18.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:18.584+0000 7fb710610640 1 -- 172.21.15.12:0/510170540 >> 172.21.15.12:0/510170540 conn(0x7fb7080a82f0 msgr2=0x7fb70809fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:18.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:18.584+0000 7fb710610640 1 -- 172.21.15.12:0/510170540 shutdown_connections 2024-09-11T23:04:18.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:18.584+0000 7fb710610640 1 -- 172.21.15.12:0/510170540 wait complete. 2024-09-11T23:04:18.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:18.604 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec cephfs-top --id=admin --dump) 2024-09-11T23:04:18.705 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:18.704+0000 7f7a059f7180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T23:04:19.099 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:19.096+0000 7f7a059f7180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T23:04:19.236 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:19.236+0000 7f7a059f7180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T23:04:19.678 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:19.676+0000 7f7a059f7180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T23:04:19.732 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:19.732+0000 7f7a059f7180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T23:04:19.783 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:19.780+0000 7f7a059f7180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T23:04:19.861 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:19.860+0000 7f7a059f7180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T23:04:19.912 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:19.912+0000 7f7a059f7180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T23:04:19.989 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:19.988+0000 7f7a059f7180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T23:04:20.045 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:20.044+0000 7f7a059f7180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T23:04:20.191 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:20.188+0000 7f7a059f7180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T23:04:20.245 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:20.244+0000 7f7a059f7180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T23:04:20.470 INFO:tasks.ceph.mgr.x.smithi012.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-11T23:04:20.471 INFO:tasks.ceph.mgr.x.smithi012.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-11T23:04:20.471 INFO:tasks.ceph.mgr.x.smithi012.stderr: from numpy import show_config as show_numpy_config 2024-09-11T23:04:20.478 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:20.476+0000 7f7a059f7180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T23:04:20.619 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:20.616+0000 7f7a059f7180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:04:20.733 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:20.732+0000 7f7a059f7180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T23:04:20.797 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:20.796+0000 7f7a059f7180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T23:04:20.937 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:20.936+0000 7f7a059f7180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:04:21.440 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:21.440+0000 7f7a059f7180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T23:04:21.516 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:21.516+0000 7f7a059f7180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T23:04:21.670 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:21.668+0000 7f7a059f7180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T23:04:21.749 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:21.748+0000 7f7a059f7180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T23:04:22.054 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:22.052+0000 7f7a059f7180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T23:04:22.111 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:22.108+0000 7f7a059f7180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T23:04:22.205 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:22.204+0000 7f798bdef640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:04:22.205 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:22.204+0000 7f798bdef640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:04:22.206 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:22.204+0000 7f798bdef640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:04:22.206 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:22.204+0000 7f798bdef640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:04:22.206 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:22.204+0000 7f798bdef640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:04:22.206 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:22.204+0000 7f798ddf3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:04:22.206 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:22.204+0000 7f798ddf3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:04:22.206 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:22.204+0000 7f798ddf3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:04:22.206 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:22.204+0000 7f798ddf3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:04:22.207 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:22.204+0000 7f798ddf3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:04:23.155 INFO:teuthology.orchestra.run.smithi012.stdout:{"date": "Wed Sep 11 23:04:23 2024", "client_count": {"total_clients": 0, "fuse": 0, "kclient": 0, "libcephfs": 0}, "filesystems": {"cephfs": {}}} 2024-09-11T23:04:23.171 DEBUG:teuthology.orchestra.run.smithi012:> sudo stdin-killer -- python3 -c ' 2024-09-11T23:04:23.171 DEBUG:teuthology.orchestra.run.smithi012:> import glob 2024-09-11T23:04:23.171 DEBUG:teuthology.orchestra.run.smithi012:> import re 2024-09-11T23:04:23.171 DEBUG:teuthology.orchestra.run.smithi012:> import os 2024-09-11T23:04:23.171 DEBUG:teuthology.orchestra.run.smithi012:> import subprocess 2024-09-11T23:04:23.171 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:04:23.171 DEBUG:teuthology.orchestra.run.smithi012:> def _find_admin_socket(client_name): 2024-09-11T23:04:23.171 DEBUG:teuthology.orchestra.run.smithi012:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-11T23:04:23.171 DEBUG:teuthology.orchestra.run.smithi012:> files = glob.glob(asok_path) 2024-09-11T23:04:23.171 DEBUG:teuthology.orchestra.run.smithi012:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-11T23:04:23.171 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:04:23.171 DEBUG:teuthology.orchestra.run.smithi012:> # Given a non-glob path, it better be there 2024-09-11T23:04:23.171 DEBUG:teuthology.orchestra.run.smithi012:> if "*" not in asok_path: 2024-09-11T23:04:23.172 DEBUG:teuthology.orchestra.run.smithi012:> assert(len(files) == 1) 2024-09-11T23:04:23.172 DEBUG:teuthology.orchestra.run.smithi012:> return files[0] 2024-09-11T23:04:23.172 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:04:23.172 DEBUG:teuthology.orchestra.run.smithi012:> for f in files: 2024-09-11T23:04:23.172 DEBUG:teuthology.orchestra.run.smithi012:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T23:04:23.172 DEBUG:teuthology.orchestra.run.smithi012:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T23:04:23.172 DEBUG:teuthology.orchestra.run.smithi012:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T23:04:23.172 DEBUG:teuthology.orchestra.run.smithi012:> contents = proc_f.read() 2024-09-11T23:04:23.172 DEBUG:teuthology.orchestra.run.smithi012:> if mountpoint in contents: 2024-09-11T23:04:23.172 DEBUG:teuthology.orchestra.run.smithi012:> return f 2024-09-11T23:04:23.172 DEBUG:teuthology.orchestra.run.smithi012:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T23:04:23.172 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:04:23.172 DEBUG:teuthology.orchestra.run.smithi012:> print(_find_admin_socket("client.0")) 2024-09-11T23:04:23.172 DEBUG:teuthology.orchestra.run.smithi012:> ' 2024-09-11T23:04:23.257 INFO:teuthology.orchestra.run.smithi012.stdout:/var/run/ceph/ceph-client.0.34896.asok 2024-09-11T23:04:23.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:04:23.268 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.34896.asok 2024-09-11T23:04:23.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:23.269 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.34896.asok mds_sessions 2024-09-11T23:04:23.425 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T23:04:23.425 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4408, 2024-09-11T23:04:23.425 INFO:teuthology.orchestra.run.smithi012.stdout: "inst": { 2024-09-11T23:04:23.425 INFO:teuthology.orchestra.run.smithi012.stdout: "name": { 2024-09-11T23:04:23.425 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "client", 2024-09-11T23:04:23.425 INFO:teuthology.orchestra.run.smithi012.stdout: "num": 4408 2024-09-11T23:04:23.425 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:23.425 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": { 2024-09-11T23:04:23.425 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T23:04:23.425 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "192.168.0.1:0", 2024-09-11T23:04:23.426 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 3959759667 2024-09-11T23:04:23.426 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:04:23.426 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:23.426 INFO:teuthology.orchestra.run.smithi012.stdout: "inst_str": "client.4408 v1:192.168.0.1:0/3959759667", 2024-09-11T23:04:23.426 INFO:teuthology.orchestra.run.smithi012.stdout: "addr_str": "v1:192.168.0.1:0/3959759667", 2024-09-11T23:04:23.426 INFO:teuthology.orchestra.run.smithi012.stdout: "sessions": [ 2024-09-11T23:04:23.426 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:04:23.426 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": 0, 2024-09-11T23:04:23.426 INFO:teuthology.orchestra.run.smithi012.stdout: "addrs": { 2024-09-11T23:04:23.426 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T23:04:23.426 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:04:23.427 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T23:04:23.427 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6828", 2024-09-11T23:04:23.427 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 514415350 2024-09-11T23:04:23.427 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:23.427 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:04:23.427 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T23:04:23.427 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6829", 2024-09-11T23:04:23.427 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 514415350 2024-09-11T23:04:23.427 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:04:23.427 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T23:04:23.427 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:23.428 INFO:teuthology.orchestra.run.smithi012.stdout: "seq": 0, 2024-09-11T23:04:23.428 INFO:teuthology.orchestra.run.smithi012.stdout: "cap_gen": 0, 2024-09-11T23:04:23.428 INFO:teuthology.orchestra.run.smithi012.stdout: "cap_ttl": "2024-09-11T23:05:14.291867+0000", 2024-09-11T23:04:23.428 INFO:teuthology.orchestra.run.smithi012.stdout: "last_cap_renew_request": "2024-09-11T23:04:14.291867+0000", 2024-09-11T23:04:23.428 INFO:teuthology.orchestra.run.smithi012.stdout: "cap_renew_seq": 2, 2024-09-11T23:04:23.428 INFO:teuthology.orchestra.run.smithi012.stdout: "num_caps": 1, 2024-09-11T23:04:23.428 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "open" 2024-09-11T23:04:23.428 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:04:23.428 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-11T23:04:23.428 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 16 2024-09-11T23:04:23.428 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T23:04:24.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:24.440 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec cephfs-top --id=admin --dump) 2024-09-11T23:04:24.530 INFO:teuthology.orchestra.run.smithi012.stdout:{"date": "Wed Sep 11 23:04:24 2024", "client_count": {"total_clients": 0, "fuse": 0, "kclient": 0, "libcephfs": 0}, "filesystems": {"cephfs": {}}} 2024-09-11T23:04:24.539 DEBUG:teuthology.orchestra.run.smithi012:> sudo stdin-killer -- python3 -c ' 2024-09-11T23:04:24.539 DEBUG:teuthology.orchestra.run.smithi012:> import glob 2024-09-11T23:04:24.540 DEBUG:teuthology.orchestra.run.smithi012:> import re 2024-09-11T23:04:24.540 DEBUG:teuthology.orchestra.run.smithi012:> import os 2024-09-11T23:04:24.540 DEBUG:teuthology.orchestra.run.smithi012:> import subprocess 2024-09-11T23:04:24.540 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:04:24.540 DEBUG:teuthology.orchestra.run.smithi012:> def _find_admin_socket(client_name): 2024-09-11T23:04:24.540 DEBUG:teuthology.orchestra.run.smithi012:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-11T23:04:24.540 DEBUG:teuthology.orchestra.run.smithi012:> files = glob.glob(asok_path) 2024-09-11T23:04:24.540 DEBUG:teuthology.orchestra.run.smithi012:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-11T23:04:24.540 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:04:24.540 DEBUG:teuthology.orchestra.run.smithi012:> # Given a non-glob path, it better be there 2024-09-11T23:04:24.540 DEBUG:teuthology.orchestra.run.smithi012:> if "*" not in asok_path: 2024-09-11T23:04:24.541 DEBUG:teuthology.orchestra.run.smithi012:> assert(len(files) == 1) 2024-09-11T23:04:24.541 DEBUG:teuthology.orchestra.run.smithi012:> return files[0] 2024-09-11T23:04:24.541 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:04:24.541 DEBUG:teuthology.orchestra.run.smithi012:> for f in files: 2024-09-11T23:04:24.541 DEBUG:teuthology.orchestra.run.smithi012:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T23:04:24.541 DEBUG:teuthology.orchestra.run.smithi012:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T23:04:24.541 DEBUG:teuthology.orchestra.run.smithi012:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T23:04:24.541 DEBUG:teuthology.orchestra.run.smithi012:> contents = proc_f.read() 2024-09-11T23:04:24.541 DEBUG:teuthology.orchestra.run.smithi012:> if mountpoint in contents: 2024-09-11T23:04:24.541 DEBUG:teuthology.orchestra.run.smithi012:> return f 2024-09-11T23:04:24.541 DEBUG:teuthology.orchestra.run.smithi012:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T23:04:24.541 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:04:24.542 DEBUG:teuthology.orchestra.run.smithi012:> print(_find_admin_socket("client.0")) 2024-09-11T23:04:24.542 DEBUG:teuthology.orchestra.run.smithi012:> ' 2024-09-11T23:04:24.554 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:04:24.609 INFO:teuthology.orchestra.run.smithi012.stdout:/var/run/ceph/ceph-client.0.34896.asok 2024-09-11T23:04:24.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:04:24.620 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.34896.asok 2024-09-11T23:04:24.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:24.621 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.34896.asok mds_sessions 2024-09-11T23:04:24.778 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T23:04:24.778 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4408, 2024-09-11T23:04:24.779 INFO:teuthology.orchestra.run.smithi012.stdout: "inst": { 2024-09-11T23:04:24.779 INFO:teuthology.orchestra.run.smithi012.stdout: "name": { 2024-09-11T23:04:24.779 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "client", 2024-09-11T23:04:24.779 INFO:teuthology.orchestra.run.smithi012.stdout: "num": 4408 2024-09-11T23:04:24.779 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:24.779 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": { 2024-09-11T23:04:24.779 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T23:04:24.779 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "192.168.0.1:0", 2024-09-11T23:04:24.779 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 3959759667 2024-09-11T23:04:24.779 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:04:24.779 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:24.779 INFO:teuthology.orchestra.run.smithi012.stdout: "inst_str": "client.4408 v1:192.168.0.1:0/3959759667", 2024-09-11T23:04:24.779 INFO:teuthology.orchestra.run.smithi012.stdout: "addr_str": "v1:192.168.0.1:0/3959759667", 2024-09-11T23:04:24.779 INFO:teuthology.orchestra.run.smithi012.stdout: "sessions": [ 2024-09-11T23:04:24.780 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:04:24.780 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": 0, 2024-09-11T23:04:24.780 INFO:teuthology.orchestra.run.smithi012.stdout: "addrs": { 2024-09-11T23:04:24.780 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T23:04:24.780 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:04:24.780 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T23:04:24.780 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6828", 2024-09-11T23:04:24.780 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 514415350 2024-09-11T23:04:24.780 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:24.780 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:04:24.780 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T23:04:24.781 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6829", 2024-09-11T23:04:24.781 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 514415350 2024-09-11T23:04:24.781 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:04:24.781 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T23:04:24.781 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:24.781 INFO:teuthology.orchestra.run.smithi012.stdout: "seq": 0, 2024-09-11T23:04:24.781 INFO:teuthology.orchestra.run.smithi012.stdout: "cap_gen": 0, 2024-09-11T23:04:24.781 INFO:teuthology.orchestra.run.smithi012.stdout: "cap_ttl": "2024-09-11T23:05:14.291867+0000", 2024-09-11T23:04:24.781 INFO:teuthology.orchestra.run.smithi012.stdout: "last_cap_renew_request": "2024-09-11T23:04:14.291867+0000", 2024-09-11T23:04:24.781 INFO:teuthology.orchestra.run.smithi012.stdout: "cap_renew_seq": 2, 2024-09-11T23:04:24.781 INFO:teuthology.orchestra.run.smithi012.stdout: "num_caps": 1, 2024-09-11T23:04:24.781 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "open" 2024-09-11T23:04:24.782 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:04:24.782 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-11T23:04:24.782 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 16 2024-09-11T23:04:24.782 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T23:04:25.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:25.794 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec cephfs-top --id=admin --dump) 2024-09-11T23:04:25.882 INFO:teuthology.orchestra.run.smithi012.stdout:{"date": "Wed Sep 11 23:04:25 2024", "client_count": {"total_clients": 0, "fuse": 0, "kclient": 0, "libcephfs": 0}, "filesystems": {"cephfs": {}}} 2024-09-11T23:04:25.891 DEBUG:teuthology.orchestra.run.smithi012:> sudo stdin-killer -- python3 -c ' 2024-09-11T23:04:25.891 DEBUG:teuthology.orchestra.run.smithi012:> import glob 2024-09-11T23:04:25.891 DEBUG:teuthology.orchestra.run.smithi012:> import re 2024-09-11T23:04:25.891 DEBUG:teuthology.orchestra.run.smithi012:> import os 2024-09-11T23:04:25.891 DEBUG:teuthology.orchestra.run.smithi012:> import subprocess 2024-09-11T23:04:25.891 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:04:25.891 DEBUG:teuthology.orchestra.run.smithi012:> def _find_admin_socket(client_name): 2024-09-11T23:04:25.892 DEBUG:teuthology.orchestra.run.smithi012:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-11T23:04:25.892 DEBUG:teuthology.orchestra.run.smithi012:> files = glob.glob(asok_path) 2024-09-11T23:04:25.892 DEBUG:teuthology.orchestra.run.smithi012:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-11T23:04:25.892 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:04:25.892 DEBUG:teuthology.orchestra.run.smithi012:> # Given a non-glob path, it better be there 2024-09-11T23:04:25.892 DEBUG:teuthology.orchestra.run.smithi012:> if "*" not in asok_path: 2024-09-11T23:04:25.892 DEBUG:teuthology.orchestra.run.smithi012:> assert(len(files) == 1) 2024-09-11T23:04:25.892 DEBUG:teuthology.orchestra.run.smithi012:> return files[0] 2024-09-11T23:04:25.892 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:04:25.892 DEBUG:teuthology.orchestra.run.smithi012:> for f in files: 2024-09-11T23:04:25.892 DEBUG:teuthology.orchestra.run.smithi012:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T23:04:25.892 DEBUG:teuthology.orchestra.run.smithi012:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T23:04:25.892 DEBUG:teuthology.orchestra.run.smithi012:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T23:04:25.892 DEBUG:teuthology.orchestra.run.smithi012:> contents = proc_f.read() 2024-09-11T23:04:25.893 DEBUG:teuthology.orchestra.run.smithi012:> if mountpoint in contents: 2024-09-11T23:04:25.893 DEBUG:teuthology.orchestra.run.smithi012:> return f 2024-09-11T23:04:25.893 DEBUG:teuthology.orchestra.run.smithi012:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T23:04:25.893 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:04:25.894 DEBUG:teuthology.orchestra.run.smithi012:> print(_find_admin_socket("client.0")) 2024-09-11T23:04:25.894 DEBUG:teuthology.orchestra.run.smithi012:> ' 2024-09-11T23:04:25.967 INFO:teuthology.orchestra.run.smithi012.stdout:/var/run/ceph/ceph-client.0.34896.asok 2024-09-11T23:04:25.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:04:25.979 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.34896.asok 2024-09-11T23:04:25.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:25.980 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.34896.asok mds_sessions 2024-09-11T23:04:26.144 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T23:04:26.145 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4408, 2024-09-11T23:04:26.145 INFO:teuthology.orchestra.run.smithi012.stdout: "inst": { 2024-09-11T23:04:26.145 INFO:teuthology.orchestra.run.smithi012.stdout: "name": { 2024-09-11T23:04:26.145 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "client", 2024-09-11T23:04:26.145 INFO:teuthology.orchestra.run.smithi012.stdout: "num": 4408 2024-09-11T23:04:26.145 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:26.145 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": { 2024-09-11T23:04:26.145 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T23:04:26.145 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "192.168.0.1:0", 2024-09-11T23:04:26.145 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 3959759667 2024-09-11T23:04:26.145 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:04:26.145 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:26.145 INFO:teuthology.orchestra.run.smithi012.stdout: "inst_str": "client.4408 v1:192.168.0.1:0/3959759667", 2024-09-11T23:04:26.145 INFO:teuthology.orchestra.run.smithi012.stdout: "addr_str": "v1:192.168.0.1:0/3959759667", 2024-09-11T23:04:26.146 INFO:teuthology.orchestra.run.smithi012.stdout: "sessions": [ 2024-09-11T23:04:26.146 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:04:26.146 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": 0, 2024-09-11T23:04:26.146 INFO:teuthology.orchestra.run.smithi012.stdout: "addrs": { 2024-09-11T23:04:26.146 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T23:04:26.146 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:04:26.146 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T23:04:26.146 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6828", 2024-09-11T23:04:26.146 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 514415350 2024-09-11T23:04:26.146 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:26.146 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:04:26.146 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T23:04:26.146 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6829", 2024-09-11T23:04:26.146 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 514415350 2024-09-11T23:04:26.147 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:04:26.147 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T23:04:26.147 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:26.147 INFO:teuthology.orchestra.run.smithi012.stdout: "seq": 0, 2024-09-11T23:04:26.147 INFO:teuthology.orchestra.run.smithi012.stdout: "cap_gen": 0, 2024-09-11T23:04:26.147 INFO:teuthology.orchestra.run.smithi012.stdout: "cap_ttl": "2024-09-11T23:05:14.291867+0000", 2024-09-11T23:04:26.147 INFO:teuthology.orchestra.run.smithi012.stdout: "last_cap_renew_request": "2024-09-11T23:04:14.291867+0000", 2024-09-11T23:04:26.147 INFO:teuthology.orchestra.run.smithi012.stdout: "cap_renew_seq": 2, 2024-09-11T23:04:26.147 INFO:teuthology.orchestra.run.smithi012.stdout: "num_caps": 1, 2024-09-11T23:04:26.147 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "open" 2024-09-11T23:04:26.147 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:04:26.147 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-11T23:04:26.147 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 16 2024-09-11T23:04:26.147 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T23:04:27.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:27.156 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec cephfs-top --id=admin --dump) 2024-09-11T23:04:27.246 INFO:teuthology.orchestra.run.smithi012.stdout:{"date": "Wed Sep 11 23:04:27 2024", "client_count": {"total_clients": 0, "fuse": 0, "kclient": 0, "libcephfs": 0}, "filesystems": {"cephfs": {}}} 2024-09-11T23:04:27.255 DEBUG:teuthology.orchestra.run.smithi012:> sudo stdin-killer -- python3 -c ' 2024-09-11T23:04:27.255 DEBUG:teuthology.orchestra.run.smithi012:> import glob 2024-09-11T23:04:27.255 DEBUG:teuthology.orchestra.run.smithi012:> import re 2024-09-11T23:04:27.255 DEBUG:teuthology.orchestra.run.smithi012:> import os 2024-09-11T23:04:27.255 DEBUG:teuthology.orchestra.run.smithi012:> import subprocess 2024-09-11T23:04:27.256 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:04:27.256 DEBUG:teuthology.orchestra.run.smithi012:> def _find_admin_socket(client_name): 2024-09-11T23:04:27.256 DEBUG:teuthology.orchestra.run.smithi012:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-11T23:04:27.256 DEBUG:teuthology.orchestra.run.smithi012:> files = glob.glob(asok_path) 2024-09-11T23:04:27.256 DEBUG:teuthology.orchestra.run.smithi012:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-11T23:04:27.256 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:04:27.256 DEBUG:teuthology.orchestra.run.smithi012:> # Given a non-glob path, it better be there 2024-09-11T23:04:27.256 DEBUG:teuthology.orchestra.run.smithi012:> if "*" not in asok_path: 2024-09-11T23:04:27.256 DEBUG:teuthology.orchestra.run.smithi012:> assert(len(files) == 1) 2024-09-11T23:04:27.256 DEBUG:teuthology.orchestra.run.smithi012:> return files[0] 2024-09-11T23:04:27.256 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:04:27.256 DEBUG:teuthology.orchestra.run.smithi012:> for f in files: 2024-09-11T23:04:27.256 DEBUG:teuthology.orchestra.run.smithi012:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T23:04:27.256 DEBUG:teuthology.orchestra.run.smithi012:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T23:04:27.257 DEBUG:teuthology.orchestra.run.smithi012:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T23:04:27.257 DEBUG:teuthology.orchestra.run.smithi012:> contents = proc_f.read() 2024-09-11T23:04:27.257 DEBUG:teuthology.orchestra.run.smithi012:> if mountpoint in contents: 2024-09-11T23:04:27.257 DEBUG:teuthology.orchestra.run.smithi012:> return f 2024-09-11T23:04:27.257 DEBUG:teuthology.orchestra.run.smithi012:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T23:04:27.257 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:04:27.257 DEBUG:teuthology.orchestra.run.smithi012:> print(_find_admin_socket("client.0")) 2024-09-11T23:04:27.257 DEBUG:teuthology.orchestra.run.smithi012:> ' 2024-09-11T23:04:27.322 INFO:teuthology.orchestra.run.smithi012.stdout:/var/run/ceph/ceph-client.0.34896.asok 2024-09-11T23:04:27.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:04:27.333 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.34896.asok 2024-09-11T23:04:27.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:27.333 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.34896.asok mds_sessions 2024-09-11T23:04:27.484 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T23:04:27.484 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4408, 2024-09-11T23:04:27.484 INFO:teuthology.orchestra.run.smithi012.stdout: "inst": { 2024-09-11T23:04:27.484 INFO:teuthology.orchestra.run.smithi012.stdout: "name": { 2024-09-11T23:04:27.484 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "client", 2024-09-11T23:04:27.484 INFO:teuthology.orchestra.run.smithi012.stdout: "num": 4408 2024-09-11T23:04:27.484 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:27.484 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": { 2024-09-11T23:04:27.485 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T23:04:27.485 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "192.168.0.1:0", 2024-09-11T23:04:27.485 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 3959759667 2024-09-11T23:04:27.485 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:04:27.485 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:27.485 INFO:teuthology.orchestra.run.smithi012.stdout: "inst_str": "client.4408 v1:192.168.0.1:0/3959759667", 2024-09-11T23:04:27.485 INFO:teuthology.orchestra.run.smithi012.stdout: "addr_str": "v1:192.168.0.1:0/3959759667", 2024-09-11T23:04:27.485 INFO:teuthology.orchestra.run.smithi012.stdout: "sessions": [ 2024-09-11T23:04:27.485 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:04:27.485 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": 0, 2024-09-11T23:04:27.485 INFO:teuthology.orchestra.run.smithi012.stdout: "addrs": { 2024-09-11T23:04:27.485 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T23:04:27.485 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:04:27.486 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T23:04:27.486 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6828", 2024-09-11T23:04:27.486 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 514415350 2024-09-11T23:04:27.486 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:27.486 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:04:27.486 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T23:04:27.486 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6829", 2024-09-11T23:04:27.486 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 514415350 2024-09-11T23:04:27.486 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:04:27.486 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T23:04:27.486 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:27.486 INFO:teuthology.orchestra.run.smithi012.stdout: "seq": 0, 2024-09-11T23:04:27.486 INFO:teuthology.orchestra.run.smithi012.stdout: "cap_gen": 0, 2024-09-11T23:04:27.487 INFO:teuthology.orchestra.run.smithi012.stdout: "cap_ttl": "2024-09-11T23:05:14.291867+0000", 2024-09-11T23:04:27.487 INFO:teuthology.orchestra.run.smithi012.stdout: "last_cap_renew_request": "2024-09-11T23:04:14.291867+0000", 2024-09-11T23:04:27.487 INFO:teuthology.orchestra.run.smithi012.stdout: "cap_renew_seq": 2, 2024-09-11T23:04:27.487 INFO:teuthology.orchestra.run.smithi012.stdout: "num_caps": 1, 2024-09-11T23:04:27.487 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "open" 2024-09-11T23:04:27.487 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:04:27.487 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-11T23:04:27.487 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 16 2024-09-11T23:04:27.487 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T23:04:28.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:28.499 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec cephfs-top --id=admin --dump) 2024-09-11T23:04:28.591 INFO:teuthology.orchestra.run.smithi012.stdout:{"date": "Wed Sep 11 23:04:28 2024", "client_count": {"total_clients": 4, "fuse": 2, "kclient": 0, "libcephfs": 2}, "filesystems": {"cephfs": {"4408": {"mount_root": "/", "chit": 78.57, "dlease": 0.0, "ofiles": "0", "oicaps": "1", "oinodes": "0", "rtio": 0.0, "raio": 0.0, "rsp": 0.0, "wtio": 0.0, "waio": 0.0, "wsp": 0.0, "rlatavg": 0.0, "rlatsd": 0.0, "wlatavg": 0.0, "wlatsd": 0.0, "mlatavg": 0.59, "mlatsd": 0.2, "mount_point@host/addr": "/home/ubuntu/cephtest/mnt.0@smithi012/192.168.0.1"}, "4414": {"mount_root": "/", "chit": 66.67, "dlease": 0.0, "ofiles": "0", "oicaps": "1", "oinodes": "0", "rtio": 0.0, "raio": 0.0, "rsp": 0.0, "wtio": 0.0, "waio": 0.0, "wsp": 0.0, "rlatavg": 0.0, "rlatsd": 0.0, "wlatavg": 0.0, "wlatsd": 0.0, "mlatavg": 0.58, "mlatsd": 0.0, "mount_point@host/addr": "/home/ubuntu/cephtest/mnt.1@smithi012/192.168.0.2"}, "4432": {"mount_root": "/", "chit": 100.0, "dlease": 0.0, "ofiles": "0", "oicaps": "1", "oinodes": "0", "rtio": 0.0, "raio": 0.0, "rsp": 0.0, "wtio": 0.0, "waio": 0.0, "wsp": 0.0, "rlatavg": 0.0, "rlatsd": 0.0, "wlatavg": 0.0, "wlatsd": 0.0, "mlatavg": 0.55, "mlatsd": 0.0, "mount_point@host/addr": "N/A@smithi012/172.21.15.12"}, "4433": {"mount_root": "/", "chit": 100.0, "dlease": 0.0, "ofiles": "0", "oicaps": "1", "oinodes": "0", "rtio": 0.0, "raio": 0.0, "rsp": 0.0, "wtio": 0.0, "waio": 0.0, "wsp": 0.0, "rlatavg": 0.0, "rlatsd": 0.0, "wlatavg": 0.0, "wlatsd": 0.0, "mlatavg": 0.72, "mlatsd": 0.0, "mount_point@host/addr": "N/A@smithi012/172.21.15.12"}}}} 2024-09-11T23:04:28.600 DEBUG:teuthology.orchestra.run.smithi012:> sudo stdin-killer -- python3 -c ' 2024-09-11T23:04:28.600 DEBUG:teuthology.orchestra.run.smithi012:> import glob 2024-09-11T23:04:28.600 DEBUG:teuthology.orchestra.run.smithi012:> import re 2024-09-11T23:04:28.600 DEBUG:teuthology.orchestra.run.smithi012:> import os 2024-09-11T23:04:28.600 DEBUG:teuthology.orchestra.run.smithi012:> import subprocess 2024-09-11T23:04:28.600 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:04:28.600 DEBUG:teuthology.orchestra.run.smithi012:> def _find_admin_socket(client_name): 2024-09-11T23:04:28.601 DEBUG:teuthology.orchestra.run.smithi012:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-11T23:04:28.601 DEBUG:teuthology.orchestra.run.smithi012:> files = glob.glob(asok_path) 2024-09-11T23:04:28.601 DEBUG:teuthology.orchestra.run.smithi012:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-11T23:04:28.601 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:04:28.601 DEBUG:teuthology.orchestra.run.smithi012:> # Given a non-glob path, it better be there 2024-09-11T23:04:28.601 DEBUG:teuthology.orchestra.run.smithi012:> if "*" not in asok_path: 2024-09-11T23:04:28.601 DEBUG:teuthology.orchestra.run.smithi012:> assert(len(files) == 1) 2024-09-11T23:04:28.601 DEBUG:teuthology.orchestra.run.smithi012:> return files[0] 2024-09-11T23:04:28.601 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:04:28.601 DEBUG:teuthology.orchestra.run.smithi012:> for f in files: 2024-09-11T23:04:28.601 DEBUG:teuthology.orchestra.run.smithi012:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T23:04:28.601 DEBUG:teuthology.orchestra.run.smithi012:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T23:04:28.601 DEBUG:teuthology.orchestra.run.smithi012:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T23:04:28.601 DEBUG:teuthology.orchestra.run.smithi012:> contents = proc_f.read() 2024-09-11T23:04:28.602 DEBUG:teuthology.orchestra.run.smithi012:> if mountpoint in contents: 2024-09-11T23:04:28.602 DEBUG:teuthology.orchestra.run.smithi012:> return f 2024-09-11T23:04:28.602 DEBUG:teuthology.orchestra.run.smithi012:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T23:04:28.602 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:04:28.602 DEBUG:teuthology.orchestra.run.smithi012:> print(_find_admin_socket("client.0")) 2024-09-11T23:04:28.602 DEBUG:teuthology.orchestra.run.smithi012:> ' 2024-09-11T23:04:28.674 INFO:teuthology.orchestra.run.smithi012.stdout:/var/run/ceph/ceph-client.0.34896.asok 2024-09-11T23:04:28.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:04:28.686 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.34896.asok 2024-09-11T23:04:28.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:28.686 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.34896.asok mds_sessions 2024-09-11T23:04:28.845 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T23:04:28.845 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4408, 2024-09-11T23:04:28.845 INFO:teuthology.orchestra.run.smithi012.stdout: "inst": { 2024-09-11T23:04:28.845 INFO:teuthology.orchestra.run.smithi012.stdout: "name": { 2024-09-11T23:04:28.845 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "client", 2024-09-11T23:04:28.845 INFO:teuthology.orchestra.run.smithi012.stdout: "num": 4408 2024-09-11T23:04:28.845 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:28.845 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": { 2024-09-11T23:04:28.845 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T23:04:28.845 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "192.168.0.1:0", 2024-09-11T23:04:28.846 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 3959759667 2024-09-11T23:04:28.846 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:04:28.846 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:28.846 INFO:teuthology.orchestra.run.smithi012.stdout: "inst_str": "client.4408 v1:192.168.0.1:0/3959759667", 2024-09-11T23:04:28.846 INFO:teuthology.orchestra.run.smithi012.stdout: "addr_str": "v1:192.168.0.1:0/3959759667", 2024-09-11T23:04:28.846 INFO:teuthology.orchestra.run.smithi012.stdout: "sessions": [ 2024-09-11T23:04:28.846 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:04:28.846 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": 0, 2024-09-11T23:04:28.846 INFO:teuthology.orchestra.run.smithi012.stdout: "addrs": { 2024-09-11T23:04:28.846 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T23:04:28.846 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:04:28.846 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T23:04:28.846 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6828", 2024-09-11T23:04:28.846 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 514415350 2024-09-11T23:04:28.847 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:28.847 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:04:28.847 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T23:04:28.847 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6829", 2024-09-11T23:04:28.847 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 514415350 2024-09-11T23:04:28.847 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:04:28.847 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T23:04:28.847 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:28.847 INFO:teuthology.orchestra.run.smithi012.stdout: "seq": 0, 2024-09-11T23:04:28.847 INFO:teuthology.orchestra.run.smithi012.stdout: "cap_gen": 0, 2024-09-11T23:04:28.847 INFO:teuthology.orchestra.run.smithi012.stdout: "cap_ttl": "2024-09-11T23:05:14.291867+0000", 2024-09-11T23:04:28.847 INFO:teuthology.orchestra.run.smithi012.stdout: "last_cap_renew_request": "2024-09-11T23:04:14.291867+0000", 2024-09-11T23:04:28.847 INFO:teuthology.orchestra.run.smithi012.stdout: "cap_renew_seq": 2, 2024-09-11T23:04:28.848 INFO:teuthology.orchestra.run.smithi012.stdout: "num_caps": 1, 2024-09-11T23:04:28.848 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "open" 2024-09-11T23:04:28.848 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:04:28.848 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-11T23:04:28.848 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 16 2024-09-11T23:04:28.848 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T23:04:28.859 DEBUG:teuthology.orchestra.run.smithi012:> sudo stdin-killer -- python3 -c ' 2024-09-11T23:04:28.859 DEBUG:teuthology.orchestra.run.smithi012:> import glob 2024-09-11T23:04:28.859 DEBUG:teuthology.orchestra.run.smithi012:> import re 2024-09-11T23:04:28.859 DEBUG:teuthology.orchestra.run.smithi012:> import os 2024-09-11T23:04:28.859 DEBUG:teuthology.orchestra.run.smithi012:> import subprocess 2024-09-11T23:04:28.859 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:04:28.859 DEBUG:teuthology.orchestra.run.smithi012:> def _find_admin_socket(client_name): 2024-09-11T23:04:28.859 DEBUG:teuthology.orchestra.run.smithi012:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-11T23:04:28.859 DEBUG:teuthology.orchestra.run.smithi012:> files = glob.glob(asok_path) 2024-09-11T23:04:28.859 DEBUG:teuthology.orchestra.run.smithi012:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-11T23:04:28.859 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:04:28.859 DEBUG:teuthology.orchestra.run.smithi012:> # Given a non-glob path, it better be there 2024-09-11T23:04:28.859 DEBUG:teuthology.orchestra.run.smithi012:> if "*" not in asok_path: 2024-09-11T23:04:28.860 DEBUG:teuthology.orchestra.run.smithi012:> assert(len(files) == 1) 2024-09-11T23:04:28.860 DEBUG:teuthology.orchestra.run.smithi012:> return files[0] 2024-09-11T23:04:28.860 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:04:28.860 DEBUG:teuthology.orchestra.run.smithi012:> for f in files: 2024-09-11T23:04:28.860 DEBUG:teuthology.orchestra.run.smithi012:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T23:04:28.860 DEBUG:teuthology.orchestra.run.smithi012:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T23:04:28.860 DEBUG:teuthology.orchestra.run.smithi012:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T23:04:28.860 DEBUG:teuthology.orchestra.run.smithi012:> contents = proc_f.read() 2024-09-11T23:04:28.860 DEBUG:teuthology.orchestra.run.smithi012:> if mountpoint in contents: 2024-09-11T23:04:28.860 DEBUG:teuthology.orchestra.run.smithi012:> return f 2024-09-11T23:04:28.860 DEBUG:teuthology.orchestra.run.smithi012:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T23:04:28.860 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:04:28.860 DEBUG:teuthology.orchestra.run.smithi012:> print(_find_admin_socket("client.1")) 2024-09-11T23:04:28.860 DEBUG:teuthology.orchestra.run.smithi012:> ' 2024-09-11T23:04:28.939 INFO:teuthology.orchestra.run.smithi012.stdout:/var/run/ceph/ceph-client.1.35006.asok 2024-09-11T23:04:28.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:04:28.951 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.35006.asok 2024-09-11T23:04:28.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:28.952 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.35006.asok mds_sessions 2024-09-11T23:04:29.114 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T23:04:29.114 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4414, 2024-09-11T23:04:29.114 INFO:teuthology.orchestra.run.smithi012.stdout: "inst": { 2024-09-11T23:04:29.114 INFO:teuthology.orchestra.run.smithi012.stdout: "name": { 2024-09-11T23:04:29.114 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "client", 2024-09-11T23:04:29.114 INFO:teuthology.orchestra.run.smithi012.stdout: "num": 4414 2024-09-11T23:04:29.114 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:29.114 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": { 2024-09-11T23:04:29.115 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T23:04:29.115 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "192.168.0.2:0", 2024-09-11T23:04:29.115 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 3440998345 2024-09-11T23:04:29.115 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:04:29.115 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:29.115 INFO:teuthology.orchestra.run.smithi012.stdout: "inst_str": "client.4414 v1:192.168.0.2:0/3440998345", 2024-09-11T23:04:29.115 INFO:teuthology.orchestra.run.smithi012.stdout: "addr_str": "v1:192.168.0.2:0/3440998345", 2024-09-11T23:04:29.115 INFO:teuthology.orchestra.run.smithi012.stdout: "sessions": [ 2024-09-11T23:04:29.115 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:04:29.115 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": 0, 2024-09-11T23:04:29.115 INFO:teuthology.orchestra.run.smithi012.stdout: "addrs": { 2024-09-11T23:04:29.115 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T23:04:29.115 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:04:29.116 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T23:04:29.116 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6828", 2024-09-11T23:04:29.116 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 514415350 2024-09-11T23:04:29.116 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:29.116 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:04:29.116 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T23:04:29.116 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6829", 2024-09-11T23:04:29.116 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 514415350 2024-09-11T23:04:29.116 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:04:29.116 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T23:04:29.116 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:29.116 INFO:teuthology.orchestra.run.smithi012.stdout: "seq": 0, 2024-09-11T23:04:29.116 INFO:teuthology.orchestra.run.smithi012.stdout: "cap_gen": 0, 2024-09-11T23:04:29.116 INFO:teuthology.orchestra.run.smithi012.stdout: "cap_ttl": "2024-09-11T23:05:16.982678+0000", 2024-09-11T23:04:29.117 INFO:teuthology.orchestra.run.smithi012.stdout: "last_cap_renew_request": "2024-09-11T23:04:16.982678+0000", 2024-09-11T23:04:29.121 INFO:teuthology.orchestra.run.smithi012.stdout: "cap_renew_seq": 2, 2024-09-11T23:04:29.121 INFO:teuthology.orchestra.run.smithi012.stdout: "num_caps": 1, 2024-09-11T23:04:29.121 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "open" 2024-09-11T23:04:29.121 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:04:29.121 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-11T23:04:29.121 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 16 2024-09-11T23:04:29.121 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T23:04:29.128 DEBUG:tasks.cephfs.test_fstop:metrics={'date': 'Wed Sep 11 23:04:28 2024', 'client_count': {'total_clients': 4, 'fuse': 2, 'kclient': 0, 'libcephfs': 2}, 'filesystems': {'cephfs': {'4408': {'mount_root': '/', 'chit': 78.57, 'dlease': 0.0, 'ofiles': '0', 'oicaps': '1', 'oinodes': '0', 'rtio': 0.0, 'raio': 0.0, 'rsp': 0.0, 'wtio': 0.0, 'waio': 0.0, 'wsp': 0.0, 'rlatavg': 0.0, 'rlatsd': 0.0, 'wlatavg': 0.0, 'wlatsd': 0.0, 'mlatavg': 0.59, 'mlatsd': 0.2, 'mount_point@host/addr': '/home/ubuntu/cephtest/mnt.0@smithi012/192.168.0.1'}, '4414': {'mount_root': '/', 'chit': 66.67, 'dlease': 0.0, 'ofiles': '0', 'oicaps': '1', 'oinodes': '0', 'rtio': 0.0, 'raio': 0.0, 'rsp': 0.0, 'wtio': 0.0, 'waio': 0.0, 'wsp': 0.0, 'rlatavg': 0.0, 'rlatsd': 0.0, 'wlatavg': 0.0, 'wlatsd': 0.0, 'mlatavg': 0.58, 'mlatsd': 0.0, 'mount_point@host/addr': '/home/ubuntu/cephtest/mnt.1@smithi012/192.168.0.2'}, '4432': {'mount_root': '/', 'chit': 100.0, 'dlease': 0.0, 'ofiles': '0', 'oicaps': '1', 'oinodes': '0', 'rtio': 0.0, 'raio': 0.0, 'rsp': 0.0, 'wtio': 0.0, 'waio': 0.0, 'wsp': 0.0, 'rlatavg': 0.0, 'rlatsd': 0.0, 'wlatavg': 0.0, 'wlatsd': 0.0, 'mlatavg': 0.55, 'mlatsd': 0.0, 'mount_point@host/addr': 'N/A@smithi012/172.21.15.12'}, '4433': {'mount_root': '/', 'chit': 100.0, 'dlease': 0.0, 'ofiles': '0', 'oicaps': '1', 'oinodes': '0', 'rtio': 0.0, 'raio': 0.0, 'rsp': 0.0, 'wtio': 0.0, 'waio': 0.0, 'wsp': 0.0, 'rlatavg': 0.0, 'rlatsd': 0.0, 'wlatavg': 0.0, 'wlatsd': 0.0, 'mlatavg': 0.72, 'mlatsd': 0.0, 'mount_point@host/addr': 'N/A@smithi012/172.21.15.12'}}}} 2024-09-11T23:04:29.128 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable stats 2024-09-11T23:04:29.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:29.256+0000 7fc44ad1f640 1 Processor -- start 2024-09-11T23:04:29.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:29.256+0000 7fc44ad1f640 1 -- start start 2024-09-11T23:04:29.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:29.256+0000 7fc44ad1f640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc44409f190 0x7fc44413cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:29.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:29.256+0000 7fc44ad1f640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc44409d690 con 0x7fc444134800 2024-09-11T23:04:29.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:29.256+0000 7fc44ad1f640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fc44409e5a0 con 0x7fc44409f190 2024-09-11T23:04:29.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:29.260+0000 7fc448abb640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fc444134800 0x7fc444134be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38542/0 (socket says 172.21.15.12:38542) 2024-09-11T23:04:29.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:29.260+0000 7fc448abb640 1 -- 172.21.15.12:0/4210654588 learned_addr learned my addr 172.21.15.12:0/4210654588 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:04:29.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:29.260+0000 7fc443fff640 1 --2- 172.21.15.12:0/4210654588 >> v2:172.21.15.12:3300/0 conn(0x7fc44409f190 0x7fc44413cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:29.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:29.260+0000 7fc443fff640 1 -- 172.21.15.12:0/4210654588 >> v1:172.21.15.12:6789/0 conn(0x7fc444134800 legacy=0x7fc444134be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:29.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:29.260+0000 7fc443fff640 1 -- 172.21.15.12:0/4210654588 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc44409cf90 con 0x7fc44409f190 2024-09-11T23:04:29.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:29.260+0000 7fc443fff640 1 --2- 172.21.15.12:0/4210654588 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc44409f190 0x7fc44413cbc0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc434009d90 tx=0x7fc43401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76547c47700644ca server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:29.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:29.260+0000 7fc4437fe640 1 -- 172.21.15.12:0/4210654588 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4340b2070 con 0x7fc44409f190 2024-09-11T23:04:29.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:29.260+0000 7fc4437fe640 1 -- 172.21.15.12:0/4210654588 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4340a5760 con 0x7fc44409f190 2024-09-11T23:04:29.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:29.260+0000 7fc4437fe640 1 -- 172.21.15.12:0/4210654588 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4340a5a60 con 0x7fc44409f190 2024-09-11T23:04:29.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:29.260+0000 7fc44ad1f640 1 -- 172.21.15.12:0/4210654588 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc44409f190 msgr2=0x7fc44413cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:29.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:29.260+0000 7fc44ad1f640 1 --2- 172.21.15.12:0/4210654588 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc44409f190 0x7fc44413cbc0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc434009d90 tx=0x7fc43401c8e0 comp rx=0 tx=0).stop 2024-09-11T23:04:29.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:29.260+0000 7fc44ad1f640 1 -- 172.21.15.12:0/4210654588 shutdown_connections 2024-09-11T23:04:29.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:29.260+0000 7fc44ad1f640 1 --2- 172.21.15.12:0/4210654588 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc44409f190 0x7fc44413cbc0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:29.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:29.260+0000 7fc44ad1f640 1 -- 172.21.15.12:0/4210654588 >> 172.21.15.12:0/4210654588 conn(0x7fc4440a82f0 msgr2=0x7fc4440a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:29.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:29.260+0000 7fc44ad1f640 1 -- 172.21.15.12:0/4210654588 shutdown_connections 2024-09-11T23:04:29.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:29.260+0000 7fc44ad1f640 1 -- 172.21.15.12:0/4210654588 wait complete. 2024-09-11T23:04:29.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:29.264+0000 7fc44ad1f640 1 Processor -- start 2024-09-11T23:04:29.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:29.264+0000 7fc44ad1f640 1 -- start start 2024-09-11T23:04:29.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:29.264+0000 7fc44ad1f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc444134800 0x7fc44409a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:29.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:29.264+0000 7fc44ad1f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc44413fb30 con 0x7fc444134800 2024-09-11T23:04:29.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:29.264+0000 7fc448abb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc444134800 0x7fc44409a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:29.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:29.264+0000 7fc448abb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc444134800 0x7fc44409a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39234/0 (socket says 172.21.15.12:39234) 2024-09-11T23:04:29.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:29.264+0000 7fc448abb640 1 -- 172.21.15.12:0/1230276876 learned_addr learned my addr 172.21.15.12:0/1230276876 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:29.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:29.264+0000 7fc448abb640 1 -- 172.21.15.12:0/1230276876 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc44411fab0 con 0x7fc444134800 2024-09-11T23:04:29.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:29.264+0000 7fc448abb640 1 --2- 172.21.15.12:0/1230276876 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc444134800 0x7fc44409a9d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc42c00c480 tx=0x7fc42c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:29.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:29.264+0000 7fc4417fa640 1 -- 172.21.15.12:0/1230276876 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc42c017070 con 0x7fc444134800 2024-09-11T23:04:29.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:29.264+0000 7fc4417fa640 1 -- 172.21.15.12:0/1230276876 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc42c005c20 con 0x7fc444134800 2024-09-11T23:04:29.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:29.264+0000 7fc4417fa640 1 -- 172.21.15.12:0/1230276876 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc42c007070 con 0x7fc444134800 2024-09-11T23:04:29.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:29.264+0000 7fc44ad1f640 1 -- 172.21.15.12:0/1230276876 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc44411fd30 con 0x7fc444134800 2024-09-11T23:04:29.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:29.264+0000 7fc44ad1f640 1 -- 172.21.15.12:0/1230276876 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc44411f050 con 0x7fc444134800 2024-09-11T23:04:29.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:29.264+0000 7fc4417fa640 1 -- 172.21.15.12:0/1230276876 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 10) ==== 44164+0+0 (secure 0 0 0) 0x7fc42c01a070 con 0x7fc444134800 2024-09-11T23:04:29.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:29.264+0000 7fc44ad1f640 1 -- 172.21.15.12:0/1230276876 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc44409c100 con 0x7fc444134800 2024-09-11T23:04:29.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:29.264+0000 7fc4417fa640 1 --2- 172.21.15.12:0/1230276876 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7fc424035f20 0x7fc4240383e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:29.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:29.264+0000 7fc4417fa640 1 -- 172.21.15.12:0/1230276876 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 3697+0+0 (secure 0 0 0) 0x7fc42c047be0 con 0x7fc444134800 2024-09-11T23:04:29.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:29.264+0000 7fc443fff640 1 --2- 172.21.15.12:0/1230276876 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7fc424035f20 0x7fc4240383e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:29.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:29.264+0000 7fc443fff640 1 --2- 172.21.15.12:0/1230276876 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7fc424035f20 0x7fc4240383e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc4340af000 tx=0x7fc4340a7070 comp rx=0 tx=0).ready entity=mgr.4420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:29.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:29.272+0000 7fc4417fa640 1 -- 172.21.15.12:0/1230276876 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc44411fab0 con 0x7fc444134800 2024-09-11T23:04:29.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:29.476+0000 7fc44ad1f640 1 -- 172.21.15.12:0/1230276876 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "stats"} v 0) -- 0x7fc444134be0 con 0x7fc444134800 2024-09-11T23:04:30.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.208+0000 7fc4417fa640 1 -- 172.21.15.12:0/1230276876 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "stats"}]=0 v11) ==== 85+0+0 (secure 0 0 0) 0x7fc42c007210 con 0x7fc444134800 2024-09-11T23:04:30.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.212+0000 7fc44ad1f640 1 -- 172.21.15.12:0/1230276876 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7fc424035f20 msgr2=0x7fc4240383e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:30.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.212+0000 7fc44ad1f640 1 --2- 172.21.15.12:0/1230276876 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7fc424035f20 0x7fc4240383e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc4340af000 tx=0x7fc4340a7070 comp rx=0 tx=0).stop 2024-09-11T23:04:30.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.212+0000 7fc44ad1f640 1 -- 172.21.15.12:0/1230276876 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc444134800 msgr2=0x7fc44409a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:30.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.212+0000 7fc44ad1f640 1 --2- 172.21.15.12:0/1230276876 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc444134800 0x7fc44409a9d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc42c00c480 tx=0x7fc42c00c940 comp rx=0 tx=0).stop 2024-09-11T23:04:30.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.212+0000 7fc4417fa640 1 -- 172.21.15.12:0/1230276876 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mgrmap(e 11) ==== 44155+0+0 (secure 0 0 0) 0x7fc42c01b450 con 0x7fc444134800 2024-09-11T23:04:30.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.212+0000 7fc44ad1f640 1 -- 172.21.15.12:0/1230276876 shutdown_connections 2024-09-11T23:04:30.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.212+0000 7fc44ad1f640 1 --2- 172.21.15.12:0/1230276876 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7fc424035f20 0x7fc4240383e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:30.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.212+0000 7fc44ad1f640 1 --2- 172.21.15.12:0/1230276876 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc444134800 0x7fc44409a9d0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:30.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.212+0000 7fc44ad1f640 1 -- 172.21.15.12:0/1230276876 >> 172.21.15.12:0/1230276876 conn(0x7fc4440a82f0 msgr2=0x7fc4440a28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:30.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.212+0000 7fc44ad1f640 1 -- 172.21.15.12:0/1230276876 shutdown_connections 2024-09-11T23:04:30.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.212+0000 7fc44ad1f640 1 -- 172.21.15.12:0/1230276876 wait complete. 2024-09-11T23:04:30.235 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T23:04:30.236 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:04:30.269 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T23:04:30.270 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:04:30.270 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T23:04:30.270 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:04:30.322 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:04:30.340 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:30.340+0000 7fd20ac33180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T23:04:30.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.456+0000 7f632a049640 1 Processor -- start 2024-09-11T23:04:30.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.456+0000 7f632a049640 1 -- start start 2024-09-11T23:04:30.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.456+0000 7f632a049640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6324136cd0 0x7f632409f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:30.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.456+0000 7f632a049640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f632406ceb0 con 0x7f63241370b0 2024-09-11T23:04:30.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.456+0000 7f632a049640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f632406dd90 con 0x7f6324136cd0 2024-09-11T23:04:30.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.456+0000 7f63237fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6324136cd0 0x7f632409f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:30.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.456+0000 7f63237fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6324136cd0 0x7f632409f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39272/0 (socket says 172.21.15.12:39272) 2024-09-11T23:04:30.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.456+0000 7f63237fe640 1 -- 172.21.15.12:0/3478706119 learned_addr learned my addr 172.21.15.12:0/3478706119 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:30.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.456+0000 7f6322ffd640 1 --1- 172.21.15.12:0/3478706119 >> v1:172.21.15.12:6789/0 conn(0x7f63241370b0 0x7f63240a5b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38558/0 (socket says 172.21.15.12:38558) 2024-09-11T23:04:30.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.456+0000 7f63237fe640 1 -- 172.21.15.12:0/3478706119 >> v1:172.21.15.12:6789/0 conn(0x7f63241370b0 legacy=0x7f63240a5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:30.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.456+0000 7f63237fe640 1 -- 172.21.15.12:0/3478706119 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f632406eba0 con 0x7f6324136cd0 2024-09-11T23:04:30.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.456+0000 7f63237fe640 1 --2- 172.21.15.12:0/3478706119 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6324136cd0 0x7f632409f150 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f63140097f0 tx=0x7f631401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=689e57acc4a450eb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:30.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.460+0000 7f63227fc640 1 -- 172.21.15.12:0/3478706119 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63140ab3f0 con 0x7f6324136cd0 2024-09-11T23:04:30.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.460+0000 7f63227fc640 1 -- 172.21.15.12:0/3478706119 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63140b0070 con 0x7f6324136cd0 2024-09-11T23:04:30.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.460+0000 7f63227fc640 1 -- 172.21.15.12:0/3478706119 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63140ab6e0 con 0x7f6324136cd0 2024-09-11T23:04:30.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.460+0000 7f632a049640 1 -- 172.21.15.12:0/3478706119 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6324136cd0 msgr2=0x7f632409f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:30.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.460+0000 7f632a049640 1 --2- 172.21.15.12:0/3478706119 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6324136cd0 0x7f632409f150 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f63140097f0 tx=0x7f631401c4e0 comp rx=0 tx=0).stop 2024-09-11T23:04:30.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.460+0000 7f632a049640 1 -- 172.21.15.12:0/3478706119 shutdown_connections 2024-09-11T23:04:30.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.460+0000 7f632a049640 1 --2- 172.21.15.12:0/3478706119 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6324136cd0 0x7f632409f150 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:30.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.460+0000 7f632a049640 1 -- 172.21.15.12:0/3478706119 >> 172.21.15.12:0/3478706119 conn(0x7f63240aa740 msgr2=0x7f63240a6c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:30.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.460+0000 7f632a049640 1 -- 172.21.15.12:0/3478706119 shutdown_connections 2024-09-11T23:04:30.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.460+0000 7f632a049640 1 -- 172.21.15.12:0/3478706119 wait complete. 2024-09-11T23:04:30.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.460+0000 7f632a049640 1 Processor -- start 2024-09-11T23:04:30.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.460+0000 7f632a049640 1 -- start start 2024-09-11T23:04:30.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.460+0000 7f632a049640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6324136cd0 0x7f63241ce920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:30.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.460+0000 7f632a049640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6324142370 con 0x7f6324136cd0 2024-09-11T23:04:30.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.460+0000 7f63237fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6324136cd0 0x7f63241ce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:30.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.460+0000 7f63237fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6324136cd0 0x7f63241ce920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39276/0 (socket says 172.21.15.12:39276) 2024-09-11T23:04:30.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.460+0000 7f63237fe640 1 -- 172.21.15.12:0/2915462359 learned_addr learned my addr 172.21.15.12:0/2915462359 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:30.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.460+0000 7f63237fe640 1 -- 172.21.15.12:0/2915462359 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f632413e6f0 con 0x7f6324136cd0 2024-09-11T23:04:30.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.460+0000 7f63237fe640 1 --2- 172.21.15.12:0/2915462359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6324136cd0 0x7f63241ce920 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f63140ad040 tx=0x7f631401ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:30.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.460+0000 7f630bfff640 1 -- 172.21.15.12:0/2915462359 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63140be3f0 con 0x7f6324136cd0 2024-09-11T23:04:30.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.460+0000 7f630bfff640 1 -- 172.21.15.12:0/2915462359 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63140be5b0 con 0x7f6324136cd0 2024-09-11T23:04:30.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.460+0000 7f632a049640 1 -- 172.21.15.12:0/2915462359 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63241ce460 con 0x7f6324136cd0 2024-09-11T23:04:30.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.460+0000 7f630bfff640 1 -- 172.21.15.12:0/2915462359 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63140be8d0 con 0x7f6324136cd0 2024-09-11T23:04:30.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.460+0000 7f632a049640 1 -- 172.21.15.12:0/2915462359 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f632413f8a0 con 0x7f6324136cd0 2024-09-11T23:04:30.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.460+0000 7f630bfff640 1 -- 172.21.15.12:0/2915462359 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 11) ==== 44155+0+0 (secure 0 0 0) 0x7f63140c7440 con 0x7f6324136cd0 2024-09-11T23:04:30.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.460+0000 7f632a049640 1 -- 172.21.15.12:0/2915462359 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f632409f150 con 0x7f6324136cd0 2024-09-11T23:04:30.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.464+0000 7f630bfff640 1 --2- 172.21.15.12:0/2915462359 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7f6310035ed0 0x7f6310038390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:30.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.464+0000 7f630bfff640 1 -- 172.21.15.12:0/2915462359 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 3697+0+0 (secure 0 0 0) 0x7f63140e3030 con 0x7f6324136cd0 2024-09-11T23:04:30.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.464+0000 7f6322ffd640 1 -- 172.21.15.12:0/2915462359 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7f6310035ed0 msgr2=0x7f6310038390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6824/2217914063 2024-09-11T23:04:30.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.464+0000 7f6322ffd640 1 --2- 172.21.15.12:0/2915462359 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7f6310035ed0 0x7f6310038390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:04:30.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.468+0000 7f630bfff640 1 -- 172.21.15.12:0/2915462359 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f63140160d0 con 0x7f6324136cd0 2024-09-11T23:04:30.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.636+0000 7f632a049640 1 -- 172.21.15.12:0/2915462359 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f632406be50 con 0x7f6324136cd0 2024-09-11T23:04:30.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.636+0000 7f630bfff640 1 -- 172.21.15.12:0/2915462359 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 6 entries v26) ==== 80+0+353 (secure 0 0 0) 0x7f63140c79c0 con 0x7f6324136cd0 2024-09-11T23:04:30.639 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/255391181 2024-09-12T23:04:22.130661+0000 2024-09-11T23:04:30.639 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/2345769658 2024-09-12T23:04:22.130661+0000 2024-09-11T23:04:30.640 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/4120232861 2024-09-12T23:04:22.130661+0000 2024-09-11T23:04:30.640 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:6825/2765460338 2024-09-12T23:04:22.130661+0000 2024-09-11T23:04:30.640 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:6824/2765460338 2024-09-12T23:04:22.130661+0000 2024-09-11T23:04:30.640 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/1241865013 2024-09-12T23:04:22.130661+0000 2024-09-11T23:04:30.641 INFO:teuthology.orchestra.run.smithi012.stderr:listed 6 entries 2024-09-11T23:04:30.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.640+0000 7f632a049640 1 -- 172.21.15.12:0/2915462359 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7f6310035ed0 msgr2=0x7f6310038390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:04:30.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.640+0000 7f632a049640 1 --2- 172.21.15.12:0/2915462359 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7f6310035ed0 0x7f6310038390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:30.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.640+0000 7f632a049640 1 -- 172.21.15.12:0/2915462359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6324136cd0 msgr2=0x7f63241ce920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:30.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.640+0000 7f632a049640 1 --2- 172.21.15.12:0/2915462359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6324136cd0 0x7f63241ce920 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f63140ad040 tx=0x7f631401ad20 comp rx=0 tx=0).stop 2024-09-11T23:04:30.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.640+0000 7f632a049640 1 -- 172.21.15.12:0/2915462359 shutdown_connections 2024-09-11T23:04:30.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.640+0000 7f632a049640 1 --2- 172.21.15.12:0/2915462359 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7f6310035ed0 0x7f6310038390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:30.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.640+0000 7f632a049640 1 --2- 172.21.15.12:0/2915462359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6324136cd0 0x7f63241ce920 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:30.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.640+0000 7f632a049640 1 -- 172.21.15.12:0/2915462359 >> 172.21.15.12:0/2915462359 conn(0x7f63240aa740 msgr2=0x7f63240a4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:30.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.640+0000 7f632a049640 1 -- 172.21.15.12:0/2915462359 shutdown_connections 2024-09-11T23:04:30.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.640+0000 7f632a049640 1 -- 172.21.15.12:0/2915462359 wait complete. 2024-09-11T23:04:30.658 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi012.front.sepia.ceph.com... 2024-09-11T23:04:30.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:30.658 DEBUG:teuthology.orchestra.run.smithi012:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-11T23:04:30.669 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi012.stderr:ceph-fuse[34896]: fuse finished with error 0 and tester_r 0 2024-09-11T23:04:30.671 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi012.front.sepia.ceph.com 2024-09-11T23:04:30.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:30.671 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-11T23:04:30.738 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:30.736+0000 7fd20ac33180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T23:04:30.742 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:04:30.742 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T23:04:30.742 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:04:30.789 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:04:30.874 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:30.872+0000 7fd20ac33180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T23:04:30.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.964+0000 7fde9cc6b640 1 Processor -- start 2024-09-11T23:04:30.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.964+0000 7fde9cc6b640 1 -- start start 2024-09-11T23:04:30.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.964+0000 7fde9cc6b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fde98131480 0x7fde98131860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:30.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.964+0000 7fde9cc6b640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde980a0ea0 con 0x7fde98073460 2024-09-11T23:04:30.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.964+0000 7fde9cc6b640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fde980a0c40 con 0x7fde98131480 2024-09-11T23:04:30.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.964+0000 7fde9659c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fde98131480 0x7fde98131860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:30.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.964+0000 7fde8dd9b640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fde98073460 0x7fde98073840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38562/0 (socket says 172.21.15.12:38562) 2024-09-11T23:04:30.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.964+0000 7fde8dd9b640 1 -- 172.21.15.12:0/3744120479 learned_addr learned my addr 172.21.15.12:0/3744120479 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:04:30.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.964+0000 7fde9659c640 1 -- 172.21.15.12:0/3744120479 >> v1:172.21.15.12:6789/0 conn(0x7fde98073460 legacy=0x7fde98073840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:30.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.964+0000 7fde9659c640 1 -- 172.21.15.12:0/3744120479 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde98070c90 con 0x7fde98131480 2024-09-11T23:04:30.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.968+0000 7fde9659c640 1 --2- 172.21.15.12:0/3744120479 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde98131480 0x7fde98131860 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fde88009740 tx=0x7fde8801c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d701ac5e01d7c45 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:30.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.968+0000 7fde95d9b640 1 -- 172.21.15.12:0/3744120479 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde880b0070 con 0x7fde98131480 2024-09-11T23:04:30.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.968+0000 7fde95d9b640 1 -- 172.21.15.12:0/3744120479 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde880ab530 con 0x7fde98131480 2024-09-11T23:04:30.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.968+0000 7fde95d9b640 1 -- 172.21.15.12:0/3744120479 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde880ab830 con 0x7fde98131480 2024-09-11T23:04:30.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.968+0000 7fde9cc6b640 1 -- 172.21.15.12:0/3744120479 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde98131480 msgr2=0x7fde98131860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:30.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.968+0000 7fde9cc6b640 1 --2- 172.21.15.12:0/3744120479 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde98131480 0x7fde98131860 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fde88009740 tx=0x7fde8801c390 comp rx=0 tx=0).stop 2024-09-11T23:04:30.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.968+0000 7fde9cc6b640 1 -- 172.21.15.12:0/3744120479 shutdown_connections 2024-09-11T23:04:30.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.968+0000 7fde9cc6b640 1 --2- 172.21.15.12:0/3744120479 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde98131480 0x7fde98131860 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:30.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.968+0000 7fde9cc6b640 1 -- 172.21.15.12:0/3744120479 >> 172.21.15.12:0/3744120479 conn(0x7fde9809aba0 msgr2=0x7fde9809afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:30.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.968+0000 7fde9cc6b640 1 -- 172.21.15.12:0/3744120479 shutdown_connections 2024-09-11T23:04:30.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.968+0000 7fde9cc6b640 1 -- 172.21.15.12:0/3744120479 wait complete. 2024-09-11T23:04:30.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.968+0000 7fde9cc6b640 1 Processor -- start 2024-09-11T23:04:30.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.968+0000 7fde9cc6b640 1 -- start start 2024-09-11T23:04:30.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.968+0000 7fde9cc6b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde98073460 0x7fde980a2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:30.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.968+0000 7fde9cc6b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fde9809bcf0 con 0x7fde98073460 2024-09-11T23:04:30.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.968+0000 7fde9659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde98073460 0x7fde980a2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:30.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.968+0000 7fde9659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde98073460 0x7fde980a2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39302/0 (socket says 172.21.15.12:39302) 2024-09-11T23:04:30.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.968+0000 7fde9659c640 1 -- 172.21.15.12:0/1154782078 learned_addr learned my addr 172.21.15.12:0/1154782078 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:30.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.968+0000 7fde9659c640 1 -- 172.21.15.12:0/1154782078 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde9813b820 con 0x7fde98073460 2024-09-11T23:04:30.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.968+0000 7fde9659c640 1 --2- 172.21.15.12:0/1154782078 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde98073460 0x7fde980a2530 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fde88019fc0 tx=0x7fde88019130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:30.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.968+0000 7fde8f7fe640 1 -- 172.21.15.12:0/1154782078 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde880b8020 con 0x7fde98073460 2024-09-11T23:04:30.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.968+0000 7fde8f7fe640 1 -- 172.21.15.12:0/1154782078 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde880b4410 con 0x7fde98073460 2024-09-11T23:04:30.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.968+0000 7fde9cc6b640 1 -- 172.21.15.12:0/1154782078 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde9812f7a0 con 0x7fde98073460 2024-09-11T23:04:30.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.968+0000 7fde8f7fe640 1 -- 172.21.15.12:0/1154782078 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde880b0040 con 0x7fde98073460 2024-09-11T23:04:30.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.968+0000 7fde9cc6b640 1 -- 172.21.15.12:0/1154782078 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde980a1800 con 0x7fde98073460 2024-09-11T23:04:30.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.972+0000 7fde9cc6b640 1 -- 172.21.15.12:0/1154782078 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde98070770 con 0x7fde98073460 2024-09-11T23:04:30.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.972+0000 7fde8f7fe640 1 -- 172.21.15.12:0/1154782078 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 11) ==== 44155+0+0 (secure 0 0 0) 0x7fde880bb020 con 0x7fde98073460 2024-09-11T23:04:30.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.972+0000 7fde8f7fe640 1 --2- 172.21.15.12:0/1154782078 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7fde78035ed0 0x7fde78038390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:30.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.972+0000 7fde8f7fe640 1 -- 172.21.15.12:0/1154782078 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 3697+0+0 (secure 0 0 0) 0x7fde880e2700 con 0x7fde98073460 2024-09-11T23:04:30.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.972+0000 7fde8dd9b640 1 -- 172.21.15.12:0/1154782078 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7fde78035ed0 msgr2=0x7fde78038390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6824/2217914063 2024-09-11T23:04:30.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.972+0000 7fde8dd9b640 1 --2- 172.21.15.12:0/1154782078 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7fde78035ed0 0x7fde78038390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:04:30.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:30.976+0000 7fde8f7fe640 1 -- 172.21.15.12:0/1154782078 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fde880c2030 con 0x7fde98073460 2024-09-11T23:04:31.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.144+0000 7fde9cc6b640 1 -- 172.21.15.12:0/1154782078 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fde980a01a0 con 0x7fde98073460 2024-09-11T23:04:31.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.144+0000 7fde8f7fe640 1 -- 172.21.15.12:0/1154782078 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 6 entries v26) ==== 80+0+353 (secure 0 0 0) 0x7fde880a4e20 con 0x7fde98073460 2024-09-11T23:04:31.146 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/255391181 2024-09-12T23:04:22.130661+0000 2024-09-11T23:04:31.146 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/2345769658 2024-09-12T23:04:22.130661+0000 2024-09-11T23:04:31.146 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/4120232861 2024-09-12T23:04:22.130661+0000 2024-09-11T23:04:31.146 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:6825/2765460338 2024-09-12T23:04:22.130661+0000 2024-09-11T23:04:31.146 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:6824/2765460338 2024-09-12T23:04:22.130661+0000 2024-09-11T23:04:31.146 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/1241865013 2024-09-12T23:04:22.130661+0000 2024-09-11T23:04:31.146 INFO:teuthology.orchestra.run.smithi012.stderr:listed 6 entries 2024-09-11T23:04:31.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.148+0000 7fde9cc6b640 1 -- 172.21.15.12:0/1154782078 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7fde78035ed0 msgr2=0x7fde78038390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:04:31.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.148+0000 7fde9cc6b640 1 --2- 172.21.15.12:0/1154782078 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7fde78035ed0 0x7fde78038390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:31.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.148+0000 7fde9cc6b640 1 -- 172.21.15.12:0/1154782078 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde98073460 msgr2=0x7fde980a2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:31.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.148+0000 7fde9cc6b640 1 --2- 172.21.15.12:0/1154782078 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde98073460 0x7fde980a2530 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fde88019fc0 tx=0x7fde88019130 comp rx=0 tx=0).stop 2024-09-11T23:04:31.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.148+0000 7fde9cc6b640 1 -- 172.21.15.12:0/1154782078 shutdown_connections 2024-09-11T23:04:31.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.148+0000 7fde9cc6b640 1 --2- 172.21.15.12:0/1154782078 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7fde78035ed0 0x7fde78038390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:31.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.148+0000 7fde9cc6b640 1 --2- 172.21.15.12:0/1154782078 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde98073460 0x7fde980a2530 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:31.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.148+0000 7fde9cc6b640 1 -- 172.21.15.12:0/1154782078 >> 172.21.15.12:0/1154782078 conn(0x7fde9809aba0 msgr2=0x7fde9813d170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:31.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.148+0000 7fde9cc6b640 1 -- 172.21.15.12:0/1154782078 shutdown_connections 2024-09-11T23:04:31.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.148+0000 7fde9cc6b640 1 -- 172.21.15.12:0/1154782078 wait complete. 2024-09-11T23:04:31.164 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi012.front.sepia.ceph.com... 2024-09-11T23:04:31.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:31.164 DEBUG:teuthology.orchestra.run.smithi012:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-11T23:04:31.216 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi012.stderr:ceph-fuse[35006]: fuse finished with error 0 and tester_r 0 2024-09-11T23:04:31.217 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi012.front.sepia.ceph.com 2024-09-11T23:04:31.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:31.218 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-11T23:04:31.320 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:31.320+0000 7fd20ac33180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T23:04:31.377 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:04:31.377 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:31.376+0000 7fd20ac33180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T23:04:31.428 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:31.424+0000 7fd20ac33180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T23:04:31.507 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:31.504+0000 7fd20ac33180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T23:04:31.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.536+0000 7f05f839e640 1 Processor -- start 2024-09-11T23:04:31.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.536+0000 7f05f839e640 1 -- start start 2024-09-11T23:04:31.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.540+0000 7f05f839e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f05f0138140 0x7f05f0138520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:31.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.540+0000 7f05f839e640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05f009ff30 con 0x7f05f009f960 2024-09-11T23:04:31.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.540+0000 7f05f839e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f05f009f210 con 0x7f05f0138140 2024-09-11T23:04:31.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.540+0000 7f05f5939640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f05f009f960 0x7f05f009b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38572/0 (socket says 172.21.15.12:38572) 2024-09-11T23:04:31.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.540+0000 7f05f613a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f05f0138140 0x7f05f0138520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:31.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.540+0000 7f05f5939640 1 -- 172.21.15.12:0/3049534628 learned_addr learned my addr 172.21.15.12:0/3049534628 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:04:31.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.540+0000 7f05f613a640 1 -- 172.21.15.12:0/3049534628 >> v1:172.21.15.12:6789/0 conn(0x7f05f009f960 legacy=0x7f05f009b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:31.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.540+0000 7f05f613a640 1 -- 172.21.15.12:0/3049534628 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05f009d4d0 con 0x7f05f0138140 2024-09-11T23:04:31.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.540+0000 7f05f613a640 1 --2- 172.21.15.12:0/3049534628 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05f0138140 0x7f05f0138520 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f05ec009740 tx=0x7f05ec01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4dc48fb8109154 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:31.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.540+0000 7f05f5138640 1 -- 172.21.15.12:0/3049534628 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05ec0b0070 con 0x7f05f0138140 2024-09-11T23:04:31.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.540+0000 7f05f5138640 1 -- 172.21.15.12:0/3049534628 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05ec0a4e50 con 0x7f05f0138140 2024-09-11T23:04:31.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.540+0000 7f05f5138640 1 -- 172.21.15.12:0/3049534628 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05ec0ab550 con 0x7f05f0138140 2024-09-11T23:04:31.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.540+0000 7f05f839e640 1 -- 172.21.15.12:0/3049534628 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05f0138140 msgr2=0x7f05f0138520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:31.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.540+0000 7f05f839e640 1 --2- 172.21.15.12:0/3049534628 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05f0138140 0x7f05f0138520 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f05ec009740 tx=0x7f05ec01c390 comp rx=0 tx=0).stop 2024-09-11T23:04:31.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.540+0000 7f05f839e640 1 -- 172.21.15.12:0/3049534628 shutdown_connections 2024-09-11T23:04:31.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.540+0000 7f05f839e640 1 --2- 172.21.15.12:0/3049534628 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05f0138140 0x7f05f0138520 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:31.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.540+0000 7f05f839e640 1 -- 172.21.15.12:0/3049534628 >> 172.21.15.12:0/3049534628 conn(0x7f05f0070df0 msgr2=0x7f05f0073210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:31.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.544+0000 7f05f839e640 1 -- 172.21.15.12:0/3049534628 shutdown_connections 2024-09-11T23:04:31.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.544+0000 7f05f839e640 1 -- 172.21.15.12:0/3049534628 wait complete. 2024-09-11T23:04:31.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.544+0000 7f05f839e640 1 Processor -- start 2024-09-11T23:04:31.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.544+0000 7f05f839e640 1 -- start start 2024-09-11T23:04:31.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.544+0000 7f05f839e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05f009f960 0x7f05f00a6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:31.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.544+0000 7f05f839e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f05f013fe80 con 0x7f05f009f960 2024-09-11T23:04:31.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.544+0000 7f05f613a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05f009f960 0x7f05f00a6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:31.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.544+0000 7f05f613a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05f009f960 0x7f05f00a6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39316/0 (socket says 172.21.15.12:39316) 2024-09-11T23:04:31.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.544+0000 7f05f613a640 1 -- 172.21.15.12:0/4199841769 learned_addr learned my addr 172.21.15.12:0/4199841769 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:31.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.544+0000 7f05f613a640 1 -- 172.21.15.12:0/4199841769 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05f0135a50 con 0x7f05f009f960 2024-09-11T23:04:31.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.544+0000 7f05f613a640 1 --2- 172.21.15.12:0/4199841769 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05f009f960 0x7f05f00a6710 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f05ec019fc0 tx=0x7f05ec01abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:31.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.544+0000 7f05e6ffd640 1 -- 172.21.15.12:0/4199841769 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05ec0b0050 con 0x7f05f009f960 2024-09-11T23:04:31.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.544+0000 7f05e6ffd640 1 -- 172.21.15.12:0/4199841769 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05ec0b1040 con 0x7f05f009f960 2024-09-11T23:04:31.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.544+0000 7f05e6ffd640 1 -- 172.21.15.12:0/4199841769 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05ec0b7580 con 0x7f05f009f960 2024-09-11T23:04:31.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.544+0000 7f05f839e640 1 -- 172.21.15.12:0/4199841769 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05f00a5fc0 con 0x7f05f009f960 2024-09-11T23:04:31.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.544+0000 7f05f839e640 1 -- 172.21.15.12:0/4199841769 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05f00a53f0 con 0x7f05f009f960 2024-09-11T23:04:31.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.544+0000 7f05e6ffd640 1 -- 172.21.15.12:0/4199841769 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 11) ==== 44155+0+0 (secure 0 0 0) 0x7f05ec0be030 con 0x7f05f009f960 2024-09-11T23:04:31.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.544+0000 7f05f839e640 1 -- 172.21.15.12:0/4199841769 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05f00008e0 con 0x7f05f009f960 2024-09-11T23:04:31.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.548+0000 7f05e6ffd640 1 --2- 172.21.15.12:0/4199841769 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7f05d4035ed0 0x7f05d4038390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:31.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.548+0000 7f05f5939640 1 -- 172.21.15.12:0/4199841769 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7f05d4035ed0 msgr2=0x7f05d4038390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6824/2217914063 2024-09-11T23:04:31.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.548+0000 7f05e6ffd640 1 -- 172.21.15.12:0/4199841769 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 3697+0+0 (secure 0 0 0) 0x7f05ec0bc070 con 0x7f05f009f960 2024-09-11T23:04:31.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.548+0000 7f05f5939640 1 --2- 172.21.15.12:0/4199841769 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7f05d4035ed0 0x7f05d4038390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:04:31.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.552+0000 7f05e6ffd640 1 -- 172.21.15.12:0/4199841769 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f05ec0c5020 con 0x7f05f009f960 2024-09-11T23:04:31.562 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:31.560+0000 7fd20ac33180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T23:04:31.639 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:31.636+0000 7fd20ac33180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T23:04:31.693 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:31.692+0000 7fd20ac33180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T23:04:31.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.748+0000 7f05f839e640 1 -- 172.21.15.12:0/4199841769 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f05f00a4180 con 0x7f05f009f960 2024-09-11T23:04:31.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.748+0000 7f05e6ffd640 1 -- 172.21.15.12:0/4199841769 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+3570 (secure 0 0 0) 0x7f05ec016010 con 0x7f05f009f960 2024-09-11T23:04:31.750 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:04:31.750 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":16,"btime":"2024-09-11T23:04:09:670574+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4328,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6827/3738380591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":3738380591},{"type":"v1","addr":"172.21.15.12:6827","nonce":3738380591}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:04:06.012942+0000","modified":"2024-09-11T23:04:09.042274+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4329},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4329":{"gid":4329,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6829/514415350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":514415350},{"type":"v1","addr":"172.21.15.12:6829","nonce":514415350}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4329,"qdb_cluster":[4329]},"id":2}]} 2024-09-11T23:04:31.750 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 16 2024-09-11T23:04:31.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.752+0000 7f05f5939640 1 -- 172.21.15.12:0/4199841769 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7f05d4035ed0 msgr2=0x7f05d4038390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6824/2217914063 2024-09-11T23:04:31.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.752+0000 7f05f5939640 1 --2- 172.21.15.12:0/4199841769 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7f05d4035ed0 0x7f05d4038390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T23:04:31.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.752+0000 7f05f839e640 1 -- 172.21.15.12:0/4199841769 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7f05d4035ed0 msgr2=0x7f05d4038390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:04:31.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.752+0000 7f05f839e640 1 --2- 172.21.15.12:0/4199841769 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7f05d4035ed0 0x7f05d4038390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:31.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.752+0000 7f05f839e640 1 -- 172.21.15.12:0/4199841769 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05f009f960 msgr2=0x7f05f00a6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:31.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.752+0000 7f05f839e640 1 --2- 172.21.15.12:0/4199841769 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05f009f960 0x7f05f00a6710 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f05ec019fc0 tx=0x7f05ec01abd0 comp rx=0 tx=0).stop 2024-09-11T23:04:31.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.752+0000 7f05f839e640 1 -- 172.21.15.12:0/4199841769 shutdown_connections 2024-09-11T23:04:31.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.752+0000 7f05f839e640 1 --2- 172.21.15.12:0/4199841769 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7f05d4035ed0 0x7f05d4038390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:31.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.752+0000 7f05f839e640 1 --2- 172.21.15.12:0/4199841769 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05f009f960 0x7f05f00a6710 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:31.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.752+0000 7f05f839e640 1 -- 172.21.15.12:0/4199841769 >> 172.21.15.12:0/4199841769 conn(0x7f05f0070df0 msgr2=0x7f05f0134da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:31.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.752+0000 7f05f839e640 1 -- 172.21.15.12:0/4199841769 shutdown_connections 2024-09-11T23:04:31.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.752+0000 7f05f839e640 1 -- 172.21.15.12:0/4199841769 wait complete. 2024-09-11T23:04:31.768 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:04:31.841 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:31.840+0000 7fd20ac33180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T23:04:31.896 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:31.896+0000 7fd20ac33180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T23:04:31.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.916+0000 7f2b35f16640 1 Processor -- start 2024-09-11T23:04:31.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.916+0000 7f2b35f16640 1 -- start start 2024-09-11T23:04:31.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.920+0000 7f2b35f16640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2b300a4b80 0x7f2b300a7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:31.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.920+0000 7f2b35f16640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b300a82a0 con 0x7f2b3013a410 2024-09-11T23:04:31.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.920+0000 7f2b35f16640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f2b300a3cb0 con 0x7f2b300a4b80 2024-09-11T23:04:31.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.920+0000 7f2b2effd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2b300a4b80 0x7f2b300a7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:31.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.920+0000 7f2b2f7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f2b3013a410 0x7f2b300a6af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38578/0 (socket says 172.21.15.12:38578) 2024-09-11T23:04:31.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.920+0000 7f2b2f7fe640 1 -- 172.21.15.12:0/1801117769 learned_addr learned my addr 172.21.15.12:0/1801117769 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:04:31.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.920+0000 7f2b2e7fc640 1 -- 172.21.15.12:0/1801117769 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3885904484 0 0) 0x7f2b300a82a0 con 0x7f2b3013a410 2024-09-11T23:04:31.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.920+0000 7f2b2e7fc640 1 -- 172.21.15.12:0/1801117769 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b18003530 con 0x7f2b3013a410 2024-09-11T23:04:31.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.920+0000 7f2b2effd640 1 -- 172.21.15.12:0/1801117769 >> v1:172.21.15.12:6789/0 conn(0x7f2b3013a410 legacy=0x7f2b300a6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:31.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.920+0000 7f2b2effd640 1 -- 172.21.15.12:0/1801117769 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b30139fe0 con 0x7f2b300a4b80 2024-09-11T23:04:31.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.920+0000 7f2b2effd640 1 --2- 172.21.15.12:0/1801117769 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b300a4b80 0x7f2b300a7200 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2b24009740 tx=0x7f2b2401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ec1d9ebf68f2032 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:31.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.920+0000 7f2b2e7fc640 1 -- 172.21.15.12:0/1801117769 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b240b0070 con 0x7f2b300a4b80 2024-09-11T23:04:31.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.920+0000 7f2b2e7fc640 1 -- 172.21.15.12:0/1801117769 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b240ab530 con 0x7f2b300a4b80 2024-09-11T23:04:31.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.920+0000 7f2b2e7fc640 1 -- 172.21.15.12:0/1801117769 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b240ab830 con 0x7f2b300a4b80 2024-09-11T23:04:31.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.924+0000 7f2b35f16640 1 -- 172.21.15.12:0/1801117769 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b300a4b80 msgr2=0x7f2b300a7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:31.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.924+0000 7f2b35f16640 1 --2- 172.21.15.12:0/1801117769 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b300a4b80 0x7f2b300a7200 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2b24009740 tx=0x7f2b2401c390 comp rx=0 tx=0).stop 2024-09-11T23:04:31.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.924+0000 7f2b35f16640 1 -- 172.21.15.12:0/1801117769 shutdown_connections 2024-09-11T23:04:31.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.924+0000 7f2b35f16640 1 --2- 172.21.15.12:0/1801117769 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b300a4b80 0x7f2b300a7200 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:31.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.924+0000 7f2b35f16640 1 -- 172.21.15.12:0/1801117769 >> 172.21.15.12:0/1801117769 conn(0x7f2b300ac2c0 msgr2=0x7f2b300ac6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:31.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.924+0000 7f2b35f16640 1 -- 172.21.15.12:0/1801117769 shutdown_connections 2024-09-11T23:04:31.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.924+0000 7f2b35f16640 1 -- 172.21.15.12:0/1801117769 wait complete. 2024-09-11T23:04:31.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.924+0000 7f2b35f16640 1 Processor -- start 2024-09-11T23:04:31.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.924+0000 7f2b35f16640 1 -- start start 2024-09-11T23:04:31.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.924+0000 7f2b35f16640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b300a4b80 0x7f2b3009b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:31.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.924+0000 7f2b35f16640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2b300a7740 con 0x7f2b300a4b80 2024-09-11T23:04:31.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.924+0000 7f2b2f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b300a4b80 0x7f2b3009b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:31.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.924+0000 7f2b2f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b300a4b80 0x7f2b3009b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39344/0 (socket says 172.21.15.12:39344) 2024-09-11T23:04:31.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.924+0000 7f2b2f7fe640 1 -- 172.21.15.12:0/1289330309 learned_addr learned my addr 172.21.15.12:0/1289330309 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:31.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.924+0000 7f2b2f7fe640 1 -- 172.21.15.12:0/1289330309 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b301ce610 con 0x7f2b300a4b80 2024-09-11T23:04:31.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.924+0000 7f2b2f7fe640 1 --2- 172.21.15.12:0/1289330309 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b300a4b80 0x7f2b3009b240 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2b2000c450 tx=0x7f2b2000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:31.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.924+0000 7f2b17fff640 1 -- 172.21.15.12:0/1289330309 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b20017070 con 0x7f2b300a4b80 2024-09-11T23:04:31.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.924+0000 7f2b17fff640 1 -- 172.21.15.12:0/1289330309 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b20005c20 con 0x7f2b300a4b80 2024-09-11T23:04:31.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.924+0000 7f2b35f16640 1 -- 172.21.15.12:0/1289330309 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b3009c1b0 con 0x7f2b300a4b80 2024-09-11T23:04:31.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.924+0000 7f2b17fff640 1 -- 172.21.15.12:0/1289330309 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b20007070 con 0x7f2b300a4b80 2024-09-11T23:04:31.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.924+0000 7f2b35f16640 1 -- 172.21.15.12:0/1289330309 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b3009d180 con 0x7f2b300a4b80 2024-09-11T23:04:31.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.924+0000 7f2b35f16640 1 -- 172.21.15.12:0/1289330309 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b300a6af0 con 0x7f2b300a4b80 2024-09-11T23:04:31.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.924+0000 7f2b17fff640 1 -- 172.21.15.12:0/1289330309 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 11) ==== 44155+0+0 (secure 0 0 0) 0x7f2b2001a070 con 0x7f2b300a4b80 2024-09-11T23:04:31.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.924+0000 7f2b17fff640 1 --2- 172.21.15.12:0/1289330309 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7f2b1c035ed0 0x7f2b1c038390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:31.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.924+0000 7f2b17fff640 1 -- 172.21.15.12:0/1289330309 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 3697+0+0 (secure 0 0 0) 0x7f2b20047b40 con 0x7f2b300a4b80 2024-09-11T23:04:31.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.924+0000 7f2b2effd640 1 -- 172.21.15.12:0/1289330309 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7f2b1c035ed0 msgr2=0x7f2b1c038390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6824/2217914063 2024-09-11T23:04:31.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.924+0000 7f2b2effd640 1 --2- 172.21.15.12:0/1289330309 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7f2b1c035ed0 0x7f2b1c038390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:04:31.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:31.936+0000 7f2b17fff640 1 -- 172.21.15.12:0/1289330309 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2b20007210 con 0x7f2b300a4b80 2024-09-11T23:04:32.128 INFO:tasks.ceph.mgr.x.smithi012.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-11T23:04:32.128 INFO:tasks.ceph.mgr.x.smithi012.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-11T23:04:32.128 INFO:tasks.ceph.mgr.x.smithi012.stderr: from numpy import show_config as show_numpy_config 2024-09-11T23:04:32.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.128+0000 7f2b2effd640 1 -- 172.21.15.12:0/1289330309 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7f2b1c035ed0 msgr2=0x7f2b1c038390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6824/2217914063 2024-09-11T23:04:32.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.128+0000 7f2b2effd640 1 --2- 172.21.15.12:0/1289330309 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7f2b1c035ed0 0x7f2b1c038390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T23:04:32.135 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:32.132+0000 7fd20ac33180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T23:04:32.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.172+0000 7f2b35f16640 1 -- 172.21.15.12:0/1289330309 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2b300a2eb0 con 0x7f2b300a4b80 2024-09-11T23:04:32.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.172+0000 7f2b17fff640 1 -- 172.21.15.12:0/1289330309 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+3570 (secure 0 0 0) 0x7f2b20012400 con 0x7f2b300a4b80 2024-09-11T23:04:32.174 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:04:32.174 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":16,"btime":"2024-09-11T23:04:09:670574+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4328,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6827/3738380591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":3738380591},{"type":"v1","addr":"172.21.15.12:6827","nonce":3738380591}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:04:06.012942+0000","modified":"2024-09-11T23:04:09.042274+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4329},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4329":{"gid":4329,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6829/514415350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":514415350},{"type":"v1","addr":"172.21.15.12:6829","nonce":514415350}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4329,"qdb_cluster":[4329]},"id":2}]} 2024-09-11T23:04:32.174 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 16 2024-09-11T23:04:32.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.176+0000 7f2b35f16640 1 -- 172.21.15.12:0/1289330309 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7f2b1c035ed0 msgr2=0x7f2b1c038390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:04:32.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.176+0000 7f2b35f16640 1 --2- 172.21.15.12:0/1289330309 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7f2b1c035ed0 0x7f2b1c038390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:32.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.176+0000 7f2b35f16640 1 -- 172.21.15.12:0/1289330309 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b300a4b80 msgr2=0x7f2b3009b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:32.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.176+0000 7f2b35f16640 1 --2- 172.21.15.12:0/1289330309 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b300a4b80 0x7f2b3009b240 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2b2000c450 tx=0x7f2b2000c910 comp rx=0 tx=0).stop 2024-09-11T23:04:32.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.176+0000 7f2b35f16640 1 -- 172.21.15.12:0/1289330309 shutdown_connections 2024-09-11T23:04:32.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.176+0000 7f2b35f16640 1 --2- 172.21.15.12:0/1289330309 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7f2b1c035ed0 0x7f2b1c038390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:32.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.176+0000 7f2b35f16640 1 --2- 172.21.15.12:0/1289330309 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b300a4b80 0x7f2b3009b240 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:32.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.176+0000 7f2b35f16640 1 -- 172.21.15.12:0/1289330309 >> 172.21.15.12:0/1289330309 conn(0x7f2b300ac2c0 msgr2=0x7f2b30139340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:32.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.176+0000 7f2b35f16640 1 -- 172.21.15.12:0/1289330309 shutdown_connections 2024-09-11T23:04:32.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.176+0000 7f2b35f16640 1 -- 172.21.15.12:0/1289330309 wait complete. 2024-09-11T23:04:32.192 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:04:32.278 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:32.276+0000 7fd20ac33180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:04:32.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.348+0000 7fdbba350640 1 Processor -- start 2024-09-11T23:04:32.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.348+0000 7fdbba350640 1 -- start start 2024-09-11T23:04:32.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.348+0000 7fdbba350640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdbb4134a70 0x7fdbb4134e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:32.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.348+0000 7fdbba350640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbb4134640 con 0x7fdbb40a0ce0 2024-09-11T23:04:32.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.348+0000 7fdbba350640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fdbb40a0120 con 0x7fdbb4134a70 2024-09-11T23:04:32.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.348+0000 7fdbb3fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdbb4134a70 0x7fdbb4134e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:32.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.348+0000 7fdbabfff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fdbb40a0ce0 0x7fdbb40707c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38588/0 (socket says 172.21.15.12:38588) 2024-09-11T23:04:32.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.348+0000 7fdbabfff640 1 -- 172.21.15.12:0/1371141683 learned_addr learned my addr 172.21.15.12:0/1371141683 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:04:32.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.348+0000 7fdbb3fff640 1 -- 172.21.15.12:0/1371141683 >> v1:172.21.15.12:6789/0 conn(0x7fdbb40a0ce0 legacy=0x7fdbb40707c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:32.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.348+0000 7fdbb3fff640 1 -- 172.21.15.12:0/1371141683 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbb409fe10 con 0x7fdbb4134a70 2024-09-11T23:04:32.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.352+0000 7fdbb3fff640 1 --2- 172.21.15.12:0/1371141683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbb4134a70 0x7fdbb4134e50 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fdba4009740 tx=0x7fdba401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b6e69846debb8c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:32.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.352+0000 7fdbb37fe640 1 -- 172.21.15.12:0/1371141683 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdba40b0070 con 0x7fdbb4134a70 2024-09-11T23:04:32.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.352+0000 7fdbb37fe640 1 -- 172.21.15.12:0/1371141683 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdba40a4e50 con 0x7fdbb4134a70 2024-09-11T23:04:32.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.352+0000 7fdbb37fe640 1 -- 172.21.15.12:0/1371141683 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdba40ab680 con 0x7fdbb4134a70 2024-09-11T23:04:32.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.352+0000 7fdbba350640 1 -- 172.21.15.12:0/1371141683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbb4134a70 msgr2=0x7fdbb4134e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:32.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.352+0000 7fdbba350640 1 --2- 172.21.15.12:0/1371141683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbb4134a70 0x7fdbb4134e50 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fdba4009740 tx=0x7fdba401c390 comp rx=0 tx=0).stop 2024-09-11T23:04:32.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.352+0000 7fdbba350640 1 -- 172.21.15.12:0/1371141683 shutdown_connections 2024-09-11T23:04:32.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.352+0000 7fdbba350640 1 --2- 172.21.15.12:0/1371141683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbb4134a70 0x7fdbb4134e50 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:32.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.352+0000 7fdbba350640 1 -- 172.21.15.12:0/1371141683 >> 172.21.15.12:0/1371141683 conn(0x7fdbb409b910 msgr2=0x7fdbb406f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:32.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.352+0000 7fdbba350640 1 -- 172.21.15.12:0/1371141683 shutdown_connections 2024-09-11T23:04:32.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.352+0000 7fdbba350640 1 -- 172.21.15.12:0/1371141683 wait complete. 2024-09-11T23:04:32.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.352+0000 7fdbba350640 1 Processor -- start 2024-09-11T23:04:32.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.352+0000 7fdbba350640 1 -- start start 2024-09-11T23:04:32.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.352+0000 7fdbba350640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbb40a0ce0 0x7fdbb40a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:32.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.352+0000 7fdbba350640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fdbb4140000 con 0x7fdbb40a0ce0 2024-09-11T23:04:32.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.352+0000 7fdbb3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbb40a0ce0 0x7fdbb40a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:32.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.352+0000 7fdbb3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbb40a0ce0 0x7fdbb40a5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39362/0 (socket says 172.21.15.12:39362) 2024-09-11T23:04:32.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.352+0000 7fdbb3fff640 1 -- 172.21.15.12:0/3537001073 learned_addr learned my addr 172.21.15.12:0/3537001073 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:32.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.352+0000 7fdbb3fff640 1 -- 172.21.15.12:0/3537001073 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbb40a3310 con 0x7fdbb40a0ce0 2024-09-11T23:04:32.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.352+0000 7fdbb3fff640 1 --2- 172.21.15.12:0/3537001073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbb40a0ce0 0x7fdbb40a5800 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fdba4019fc0 tx=0x7fdba401abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:32.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.352+0000 7fdbb17fa640 1 -- 172.21.15.12:0/3537001073 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdba40b0050 con 0x7fdbb40a0ce0 2024-09-11T23:04:32.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.352+0000 7fdbb17fa640 1 -- 172.21.15.12:0/3537001073 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdba40b1040 con 0x7fdbb40a0ce0 2024-09-11T23:04:32.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.352+0000 7fdbb17fa640 1 -- 172.21.15.12:0/3537001073 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdba40b7580 con 0x7fdbb40a0ce0 2024-09-11T23:04:32.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.352+0000 7fdbba350640 1 -- 172.21.15.12:0/3537001073 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbb40a50b0 con 0x7fdbb40a0ce0 2024-09-11T23:04:32.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.352+0000 7fdbba350640 1 -- 172.21.15.12:0/3537001073 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbb40a3550 con 0x7fdbb40a0ce0 2024-09-11T23:04:32.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.356+0000 7fdbb17fa640 1 -- 172.21.15.12:0/3537001073 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 11) ==== 44155+0+0 (secure 0 0 0) 0x7fdba40be030 con 0x7fdbb40a0ce0 2024-09-11T23:04:32.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.356+0000 7fdbba350640 1 -- 172.21.15.12:0/3537001073 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbb40008e0 con 0x7fdbb40a0ce0 2024-09-11T23:04:32.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.356+0000 7fdbb17fa640 1 --2- 172.21.15.12:0/3537001073 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7fdb94035f00 0x7fdb940383c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:32.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.356+0000 7fdbabfff640 1 -- 172.21.15.12:0/3537001073 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7fdb94035f00 msgr2=0x7fdb940383c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6824/2217914063 2024-09-11T23:04:32.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.356+0000 7fdbb17fa640 1 -- 172.21.15.12:0/3537001073 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 3697+0+0 (secure 0 0 0) 0x7fdba40bc070 con 0x7fdbb40a0ce0 2024-09-11T23:04:32.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.356+0000 7fdbabfff640 1 --2- 172.21.15.12:0/3537001073 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7fdb94035f00 0x7fdb940383c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:04:32.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.364+0000 7fdbb17fa640 1 -- 172.21.15.12:0/3537001073 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fdba40c5020 con 0x7fdbb40a0ce0 2024-09-11T23:04:32.401 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:32.396+0000 7fd20ac33180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T23:04:32.463 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:32.460+0000 7fd20ac33180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T23:04:32.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.532+0000 7fdbba350640 1 -- 172.21.15.12:0/3537001073 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdbb40a4da0 con 0x7fdbb40a0ce0 2024-09-11T23:04:32.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.536+0000 7fdbb17fa640 1 -- 172.21.15.12:0/3537001073 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+11051 (secure 0 0 0) 0x7fdba4016010 con 0x7fdbb40a0ce0 2024-09-11T23:04:32.537 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:04:32.537 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":26,"fsid":"8be14356-3340-4500-91a2-4cbc6b511f65","created":"2024-09-11T23:03:10.620234+0000","modified":"2024-09-11T23:04:22.130726+0000","last_up_change":"2024-09-11T23:03:22.359028+0000","last_in_change":"2024-09-11T23:03:11.545817+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:03:23.587068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:04:03.949125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-11T23:04:05.020777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"153b72a1-40b1-400d-93ea-333e733f9bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6817","nonce":3680911937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6819","nonce":3680911937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6823","nonce":3680911937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6821","nonce":3680911937}]},"public_addr":"172.21.15.12:6817/3680911937","cluster_addr":"172.21.15.12:6819/3680911937","heartbeat_back_addr":"172.21.15.12:6823/3680911937","heartbeat_front_addr":"172.21.15.12:6821/3680911937","state":["exists","up"]},{"osd":1,"uuid":"94669e49-ee4f-4acf-9e25-e94374dda8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6801","nonce":236825163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6803","nonce":236825163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6807","nonce":236825163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6805","nonce":236825163}]},"public_addr":"172.21.15.12:6801/236825163","cluster_addr":"172.21.15.12:6803/236825163","heartbeat_back_addr":"172.21.15.12:6807/236825163","heartbeat_front_addr":"172.21.15.12:6805/236825163","state":["exists","up"]},{"osd":2,"uuid":"826dae4d-8888-4ec5-8f00-425b3be93814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6809","nonce":3263521655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6811","nonce":3263521655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6815","nonce":3263521655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6813","nonce":3263521655}]},"public_addr":"172.21.15.12:6809/3263521655","cluster_addr":"172.21.15.12:6811/3263521655","heartbeat_back_addr":"172.21.15.12:6815/3263521655","heartbeat_front_addr":"172.21.15.12:6813/3263521655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:19.398518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.761524+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.904997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/255391181":"2024-09-12T23:04:22.130661+0000","172.21.15.12:0/2345769658":"2024-09-12T23:04:22.130661+0000","172.21.15.12:0/4120232861":"2024-09-12T23:04:22.130661+0000","172.21.15.12:6825/2765460338":"2024-09-12T23:04:22.130661+0000","172.21.15.12:6824/2765460338":"2024-09-12T23:04:22.130661+0000","172.21.15.12:0/1241865013":"2024-09-12T23:04:22.130661+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:04:32.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.536+0000 7fdbba350640 1 -- 172.21.15.12:0/3537001073 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7fdb94035f00 msgr2=0x7fdb940383c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:04:32.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.536+0000 7fdbba350640 1 --2- 172.21.15.12:0/3537001073 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7fdb94035f00 0x7fdb940383c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:32.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.536+0000 7fdbba350640 1 -- 172.21.15.12:0/3537001073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbb40a0ce0 msgr2=0x7fdbb40a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:32.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.536+0000 7fdbba350640 1 --2- 172.21.15.12:0/3537001073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbb40a0ce0 0x7fdbb40a5800 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fdba4019fc0 tx=0x7fdba401abd0 comp rx=0 tx=0).stop 2024-09-11T23:04:32.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.536+0000 7fdbba350640 1 -- 172.21.15.12:0/3537001073 shutdown_connections 2024-09-11T23:04:32.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.536+0000 7fdbba350640 1 --2- 172.21.15.12:0/3537001073 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7fdb94035f00 0x7fdb940383c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:32.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.536+0000 7fdbba350640 1 --2- 172.21.15.12:0/3537001073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbb40a0ce0 0x7fdbb40a5800 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:32.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.536+0000 7fdbba350640 1 -- 172.21.15.12:0/3537001073 >> 172.21.15.12:0/3537001073 conn(0x7fdbb409b910 msgr2=0x7fdbb4133af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:32.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.536+0000 7fdbba350640 1 -- 172.21.15.12:0/3537001073 shutdown_connections 2024-09-11T23:04:32.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.536+0000 7fdbba350640 1 -- 172.21.15.12:0/3537001073 wait complete. 2024-09-11T23:04:32.555 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T23:04:32.555 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:04:32.605 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:32.604+0000 7fd20ac33180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:04:32.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.720+0000 7ff41963a640 1 Processor -- start 2024-09-11T23:04:32.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.720+0000 7ff41963a640 1 -- start start 2024-09-11T23:04:32.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.724+0000 7ff41963a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff41409f6e0 0x7ff41413cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:32.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.724+0000 7ff41963a640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff41409e930 con 0x7ff414137e60 2024-09-11T23:04:32.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.724+0000 7ff41963a640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7ff4141379e0 con 0x7ff41409f6e0 2024-09-11T23:04:32.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.724+0000 7ff412ffd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff414137e60 0x7ff414138240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38596/0 (socket says 172.21.15.12:38596) 2024-09-11T23:04:32.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.724+0000 7ff412ffd640 1 -- 172.21.15.12:0/2329293003 learned_addr learned my addr 172.21.15.12:0/2329293003 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:04:32.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.724+0000 7ff4127fc640 1 --2- 172.21.15.12:0/2329293003 >> v2:172.21.15.12:3300/0 conn(0x7ff41409f6e0 0x7ff41413cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:32.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.724+0000 7ff411ffb640 1 -- 172.21.15.12:0/2329293003 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1421207116 0 0) 0x7ff41409e930 con 0x7ff414137e60 2024-09-11T23:04:32.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.724+0000 7ff411ffb640 1 -- 172.21.15.12:0/2329293003 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3fc003530 con 0x7ff414137e60 2024-09-11T23:04:32.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.724+0000 7ff4127fc640 1 -- 172.21.15.12:0/2329293003 >> v1:172.21.15.12:6789/0 conn(0x7ff414137e60 legacy=0x7ff414138240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:32.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.724+0000 7ff411ffb640 1 -- 172.21.15.12:0/2329293003 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2398006489 0 0) 0x7ff3fc003530 con 0x7ff414137e60 2024-09-11T23:04:32.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.724+0000 7ff4127fc640 1 -- 172.21.15.12:0/2329293003 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff41409d910 con 0x7ff41409f6e0 2024-09-11T23:04:32.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.724+0000 7ff4127fc640 1 --2- 172.21.15.12:0/2329293003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff41409f6e0 0x7ff41413cc60 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff408009740 tx=0x7ff40801c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=371734c8ccbbecc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:32.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.724+0000 7ff411ffb640 1 -- 172.21.15.12:0/2329293003 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4080b0070 con 0x7ff41409f6e0 2024-09-11T23:04:32.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.724+0000 7ff411ffb640 1 -- 172.21.15.12:0/2329293003 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4080ab400 con 0x7ff41409f6e0 2024-09-11T23:04:32.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.724+0000 7ff411ffb640 1 -- 172.21.15.12:0/2329293003 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4040015b0 con 0x7ff41409f6e0 2024-09-11T23:04:32.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.728+0000 7ff41963a640 1 -- 172.21.15.12:0/2329293003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff41409f6e0 msgr2=0x7ff41413cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:32.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.728+0000 7ff41963a640 1 --2- 172.21.15.12:0/2329293003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff41409f6e0 0x7ff41413cc60 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff408009740 tx=0x7ff40801c340 comp rx=0 tx=0).stop 2024-09-11T23:04:32.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.728+0000 7ff41963a640 1 -- 172.21.15.12:0/2329293003 shutdown_connections 2024-09-11T23:04:32.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.728+0000 7ff41963a640 1 --2- 172.21.15.12:0/2329293003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff41409f6e0 0x7ff41413cc60 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:32.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.728+0000 7ff41963a640 1 -- 172.21.15.12:0/2329293003 >> 172.21.15.12:0/2329293003 conn(0x7ff4140a8450 msgr2=0x7ff4140a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:32.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.728+0000 7ff41963a640 1 -- 172.21.15.12:0/2329293003 shutdown_connections 2024-09-11T23:04:32.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.728+0000 7ff41963a640 1 -- 172.21.15.12:0/2329293003 wait complete. 2024-09-11T23:04:32.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.728+0000 7ff41963a640 1 Processor -- start 2024-09-11T23:04:32.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.728+0000 7ff41963a640 1 -- start start 2024-09-11T23:04:32.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.728+0000 7ff41963a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff41409f6e0 0x7ff414071af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:32.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.728+0000 7ff41963a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff41413fd50 con 0x7ff41409f6e0 2024-09-11T23:04:32.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.728+0000 7ff412ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff41409f6e0 0x7ff414071af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:32.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.728+0000 7ff412ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff41409f6e0 0x7ff414071af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39384/0 (socket says 172.21.15.12:39384) 2024-09-11T23:04:32.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.728+0000 7ff412ffd640 1 -- 172.21.15.12:0/1089291439 learned_addr learned my addr 172.21.15.12:0/1089291439 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:32.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.728+0000 7ff412ffd640 1 -- 172.21.15.12:0/1089291439 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff414070da0 con 0x7ff41409f6e0 2024-09-11T23:04:32.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.728+0000 7ff412ffd640 1 --2- 172.21.15.12:0/1089291439 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff41409f6e0 0x7ff414071af0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff40400c4b0 tx=0x7ff40400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:32.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.728+0000 7ff3fb7fe640 1 -- 172.21.15.12:0/1089291439 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff404017070 con 0x7ff41409f6e0 2024-09-11T23:04:32.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.728+0000 7ff3fb7fe640 1 -- 172.21.15.12:0/1089291439 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff404005c20 con 0x7ff41409f6e0 2024-09-11T23:04:32.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.728+0000 7ff41963a640 1 -- 172.21.15.12:0/1089291439 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff414071370 con 0x7ff41409f6e0 2024-09-11T23:04:32.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.728+0000 7ff3fb7fe640 1 -- 172.21.15.12:0/1089291439 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff404007070 con 0x7ff41409f6e0 2024-09-11T23:04:32.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.728+0000 7ff41963a640 1 -- 172.21.15.12:0/1089291439 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff414072430 con 0x7ff41409f6e0 2024-09-11T23:04:32.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.728+0000 7ff3fb7fe640 1 -- 172.21.15.12:0/1089291439 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 11) ==== 44155+0+0 (secure 0 0 0) 0x7ff40401a070 con 0x7ff41409f6e0 2024-09-11T23:04:32.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.728+0000 7ff41963a640 1 -- 172.21.15.12:0/1089291439 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff414072030 con 0x7ff41409f6e0 2024-09-11T23:04:32.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.728+0000 7ff3fb7fe640 1 --2- 172.21.15.12:0/1089291439 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7ff400035e80 0x7ff400038340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:32.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.728+0000 7ff3fb7fe640 1 -- 172.21.15.12:0/1089291439 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 3697+0+0 (secure 0 0 0) 0x7ff404047e70 con 0x7ff41409f6e0 2024-09-11T23:04:32.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.728+0000 7ff4127fc640 1 -- 172.21.15.12:0/1089291439 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7ff400035e80 msgr2=0x7ff400038340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6824/2217914063 2024-09-11T23:04:32.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.728+0000 7ff4127fc640 1 --2- 172.21.15.12:0/1089291439 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7ff400035e80 0x7ff400038340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:04:32.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.740+0000 7ff3fb7fe640 1 -- 172.21.15.12:0/1089291439 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff404046b40 con 0x7ff41409f6e0 2024-09-11T23:04:32.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.932+0000 7ff4127fc640 1 -- 172.21.15.12:0/1089291439 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7ff400035e80 msgr2=0x7ff400038340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6824/2217914063 2024-09-11T23:04:32.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.932+0000 7ff4127fc640 1 --2- 172.21.15.12:0/1089291439 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7ff400035e80 0x7ff400038340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T23:04:32.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.932+0000 7ff41963a640 1 -- 172.21.15.12:0/1089291439 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff4140a1100 con 0x7ff41409f6e0 2024-09-11T23:04:32.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.932+0000 7ff3fb7fe640 1 -- 172.21.15.12:0/1089291439 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+3570 (secure 0 0 0) 0x7ff40401b730 con 0x7ff41409f6e0 2024-09-11T23:04:32.934 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:04:32.934 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":16,"btime":"2024-09-11T23:04:09:670574+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4328,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6827/3738380591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":3738380591},{"type":"v1","addr":"172.21.15.12:6827","nonce":3738380591}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:04:06.012942+0000","modified":"2024-09-11T23:04:09.042274+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4329},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4329":{"gid":4329,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6829/514415350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":514415350},{"type":"v1","addr":"172.21.15.12:6829","nonce":514415350}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4329,"qdb_cluster":[4329]},"id":2}]} 2024-09-11T23:04:32.935 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 16 2024-09-11T23:04:32.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.936+0000 7ff41963a640 1 -- 172.21.15.12:0/1089291439 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7ff400035e80 msgr2=0x7ff400038340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:04:32.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.936+0000 7ff41963a640 1 --2- 172.21.15.12:0/1089291439 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7ff400035e80 0x7ff400038340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:32.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.936+0000 7ff41963a640 1 -- 172.21.15.12:0/1089291439 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff41409f6e0 msgr2=0x7ff414071af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:32.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.936+0000 7ff41963a640 1 --2- 172.21.15.12:0/1089291439 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff41409f6e0 0x7ff414071af0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff40400c4b0 tx=0x7ff40400c970 comp rx=0 tx=0).stop 2024-09-11T23:04:32.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.936+0000 7ff41963a640 1 -- 172.21.15.12:0/1089291439 shutdown_connections 2024-09-11T23:04:32.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.936+0000 7ff41963a640 1 --2- 172.21.15.12:0/1089291439 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7ff400035e80 0x7ff400038340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:32.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.936+0000 7ff41963a640 1 --2- 172.21.15.12:0/1089291439 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff41409f6e0 0x7ff414071af0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:32.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.936+0000 7ff41963a640 1 -- 172.21.15.12:0/1089291439 >> 172.21.15.12:0/1089291439 conn(0x7ff4140a8450 msgr2=0x7ff414135740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:32.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.936+0000 7ff41963a640 1 -- 172.21.15.12:0/1089291439 shutdown_connections 2024-09-11T23:04:32.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:32.936+0000 7ff41963a640 1 -- 172.21.15.12:0/1089291439 wait complete. 2024-09-11T23:04:32.952 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:04:33.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.116+0000 7f39cbcca640 1 Processor -- start 2024-09-11T23:04:33.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.116+0000 7f39cbcca640 1 -- start start 2024-09-11T23:04:33.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.116+0000 7f39cbcca640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f39c4134900 0x7f39c4134ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:33.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.116+0000 7f39cbcca640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39c406be20 con 0x7f39c4135220 2024-09-11T23:04:33.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.116+0000 7f39cbcca640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f39c406cb80 con 0x7f39c4134900 2024-09-11T23:04:33.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.116+0000 7f39c9a66640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f39c4134900 0x7f39c4134ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:33.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.116+0000 7f39c9a66640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f39c4134900 0x7f39c4134ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39394/0 (socket says 172.21.15.12:39394) 2024-09-11T23:04:33.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.116+0000 7f39c9265640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f39c4135220 0x7f39c40a24b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38608/0 (socket says 172.21.15.12:38608) 2024-09-11T23:04:33.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.116+0000 7f39c9a66640 1 -- 172.21.15.12:0/753999781 learned_addr learned my addr 172.21.15.12:0/753999781 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:33.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.116+0000 7f39c9a66640 1 -- 172.21.15.12:0/753999781 >> v1:172.21.15.12:6789/0 conn(0x7f39c4135220 legacy=0x7f39c40a24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:33.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.116+0000 7f39c9a66640 1 -- 172.21.15.12:0/753999781 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39c40a4af0 con 0x7f39c4134900 2024-09-11T23:04:33.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.116+0000 7f39c9a66640 1 --2- 172.21.15.12:0/753999781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39c4134900 0x7f39c4134ce0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f39b40097f0 tx=0x7f39b401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a83fe3ccd40c3862 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:33.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.116+0000 7f39c8a64640 1 -- 172.21.15.12:0/753999781 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39b40a7070 con 0x7f39c4134900 2024-09-11T23:04:33.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.116+0000 7f39c8a64640 1 -- 172.21.15.12:0/753999781 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39b40b0070 con 0x7f39c4134900 2024-09-11T23:04:33.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.116+0000 7f39c8a64640 1 -- 172.21.15.12:0/753999781 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39b40ab5c0 con 0x7f39c4134900 2024-09-11T23:04:33.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.120+0000 7f39cbcca640 1 -- 172.21.15.12:0/753999781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39c4134900 msgr2=0x7f39c4134ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:33.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.120+0000 7f39cbcca640 1 --2- 172.21.15.12:0/753999781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39c4134900 0x7f39c4134ce0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f39b40097f0 tx=0x7f39b401c450 comp rx=0 tx=0).stop 2024-09-11T23:04:33.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.120+0000 7f39cbcca640 1 -- 172.21.15.12:0/753999781 shutdown_connections 2024-09-11T23:04:33.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.120+0000 7f39cbcca640 1 --2- 172.21.15.12:0/753999781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39c4134900 0x7f39c4134ce0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:33.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.120+0000 7f39cbcca640 1 -- 172.21.15.12:0/753999781 >> 172.21.15.12:0/753999781 conn(0x7f39c4068000 msgr2=0x7f39c40a5910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:33.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.120+0000 7f39cbcca640 1 -- 172.21.15.12:0/753999781 shutdown_connections 2024-09-11T23:04:33.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.120+0000 7f39cbcca640 1 -- 172.21.15.12:0/753999781 wait complete. 2024-09-11T23:04:33.121 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:33.120+0000 7fd20ac33180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T23:04:33.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.120+0000 7f39cbcca640 1 Processor -- start 2024-09-11T23:04:33.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.120+0000 7f39cbcca640 1 -- start start 2024-09-11T23:04:33.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.120+0000 7f39cbcca640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39c4134900 0x7f39c41cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:33.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.120+0000 7f39cbcca640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f39c413ff00 con 0x7f39c4134900 2024-09-11T23:04:33.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.120+0000 7f39c9a66640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39c4134900 0x7f39c41cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:33.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.120+0000 7f39c9a66640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39c4134900 0x7f39c41cfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39406/0 (socket says 172.21.15.12:39406) 2024-09-11T23:04:33.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.120+0000 7f39c9a66640 1 -- 172.21.15.12:0/4035153953 learned_addr learned my addr 172.21.15.12:0/4035153953 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:33.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.120+0000 7f39c9a66640 1 -- 172.21.15.12:0/4035153953 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39c41cf850 con 0x7f39c4134900 2024-09-11T23:04:33.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.120+0000 7f39c9a66640 1 --2- 172.21.15.12:0/4035153953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39c4134900 0x7f39c41cfc80 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f39b401a080 tx=0x7f39b401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:33.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.120+0000 7f39ba7fc640 1 -- 172.21.15.12:0/4035153953 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39b40abe30 con 0x7f39c4134900 2024-09-11T23:04:33.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.120+0000 7f39ba7fc640 1 -- 172.21.15.12:0/4035153953 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39b40b4600 con 0x7f39c4134900 2024-09-11T23:04:33.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.120+0000 7f39cbcca640 1 -- 172.21.15.12:0/4035153953 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39c413cdd0 con 0x7f39c4134900 2024-09-11T23:04:33.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.120+0000 7f39ba7fc640 1 -- 172.21.15.12:0/4035153953 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39b40b48e0 con 0x7f39c4134900 2024-09-11T23:04:33.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.120+0000 7f39cbcca640 1 -- 172.21.15.12:0/4035153953 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39c413af90 con 0x7f39c4134900 2024-09-11T23:04:33.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.120+0000 7f39ba7fc640 1 -- 172.21.15.12:0/4035153953 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 11) ==== 44155+0+0 (secure 0 0 0) 0x7f39b40b4a80 con 0x7f39c4134900 2024-09-11T23:04:33.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.120+0000 7f39ba7fc640 1 --2- 172.21.15.12:0/4035153953 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7f39a8035ed0 0x7f39a8038390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:33.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.120+0000 7f39ba7fc640 1 -- 172.21.15.12:0/4035153953 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 3697+0+0 (secure 0 0 0) 0x7f39b40e32b0 con 0x7f39c4134900 2024-09-11T23:04:33.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.120+0000 7f39c9265640 1 -- 172.21.15.12:0/4035153953 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7f39a8035ed0 msgr2=0x7f39a8038390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6824/2217914063 2024-09-11T23:04:33.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.120+0000 7f39c9265640 1 --2- 172.21.15.12:0/4035153953 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7f39a8035ed0 0x7f39a8038390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:04:33.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.120+0000 7f39cbcca640 1 -- 172.21.15.12:0/4035153953 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39c4134ce0 con 0x7f39c4134900 2024-09-11T23:04:33.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.128+0000 7f39ba7fc640 1 -- 172.21.15.12:0/4035153953 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f39b40160d0 con 0x7f39c4134900 2024-09-11T23:04:33.199 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:33.196+0000 7fd20ac33180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T23:04:33.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.324+0000 7f39c9265640 1 -- 172.21.15.12:0/4035153953 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7f39a8035ed0 msgr2=0x7f39a8038390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6824/2217914063 2024-09-11T23:04:33.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.324+0000 7f39c9265640 1 --2- 172.21.15.12:0/4035153953 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7f39a8035ed0 0x7f39a8038390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T23:04:33.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.324+0000 7f39cbcca640 1 -- 172.21.15.12:0/4035153953 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f39c4135ad0 con 0x7f39c4134900 2024-09-11T23:04:33.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.324+0000 7f39ba7fc640 1 -- 172.21.15.12:0/4035153953 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+3570 (secure 0 0 0) 0x7f39b40b4d70 con 0x7f39c4134900 2024-09-11T23:04:33.327 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:04:33.327 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":16,"btime":"2024-09-11T23:04:09:670574+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4328,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6827/3738380591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":3738380591},{"type":"v1","addr":"172.21.15.12:6827","nonce":3738380591}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:04:06.012942+0000","modified":"2024-09-11T23:04:09.042274+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4329},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4329":{"gid":4329,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6829/514415350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":514415350},{"type":"v1","addr":"172.21.15.12:6829","nonce":514415350}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4329,"qdb_cluster":[4329]},"id":2}]} 2024-09-11T23:04:33.327 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 16 2024-09-11T23:04:33.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.328+0000 7f39cbcca640 1 -- 172.21.15.12:0/4035153953 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7f39a8035ed0 msgr2=0x7f39a8038390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:04:33.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.328+0000 7f39cbcca640 1 --2- 172.21.15.12:0/4035153953 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7f39a8035ed0 0x7f39a8038390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:33.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.328+0000 7f39cbcca640 1 -- 172.21.15.12:0/4035153953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39c4134900 msgr2=0x7f39c41cfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:33.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.328+0000 7f39cbcca640 1 --2- 172.21.15.12:0/4035153953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39c4134900 0x7f39c41cfc80 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f39b401a080 tx=0x7f39b401ac90 comp rx=0 tx=0).stop 2024-09-11T23:04:33.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.328+0000 7f39cbcca640 1 -- 172.21.15.12:0/4035153953 shutdown_connections 2024-09-11T23:04:33.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.328+0000 7f39cbcca640 1 --2- 172.21.15.12:0/4035153953 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7f39a8035ed0 0x7f39a8038390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:33.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.328+0000 7f39cbcca640 1 --2- 172.21.15.12:0/4035153953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39c4134900 0x7f39c41cfc80 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:33.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.328+0000 7f39cbcca640 1 -- 172.21.15.12:0/4035153953 >> 172.21.15.12:0/4035153953 conn(0x7f39c4068000 msgr2=0x7f39c40a80c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:33.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.328+0000 7f39cbcca640 1 -- 172.21.15.12:0/4035153953 shutdown_connections 2024-09-11T23:04:33.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.328+0000 7f39cbcca640 1 -- 172.21.15.12:0/4035153953 wait complete. 2024-09-11T23:04:33.344 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:04:33.354 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:33.352+0000 7fd20ac33180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T23:04:33.432 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:33.428+0000 7fd20ac33180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T23:04:33.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.460+0000 7f65cfa9e640 1 Processor -- start 2024-09-11T23:04:33.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.460+0000 7f65cfa9e640 1 -- start start 2024-09-11T23:04:33.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.464+0000 7f65cfa9e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f65c80a2fa0 0x7f65c813ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:33.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.464+0000 7f65cfa9e640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65c80702d0 con 0x7f65c80a24b0 2024-09-11T23:04:33.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.464+0000 7f65cfa9e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f65c80a4d30 con 0x7f65c80a2fa0 2024-09-11T23:04:33.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.464+0000 7f65cd039640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f65c80a2fa0 0x7f65c813ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:33.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.464+0000 7f65cd83a640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f65c80a24b0 0x7f65c80a2890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38618/0 (socket says 172.21.15.12:38618) 2024-09-11T23:04:33.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.464+0000 7f65cd83a640 1 -- 172.21.15.12:0/4124909017 learned_addr learned my addr 172.21.15.12:0/4124909017 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:04:33.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.464+0000 7f65cc838640 1 -- 172.21.15.12:0/4124909017 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3131720943 0 0) 0x7f65c80702d0 con 0x7f65c80a24b0 2024-09-11T23:04:33.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.464+0000 7f65cc838640 1 -- 172.21.15.12:0/4124909017 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65b4003530 con 0x7f65c80a24b0 2024-09-11T23:04:33.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.464+0000 7f65cd039640 1 -- 172.21.15.12:0/4124909017 >> v1:172.21.15.12:6789/0 conn(0x7f65c80a24b0 legacy=0x7f65c80a2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:33.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.464+0000 7f65cd039640 1 -- 172.21.15.12:0/4124909017 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65c806c9f0 con 0x7f65c80a2fa0 2024-09-11T23:04:33.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.464+0000 7f65cd039640 1 --2- 172.21.15.12:0/4124909017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65c80a2fa0 0x7f65c813ce00 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f65b8009740 tx=0x7f65b801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f0f8eb9708a9cd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:33.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.464+0000 7f65cc838640 1 -- 172.21.15.12:0/4124909017 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65b80b0070 con 0x7f65c80a2fa0 2024-09-11T23:04:33.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.464+0000 7f65cc838640 1 -- 172.21.15.12:0/4124909017 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65b80ab530 con 0x7f65c80a2fa0 2024-09-11T23:04:33.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.464+0000 7f65cc838640 1 -- 172.21.15.12:0/4124909017 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65b80ab830 con 0x7f65c80a2fa0 2024-09-11T23:04:33.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.468+0000 7f65cfa9e640 1 -- 172.21.15.12:0/4124909017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65c80a2fa0 msgr2=0x7f65c813ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:33.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.468+0000 7f65cfa9e640 1 --2- 172.21.15.12:0/4124909017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65c80a2fa0 0x7f65c813ce00 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f65b8009740 tx=0x7f65b801c420 comp rx=0 tx=0).stop 2024-09-11T23:04:33.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.468+0000 7f65cfa9e640 1 -- 172.21.15.12:0/4124909017 shutdown_connections 2024-09-11T23:04:33.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.468+0000 7f65cfa9e640 1 --2- 172.21.15.12:0/4124909017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65c80a2fa0 0x7f65c813ce00 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:33.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.468+0000 7f65cfa9e640 1 -- 172.21.15.12:0/4124909017 >> 172.21.15.12:0/4124909017 conn(0x7f65c8068000 msgr2=0x7f65c80a5910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:33.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.468+0000 7f65cfa9e640 1 -- 172.21.15.12:0/4124909017 shutdown_connections 2024-09-11T23:04:33.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.468+0000 7f65cfa9e640 1 -- 172.21.15.12:0/4124909017 wait complete. 2024-09-11T23:04:33.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.468+0000 7f65cfa9e640 1 Processor -- start 2024-09-11T23:04:33.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.468+0000 7f65cfa9e640 1 -- start start 2024-09-11T23:04:33.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.468+0000 7f65cfa9e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65c80a24b0 0x7f65c80a02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:33.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.468+0000 7f65cfa9e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f65c813fce0 con 0x7f65c80a24b0 2024-09-11T23:04:33.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.468+0000 7f65cd83a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65c80a24b0 0x7f65c80a02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:33.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.468+0000 7f65cd83a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65c80a24b0 0x7f65c80a02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39428/0 (socket says 172.21.15.12:39428) 2024-09-11T23:04:33.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.468+0000 7f65cd83a640 1 -- 172.21.15.12:0/3325736696 learned_addr learned my addr 172.21.15.12:0/3325736696 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:33.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.468+0000 7f65cd83a640 1 -- 172.21.15.12:0/3325736696 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65c811f650 con 0x7f65c80a24b0 2024-09-11T23:04:33.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.468+0000 7f65cd83a640 1 --2- 172.21.15.12:0/3325736696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65c80a24b0 0x7f65c80a02a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f65c400c450 tx=0x7f65c400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:33.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.468+0000 7f65be7fc640 1 -- 172.21.15.12:0/3325736696 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65c4017070 con 0x7f65c80a24b0 2024-09-11T23:04:33.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.468+0000 7f65be7fc640 1 -- 172.21.15.12:0/3325736696 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65c4005c20 con 0x7f65c80a24b0 2024-09-11T23:04:33.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.468+0000 7f65cfa9e640 1 -- 172.21.15.12:0/3325736696 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65c81202b0 con 0x7f65c80a24b0 2024-09-11T23:04:33.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.468+0000 7f65be7fc640 1 -- 172.21.15.12:0/3325736696 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65c4007070 con 0x7f65c80a24b0 2024-09-11T23:04:33.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.468+0000 7f65cfa9e640 1 -- 172.21.15.12:0/3325736696 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65c80a2290 con 0x7f65c80a24b0 2024-09-11T23:04:33.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.468+0000 7f65be7fc640 1 -- 172.21.15.12:0/3325736696 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 11) ==== 44155+0+0 (secure 0 0 0) 0x7f65c401a070 con 0x7f65c80a24b0 2024-09-11T23:04:33.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.468+0000 7f65cfa9e640 1 -- 172.21.15.12:0/3325736696 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65c80a2890 con 0x7f65c80a24b0 2024-09-11T23:04:33.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.468+0000 7f65be7fc640 1 --2- 172.21.15.12:0/3325736696 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7f65ac035ed0 0x7f65ac038390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:33.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.468+0000 7f65be7fc640 1 -- 172.21.15.12:0/3325736696 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 3697+0+0 (secure 0 0 0) 0x7f65c4047b40 con 0x7f65c80a24b0 2024-09-11T23:04:33.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.468+0000 7f65cd039640 1 -- 172.21.15.12:0/3325736696 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7f65ac035ed0 msgr2=0x7f65ac038390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6824/2217914063 2024-09-11T23:04:33.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.468+0000 7f65cd039640 1 --2- 172.21.15.12:0/3325736696 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7f65ac035ed0 0x7f65ac038390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:04:33.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.476+0000 7f65be7fc640 1 -- 172.21.15.12:0/3325736696 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f65c4007210 con 0x7f65c80a24b0 2024-09-11T23:04:33.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.636+0000 7f65cfa9e640 1 -- 172.21.15.12:0/3325736696 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f65c80a1fc0 con 0x7f65c80a24b0 2024-09-11T23:04:33.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.640+0000 7f65be7fc640 1 -- 172.21.15.12:0/3325736696 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+11051 (secure 0 0 0) 0x7f65c4012400 con 0x7f65c80a24b0 2024-09-11T23:04:33.641 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:04:33.641 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":26,"fsid":"8be14356-3340-4500-91a2-4cbc6b511f65","created":"2024-09-11T23:03:10.620234+0000","modified":"2024-09-11T23:04:22.130726+0000","last_up_change":"2024-09-11T23:03:22.359028+0000","last_in_change":"2024-09-11T23:03:11.545817+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:03:23.587068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:04:03.949125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-11T23:04:05.020777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"153b72a1-40b1-400d-93ea-333e733f9bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6817","nonce":3680911937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6819","nonce":3680911937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6823","nonce":3680911937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6821","nonce":3680911937}]},"public_addr":"172.21.15.12:6817/3680911937","cluster_addr":"172.21.15.12:6819/3680911937","heartbeat_back_addr":"172.21.15.12:6823/3680911937","heartbeat_front_addr":"172.21.15.12:6821/3680911937","state":["exists","up"]},{"osd":1,"uuid":"94669e49-ee4f-4acf-9e25-e94374dda8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6801","nonce":236825163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6803","nonce":236825163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6807","nonce":236825163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6805","nonce":236825163}]},"public_addr":"172.21.15.12:6801/236825163","cluster_addr":"172.21.15.12:6803/236825163","heartbeat_back_addr":"172.21.15.12:6807/236825163","heartbeat_front_addr":"172.21.15.12:6805/236825163","state":["exists","up"]},{"osd":2,"uuid":"826dae4d-8888-4ec5-8f00-425b3be93814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6809","nonce":3263521655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6811","nonce":3263521655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6815","nonce":3263521655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6813","nonce":3263521655}]},"public_addr":"172.21.15.12:6809/3263521655","cluster_addr":"172.21.15.12:6811/3263521655","heartbeat_back_addr":"172.21.15.12:6815/3263521655","heartbeat_front_addr":"172.21.15.12:6813/3263521655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:19.398518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.761524+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.904997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/255391181":"2024-09-12T23:04:22.130661+0000","172.21.15.12:0/2345769658":"2024-09-12T23:04:22.130661+0000","172.21.15.12:0/4120232861":"2024-09-12T23:04:22.130661+0000","172.21.15.12:6825/2765460338":"2024-09-12T23:04:22.130661+0000","172.21.15.12:6824/2765460338":"2024-09-12T23:04:22.130661+0000","172.21.15.12:0/1241865013":"2024-09-12T23:04:22.130661+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:04:33.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.640+0000 7f65cfa9e640 1 -- 172.21.15.12:0/3325736696 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7f65ac035ed0 msgr2=0x7f65ac038390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:04:33.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.640+0000 7f65cfa9e640 1 --2- 172.21.15.12:0/3325736696 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7f65ac035ed0 0x7f65ac038390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:33.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.640+0000 7f65cfa9e640 1 -- 172.21.15.12:0/3325736696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65c80a24b0 msgr2=0x7f65c80a02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:33.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.640+0000 7f65cfa9e640 1 --2- 172.21.15.12:0/3325736696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65c80a24b0 0x7f65c80a02a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f65c400c450 tx=0x7f65c400c910 comp rx=0 tx=0).stop 2024-09-11T23:04:33.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.640+0000 7f65cfa9e640 1 -- 172.21.15.12:0/3325736696 shutdown_connections 2024-09-11T23:04:33.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.640+0000 7f65cfa9e640 1 --2- 172.21.15.12:0/3325736696 >> [v2:172.21.15.12:6824/2217914063,v1:172.21.15.12:6825/2217914063] conn(0x7f65ac035ed0 0x7f65ac038390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:33.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.640+0000 7f65cfa9e640 1 --2- 172.21.15.12:0/3325736696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65c80a24b0 0x7f65c80a02a0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:33.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.640+0000 7f65cfa9e640 1 -- 172.21.15.12:0/3325736696 >> 172.21.15.12:0/3325736696 conn(0x7f65c8068000 msgr2=0x7f65c80a7ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:33.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.640+0000 7f65cfa9e640 1 -- 172.21.15.12:0/3325736696 shutdown_connections 2024-09-11T23:04:33.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.640+0000 7f65cfa9e640 1 -- 172.21.15.12:0/3325736696 wait complete. 2024-09-11T23:04:33.659 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-11T23:04:33.735 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:33.732+0000 7fd20ac33180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T23:04:33.793 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:33.792+0000 7fd20ac33180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T23:04:33.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.820+0000 7f54a2545640 1 Processor -- start 2024-09-11T23:04:33.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.820+0000 7f54a2545640 1 -- start start 2024-09-11T23:04:33.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.820+0000 7f54a2545640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f549c09f190 0x7f549c09f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:33.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.820+0000 7f54a2545640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f549c0a0670 con 0x7f549c09a9d0 2024-09-11T23:04:33.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.820+0000 7f54a2545640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f549c0a0e30 con 0x7f549c09f190 2024-09-11T23:04:33.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.820+0000 7f549bfff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f549c09f190 0x7f549c09f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:33.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.820+0000 7f549b7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f549c09a9d0 0x7f549c136460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38620/0 (socket says 172.21.15.12:38620) 2024-09-11T23:04:33.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.820+0000 7f549bfff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f549c09f190 0x7f549c09f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39448/0 (socket says 172.21.15.12:39448) 2024-09-11T23:04:33.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.820+0000 7f549b7fe640 1 -- 172.21.15.12:0/1195426383 learned_addr learned my addr 172.21.15.12:0/1195426383 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:04:33.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.820+0000 7f549bfff640 1 -- 172.21.15.12:0/1195426383 >> v1:172.21.15.12:6789/0 conn(0x7f549c09a9d0 legacy=0x7f549c136460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:33.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.820+0000 7f549bfff640 1 -- 172.21.15.12:0/1195426383 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f549c0a3ec0 con 0x7f549c09f190 2024-09-11T23:04:33.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.820+0000 7f549affd640 1 -- 172.21.15.12:0/1195426383 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1803388300 0 0) 0x7f549c0a0670 con 0x7f549c09a9d0 2024-09-11T23:04:33.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.824+0000 7f549bfff640 1 --2- 172.21.15.12:0/1195426383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f549c09f190 0x7f549c09f570 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f548c00a8e0 tx=0x7f548c01d760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b0baddc8b59ddb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:33.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.824+0000 7f549affd640 1 -- 172.21.15.12:0/1195426383 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f548c00b040 con 0x7f549c09f190 2024-09-11T23:04:33.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.824+0000 7f549affd640 1 -- 172.21.15.12:0/1195426383 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f548c0a9550 con 0x7f549c09f190 2024-09-11T23:04:33.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.824+0000 7f549affd640 1 -- 172.21.15.12:0/1195426383 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f548c0a9850 con 0x7f549c09f190 2024-09-11T23:04:33.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.824+0000 7f54a2545640 1 -- 172.21.15.12:0/1195426383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f549c09f190 msgr2=0x7f549c09f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:33.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.824+0000 7f54a2545640 1 --2- 172.21.15.12:0/1195426383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f549c09f190 0x7f549c09f570 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f548c00a8e0 tx=0x7f548c01d760 comp rx=0 tx=0).stop 2024-09-11T23:04:33.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.824+0000 7f54a2545640 1 -- 172.21.15.12:0/1195426383 shutdown_connections 2024-09-11T23:04:33.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.824+0000 7f54a2545640 1 --2- 172.21.15.12:0/1195426383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f549c09f190 0x7f549c09f570 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:33.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.824+0000 7f54a2545640 1 -- 172.21.15.12:0/1195426383 >> 172.21.15.12:0/1195426383 conn(0x7f549c0a82f0 msgr2=0x7f549c0a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:33.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.824+0000 7f54a2545640 1 -- 172.21.15.12:0/1195426383 shutdown_connections 2024-09-11T23:04:33.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.824+0000 7f54a2545640 1 -- 172.21.15.12:0/1195426383 wait complete. 2024-09-11T23:04:33.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.828+0000 7f54a2545640 1 Processor -- start 2024-09-11T23:04:33.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.828+0000 7f54a2545640 1 -- start start 2024-09-11T23:04:33.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.828+0000 7f54a2545640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f549c09f190 0x7f549c072860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:33.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.828+0000 7f54a2545640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f549c0a3a80 con 0x7f549c09f190 2024-09-11T23:04:33.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.828+0000 7f549bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f549c09f190 0x7f549c072860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:33.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.828+0000 7f549bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f549c09f190 0x7f549c072860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39468/0 (socket says 172.21.15.12:39468) 2024-09-11T23:04:33.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.828+0000 7f549bfff640 1 -- 172.21.15.12:0/2733444661 learned_addr learned my addr 172.21.15.12:0/2733444661 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:33.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.828+0000 7f549bfff640 1 -- 172.21.15.12:0/2733444661 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f549c071d30 con 0x7f549c09f190 2024-09-11T23:04:33.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.828+0000 7f549bfff640 1 --2- 172.21.15.12:0/2733444661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f549c09f190 0x7f549c072860 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f548c00a8e0 tx=0x7f548c01a500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:33.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.828+0000 7f5498ff9640 1 -- 172.21.15.12:0/2733444661 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f548c0bf070 con 0x7f549c09f190 2024-09-11T23:04:33.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.828+0000 7f5498ff9640 1 -- 172.21.15.12:0/2733444661 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f548c0b1610 con 0x7f549c09f190 2024-09-11T23:04:33.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.828+0000 7f54a2545640 1 -- 172.21.15.12:0/2733444661 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f549c13b6c0 con 0x7f549c09f190 2024-09-11T23:04:33.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.828+0000 7f5498ff9640 1 -- 172.21.15.12:0/2733444661 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f548c0b6070 con 0x7f549c09f190 2024-09-11T23:04:33.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.828+0000 7f54a2545640 1 -- 172.21.15.12:0/2733444661 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f549c06fef0 con 0x7f549c09f190 2024-09-11T23:04:33.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.828+0000 7f5498ff9640 1 -- 172.21.15.12:0/2733444661 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 12) ==== 43764+0+0 (secure 0 0 0) 0x7f548c0c2070 con 0x7f549c09f190 2024-09-11T23:04:33.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.828+0000 7f54a2545640 1 -- 172.21.15.12:0/2733444661 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f549c073550 con 0x7f549c09f190 2024-09-11T23:04:33.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.828+0000 7f5498ff9640 1 -- 172.21.15.12:0/2733444661 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4041+0+0 (secure 0 0 0) 0x7f548c0e26f0 con 0x7f549c09f190 2024-09-11T23:04:33.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:33.832+0000 7f5498ff9640 1 -- 172.21.15.12:0/2733444661 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f548c0ad030 con 0x7f549c09f190 2024-09-11T23:04:33.890 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:33.888+0000 7fd19282a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:04:33.891 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:33.888+0000 7fd19282a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:04:33.891 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:33.888+0000 7fd19282a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:04:33.891 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:33.888+0000 7fd19282a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:04:33.891 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:33.888+0000 7fd19282a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:04:33.891 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:33.888+0000 7fd195830640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:04:33.891 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:33.888+0000 7fd195830640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:04:33.892 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:33.888+0000 7fd195830640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:04:33.892 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:33.888+0000 7fd195830640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:04:33.892 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:04:33.888+0000 7fd195830640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:04:34.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:34.040+0000 7f54a2545640 1 -- 172.21.15.12:0/2733444661 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f549c09f570 con 0x7f549c09f190 2024-09-11T23:04:34.043 INFO:tasks.ceph.mon.a.smithi012.stderr:2024-09-11T23:04:34.040+0000 7fd71c996640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T23:04:34.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:34.044+0000 7f5498ff9640 1 -- 172.21.15.12:0/2733444661 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) ==== 161+0+0 (secure 0 0 0) 0x7f548c0173e0 con 0x7f549c09f190 2024-09-11T23:04:34.045 INFO:teuthology.orchestra.run.smithi012.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T23:04:34.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:34.044+0000 7f54a2545640 1 -- 172.21.15.12:0/2733444661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f549c09f190 msgr2=0x7f549c072860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:34.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:34.044+0000 7f54a2545640 1 --2- 172.21.15.12:0/2733444661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f549c09f190 0x7f549c072860 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f548c00a8e0 tx=0x7f548c01a500 comp rx=0 tx=0).stop 2024-09-11T23:04:34.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:34.044+0000 7f54a2545640 1 -- 172.21.15.12:0/2733444661 shutdown_connections 2024-09-11T23:04:34.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:34.044+0000 7f54a2545640 1 --2- 172.21.15.12:0/2733444661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f549c09f190 0x7f549c072860 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:34.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:34.044+0000 7f54a2545640 1 -- 172.21.15.12:0/2733444661 >> 172.21.15.12:0/2733444661 conn(0x7f549c0a82f0 msgr2=0x7f549c09cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:34.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:34.044+0000 7f54a2545640 1 -- 172.21.15.12:0/2733444661 shutdown_connections 2024-09-11T23:04:34.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:34.044+0000 7f54a2545640 1 -- 172.21.15.12:0/2733444661 wait complete. 2024-09-11T23:04:34.055 INFO:tasks.ceph.mds.b.smithi012.stderr: -2908> 2024-09-11T23:04:11.628+0000 7f7f3436b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T23:04:34.064 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-11T23:04:34.109 INFO:tasks.ceph.mds.b.smithi012.stdout:starting mds.b at 2024-09-11T23:04:34.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:34.220+0000 7f2a0cc9f640 1 Processor -- start 2024-09-11T23:04:34.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:34.220+0000 7f2a0cc9f640 1 -- start start 2024-09-11T23:04:34.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:34.220+0000 7f2a0cc9f640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2a0809dbc0 0x7f2a0806d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:34.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:34.220+0000 7f2a0cc9f640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a0809c440 con 0x7f2a080aaab0 2024-09-11T23:04:34.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:34.220+0000 7f2a0cc9f640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f2a0809c210 con 0x7f2a0809dbc0 2024-09-11T23:04:34.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:34.220+0000 7f2a05d9b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2a0809dbc0 0x7f2a0806d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:34.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:34.220+0000 7f2a0659c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f2a080aaab0 0x7f2a0806cd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38636/0 (socket says 172.21.15.12:38636) 2024-09-11T23:04:34.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:34.220+0000 7f2a0659c640 1 -- 172.21.15.12:0/1718969045 learned_addr learned my addr 172.21.15.12:0/1718969045 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:04:34.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:34.220+0000 7f2a05d9b640 1 -- 172.21.15.12:0/1718969045 >> v1:172.21.15.12:6789/0 conn(0x7f2a080aaab0 legacy=0x7f2a0806cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:34.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:34.220+0000 7f2a05d9b640 1 -- 172.21.15.12:0/1718969045 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a0809cf00 con 0x7f2a0809dbc0 2024-09-11T23:04:34.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:34.220+0000 7f2a05d9b640 1 --2- 172.21.15.12:0/1718969045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a0809dbc0 0x7f2a0806d480 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f29fc009740 tx=0x7f29fc01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bdde20d78d194d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:34.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:34.220+0000 7f2a0559a640 1 -- 172.21.15.12:0/1718969045 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29fc0b0070 con 0x7f2a0809dbc0 2024-09-11T23:04:34.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:34.220+0000 7f2a0559a640 1 -- 172.21.15.12:0/1718969045 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29fc0ab530 con 0x7f2a0809dbc0 2024-09-11T23:04:34.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:34.220+0000 7f2a0559a640 1 -- 172.21.15.12:0/1718969045 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29fc0ab830 con 0x7f2a0809dbc0 2024-09-11T23:04:34.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:34.224+0000 7f2a0cc9f640 1 -- 172.21.15.12:0/1718969045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a0809dbc0 msgr2=0x7f2a0806d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:34.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:34.224+0000 7f2a0cc9f640 1 --2- 172.21.15.12:0/1718969045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a0809dbc0 0x7f2a0806d480 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f29fc009740 tx=0x7f29fc01c420 comp rx=0 tx=0).stop 2024-09-11T23:04:34.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:34.224+0000 7f2a0cc9f640 1 -- 172.21.15.12:0/1718969045 shutdown_connections 2024-09-11T23:04:34.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:34.224+0000 7f2a0cc9f640 1 --2- 172.21.15.12:0/1718969045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a0809dbc0 0x7f2a0806d480 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:34.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:34.224+0000 7f2a0cc9f640 1 -- 172.21.15.12:0/1718969045 >> 172.21.15.12:0/1718969045 conn(0x7f2a080719a0 msgr2=0x7f2a0809a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:34.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:34.224+0000 7f2a0cc9f640 1 -- 172.21.15.12:0/1718969045 shutdown_connections 2024-09-11T23:04:34.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:34.224+0000 7f2a0cc9f640 1 -- 172.21.15.12:0/1718969045 wait complete. 2024-09-11T23:04:34.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:34.224+0000 7f2a0cc9f640 1 Processor -- start 2024-09-11T23:04:34.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:34.224+0000 7f2a0cc9f640 1 -- start start 2024-09-11T23:04:34.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:34.224+0000 7f2a0cc9f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a0809dbc0 0x7f2a08123bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:34.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:34.224+0000 7f2a0cc9f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2a0806e1c0 con 0x7f2a0809dbc0 2024-09-11T23:04:34.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:34.224+0000 7f2a0659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a0809dbc0 0x7f2a08123bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:34.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:34.224+0000 7f2a0659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a0809dbc0 0x7f2a08123bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39588/0 (socket says 172.21.15.12:39588) 2024-09-11T23:04:34.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:34.224+0000 7f2a0659c640 1 -- 172.21.15.12:0/3391527221 learned_addr learned my addr 172.21.15.12:0/3391527221 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:34.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:34.224+0000 7f2a0659c640 1 -- 172.21.15.12:0/3391527221 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a081234a0 con 0x7f2a0809dbc0 2024-09-11T23:04:34.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:34.224+0000 7f2a0659c640 1 --2- 172.21.15.12:0/3391527221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a0809dbc0 0x7f2a08123bf0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f29f800c480 tx=0x7f29f800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:34.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:34.224+0000 7f29f6ffd640 1 -- 172.21.15.12:0/3391527221 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29f8017070 con 0x7f2a0809dbc0 2024-09-11T23:04:34.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:34.224+0000 7f29f6ffd640 1 -- 172.21.15.12:0/3391527221 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29f8005c20 con 0x7f2a0809dbc0 2024-09-11T23:04:34.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:34.224+0000 7f2a0cc9f640 1 -- 172.21.15.12:0/3391527221 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a080a9f10 con 0x7f2a0809dbc0 2024-09-11T23:04:34.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:34.224+0000 7f29f6ffd640 1 -- 172.21.15.12:0/3391527221 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29f8007070 con 0x7f2a0809dbc0 2024-09-11T23:04:34.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:34.224+0000 7f2a0cc9f640 1 -- 172.21.15.12:0/3391527221 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a080a95c0 con 0x7f2a0809dbc0 2024-09-11T23:04:34.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:34.224+0000 7f29f6ffd640 1 -- 172.21.15.12:0/3391527221 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 12) ==== 43764+0+0 (secure 0 0 0) 0x7f29f801a070 con 0x7f2a0809dbc0 2024-09-11T23:04:34.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:34.224+0000 7f2a0cc9f640 1 -- 172.21.15.12:0/3391527221 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a08122220 con 0x7f2a0809dbc0 2024-09-11T23:04:34.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:34.224+0000 7f29f6ffd640 1 -- 172.21.15.12:0/3391527221 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4127+0+0 (secure 0 0 0) 0x7f29f8047690 con 0x7f2a0809dbc0 2024-09-11T23:04:34.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:34.232+0000 7f29f6ffd640 1 -- 172.21.15.12:0/3391527221 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f29f8007210 con 0x7f2a0809dbc0 2024-09-11T23:04:34.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:34.440+0000 7f2a0cc9f640 1 -- 172.21.15.12:0/3391527221 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f2a0806cd70 con 0x7f2a0809dbc0 2024-09-11T23:04:34.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:34.820+0000 7f29f6ffd640 1 -- 172.21.15.12:0/3391527221 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 13) ==== 43891+0+0 (secure 0 0 0) 0x7f29f801b3b0 con 0x7f2a0809dbc0 2024-09-11T23:04:34.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:34.820+0000 7f29f6ffd640 1 --2- 172.21.15.12:0/3391527221 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f29e803a4f0 0x7f29e803c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:34.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:34.824+0000 7f2a05d9b640 1 --2- 172.21.15.12:0/3391527221 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f29e803a4f0 0x7f29e803c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:34.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:34.824+0000 7f2a05d9b640 1 --2- 172.21.15.12:0/3391527221 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f29e803a4f0 0x7f29e803c8e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f29fc0ad000 tx=0x7f29fc0a6000 comp rx=0 tx=0).ready entity=mgr.4452 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:35.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.044+0000 7f29f6ffd640 1 -- 172.21.15.12:0/3391527221 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) ==== 104+0+0 (secure 0 0 0) 0x7f29f8049820 con 0x7f2a0809dbc0 2024-09-11T23:04:35.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.048+0000 7f2a0cc9f640 1 -- 172.21.15.12:0/3391527221 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f29e803a4f0 msgr2=0x7f29e803c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:35.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.048+0000 7f2a0cc9f640 1 --2- 172.21.15.12:0/3391527221 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f29e803a4f0 0x7f29e803c8e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f29fc0ad000 tx=0x7f29fc0a6000 comp rx=0 tx=0).stop 2024-09-11T23:04:35.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.048+0000 7f2a0cc9f640 1 -- 172.21.15.12:0/3391527221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a0809dbc0 msgr2=0x7f2a08123bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:35.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.048+0000 7f2a0cc9f640 1 --2- 172.21.15.12:0/3391527221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a0809dbc0 0x7f2a08123bf0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f29f800c480 tx=0x7f29f800c940 comp rx=0 tx=0).stop 2024-09-11T23:04:35.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.048+0000 7f2a0cc9f640 1 -- 172.21.15.12:0/3391527221 shutdown_connections 2024-09-11T23:04:35.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.048+0000 7f2a0cc9f640 1 --2- 172.21.15.12:0/3391527221 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f29e803a4f0 0x7f29e803c8e0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:35.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.048+0000 7f2a0cc9f640 1 --2- 172.21.15.12:0/3391527221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a0809dbc0 0x7f2a08123bf0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:35.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.048+0000 7f2a0cc9f640 1 -- 172.21.15.12:0/3391527221 >> 172.21.15.12:0/3391527221 conn(0x7f2a080719a0 msgr2=0x7f2a0809ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:35.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.048+0000 7f2a0cc9f640 1 -- 172.21.15.12:0/3391527221 shutdown_connections 2024-09-11T23:04:35.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.048+0000 7f2a0cc9f640 1 -- 172.21.15.12:0/3391527221 wait complete. 2024-09-11T23:04:35.072 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-11T23:04:35.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.204+0000 7fd4cd16d640 1 Processor -- start 2024-09-11T23:04:35.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.204+0000 7fd4cd16d640 1 -- start start 2024-09-11T23:04:35.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.204+0000 7fd4cd16d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd4c809f3a0 0x7fd4c813cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:35.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.204+0000 7fd4cd16d640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4c809f7a0 con 0x7fd4c8134a30 2024-09-11T23:04:35.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.204+0000 7fd4cd16d640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fd4c809db90 con 0x7fd4c809f3a0 2024-09-11T23:04:35.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.204+0000 7fd4c659c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd4c809f3a0 0x7fd4c813cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:35.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.204+0000 7fd4c6d9d640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd4c8134a30 0x7fd4c8134e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47004/0 (socket says 172.21.15.12:47004) 2024-09-11T23:04:35.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.204+0000 7fd4c6d9d640 1 -- 172.21.15.12:0/3502911581 learned_addr learned my addr 172.21.15.12:0/3502911581 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:04:35.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.204+0000 7fd4c659c640 1 -- 172.21.15.12:0/3502911581 >> v1:172.21.15.12:6789/0 conn(0x7fd4c8134a30 legacy=0x7fd4c8134e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:35.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.204+0000 7fd4c659c640 1 -- 172.21.15.12:0/3502911581 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4c809e930 con 0x7fd4c809f3a0 2024-09-11T23:04:35.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.208+0000 7fd4c659c640 1 --2- 172.21.15.12:0/3502911581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4c809f3a0 0x7fd4c813cd20 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc009740 tx=0x7fd4bc01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=493f793aa7634c24 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:35.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.208+0000 7fd4c5d9b640 1 -- 172.21.15.12:0/3502911581 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4bc0b0070 con 0x7fd4c809f3a0 2024-09-11T23:04:35.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.208+0000 7fd4c5d9b640 1 -- 172.21.15.12:0/3502911581 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4bc0ab530 con 0x7fd4c809f3a0 2024-09-11T23:04:35.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.208+0000 7fd4c5d9b640 1 -- 172.21.15.12:0/3502911581 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4bc0ab830 con 0x7fd4c809f3a0 2024-09-11T23:04:35.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.208+0000 7fd4cd16d640 1 -- 172.21.15.12:0/3502911581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4c809f3a0 msgr2=0x7fd4c813cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:35.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.208+0000 7fd4cd16d640 1 --2- 172.21.15.12:0/3502911581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4c809f3a0 0x7fd4c813cd20 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc009740 tx=0x7fd4bc01c390 comp rx=0 tx=0).stop 2024-09-11T23:04:35.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.208+0000 7fd4cd16d640 1 -- 172.21.15.12:0/3502911581 shutdown_connections 2024-09-11T23:04:35.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.208+0000 7fd4cd16d640 1 --2- 172.21.15.12:0/3502911581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4c809f3a0 0x7fd4c813cd20 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:35.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.208+0000 7fd4cd16d640 1 -- 172.21.15.12:0/3502911581 >> 172.21.15.12:0/3502911581 conn(0x7fd4c80a85b0 msgr2=0x7fd4c80a49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:35.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.208+0000 7fd4cd16d640 1 -- 172.21.15.12:0/3502911581 shutdown_connections 2024-09-11T23:04:35.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.208+0000 7fd4cd16d640 1 -- 172.21.15.12:0/3502911581 wait complete. 2024-09-11T23:04:35.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.208+0000 7fd4cd16d640 1 Processor -- start 2024-09-11T23:04:35.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.208+0000 7fd4cd16d640 1 -- start start 2024-09-11T23:04:35.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.212+0000 7fd4cd16d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4c809f3a0 0x7fd4c81cc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:35.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.212+0000 7fd4cd16d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c813fc00 con 0x7fd4c809f3a0 2024-09-11T23:04:35.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.212+0000 7fd4c6d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4c809f3a0 0x7fd4c81cc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:35.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.212+0000 7fd4c6d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4c809f3a0 0x7fd4c81cc4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51802/0 (socket says 172.21.15.12:51802) 2024-09-11T23:04:35.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.212+0000 7fd4c6d9d640 1 -- 172.21.15.12:0/3634687113 learned_addr learned my addr 172.21.15.12:0/3634687113 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:35.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.212+0000 7fd4c6d9d640 1 -- 172.21.15.12:0/3634687113 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4c81cc080 con 0x7fd4c809f3a0 2024-09-11T23:04:35.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.212+0000 7fd4c6d9d640 1 --2- 172.21.15.12:0/3634687113 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4c809f3a0 0x7fd4c81cc4b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fd4c000c430 tx=0x7fd4c000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:35.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.212+0000 7fd4af7fe640 1 -- 172.21.15.12:0/3634687113 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4c0017070 con 0x7fd4c809f3a0 2024-09-11T23:04:35.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.212+0000 7fd4af7fe640 1 -- 172.21.15.12:0/3634687113 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4c0005c20 con 0x7fd4c809f3a0 2024-09-11T23:04:35.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.212+0000 7fd4cd16d640 1 -- 172.21.15.12:0/3634687113 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4c8070bf0 con 0x7fd4c809f3a0 2024-09-11T23:04:35.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.212+0000 7fd4af7fe640 1 -- 172.21.15.12:0/3634687113 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4c0007070 con 0x7fd4c809f3a0 2024-09-11T23:04:35.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.212+0000 7fd4cd16d640 1 -- 172.21.15.12:0/3634687113 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4c8070910 con 0x7fd4c809f3a0 2024-09-11T23:04:35.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.212+0000 7fd4af7fe640 1 -- 172.21.15.12:0/3634687113 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) ==== 43891+0+0 (secure 0 0 0) 0x7fd4c001a070 con 0x7fd4c809f3a0 2024-09-11T23:04:35.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.212+0000 7fd4cd16d640 1 -- 172.21.15.12:0/3634687113 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4c80008e0 con 0x7fd4c809f3a0 2024-09-11T23:04:35.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.212+0000 7fd4af7fe640 1 --2- 172.21.15.12:0/3634687113 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fd4b4035c00 0x7fd4b40380c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:35.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.212+0000 7fd4af7fe640 1 -- 172.21.15.12:0/3634687113 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4127+0+0 (secure 0 0 0) 0x7fd4c0047880 con 0x7fd4c809f3a0 2024-09-11T23:04:35.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.212+0000 7fd4c659c640 1 --2- 172.21.15.12:0/3634687113 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fd4b4035c00 0x7fd4b40380c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:35.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.212+0000 7fd4c659c640 1 --2- 172.21.15.12:0/3634687113 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fd4b4035c00 0x7fd4b40380c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc0ad000 tx=0x7fd4bc008040 comp rx=0 tx=0).ready entity=mgr.4452 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:35.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.220+0000 7fd4af7fe640 1 -- 172.21.15.12:0/3634687113 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd4c809f7a0 con 0x7fd4c809f3a0 2024-09-11T23:04:35.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:35.380+0000 7fd4cd16d640 1 -- 172.21.15.12:0/3634687113 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd4c8071a00 con 0x7fd4c809f3a0 2024-09-11T23:04:36.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.212+0000 7fd4af7fe640 1 -- 172.21.15.12:0/3634687113 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) ==== 181+0+0 (secure 0 0 0) 0x7fd4c001b3b0 con 0x7fd4c809f3a0 2024-09-11T23:04:36.214 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' removed 2024-09-11T23:04:36.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.216+0000 7fd4cd16d640 1 -- 172.21.15.12:0/3634687113 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fd4b4035c00 msgr2=0x7fd4b40380c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:36.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.216+0000 7fd4cd16d640 1 --2- 172.21.15.12:0/3634687113 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fd4b4035c00 0x7fd4b40380c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc0ad000 tx=0x7fd4bc008040 comp rx=0 tx=0).stop 2024-09-11T23:04:36.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.216+0000 7fd4cd16d640 1 -- 172.21.15.12:0/3634687113 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4c809f3a0 msgr2=0x7fd4c81cc4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:36.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.216+0000 7fd4cd16d640 1 --2- 172.21.15.12:0/3634687113 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4c809f3a0 0x7fd4c81cc4b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fd4c000c430 tx=0x7fd4c000c8f0 comp rx=0 tx=0).stop 2024-09-11T23:04:36.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.220+0000 7fd4cd16d640 1 -- 172.21.15.12:0/3634687113 shutdown_connections 2024-09-11T23:04:36.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.220+0000 7fd4cd16d640 1 --2- 172.21.15.12:0/3634687113 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fd4b4035c00 0x7fd4b40380c0 secure :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc0ad000 tx=0x7fd4bc008040 comp rx=0 tx=0).stop 2024-09-11T23:04:36.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.220+0000 7fd4cd16d640 1 --2- 172.21.15.12:0/3634687113 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4c809f3a0 0x7fd4c81cc4b0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:36.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.220+0000 7fd4cd16d640 1 -- 172.21.15.12:0/3634687113 >> 172.21.15.12:0/3634687113 conn(0x7fd4c80a85b0 msgr2=0x7fd4c8136ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:36.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.220+0000 7fd4cd16d640 1 -- 172.21.15.12:0/3634687113 shutdown_connections 2024-09-11T23:04:36.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.220+0000 7fd4cd16d640 1 -- 172.21.15.12:0/3634687113 wait complete. 2024-09-11T23:04:36.243 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-11T23:04:36.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.368+0000 7f202c453640 1 Processor -- start 2024-09-11T23:04:36.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.368+0000 7f202c453640 1 -- start start 2024-09-11T23:04:36.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.368+0000 7f202c453640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f20240a76f0 0x7f202413a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:36.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.368+0000 7f202c453640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f202406cf00 con 0x7f202409f6a0 2024-09-11T23:04:36.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.368+0000 7f202c453640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f2024139ba0 con 0x7f20240a76f0 2024-09-11T23:04:36.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.368+0000 7f202a1ef640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f20240a76f0 0x7f202413a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:36.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.368+0000 7f20299ee640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f202409f6a0 0x7f20240a5ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47018/0 (socket says 172.21.15.12:47018) 2024-09-11T23:04:36.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.368+0000 7f20299ee640 1 -- 172.21.15.12:0/904514897 learned_addr learned my addr 172.21.15.12:0/904514897 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:04:36.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.368+0000 7f202a1ef640 1 -- 172.21.15.12:0/904514897 >> v1:172.21.15.12:6789/0 conn(0x7f202409f6a0 legacy=0x7f20240a5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:36.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.368+0000 7f202a1ef640 1 -- 172.21.15.12:0/904514897 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f202406eb80 con 0x7f20240a76f0 2024-09-11T23:04:36.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.372+0000 7f202a1ef640 1 --2- 172.21.15.12:0/904514897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20240a76f0 0x7f202413a0e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f2020009740 tx=0x7f202001c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a85088bbdd423289 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:36.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.372+0000 7f20291ed640 1 -- 172.21.15.12:0/904514897 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20200b0070 con 0x7f20240a76f0 2024-09-11T23:04:36.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.372+0000 7f20291ed640 1 -- 172.21.15.12:0/904514897 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20200ab530 con 0x7f20240a76f0 2024-09-11T23:04:36.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.372+0000 7f20291ed640 1 -- 172.21.15.12:0/904514897 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20200ab830 con 0x7f20240a76f0 2024-09-11T23:04:36.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.372+0000 7f202c453640 1 -- 172.21.15.12:0/904514897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20240a76f0 msgr2=0x7f202413a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:36.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.372+0000 7f202c453640 1 --2- 172.21.15.12:0/904514897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20240a76f0 0x7f202413a0e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f2020009740 tx=0x7f202001c390 comp rx=0 tx=0).stop 2024-09-11T23:04:36.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.372+0000 7f202c453640 1 -- 172.21.15.12:0/904514897 shutdown_connections 2024-09-11T23:04:36.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.372+0000 7f202c453640 1 --2- 172.21.15.12:0/904514897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20240a76f0 0x7f202413a0e0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:36.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.372+0000 7f202c453640 1 -- 172.21.15.12:0/904514897 >> 172.21.15.12:0/904514897 conn(0x7f20240a6bd0 msgr2=0x7f20240a6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:36.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.372+0000 7f202c453640 1 -- 172.21.15.12:0/904514897 shutdown_connections 2024-09-11T23:04:36.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.372+0000 7f202c453640 1 -- 172.21.15.12:0/904514897 wait complete. 2024-09-11T23:04:36.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.372+0000 7f202c453640 1 Processor -- start 2024-09-11T23:04:36.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.372+0000 7f202c453640 1 -- start start 2024-09-11T23:04:36.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.376+0000 7f202c453640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f202409f6a0 0x7f202413d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:36.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.376+0000 7f202c453640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2024142060 con 0x7f202409f6a0 2024-09-11T23:04:36.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.376+0000 7f202a1ef640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f202409f6a0 0x7f202413d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:36.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.376+0000 7f202a1ef640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f202409f6a0 0x7f202413d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51824/0 (socket says 172.21.15.12:51824) 2024-09-11T23:04:36.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.376+0000 7f202a1ef640 1 -- 172.21.15.12:0/1956521524 learned_addr learned my addr 172.21.15.12:0/1956521524 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:36.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.376+0000 7f202a1ef640 1 -- 172.21.15.12:0/1956521524 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2024121b00 con 0x7f202409f6a0 2024-09-11T23:04:36.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.376+0000 7f202a1ef640 1 --2- 172.21.15.12:0/1956521524 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f202409f6a0 0x7f202413d9c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f20200ae040 tx=0x7f2020019130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:36.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.376+0000 7f201affd640 1 -- 172.21.15.12:0/1956521524 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20200b8020 con 0x7f202409f6a0 2024-09-11T23:04:36.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.376+0000 7f201affd640 1 -- 172.21.15.12:0/1956521524 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20200b4410 con 0x7f202409f6a0 2024-09-11T23:04:36.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.376+0000 7f202c453640 1 -- 172.21.15.12:0/1956521524 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f202413f940 con 0x7f202409f6a0 2024-09-11T23:04:36.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.376+0000 7f201affd640 1 -- 172.21.15.12:0/1956521524 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20200b0040 con 0x7f202409f6a0 2024-09-11T23:04:36.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.376+0000 7f202c453640 1 -- 172.21.15.12:0/1956521524 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2024138e70 con 0x7f202409f6a0 2024-09-11T23:04:36.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.376+0000 7f201affd640 1 -- 172.21.15.12:0/1956521524 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) ==== 43891+0+0 (secure 0 0 0) 0x7f20200bb020 con 0x7f202409f6a0 2024-09-11T23:04:36.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.376+0000 7f202c453640 1 -- 172.21.15.12:0/1956521524 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f202413a0e0 con 0x7f202409f6a0 2024-09-11T23:04:36.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.376+0000 7f201affd640 1 --2- 172.21.15.12:0/1956521524 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f2008035c00 0x7f20080380c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:36.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.376+0000 7f201affd640 1 -- 172.21.15.12:0/1956521524 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 3689+0+0 (secure 0 0 0) 0x7f20200e2170 con 0x7f202409f6a0 2024-09-11T23:04:36.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.376+0000 7f20299ee640 1 --2- 172.21.15.12:0/1956521524 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f2008035c00 0x7f20080380c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:36.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.376+0000 7f20299ee640 1 --2- 172.21.15.12:0/1956521524 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f2008035c00 0x7f20080380c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f202406e760 tx=0x7f2014007ad0 comp rx=0 tx=0).ready entity=mgr.4452 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:36.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.380+0000 7f201affd640 1 -- 172.21.15.12:0/1956521524 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f20200c2030 con 0x7f202409f6a0 2024-09-11T23:04:36.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.544+0000 7f202c453640 1 -- 172.21.15.12:0/1956521524 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f2024120b20 con 0x7f202409f6a0 2024-09-11T23:04:36.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:36.832+0000 7f201affd640 1 -- 172.21.15.12:0/1956521524 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 14) ==== 44099+0+0 (secure 0 0 0) 0x7f20200aa3a0 con 0x7f202409f6a0 2024-09-11T23:04:37.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.228+0000 7f201affd640 1 -- 172.21.15.12:0/1956521524 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) ==== 169+0+0 (secure 0 0 0) 0x7f2020016010 con 0x7f202409f6a0 2024-09-11T23:04:37.231 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' removed 2024-09-11T23:04:37.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.232+0000 7f202c453640 1 -- 172.21.15.12:0/1956521524 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f2008035c00 msgr2=0x7f20080380c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:37.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.232+0000 7f202c453640 1 --2- 172.21.15.12:0/1956521524 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f2008035c00 0x7f20080380c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f202406e760 tx=0x7f2014007ad0 comp rx=0 tx=0).stop 2024-09-11T23:04:37.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.232+0000 7f202c453640 1 -- 172.21.15.12:0/1956521524 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f202409f6a0 msgr2=0x7f202413d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:37.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.232+0000 7f202c453640 1 --2- 172.21.15.12:0/1956521524 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f202409f6a0 0x7f202413d9c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f20200ae040 tx=0x7f2020019130 comp rx=0 tx=0).stop 2024-09-11T23:04:37.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.232+0000 7f202c453640 1 -- 172.21.15.12:0/1956521524 shutdown_connections 2024-09-11T23:04:37.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.232+0000 7f202c453640 1 --2- 172.21.15.12:0/1956521524 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f2008035c00 0x7f20080380c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:37.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.232+0000 7f202c453640 1 --2- 172.21.15.12:0/1956521524 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f202409f6a0 0x7f202413d9c0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:37.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.232+0000 7f202c453640 1 -- 172.21.15.12:0/1956521524 >> 172.21.15.12:0/1956521524 conn(0x7f20240a6bd0 msgr2=0x7f20240a05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:37.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.232+0000 7f202c453640 1 -- 172.21.15.12:0/1956521524 shutdown_connections 2024-09-11T23:04:37.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.232+0000 7f202c453640 1 -- 172.21.15.12:0/1956521524 wait complete. 2024-09-11T23:04:37.260 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-11T23:04:37.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.380+0000 7f3f8886f640 1 Processor -- start 2024-09-11T23:04:37.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.380+0000 7f3f8886f640 1 -- start start 2024-09-11T23:04:37.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.384+0000 7f3f8886f640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3f840a0780 0x7f3f8413ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:37.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.384+0000 7f3f8886f640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f8409fe00 con 0x7f3f84139ff0 2024-09-11T23:04:37.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.384+0000 7f3f8886f640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f3f84139bc0 con 0x7f3f840a0780 2024-09-11T23:04:37.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.384+0000 7f3f81d9b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3f840a0780 0x7f3f8413ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:37.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.384+0000 7f3f8259c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f3f84139ff0 0x7f3f8413a3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47026/0 (socket says 172.21.15.12:47026) 2024-09-11T23:04:37.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.384+0000 7f3f8259c640 1 -- 172.21.15.12:0/2264696665 learned_addr learned my addr 172.21.15.12:0/2264696665 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:04:37.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.384+0000 7f3f81d9b640 1 -- 172.21.15.12:0/2264696665 >> v1:172.21.15.12:6789/0 conn(0x7f3f84139ff0 legacy=0x7f3f8413a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:37.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.384+0000 7f3f81d9b640 1 -- 172.21.15.12:0/2264696665 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f8409faf0 con 0x7f3f840a0780 2024-09-11T23:04:37.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.384+0000 7f3f8159a640 1 -- 172.21.15.12:0/2264696665 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2715070120 0 0) 0x7f3f8409fe00 con 0x7f3f84139ff0 2024-09-11T23:04:37.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.384+0000 7f3f81d9b640 1 --2- 172.21.15.12:0/2264696665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f840a0780 0x7f3f8413ed60 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c009740 tx=0x7f3f6c01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48e95a2afc9962d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:37.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.384+0000 7f3f8159a640 1 -- 172.21.15.12:0/2264696665 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f6c0b0070 con 0x7f3f840a0780 2024-09-11T23:04:37.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.384+0000 7f3f8159a640 1 -- 172.21.15.12:0/2264696665 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f6c0ab530 con 0x7f3f840a0780 2024-09-11T23:04:37.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.384+0000 7f3f8159a640 1 -- 172.21.15.12:0/2264696665 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f6c0ab830 con 0x7f3f840a0780 2024-09-11T23:04:37.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.384+0000 7f3f8886f640 1 -- 172.21.15.12:0/2264696665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f840a0780 msgr2=0x7f3f8413ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:37.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.384+0000 7f3f8886f640 1 --2- 172.21.15.12:0/2264696665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f840a0780 0x7f3f8413ed60 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c009740 tx=0x7f3f6c01c390 comp rx=0 tx=0).stop 2024-09-11T23:04:37.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.384+0000 7f3f8886f640 1 -- 172.21.15.12:0/2264696665 shutdown_connections 2024-09-11T23:04:37.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.384+0000 7f3f8886f640 1 --2- 172.21.15.12:0/2264696665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f840a0780 0x7f3f8413ed60 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:37.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.384+0000 7f3f8886f640 1 -- 172.21.15.12:0/2264696665 >> 172.21.15.12:0/2264696665 conn(0x7f3f840a82f0 msgr2=0x7f3f840a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:37.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.384+0000 7f3f8886f640 1 -- 172.21.15.12:0/2264696665 shutdown_connections 2024-09-11T23:04:37.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.384+0000 7f3f8886f640 1 -- 172.21.15.12:0/2264696665 wait complete. 2024-09-11T23:04:37.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.388+0000 7f3f8886f640 1 Processor -- start 2024-09-11T23:04:37.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.388+0000 7f3f8886f640 1 -- start start 2024-09-11T23:04:37.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.388+0000 7f3f8886f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f840a0780 0x7f3f8411e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:37.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.388+0000 7f3f8886f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3f84141c40 con 0x7f3f840a0780 2024-09-11T23:04:37.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.388+0000 7f3f8259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f840a0780 0x7f3f8411e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:37.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.388+0000 7f3f8259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f840a0780 0x7f3f8411e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51840/0 (socket says 172.21.15.12:51840) 2024-09-11T23:04:37.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.388+0000 7f3f8259c640 1 -- 172.21.15.12:0/657168248 learned_addr learned my addr 172.21.15.12:0/657168248 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:37.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.388+0000 7f3f8259c640 1 -- 172.21.15.12:0/657168248 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f8409d5a0 con 0x7f3f840a0780 2024-09-11T23:04:37.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.388+0000 7f3f8259c640 1 --2- 172.21.15.12:0/657168248 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f840a0780 0x7f3f8411e8b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c00cb80 tx=0x7f3f7c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:37.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.388+0000 7f3f7affd640 1 -- 172.21.15.12:0/657168248 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f7c00ac90 con 0x7f3f840a0780 2024-09-11T23:04:37.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.388+0000 7f3f7affd640 1 -- 172.21.15.12:0/657168248 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f7c00ae30 con 0x7f3f840a0780 2024-09-11T23:04:37.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.388+0000 7f3f8886f640 1 -- 172.21.15.12:0/657168248 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f8409d830 con 0x7f3f840a0780 2024-09-11T23:04:37.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.388+0000 7f3f7affd640 1 -- 172.21.15.12:0/657168248 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f7c012530 con 0x7f3f840a0780 2024-09-11T23:04:37.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.388+0000 7f3f8886f640 1 -- 172.21.15.12:0/657168248 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f8409ca50 con 0x7f3f840a0780 2024-09-11T23:04:37.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.388+0000 7f3f7affd640 1 -- 172.21.15.12:0/657168248 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 14) ==== 44099+0+0 (secure 0 0 0) 0x7f3f7c0126d0 con 0x7f3f840a0780 2024-09-11T23:04:37.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.388+0000 7f3f8886f640 1 -- 172.21.15.12:0/657168248 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f8409d330 con 0x7f3f840a0780 2024-09-11T23:04:37.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.388+0000 7f3f7affd640 1 --2- 172.21.15.12:0/657168248 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f3f68035e40 0x7f3f68038300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:37.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.388+0000 7f3f7affd640 1 -- 172.21.15.12:0/657168248 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3275+0+0 (secure 0 0 0) 0x7f3f7c048cf0 con 0x7f3f840a0780 2024-09-11T23:04:37.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.388+0000 7f3f81d9b640 1 --2- 172.21.15.12:0/657168248 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f3f68035e40 0x7f3f68038300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:37.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.388+0000 7f3f81d9b640 1 --2- 172.21.15.12:0/657168248 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f3f68035e40 0x7f3f68038300 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c0ad000 tx=0x7f3f6c008040 comp rx=0 tx=0).ready entity=mgr.4452 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:37.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.392+0000 7f3f7affd640 1 -- 172.21.15.12:0/657168248 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3f7c019de0 con 0x7f3f840a0780 2024-09-11T23:04:37.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.556+0000 7f3f8886f640 1 -- 172.21.15.12:0/657168248 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f3f8409ee70 con 0x7f3f840a0780 2024-09-11T23:04:37.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.560+0000 7f3f7affd640 1 -- 172.21.15.12:0/657168248 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v6) ==== 104+0+0 (secure 0 0 0) 0x7f3f7c01b920 con 0x7f3f840a0780 2024-09-11T23:04:37.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.564+0000 7f3f8886f640 1 -- 172.21.15.12:0/657168248 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f3f68035e40 msgr2=0x7f3f68038300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:37.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.564+0000 7f3f8886f640 1 --2- 172.21.15.12:0/657168248 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f3f68035e40 0x7f3f68038300 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c0ad000 tx=0x7f3f6c008040 comp rx=0 tx=0).stop 2024-09-11T23:04:37.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.564+0000 7f3f8886f640 1 -- 172.21.15.12:0/657168248 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f840a0780 msgr2=0x7f3f8411e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:37.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.564+0000 7f3f8886f640 1 --2- 172.21.15.12:0/657168248 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f840a0780 0x7f3f8411e8b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c00cb80 tx=0x7f3f7c00a430 comp rx=0 tx=0).stop 2024-09-11T23:04:37.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.564+0000 7f3f8886f640 1 -- 172.21.15.12:0/657168248 shutdown_connections 2024-09-11T23:04:37.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.564+0000 7f3f8886f640 1 --2- 172.21.15.12:0/657168248 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f3f68035e40 0x7f3f68038300 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:37.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.564+0000 7f3f8886f640 1 --2- 172.21.15.12:0/657168248 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f840a0780 0x7f3f8411e8b0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:37.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.564+0000 7f3f8886f640 1 -- 172.21.15.12:0/657168248 >> 172.21.15.12:0/657168248 conn(0x7f3f840a82f0 msgr2=0x7f3f84135780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:37.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.564+0000 7f3f8886f640 1 -- 172.21.15.12:0/657168248 shutdown_connections 2024-09-11T23:04:37.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.564+0000 7f3f8886f640 1 -- 172.21.15.12:0/657168248 wait complete. 2024-09-11T23:04:37.582 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_fstop.TestFSTop.test_dump' 2024-09-11T23:04:37.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.696+0000 7fdb0762b640 1 Processor -- start 2024-09-11T23:04:37.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.696+0000 7fdb0762b640 1 -- start start 2024-09-11T23:04:37.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.700+0000 7fdb0762b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdb00137e60 0x7fdb00138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:37.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.700+0000 7fdb0762b640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb0009e930 con 0x7fdb0009f6e0 2024-09-11T23:04:37.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.700+0000 7fdb0762b640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fdb001379e0 con 0x7fdb00137e60 2024-09-11T23:04:37.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.700+0000 7fdb053c7640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdb00137e60 0x7fdb00138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:37.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.700+0000 7fdb04bc6640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fdb0009f6e0 0x7fdb000a36a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47034/0 (socket says 172.21.15.12:47034) 2024-09-11T23:04:37.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.700+0000 7fdb04bc6640 1 -- 172.21.15.12:0/2696825139 learned_addr learned my addr 172.21.15.12:0/2696825139 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:04:37.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.700+0000 7fdb053c7640 1 -- 172.21.15.12:0/2696825139 >> v1:172.21.15.12:6789/0 conn(0x7fdb0009f6e0 legacy=0x7fdb000a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:37.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.700+0000 7fdb053c7640 1 -- 172.21.15.12:0/2696825139 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb0009d910 con 0x7fdb00137e60 2024-09-11T23:04:37.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.700+0000 7fdb053c7640 1 --2- 172.21.15.12:0/2696825139 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb00137e60 0x7fdb00138240 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fdafc009740 tx=0x7fdafc01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=726c743292d12bb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:37.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.700+0000 7fdaf7fff640 1 -- 172.21.15.12:0/2696825139 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdafc0ab570 con 0x7fdb00137e60 2024-09-11T23:04:37.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.700+0000 7fdaf7fff640 1 -- 172.21.15.12:0/2696825139 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdafc0b0070 con 0x7fdb00137e60 2024-09-11T23:04:37.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.700+0000 7fdaf7fff640 1 -- 172.21.15.12:0/2696825139 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdafc0ab860 con 0x7fdb00137e60 2024-09-11T23:04:37.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.704+0000 7fdb0762b640 1 -- 172.21.15.12:0/2696825139 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb00137e60 msgr2=0x7fdb00138240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:37.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.704+0000 7fdb0762b640 1 --2- 172.21.15.12:0/2696825139 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb00137e60 0x7fdb00138240 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fdafc009740 tx=0x7fdafc01c420 comp rx=0 tx=0).stop 2024-09-11T23:04:37.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.704+0000 7fdb0762b640 1 -- 172.21.15.12:0/2696825139 shutdown_connections 2024-09-11T23:04:37.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.704+0000 7fdb0762b640 1 --2- 172.21.15.12:0/2696825139 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb00137e60 0x7fdb00138240 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:37.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.704+0000 7fdb0762b640 1 -- 172.21.15.12:0/2696825139 >> 172.21.15.12:0/2696825139 conn(0x7fdb000a8450 msgr2=0x7fdb000a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:37.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.704+0000 7fdb0762b640 1 -- 172.21.15.12:0/2696825139 shutdown_connections 2024-09-11T23:04:37.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.704+0000 7fdb0762b640 1 -- 172.21.15.12:0/2696825139 wait complete. 2024-09-11T23:04:37.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.704+0000 7fdb0762b640 1 Processor -- start 2024-09-11T23:04:37.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.704+0000 7fdb0762b640 1 -- start start 2024-09-11T23:04:37.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.704+0000 7fdb0762b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb0009f6e0 0x7fdb00072070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:37.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.704+0000 7fdb0762b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fdb0013fe00 con 0x7fdb0009f6e0 2024-09-11T23:04:37.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.704+0000 7fdb053c7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb0009f6e0 0x7fdb00072070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:37.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.704+0000 7fdb053c7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb0009f6e0 0x7fdb00072070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51860/0 (socket says 172.21.15.12:51860) 2024-09-11T23:04:37.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.704+0000 7fdb053c7640 1 -- 172.21.15.12:0/3701575559 learned_addr learned my addr 172.21.15.12:0/3701575559 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:37.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.704+0000 7fdb053c7640 1 -- 172.21.15.12:0/3701575559 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb00120ab0 con 0x7fdb0009f6e0 2024-09-11T23:04:37.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.704+0000 7fdb053c7640 1 --2- 172.21.15.12:0/3701575559 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb0009f6e0 0x7fdb00072070 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fdafc019030 tx=0x7fdafc01ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:37.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.704+0000 7fdaf5ffb640 1 -- 172.21.15.12:0/3701575559 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdafc0bf410 con 0x7fdb0009f6e0 2024-09-11T23:04:37.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.704+0000 7fdaf5ffb640 1 -- 172.21.15.12:0/3701575559 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdafc0bf5d0 con 0x7fdb0009f6e0 2024-09-11T23:04:37.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.704+0000 7fdaf5ffb640 1 -- 172.21.15.12:0/3701575559 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdafc0bf8f0 con 0x7fdb0009f6e0 2024-09-11T23:04:37.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.704+0000 7fdb0762b640 1 -- 172.21.15.12:0/3701575559 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb00120360 con 0x7fdb0009f6e0 2024-09-11T23:04:37.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.704+0000 7fdb0762b640 1 -- 172.21.15.12:0/3701575559 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb000a0e90 con 0x7fdb0009f6e0 2024-09-11T23:04:37.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.704+0000 7fdaf5ffb640 1 -- 172.21.15.12:0/3701575559 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 14) ==== 44099+0+0 (secure 0 0 0) 0x7fdafc0bd020 con 0x7fdb0009f6e0 2024-09-11T23:04:37.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.704+0000 7fdaf5ffb640 1 --2- 172.21.15.12:0/3701575559 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fdae4035e40 0x7fdae4038300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:37.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.704+0000 7fdaf5ffb640 1 -- 172.21.15.12:0/3701575559 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3275+0+0 (secure 0 0 0) 0x7fdafc0e2e50 con 0x7fdb0009f6e0 2024-09-11T23:04:37.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.704+0000 7fdb0762b640 1 -- 172.21.15.12:0/3701575559 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb0011f0e0 con 0x7fdb0009f6e0 2024-09-11T23:04:37.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.704+0000 7fdb04bc6640 1 --2- 172.21.15.12:0/3701575559 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fdae4035e40 0x7fdae4038300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:37.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.708+0000 7fdb04bc6640 1 --2- 172.21.15.12:0/3701575559 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fdae4035e40 0x7fdae4038300 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0001610 tx=0x7fdaf0007ad0 comp rx=0 tx=0).ready entity=mgr.4452 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:37.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.712+0000 7fdaf5ffb640 1 -- 172.21.15.12:0/3701575559 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fdb00120ab0 con 0x7fdb0009f6e0 2024-09-11T23:04:37.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:37.932+0000 7fdb0762b640 1 -- 172.21.15.12:0/3701575559 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_fstop.TestFSTop.test_dump"]} v 0) -- 0x7fdb00120c90 con 0x7fdb0009f6e0 2024-09-11T23:04:38.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.228+0000 7fdaf5ffb640 1 -- 172.21.15.12:0/3701575559 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_fstop.TestFSTop.test_dump"]}]=0 v79) ==== 122+0+0 (secure 0 0 0) 0x7fdafc016010 con 0x7fdb0009f6e0 2024-09-11T23:04:38.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.232+0000 7fdb0762b640 1 -- 172.21.15.12:0/3701575559 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fdae4035e40 msgr2=0x7fdae4038300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:38.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.232+0000 7fdb0762b640 1 --2- 172.21.15.12:0/3701575559 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fdae4035e40 0x7fdae4038300 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0001610 tx=0x7fdaf0007ad0 comp rx=0 tx=0).stop 2024-09-11T23:04:38.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.232+0000 7fdb0762b640 1 -- 172.21.15.12:0/3701575559 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb0009f6e0 msgr2=0x7fdb00072070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:38.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.232+0000 7fdb0762b640 1 --2- 172.21.15.12:0/3701575559 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb0009f6e0 0x7fdb00072070 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fdafc019030 tx=0x7fdafc01ac60 comp rx=0 tx=0).stop 2024-09-11T23:04:38.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.232+0000 7fdb0762b640 1 -- 172.21.15.12:0/3701575559 shutdown_connections 2024-09-11T23:04:38.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.232+0000 7fdb0762b640 1 --2- 172.21.15.12:0/3701575559 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fdae4035e40 0x7fdae4038300 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:38.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.232+0000 7fdb0762b640 1 --2- 172.21.15.12:0/3701575559 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb0009f6e0 0x7fdb00072070 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:38.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.232+0000 7fdb0762b640 1 -- 172.21.15.12:0/3701575559 >> 172.21.15.12:0/3701575559 conn(0x7fdb000a8450 msgr2=0x7fdb000a7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:38.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.232+0000 7fdb0762b640 1 -- 172.21.15.12:0/3701575559 shutdown_connections 2024-09-11T23:04:38.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.232+0000 7fdb0762b640 1 -- 172.21.15.12:0/3701575559 wait complete. 2024-09-11T23:04:38.255 INFO:tasks.cephfs_test_runner:Tests 'cephfs-top --dump' output is valid ... ok 2024-09-11T23:04:38.256 INFO:tasks.cephfs_test_runner:Starting test: test_dumpfs (tasks.cephfs.test_fstop.TestFSTop) Tests 'cephfs-top --dumpfs' output is valid 2024-09-11T23:04:38.256 INFO:tasks.cephfs_test_runner:test_dumpfs (tasks.cephfs.test_fstop.TestFSTop) 2024-09-11T23:04:38.257 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:04:38.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.384+0000 7f639b546640 1 Processor -- start 2024-09-11T23:04:38.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.384+0000 7f639b546640 1 -- start start 2024-09-11T23:04:38.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.388+0000 7f639b546640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6394137e60 0x7f6394138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:38.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.388+0000 7f639b546640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f639409e930 con 0x7f639409f6e0 2024-09-11T23:04:38.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.388+0000 7f639b546640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f63941379e0 con 0x7f6394137e60 2024-09-11T23:04:38.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.388+0000 7f63992e2640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6394137e60 0x7f6394138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:38.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.388+0000 7f6398ae1640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f639409f6e0 0x7f63940a36a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47048/0 (socket says 172.21.15.12:47048) 2024-09-11T23:04:38.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.388+0000 7f6398ae1640 1 -- 172.21.15.12:0/657792513 learned_addr learned my addr 172.21.15.12:0/657792513 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:04:38.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.388+0000 7f63992e2640 1 -- 172.21.15.12:0/657792513 >> v1:172.21.15.12:6789/0 conn(0x7f639409f6e0 legacy=0x7f63940a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:38.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.388+0000 7f63992e2640 1 -- 172.21.15.12:0/657792513 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f639409d910 con 0x7f6394137e60 2024-09-11T23:04:38.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.388+0000 7f6393fff640 1 -- 172.21.15.12:0/657792513 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2265749294 0 0) 0x7f639409e930 con 0x7f639409f6e0 2024-09-11T23:04:38.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.388+0000 7f63992e2640 1 --2- 172.21.15.12:0/657792513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6394137e60 0x7f6394138240 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f638c009d90 tx=0x7f638c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd253d877b4392ff server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:38.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.388+0000 7f6393fff640 1 -- 172.21.15.12:0/657792513 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f638c0b2070 con 0x7f6394137e60 2024-09-11T23:04:38.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.388+0000 7f6393fff640 1 -- 172.21.15.12:0/657792513 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f638c0a5900 con 0x7f6394137e60 2024-09-11T23:04:38.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.388+0000 7f6393fff640 1 -- 172.21.15.12:0/657792513 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f638c0a5c00 con 0x7f6394137e60 2024-09-11T23:04:38.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.392+0000 7f639b546640 1 -- 172.21.15.12:0/657792513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6394137e60 msgr2=0x7f6394138240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:38.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.392+0000 7f639b546640 1 --2- 172.21.15.12:0/657792513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6394137e60 0x7f6394138240 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f638c009d90 tx=0x7f638c01c970 comp rx=0 tx=0).stop 2024-09-11T23:04:38.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.392+0000 7f639b546640 1 -- 172.21.15.12:0/657792513 shutdown_connections 2024-09-11T23:04:38.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.392+0000 7f639b546640 1 --2- 172.21.15.12:0/657792513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6394137e60 0x7f6394138240 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:38.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.392+0000 7f639b546640 1 -- 172.21.15.12:0/657792513 >> 172.21.15.12:0/657792513 conn(0x7f63940a8450 msgr2=0x7f63940a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:38.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.392+0000 7f639b546640 1 -- 172.21.15.12:0/657792513 shutdown_connections 2024-09-11T23:04:38.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.392+0000 7f639b546640 1 -- 172.21.15.12:0/657792513 wait complete. 2024-09-11T23:04:38.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.392+0000 7f639b546640 1 Processor -- start 2024-09-11T23:04:38.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.392+0000 7f639b546640 1 -- start start 2024-09-11T23:04:38.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.392+0000 7f639b546640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f639409f6e0 0x7f6394133760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:38.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.392+0000 7f639b546640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f639413fe00 con 0x7f639409f6e0 2024-09-11T23:04:38.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.392+0000 7f63992e2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f639409f6e0 0x7f6394133760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:38.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.392+0000 7f63992e2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f639409f6e0 0x7f6394133760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51878/0 (socket says 172.21.15.12:51878) 2024-09-11T23:04:38.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.392+0000 7f63992e2640 1 -- 172.21.15.12:0/2457518170 learned_addr learned my addr 172.21.15.12:0/2457518170 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:38.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.392+0000 7f63992e2640 1 -- 172.21.15.12:0/2457518170 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f639411fd30 con 0x7f639409f6e0 2024-09-11T23:04:38.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.392+0000 7f63992e2640 1 --2- 172.21.15.12:0/2457518170 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f639409f6e0 0x7f6394133760 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f638c01c9b0 tx=0x7f638c019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:38.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.392+0000 7f6391ffb640 1 -- 172.21.15.12:0/2457518170 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f638c0bd020 con 0x7f639409f6e0 2024-09-11T23:04:38.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.392+0000 7f6391ffb640 1 -- 172.21.15.12:0/2457518170 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f638c0ad5f0 con 0x7f639409f6e0 2024-09-11T23:04:38.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.392+0000 7f639b546640 1 -- 172.21.15.12:0/2457518170 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f639409c5a0 con 0x7f639409f6e0 2024-09-11T23:04:38.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.392+0000 7f6391ffb640 1 -- 172.21.15.12:0/2457518170 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f638c0b2040 con 0x7f639409f6e0 2024-09-11T23:04:38.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.392+0000 7f639b546640 1 -- 172.21.15.12:0/2457518170 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f639413d140 con 0x7f639409f6e0 2024-09-11T23:04:38.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.396+0000 7f6391ffb640 1 -- 172.21.15.12:0/2457518170 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 14) ==== 44099+0+0 (secure 0 0 0) 0x7f638c0c0020 con 0x7f639409f6e0 2024-09-11T23:04:38.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.396+0000 7f639b546640 1 -- 172.21.15.12:0/2457518170 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f639411ec20 con 0x7f639409f6e0 2024-09-11T23:04:38.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.396+0000 7f6391ffb640 1 --2- 172.21.15.12:0/2457518170 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f6380035e40 0x7f6380038300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:38.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.396+0000 7f6391ffb640 1 -- 172.21.15.12:0/2457518170 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3275+0+0 (secure 0 0 0) 0x7f638c0e37f0 con 0x7f639409f6e0 2024-09-11T23:04:38.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.396+0000 7f6398ae1640 1 --2- 172.21.15.12:0/2457518170 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f6380035e40 0x7f6380038300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:38.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.396+0000 7f6398ae1640 1 --2- 172.21.15.12:0/2457518170 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f6380035e40 0x7f6380038300 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6388007fd0 tx=0x7f6388007920 comp rx=0 tx=0).ready entity=mgr.4452 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:38.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.400+0000 7f6391ffb640 1 -- 172.21.15.12:0/2457518170 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f638c0c7030 con 0x7f639409f6e0 2024-09-11T23:04:38.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.556+0000 7f639b546640 1 -- 172.21.15.12:0/2457518170 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f639406bc60 con 0x7f639409f6e0 2024-09-11T23:04:38.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.560+0000 7f6391ffb640 1 -- 172.21.15.12:0/2457518170 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) ==== 74+0+7797 (secure 0 0 0) 0x7f638c016560 con 0x7f639409f6e0 2024-09-11T23:04:38.561 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:04:38.561 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":30,"fsid":"8be14356-3340-4500-91a2-4cbc6b511f65","created":"2024-09-11T23:03:10.620234+0000","modified":"2024-09-11T23:04:37.221563+0000","last_up_change":"2024-09-11T23:03:22.359028+0000","last_in_change":"2024-09-11T23:03:11.545817+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:03:23.587068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"153b72a1-40b1-400d-93ea-333e733f9bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6817","nonce":3680911937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6819","nonce":3680911937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6823","nonce":3680911937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6821","nonce":3680911937}]},"public_addr":"172.21.15.12:6817/3680911937","cluster_addr":"172.21.15.12:6819/3680911937","heartbeat_back_addr":"172.21.15.12:6823/3680911937","heartbeat_front_addr":"172.21.15.12:6821/3680911937","state":["exists","up"]},{"osd":1,"uuid":"94669e49-ee4f-4acf-9e25-e94374dda8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6801","nonce":236825163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6803","nonce":236825163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6807","nonce":236825163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6805","nonce":236825163}]},"public_addr":"172.21.15.12:6801/236825163","cluster_addr":"172.21.15.12:6803/236825163","heartbeat_back_addr":"172.21.15.12:6807/236825163","heartbeat_front_addr":"172.21.15.12:6805/236825163","state":["exists","up"]},{"osd":2,"uuid":"826dae4d-8888-4ec5-8f00-425b3be93814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6809","nonce":3263521655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6811","nonce":3263521655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6815","nonce":3263521655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6813","nonce":3263521655}]},"public_addr":"172.21.15.12:6809/3263521655","cluster_addr":"172.21.15.12:6811/3263521655","heartbeat_back_addr":"172.21.15.12:6815/3263521655","heartbeat_front_addr":"172.21.15.12:6813/3263521655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:19.398518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.761524+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.904997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:6829/514415350":"2024-09-12T23:04:34.043908+0000","172.21.15.12:6828/514415350":"2024-09-12T23:04:34.043908+0000","172.21.15.12:0/1241865013":"2024-09-12T23:04:22.130661+0000","172.21.15.12:6824/2765460338":"2024-09-12T23:04:22.130661+0000","172.21.15.12:6825/2765460338":"2024-09-12T23:04:22.130661+0000","172.21.15.12:0/1129667065":"2024-09-12T23:04:33.814053+0000","172.21.15.12:0/3043705865":"2024-09-12T23:04:33.814053+0000","172.21.15.12:0/2345769658":"2024-09-12T23:04:22.130661+0000","172.21.15.12:0/255391181":"2024-09-12T23:04:22.130661+0000","172.21.15.12:0/4120232861":"2024-09-12T23:04:22.130661+0000","172.21.15.12:0/2454649526":"2024-09-12T23:04:33.814053+0000","172.21.15.12:6824/2217914063":"2024-09-12T23:04:33.814053+0000","172.21.15.12:0/866314824":"2024-09-12T23:04:33.814053+0000","172.21.15.12:0/3670076525":"2024-09-12T23:04:33.814053+0000","172.21.15.12:0/101779155":"2024-09-12T23:04:33.814053+0000","172.21.15.12:6825/2217914063":"2024-09-12T23:04:33.814053+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:04:38.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.560+0000 7f639b546640 1 -- 172.21.15.12:0/2457518170 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f6380035e40 msgr2=0x7f6380038300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:38.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.560+0000 7f639b546640 1 --2- 172.21.15.12:0/2457518170 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f6380035e40 0x7f6380038300 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6388007fd0 tx=0x7f6388007920 comp rx=0 tx=0).stop 2024-09-11T23:04:38.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.560+0000 7f639b546640 1 -- 172.21.15.12:0/2457518170 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f639409f6e0 msgr2=0x7f6394133760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:38.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.560+0000 7f639b546640 1 --2- 172.21.15.12:0/2457518170 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f639409f6e0 0x7f6394133760 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f638c01c9b0 tx=0x7f638c019710 comp rx=0 tx=0).stop 2024-09-11T23:04:38.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.560+0000 7f639b546640 1 -- 172.21.15.12:0/2457518170 shutdown_connections 2024-09-11T23:04:38.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.560+0000 7f639b546640 1 --2- 172.21.15.12:0/2457518170 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f6380035e40 0x7f6380038300 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:38.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.560+0000 7f639b546640 1 --2- 172.21.15.12:0/2457518170 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f639409f6e0 0x7f6394133760 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:38.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.560+0000 7f639b546640 1 -- 172.21.15.12:0/2457518170 >> 172.21.15.12:0/2457518170 conn(0x7f63940a8450 msgr2=0x7f6394134650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:38.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.560+0000 7f639b546640 1 -- 172.21.15.12:0/2457518170 shutdown_connections 2024-09-11T23:04:38.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.560+0000 7f639b546640 1 -- 172.21.15.12:0/2457518170 wait complete. 2024-09-11T23:04:38.581 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T23:03:23.587068+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T23:04:38.581 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-11T23:04:38.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.708+0000 7f3ed7b56640 1 Processor -- start 2024-09-11T23:04:38.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.708+0000 7f3ed7b56640 1 -- start start 2024-09-11T23:04:38.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.708+0000 7f3ed7b56640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3ed0137de0 0x7f3ed009f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:38.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.708+0000 7f3ed7b56640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ed009d690 con 0x7f3ed01381c0 2024-09-11T23:04:38.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.708+0000 7f3ed7b56640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f3ed009ea90 con 0x7f3ed0137de0 2024-09-11T23:04:38.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.708+0000 7f3ed58f2640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3ed0137de0 0x7f3ed009f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:38.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.708+0000 7f3ed58f2640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3ed0137de0 0x7f3ed009f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51882/0 (socket says 172.21.15.12:51882) 2024-09-11T23:04:38.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.708+0000 7f3ed58f2640 1 -- 172.21.15.12:0/2275514918 learned_addr learned my addr 172.21.15.12:0/2275514918 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:38.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.708+0000 7f3ed58f2640 1 -- 172.21.15.12:0/2275514918 >> v1:172.21.15.12:6789/0 conn(0x7f3ed01381c0 legacy=0x7f3ed00a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:38.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.708+0000 7f3ed58f2640 1 -- 172.21.15.12:0/2275514918 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ed009f6d0 con 0x7f3ed0137de0 2024-09-11T23:04:38.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.712+0000 7f3ed58f2640 1 --2- 172.21.15.12:0/2275514918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ed0137de0 0x7f3ed009f190 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc0097f0 tx=0x7f3ecc01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e06346f1aa4d27 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:38.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.712+0000 7f3ed48f0640 1 -- 172.21.15.12:0/2275514918 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ecc0b0070 con 0x7f3ed0137de0 2024-09-11T23:04:38.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.712+0000 7f3ed48f0640 1 -- 172.21.15.12:0/2275514918 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ecc0ab530 con 0x7f3ed0137de0 2024-09-11T23:04:38.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.712+0000 7f3ed48f0640 1 -- 172.21.15.12:0/2275514918 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ecc0ab830 con 0x7f3ed0137de0 2024-09-11T23:04:38.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.712+0000 7f3ed7b56640 1 -- 172.21.15.12:0/2275514918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ed0137de0 msgr2=0x7f3ed009f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:38.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.712+0000 7f3ed7b56640 1 --2- 172.21.15.12:0/2275514918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ed0137de0 0x7f3ed009f190 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc0097f0 tx=0x7f3ecc01c450 comp rx=0 tx=0).stop 2024-09-11T23:04:38.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.712+0000 7f3ed7b56640 1 -- 172.21.15.12:0/2275514918 shutdown_connections 2024-09-11T23:04:38.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.712+0000 7f3ed7b56640 1 --2- 172.21.15.12:0/2275514918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ed0137de0 0x7f3ed009f190 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:38.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.712+0000 7f3ed7b56640 1 -- 172.21.15.12:0/2275514918 >> 172.21.15.12:0/2275514918 conn(0x7f3ed00a82f0 msgr2=0x7f3ed00a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:38.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.712+0000 7f3ed7b56640 1 -- 172.21.15.12:0/2275514918 shutdown_connections 2024-09-11T23:04:38.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.712+0000 7f3ed7b56640 1 -- 172.21.15.12:0/2275514918 wait complete. 2024-09-11T23:04:38.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.712+0000 7f3ed7b56640 1 Processor -- start 2024-09-11T23:04:38.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.712+0000 7f3ed7b56640 1 -- start start 2024-09-11T23:04:38.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.712+0000 7f3ed7b56640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ed01381c0 0x7f3ed013a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:38.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.712+0000 7f3ed7b56640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed009e7d0 con 0x7f3ed01381c0 2024-09-11T23:04:38.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.712+0000 7f3ed58f2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ed01381c0 0x7f3ed013a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:38.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.712+0000 7f3ed58f2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ed01381c0 0x7f3ed013a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51884/0 (socket says 172.21.15.12:51884) 2024-09-11T23:04:38.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.712+0000 7f3ed58f2640 1 -- 172.21.15.12:0/2665806072 learned_addr learned my addr 172.21.15.12:0/2665806072 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:38.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.712+0000 7f3ed58f2640 1 -- 172.21.15.12:0/2665806072 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ed011edd0 con 0x7f3ed01381c0 2024-09-11T23:04:38.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.712+0000 7f3ed58f2640 1 --2- 172.21.15.12:0/2665806072 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ed01381c0 0x7f3ed013a150 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc0097f0 tx=0x7f3ecc01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:38.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.712+0000 7f3ec27fc640 1 -- 172.21.15.12:0/2665806072 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ecc0ba020 con 0x7f3ed01381c0 2024-09-11T23:04:38.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.712+0000 7f3ec27fc640 1 -- 172.21.15.12:0/2665806072 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ecc0abe40 con 0x7f3ed01381c0 2024-09-11T23:04:38.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.712+0000 7f3ec27fc640 1 -- 172.21.15.12:0/2665806072 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ecc0b0040 con 0x7f3ed01381c0 2024-09-11T23:04:38.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.716+0000 7f3ed7b56640 1 -- 172.21.15.12:0/2665806072 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ed011e2e0 con 0x7f3ed01381c0 2024-09-11T23:04:38.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.716+0000 7f3ed7b56640 1 -- 172.21.15.12:0/2665806072 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ed013bd60 con 0x7f3ed01381c0 2024-09-11T23:04:38.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.716+0000 7f3ec27fc640 1 -- 172.21.15.12:0/2665806072 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 15) ==== 44155+0+0 (secure 0 0 0) 0x7f3ecc0bd020 con 0x7f3ed01381c0 2024-09-11T23:04:38.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.716+0000 7f3ed7b56640 1 -- 172.21.15.12:0/2665806072 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ed009f190 con 0x7f3ed01381c0 2024-09-11T23:04:38.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.716+0000 7f3ec27fc640 1 --2- 172.21.15.12:0/2665806072 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f3eb4035ed0 0x7f3eb4038390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:38.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.716+0000 7f3ec27fc640 1 -- 172.21.15.12:0/2665806072 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3275+0+0 (secure 0 0 0) 0x7f3ecc0e2af0 con 0x7f3ed01381c0 2024-09-11T23:04:38.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.716+0000 7f3ed50f1640 1 --2- 172.21.15.12:0/2665806072 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f3eb4035ed0 0x7f3eb4038390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:38.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.716+0000 7f3ed50f1640 1 --2- 172.21.15.12:0/2665806072 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f3eb4035ed0 0x7f3eb4038390 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4000f70 tx=0x7f3ec4007a40 comp rx=0 tx=0).ready entity=mgr.4452 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:38.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.720+0000 7f3ec27fc640 1 -- 172.21.15.12:0/2665806072 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3ecc0c4030 con 0x7f3ed01381c0 2024-09-11T23:04:38.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.876+0000 7f3ed7b56640 1 -- 172.21.15.12:0/2665806072 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3ed0135250 con 0x7f3ed01381c0 2024-09-11T23:04:38.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.876+0000 7f3ec27fc640 1 -- 172.21.15.12:0/2665806072 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) ==== 93+0+10 (secure 0 0 0) 0x7f3ecc0160d0 con 0x7f3ed01381c0 2024-09-11T23:04:38.878 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2024-09-11T23:04:38.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.880+0000 7f3ed7b56640 1 -- 172.21.15.12:0/2665806072 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f3eb4035ed0 msgr2=0x7f3eb4038390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:38.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.880+0000 7f3ed7b56640 1 --2- 172.21.15.12:0/2665806072 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f3eb4035ed0 0x7f3eb4038390 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4000f70 tx=0x7f3ec4007a40 comp rx=0 tx=0).stop 2024-09-11T23:04:38.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.880+0000 7f3ed7b56640 1 -- 172.21.15.12:0/2665806072 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ed01381c0 msgr2=0x7f3ed013a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:38.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.880+0000 7f3ed7b56640 1 --2- 172.21.15.12:0/2665806072 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ed01381c0 0x7f3ed013a150 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc0097f0 tx=0x7f3ecc01ac90 comp rx=0 tx=0).stop 2024-09-11T23:04:38.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.880+0000 7f3ed7b56640 1 -- 172.21.15.12:0/2665806072 shutdown_connections 2024-09-11T23:04:38.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.880+0000 7f3ed7b56640 1 --2- 172.21.15.12:0/2665806072 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f3eb4035ed0 0x7f3eb4038390 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:38.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.880+0000 7f3ed7b56640 1 --2- 172.21.15.12:0/2665806072 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ed01381c0 0x7f3ed013a150 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:38.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.880+0000 7f3ed7b56640 1 -- 172.21.15.12:0/2665806072 >> 172.21.15.12:0/2665806072 conn(0x7f3ed00a82f0 msgr2=0x7f3ed00a73b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:38.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.880+0000 7f3ed7b56640 1 -- 172.21.15.12:0/2665806072 shutdown_connections 2024-09-11T23:04:38.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:38.880+0000 7f3ed7b56640 1 -- 172.21.15.12:0/2665806072 wait complete. 2024-09-11T23:04:38.897 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_fstop.TestFSTop.test_dumpfs' 2024-09-11T23:04:39.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:39.008+0000 7f0a826fb640 1 Processor -- start 2024-09-11T23:04:39.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:39.008+0000 7f0a826fb640 1 -- start start 2024-09-11T23:04:39.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:39.008+0000 7f0a826fb640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0a7c0a4b80 0x7f0a7c0a7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:39.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:39.008+0000 7f0a826fb640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a7c0a82a0 con 0x7f0a7c13a410 2024-09-11T23:04:39.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:39.008+0000 7f0a826fb640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f0a7c0a3cb0 con 0x7f0a7c0a4b80 2024-09-11T23:04:39.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:39.008+0000 7f0a7b7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0a7c0a4b80 0x7f0a7c0a7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:39.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:39.008+0000 7f0a7bfff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f0a7c13a410 0x7f0a7c0a6af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47066/0 (socket says 172.21.15.12:47066) 2024-09-11T23:04:39.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:39.008+0000 7f0a7bfff640 1 -- 172.21.15.12:0/1276377920 learned_addr learned my addr 172.21.15.12:0/1276377920 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:04:39.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:39.008+0000 7f0a7b7fe640 1 -- 172.21.15.12:0/1276377920 >> v1:172.21.15.12:6789/0 conn(0x7f0a7c13a410 legacy=0x7f0a7c0a6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:39.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:39.008+0000 7f0a7b7fe640 1 -- 172.21.15.12:0/1276377920 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a7c139fe0 con 0x7f0a7c0a4b80 2024-09-11T23:04:39.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:39.012+0000 7f0a7b7fe640 1 --2- 172.21.15.12:0/1276377920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a7c0a4b80 0x7f0a7c0a7200 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f0a70009740 tx=0x7f0a7001c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b131b826a99db193 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:39.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:39.012+0000 7f0a7affd640 1 -- 172.21.15.12:0/1276377920 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a700b0070 con 0x7f0a7c0a4b80 2024-09-11T23:04:39.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:39.012+0000 7f0a7affd640 1 -- 172.21.15.12:0/1276377920 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a700ab530 con 0x7f0a7c0a4b80 2024-09-11T23:04:39.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:39.012+0000 7f0a7affd640 1 -- 172.21.15.12:0/1276377920 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a700ab830 con 0x7f0a7c0a4b80 2024-09-11T23:04:39.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:39.012+0000 7f0a826fb640 1 -- 172.21.15.12:0/1276377920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a7c0a4b80 msgr2=0x7f0a7c0a7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:39.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:39.012+0000 7f0a826fb640 1 --2- 172.21.15.12:0/1276377920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a7c0a4b80 0x7f0a7c0a7200 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f0a70009740 tx=0x7f0a7001c390 comp rx=0 tx=0).stop 2024-09-11T23:04:39.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:39.012+0000 7f0a826fb640 1 -- 172.21.15.12:0/1276377920 shutdown_connections 2024-09-11T23:04:39.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:39.012+0000 7f0a826fb640 1 --2- 172.21.15.12:0/1276377920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a7c0a4b80 0x7f0a7c0a7200 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:39.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:39.012+0000 7f0a826fb640 1 -- 172.21.15.12:0/1276377920 >> 172.21.15.12:0/1276377920 conn(0x7f0a7c0ac2c0 msgr2=0x7f0a7c0ac6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:39.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:39.012+0000 7f0a826fb640 1 -- 172.21.15.12:0/1276377920 shutdown_connections 2024-09-11T23:04:39.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:39.012+0000 7f0a826fb640 1 -- 172.21.15.12:0/1276377920 wait complete. 2024-09-11T23:04:39.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:39.012+0000 7f0a826fb640 1 Processor -- start 2024-09-11T23:04:39.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:39.012+0000 7f0a826fb640 1 -- start start 2024-09-11T23:04:39.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:39.016+0000 7f0a826fb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a7c0a4b80 0x7f0a7c0a0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:39.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:39.016+0000 7f0a826fb640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0a7c0a7740 con 0x7f0a7c0a4b80 2024-09-11T23:04:39.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:39.016+0000 7f0a7bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a7c0a4b80 0x7f0a7c0a0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:39.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:39.016+0000 7f0a7bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a7c0a4b80 0x7f0a7c0a0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51906/0 (socket says 172.21.15.12:51906) 2024-09-11T23:04:39.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:39.016+0000 7f0a7bfff640 1 -- 172.21.15.12:0/3664036034 learned_addr learned my addr 172.21.15.12:0/3664036034 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:39.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:39.016+0000 7f0a7bfff640 1 -- 172.21.15.12:0/3664036034 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a7c0a1710 con 0x7f0a7c0a4b80 2024-09-11T23:04:39.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:39.016+0000 7f0a7bfff640 1 --2- 172.21.15.12:0/3664036034 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a7c0a4b80 0x7f0a7c0a0fd0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c00c480 tx=0x7f0a6c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:39.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:39.016+0000 7f0a78ff9640 1 -- 172.21.15.12:0/3664036034 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a6c017070 con 0x7f0a7c0a4b80 2024-09-11T23:04:39.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:39.016+0000 7f0a78ff9640 1 -- 172.21.15.12:0/3664036034 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a6c005c20 con 0x7f0a7c0a4b80 2024-09-11T23:04:39.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:39.016+0000 7f0a78ff9640 1 -- 172.21.15.12:0/3664036034 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a6c007070 con 0x7f0a7c0a4b80 2024-09-11T23:04:39.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:39.016+0000 7f0a826fb640 1 -- 172.21.15.12:0/3664036034 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a7c0a1a30 con 0x7f0a7c0a4b80 2024-09-11T23:04:39.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:39.016+0000 7f0a826fb640 1 -- 172.21.15.12:0/3664036034 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a7c09f590 con 0x7f0a7c0a4b80 2024-09-11T23:04:39.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:39.016+0000 7f0a826fb640 1 -- 172.21.15.12:0/3664036034 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a7c0a1510 con 0x7f0a7c0a4b80 2024-09-11T23:04:39.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:39.016+0000 7f0a78ff9640 1 -- 172.21.15.12:0/3664036034 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 15) ==== 44155+0+0 (secure 0 0 0) 0x7f0a6c01a070 con 0x7f0a7c0a4b80 2024-09-11T23:04:39.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:39.016+0000 7f0a78ff9640 1 --2- 172.21.15.12:0/3664036034 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f0a68035ed0 0x7f0a68038390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:39.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:39.016+0000 7f0a78ff9640 1 -- 172.21.15.12:0/3664036034 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3275+0+0 (secure 0 0 0) 0x7f0a6c0479f0 con 0x7f0a7c0a4b80 2024-09-11T23:04:39.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:39.016+0000 7f0a7b7fe640 1 --2- 172.21.15.12:0/3664036034 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f0a68035ed0 0x7f0a68038390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:39.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:39.016+0000 7f0a7b7fe640 1 --2- 172.21.15.12:0/3664036034 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f0a68035ed0 0x7f0a68038390 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0a700ad000 tx=0x7f0a70008040 comp rx=0 tx=0).ready entity=mgr.4452 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:39.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:39.020+0000 7f0a78ff9640 1 -- 172.21.15.12:0/3664036034 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0a6c049e20 con 0x7f0a7c0a4b80 2024-09-11T23:04:39.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:39.240+0000 7f0a826fb640 1 -- 172.21.15.12:0/3664036034 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fstop.TestFSTop.test_dumpfs"]} v 0) -- 0x7f0a7c09ecb0 con 0x7f0a7c0a4b80 2024-09-11T23:04:40.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.232+0000 7f0a78ff9640 1 -- 172.21.15.12:0/3664036034 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fstop.TestFSTop.test_dumpfs"]}]=0 v81) ==== 127+0+0 (secure 0 0 0) 0x7f0a6c007210 con 0x7f0a7c0a4b80 2024-09-11T23:04:40.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.236+0000 7f0a826fb640 1 -- 172.21.15.12:0/3664036034 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f0a68035ed0 msgr2=0x7f0a68038390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:40.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.236+0000 7f0a826fb640 1 --2- 172.21.15.12:0/3664036034 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f0a68035ed0 0x7f0a68038390 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0a700ad000 tx=0x7f0a70008040 comp rx=0 tx=0).stop 2024-09-11T23:04:40.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.236+0000 7f0a826fb640 1 -- 172.21.15.12:0/3664036034 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a7c0a4b80 msgr2=0x7f0a7c0a0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:40.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.236+0000 7f0a826fb640 1 --2- 172.21.15.12:0/3664036034 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a7c0a4b80 0x7f0a7c0a0fd0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c00c480 tx=0x7f0a6c00c940 comp rx=0 tx=0).stop 2024-09-11T23:04:40.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.236+0000 7f0a826fb640 1 -- 172.21.15.12:0/3664036034 shutdown_connections 2024-09-11T23:04:40.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.236+0000 7f0a826fb640 1 --2- 172.21.15.12:0/3664036034 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f0a68035ed0 0x7f0a68038390 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:40.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.236+0000 7f0a826fb640 1 --2- 172.21.15.12:0/3664036034 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a7c0a4b80 0x7f0a7c0a0fd0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:40.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.236+0000 7f0a826fb640 1 -- 172.21.15.12:0/3664036034 >> 172.21.15.12:0/3664036034 conn(0x7f0a7c0ac2c0 msgr2=0x7f0a7c0aa560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:40.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.236+0000 7f0a826fb640 1 -- 172.21.15.12:0/3664036034 shutdown_connections 2024-09-11T23:04:40.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.236+0000 7f0a826fb640 1 -- 172.21.15.12:0/3664036034 wait complete. 2024-09-11T23:04:40.260 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-11T23:04:40.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.392+0000 7effa0444640 1 Processor -- start 2024-09-11T23:04:40.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.392+0000 7effa0444640 1 -- start start 2024-09-11T23:04:40.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.392+0000 7effa0444640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7eff98137de0 0x7eff9809f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:40.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.392+0000 7effa0444640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff9809d690 con 0x7eff981381c0 2024-09-11T23:04:40.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.392+0000 7effa0444640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7eff9809ea90 con 0x7eff98137de0 2024-09-11T23:04:40.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.392+0000 7eff9e1e0640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7eff98137de0 0x7eff9809f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:40.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.392+0000 7eff9d9df640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7eff981381c0 0x7eff980a36a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47076/0 (socket says 172.21.15.12:47076) 2024-09-11T23:04:40.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.392+0000 7eff9d9df640 1 -- 172.21.15.12:0/2277358837 learned_addr learned my addr 172.21.15.12:0/2277358837 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:04:40.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.392+0000 7eff9d1de640 1 -- 172.21.15.12:0/2277358837 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3522331280 0 0) 0x7eff9809d690 con 0x7eff981381c0 2024-09-11T23:04:40.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.392+0000 7eff9d1de640 1 -- 172.21.15.12:0/2277358837 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff84003530 con 0x7eff981381c0 2024-09-11T23:04:40.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.392+0000 7eff9e1e0640 1 -- 172.21.15.12:0/2277358837 >> v1:172.21.15.12:6789/0 conn(0x7eff981381c0 legacy=0x7eff980a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:40.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.392+0000 7eff9e1e0640 1 -- 172.21.15.12:0/2277358837 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff9809f6d0 con 0x7eff98137de0 2024-09-11T23:04:40.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.396+0000 7eff9e1e0640 1 --2- 172.21.15.12:0/2277358837 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff98137de0 0x7eff9809f190 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7eff90009d90 tx=0x7eff9001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=489d6f358d6bd70c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:40.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.396+0000 7eff9d1de640 1 -- 172.21.15.12:0/2277358837 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff900b2070 con 0x7eff98137de0 2024-09-11T23:04:40.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.396+0000 7eff9d1de640 1 -- 172.21.15.12:0/2277358837 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff900a5680 con 0x7eff98137de0 2024-09-11T23:04:40.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.396+0000 7eff9d1de640 1 -- 172.21.15.12:0/2277358837 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff900a5980 con 0x7eff98137de0 2024-09-11T23:04:40.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.396+0000 7effa0444640 1 -- 172.21.15.12:0/2277358837 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff98137de0 msgr2=0x7eff9809f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:40.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.396+0000 7effa0444640 1 --2- 172.21.15.12:0/2277358837 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff98137de0 0x7eff9809f190 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7eff90009d90 tx=0x7eff9001c8e0 comp rx=0 tx=0).stop 2024-09-11T23:04:40.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.396+0000 7effa0444640 1 -- 172.21.15.12:0/2277358837 shutdown_connections 2024-09-11T23:04:40.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.396+0000 7effa0444640 1 --2- 172.21.15.12:0/2277358837 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff98137de0 0x7eff9809f190 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:40.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.396+0000 7effa0444640 1 -- 172.21.15.12:0/2277358837 >> 172.21.15.12:0/2277358837 conn(0x7eff980a82f0 msgr2=0x7eff980a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:40.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.396+0000 7effa0444640 1 -- 172.21.15.12:0/2277358837 shutdown_connections 2024-09-11T23:04:40.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.396+0000 7effa0444640 1 -- 172.21.15.12:0/2277358837 wait complete. 2024-09-11T23:04:40.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.400+0000 7effa0444640 1 Processor -- start 2024-09-11T23:04:40.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.400+0000 7effa0444640 1 -- start start 2024-09-11T23:04:40.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.400+0000 7effa0444640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff98137de0 0x7eff98072250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:40.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.400+0000 7effa0444640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7eff9809e7d0 con 0x7eff98137de0 2024-09-11T23:04:40.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.400+0000 7eff9e1e0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff98137de0 0x7eff98072250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:40.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.400+0000 7eff9e1e0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff98137de0 0x7eff98072250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51922/0 (socket says 172.21.15.12:51922) 2024-09-11T23:04:40.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.400+0000 7eff9e1e0640 1 -- 172.21.15.12:0/1016688810 learned_addr learned my addr 172.21.15.12:0/1016688810 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:40.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.400+0000 7eff9e1e0640 1 -- 172.21.15.12:0/1016688810 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff981349f0 con 0x7eff98137de0 2024-09-11T23:04:40.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.400+0000 7eff9e1e0640 1 --2- 172.21.15.12:0/1016688810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff98137de0 0x7eff98072250 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7eff900194f0 tx=0x7eff90019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:40.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.400+0000 7eff8effd640 1 -- 172.21.15.12:0/1016688810 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff900bd020 con 0x7eff98137de0 2024-09-11T23:04:40.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.400+0000 7eff8effd640 1 -- 172.21.15.12:0/1016688810 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff900b8470 con 0x7eff98137de0 2024-09-11T23:04:40.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.400+0000 7eff8effd640 1 -- 172.21.15.12:0/1016688810 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff900b2040 con 0x7eff98137de0 2024-09-11T23:04:40.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.400+0000 7effa0444640 1 -- 172.21.15.12:0/1016688810 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff98071d40 con 0x7eff98137de0 2024-09-11T23:04:40.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.400+0000 7effa0444640 1 -- 172.21.15.12:0/1016688810 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff98134d40 con 0x7eff98137de0 2024-09-11T23:04:40.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.400+0000 7eff8effd640 1 -- 172.21.15.12:0/1016688810 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 15) ==== 44155+0+0 (secure 0 0 0) 0x7eff900c0020 con 0x7eff98137de0 2024-09-11T23:04:40.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.400+0000 7eff8effd640 1 --2- 172.21.15.12:0/1016688810 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7eff7c035f00 0x7eff7c0383c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:40.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.400+0000 7eff8effd640 1 -- 172.21.15.12:0/1016688810 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3275+0+0 (secure 0 0 0) 0x7eff900e3420 con 0x7eff98137de0 2024-09-11T23:04:40.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.400+0000 7effa0444640 1 -- 172.21.15.12:0/1016688810 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff9809f190 con 0x7eff98137de0 2024-09-11T23:04:40.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.400+0000 7eff9d9df640 1 --2- 172.21.15.12:0/1016688810 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7eff7c035f00 0x7eff7c0383c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:40.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.400+0000 7eff9d9df640 1 --2- 172.21.15.12:0/1016688810 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7eff7c035f00 0x7eff7c0383c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7eff88000f70 tx=0x7eff880010b0 comp rx=0 tx=0).ready entity=mgr.4452 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:40.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.404+0000 7eff8effd640 1 -- 172.21.15.12:0/1016688810 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7eff900c7030 con 0x7eff98137de0 2024-09-11T23:04:40.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.568+0000 7effa0444640 1 -- 172.21.15.12:0/1016688810 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7eff9813cfa0 con 0x7eff98137de0 2024-09-11T23:04:40.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.572+0000 7eff8effd640 1 -- 172.21.15.12:0/1016688810 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v7)=0 v7) ==== 122+0+0 (secure 0 0 0) 0x7eff90016560 con 0x7eff98137de0 2024-09-11T23:04:40.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.576+0000 7effa0444640 1 -- 172.21.15.12:0/1016688810 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7eff7c035f00 msgr2=0x7eff7c0383c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:40.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.576+0000 7effa0444640 1 --2- 172.21.15.12:0/1016688810 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7eff7c035f00 0x7eff7c0383c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7eff88000f70 tx=0x7eff880010b0 comp rx=0 tx=0).stop 2024-09-11T23:04:40.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.576+0000 7effa0444640 1 -- 172.21.15.12:0/1016688810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff98137de0 msgr2=0x7eff98072250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:40.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.576+0000 7effa0444640 1 --2- 172.21.15.12:0/1016688810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff98137de0 0x7eff98072250 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7eff900194f0 tx=0x7eff90019680 comp rx=0 tx=0).stop 2024-09-11T23:04:40.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.576+0000 7effa0444640 1 -- 172.21.15.12:0/1016688810 shutdown_connections 2024-09-11T23:04:40.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.576+0000 7effa0444640 1 --2- 172.21.15.12:0/1016688810 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7eff7c035f00 0x7eff7c0383c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:40.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.576+0000 7effa0444640 1 --2- 172.21.15.12:0/1016688810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff98137de0 0x7eff98072250 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:40.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.576+0000 7effa0444640 1 -- 172.21.15.12:0/1016688810 >> 172.21.15.12:0/1016688810 conn(0x7eff980a82f0 msgr2=0x7eff98136d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:40.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.576+0000 7effa0444640 1 -- 172.21.15.12:0/1016688810 shutdown_connections 2024-09-11T23:04:40.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.576+0000 7effa0444640 1 -- 172.21.15.12:0/1016688810 wait complete. 2024-09-11T23:04:40.595 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T23:04:40.595 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:04:40.649 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T23:04:40.650 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T23:04:40.650 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:04:40.655 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339568k,nr_inodes=4084892,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15839 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275300k,nr_inodes=818825,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-09-11T23:04:40.656 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T23:04:40.656 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:04:40.704 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339568k,nr_inodes=4084892,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15839 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275300k,nr_inodes=818825,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-09-11T23:04:40.704 INFO:tasks.cephfs.cephfs_test_case:[, ] 2024-09-11T23:04:40.705 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:04:40.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.872+0000 7f88b3766640 1 Processor -- start 2024-09-11T23:04:40.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.872+0000 7f88b3766640 1 -- start start 2024-09-11T23:04:40.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.872+0000 7f88b3766640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f88ac137080 0x7f88ac13bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:40.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.872+0000 7f88b3766640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88ac0a1ff0 con 0x7f88ac136ca0 2024-09-11T23:04:40.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.872+0000 7f88b3766640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f88ac09b4a0 con 0x7f88ac137080 2024-09-11T23:04:40.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.872+0000 7f88b0d01640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f88ac137080 0x7f88ac13bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:40.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.872+0000 7f88b1502640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f88ac136ca0 0x7f88ac09ad90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47080/0 (socket says 172.21.15.12:47080) 2024-09-11T23:04:40.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.872+0000 7f88b1502640 1 -- 172.21.15.12:0/2516158728 learned_addr learned my addr 172.21.15.12:0/2516158728 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:04:40.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.872+0000 7f88b0d01640 1 -- 172.21.15.12:0/2516158728 >> v1:172.21.15.12:6789/0 conn(0x7f88ac136ca0 legacy=0x7f88ac09ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:40.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.872+0000 7f88b0d01640 1 -- 172.21.15.12:0/2516158728 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88ac0a0eb0 con 0x7f88ac137080 2024-09-11T23:04:40.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.872+0000 7f88a3fff640 1 -- 172.21.15.12:0/2516158728 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2852311079 0 0) 0x7f88ac0a1ff0 con 0x7f88ac136ca0 2024-09-11T23:04:40.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.876+0000 7f88b0d01640 1 --2- 172.21.15.12:0/2516158728 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88ac137080 0x7f88ac13bb70 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f889c009740 tx=0x7f889c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3125f6d622499192 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:40.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.876+0000 7f88a3fff640 1 -- 172.21.15.12:0/2516158728 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f889c0b0070 con 0x7f88ac137080 2024-09-11T23:04:40.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.876+0000 7f88a3fff640 1 -- 172.21.15.12:0/2516158728 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f889c0ab530 con 0x7f88ac137080 2024-09-11T23:04:40.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.876+0000 7f88a3fff640 1 -- 172.21.15.12:0/2516158728 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f889c0ab830 con 0x7f88ac137080 2024-09-11T23:04:40.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.876+0000 7f88b3766640 1 -- 172.21.15.12:0/2516158728 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88ac137080 msgr2=0x7f88ac13bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:40.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.876+0000 7f88b3766640 1 --2- 172.21.15.12:0/2516158728 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88ac137080 0x7f88ac13bb70 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f889c009740 tx=0x7f889c01c420 comp rx=0 tx=0).stop 2024-09-11T23:04:40.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.876+0000 7f88b3766640 1 -- 172.21.15.12:0/2516158728 shutdown_connections 2024-09-11T23:04:40.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.876+0000 7f88b3766640 1 --2- 172.21.15.12:0/2516158728 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88ac137080 0x7f88ac13bb70 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:40.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.876+0000 7f88b3766640 1 -- 172.21.15.12:0/2516158728 >> 172.21.15.12:0/2516158728 conn(0x7f88ac0a8450 msgr2=0x7f88ac0a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:40.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.876+0000 7f88b3766640 1 -- 172.21.15.12:0/2516158728 shutdown_connections 2024-09-11T23:04:40.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.876+0000 7f88b3766640 1 -- 172.21.15.12:0/2516158728 wait complete. 2024-09-11T23:04:40.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.876+0000 7f88b3766640 1 Processor -- start 2024-09-11T23:04:40.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.876+0000 7f88b3766640 1 -- start start 2024-09-11T23:04:40.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.876+0000 7f88b3766640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88ac136ca0 0x7f88ac070390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:40.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.876+0000 7f88b3766640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f88ac13ec60 con 0x7f88ac136ca0 2024-09-11T23:04:40.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.876+0000 7f88b1502640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88ac136ca0 0x7f88ac070390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:40.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.876+0000 7f88b1502640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88ac136ca0 0x7f88ac070390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51952/0 (socket says 172.21.15.12:51952) 2024-09-11T23:04:40.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.876+0000 7f88b1502640 1 -- 172.21.15.12:0/3628704120 learned_addr learned my addr 172.21.15.12:0/3628704120 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:40.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.876+0000 7f88b1502640 1 -- 172.21.15.12:0/3628704120 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88ac06fd10 con 0x7f88ac136ca0 2024-09-11T23:04:40.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.876+0000 7f88b1502640 1 --2- 172.21.15.12:0/3628704120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88ac136ca0 0x7f88ac070390 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f88a800c390 tx=0x7f88a800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:40.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.880+0000 7f88a1ffb640 1 -- 172.21.15.12:0/3628704120 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88a8007410 con 0x7f88ac136ca0 2024-09-11T23:04:40.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.880+0000 7f88a1ffb640 1 -- 172.21.15.12:0/3628704120 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88a80075d0 con 0x7f88ac136ca0 2024-09-11T23:04:40.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.880+0000 7f88b3766640 1 -- 172.21.15.12:0/3628704120 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88ac09d420 con 0x7f88ac136ca0 2024-09-11T23:04:40.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.880+0000 7f88a1ffb640 1 -- 172.21.15.12:0/3628704120 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88a8004960 con 0x7f88ac136ca0 2024-09-11T23:04:40.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.880+0000 7f88b3766640 1 -- 172.21.15.12:0/3628704120 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88ac1d2040 con 0x7f88ac136ca0 2024-09-11T23:04:40.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.880+0000 7f88a1ffb640 1 -- 172.21.15.12:0/3628704120 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 15) ==== 44155+0+0 (secure 0 0 0) 0x7f88a8011070 con 0x7f88ac136ca0 2024-09-11T23:04:40.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.880+0000 7f88b3766640 1 -- 172.21.15.12:0/3628704120 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88ac09ad90 con 0x7f88ac136ca0 2024-09-11T23:04:40.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.880+0000 7f88a1ffb640 1 --2- 172.21.15.12:0/3628704120 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f8890035ed0 0x7f8890038390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:40.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.880+0000 7f88a1ffb640 1 -- 172.21.15.12:0/3628704120 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3275+0+0 (secure 0 0 0) 0x7f88a8048250 con 0x7f88ac136ca0 2024-09-11T23:04:40.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.880+0000 7f88b0d01640 1 --2- 172.21.15.12:0/3628704120 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f8890035ed0 0x7f8890038390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:40.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.880+0000 7f88b0d01640 1 --2- 172.21.15.12:0/3628704120 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f8890035ed0 0x7f8890038390 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f889c0ad000 tx=0x7f889c0a6000 comp rx=0 tx=0).ready entity=mgr.4452 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:40.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:40.884+0000 7f88a1ffb640 1 -- 172.21.15.12:0/3628704120 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f88a8011c60 con 0x7f88ac136ca0 2024-09-11T23:04:41.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.080+0000 7f88b3766640 1 -- 172.21.15.12:0/3628704120 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f88ac072100 con 0x7f88ac136ca0 2024-09-11T23:04:41.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.084+0000 7f88a1ffb640 1 -- 172.21.15.12:0/3628704120 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+2258 (secure 0 0 0) 0x7f88a8004d90 con 0x7f88ac136ca0 2024-09-11T23:04:41.085 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:04:41.085 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":18,"btime":"2024-09-11T23:04:35:045441+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4328,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6827/3738380591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":3738380591},{"type":"v1","addr":"172.21.15.12:6827","nonce":3738380591}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4492,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6829/288900714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":288900714},{"type":"v1","addr":"172.21.15.12:6829","nonce":288900714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[]} 2024-09-11T23:04:41.085 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 18 2024-09-11T23:04:41.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.084+0000 7f88b3766640 1 -- 172.21.15.12:0/3628704120 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f8890035ed0 msgr2=0x7f8890038390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:41.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.084+0000 7f88b3766640 1 --2- 172.21.15.12:0/3628704120 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f8890035ed0 0x7f8890038390 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f889c0ad000 tx=0x7f889c0a6000 comp rx=0 tx=0).stop 2024-09-11T23:04:41.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.084+0000 7f88b3766640 1 -- 172.21.15.12:0/3628704120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88ac136ca0 msgr2=0x7f88ac070390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:41.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.084+0000 7f88b3766640 1 --2- 172.21.15.12:0/3628704120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88ac136ca0 0x7f88ac070390 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f88a800c390 tx=0x7f88a800c850 comp rx=0 tx=0).stop 2024-09-11T23:04:41.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.084+0000 7f88b3766640 1 -- 172.21.15.12:0/3628704120 shutdown_connections 2024-09-11T23:04:41.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.084+0000 7f88b3766640 1 --2- 172.21.15.12:0/3628704120 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f8890035ed0 0x7f8890038390 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:41.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.084+0000 7f88b3766640 1 --2- 172.21.15.12:0/3628704120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88ac136ca0 0x7f88ac070390 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:41.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.084+0000 7f88b3766640 1 -- 172.21.15.12:0/3628704120 >> 172.21.15.12:0/3628704120 conn(0x7f88ac0a8450 msgr2=0x7f88ac1345d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:41.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.084+0000 7f88b3766640 1 -- 172.21.15.12:0/3628704120 shutdown_connections 2024-09-11T23:04:41.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.084+0000 7f88b3766640 1 -- 172.21.15.12:0/3628704120 wait complete. 2024-09-11T23:04:41.105 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-11T23:04:41.105 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-11T23:04:41.105 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-11T23:04:41.105 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:04:41.106 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-11T23:04:41.106 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-11T23:04:41.106 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-11T23:04:41.106 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:04:41.119 INFO:tasks.ceph.mds.b:Stopped 2024-09-11T23:04:41.119 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-11T23:04:41.120 INFO:tasks.ceph.mds.a:Stopped 2024-09-11T23:04:41.120 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-11T23:04:41.161 INFO:tasks.ceph.mds.b:Started 2024-09-11T23:04:41.162 DEBUG:teuthology.parallel:result is None 2024-09-11T23:04:41.162 INFO:tasks.ceph.mds.a:Started 2024-09-11T23:04:41.162 DEBUG:teuthology.parallel:result is None 2024-09-11T23:04:41.163 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-11T23:04:41.224 INFO:tasks.ceph.mds.a.smithi012.stdout:starting mds.a at 2024-09-11T23:04:41.225 INFO:tasks.ceph.mds.b.smithi012.stdout:starting mds.b at 2024-09-11T23:04:41.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.276+0000 7f29bb160640 1 Processor -- start 2024-09-11T23:04:41.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.276+0000 7f29bb160640 1 -- start start 2024-09-11T23:04:41.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.280+0000 7f29bb160640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f29b409fc40 0x7f29b413ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:41.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.280+0000 7f29bb160640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29b40a1c00 con 0x7f29b413a200 2024-09-11T23:04:41.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.280+0000 7f29bb160640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f29b40a0e40 con 0x7f29b409fc40 2024-09-11T23:04:41.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.280+0000 7f29b8efc640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f29b413a200 0x7f29b413a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47108/0 (socket says 172.21.15.12:47108) 2024-09-11T23:04:41.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.280+0000 7f29b8efc640 1 -- 172.21.15.12:0/4150895224 learned_addr learned my addr 172.21.15.12:0/4150895224 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:04:41.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.280+0000 7f29b3fff640 1 --2- 172.21.15.12:0/4150895224 >> v2:172.21.15.12:3300/0 conn(0x7f29b409fc40 0x7f29b413ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:41.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.280+0000 7f29b37fe640 1 -- 172.21.15.12:0/4150895224 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3164190588 0 0) 0x7f29b40a1c00 con 0x7f29b413a200 2024-09-11T23:04:41.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.280+0000 7f29b37fe640 1 -- 172.21.15.12:0/4150895224 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29a0003530 con 0x7f29b413a200 2024-09-11T23:04:41.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.280+0000 7f29b3fff640 1 -- 172.21.15.12:0/4150895224 >> v1:172.21.15.12:6789/0 conn(0x7f29b413a200 legacy=0x7f29b413a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:41.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.280+0000 7f29b3fff640 1 -- 172.21.15.12:0/4150895224 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b409f350 con 0x7f29b409fc40 2024-09-11T23:04:41.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.280+0000 7f29b3fff640 1 --2- 172.21.15.12:0/4150895224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29b409fc40 0x7f29b413ef80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f299c009740 tx=0x7f299c01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dad6c0fb26f87d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:41.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.280+0000 7f29b37fe640 1 -- 172.21.15.12:0/4150895224 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f299c0b0070 con 0x7f29b409fc40 2024-09-11T23:04:41.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.280+0000 7f29b37fe640 1 -- 172.21.15.12:0/4150895224 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f299c0ab530 con 0x7f29b409fc40 2024-09-11T23:04:41.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.280+0000 7f29b37fe640 1 -- 172.21.15.12:0/4150895224 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f299c0ab830 con 0x7f29b409fc40 2024-09-11T23:04:41.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.280+0000 7f29bb160640 1 -- 172.21.15.12:0/4150895224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29b409fc40 msgr2=0x7f29b413ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:41.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.280+0000 7f29bb160640 1 --2- 172.21.15.12:0/4150895224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29b409fc40 0x7f29b413ef80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f299c009740 tx=0x7f299c01c390 comp rx=0 tx=0).stop 2024-09-11T23:04:41.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.280+0000 7f29bb160640 1 -- 172.21.15.12:0/4150895224 shutdown_connections 2024-09-11T23:04:41.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.280+0000 7f29bb160640 1 --2- 172.21.15.12:0/4150895224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29b409fc40 0x7f29b413ef80 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:41.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.280+0000 7f29bb160640 1 -- 172.21.15.12:0/4150895224 >> 172.21.15.12:0/4150895224 conn(0x7f29b406da30 msgr2=0x7f29b406de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:41.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.280+0000 7f29bb160640 1 -- 172.21.15.12:0/4150895224 shutdown_connections 2024-09-11T23:04:41.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.280+0000 7f29bb160640 1 -- 172.21.15.12:0/4150895224 wait complete. 2024-09-11T23:04:41.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.284+0000 7f29bb160640 1 Processor -- start 2024-09-11T23:04:41.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.284+0000 7f29bb160640 1 -- start start 2024-09-11T23:04:41.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.284+0000 7f29bb160640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29b413a200 0x7f29b40a31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:41.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.284+0000 7f29bb160640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f29b4141ce0 con 0x7f29b413a200 2024-09-11T23:04:41.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.284+0000 7f29b8efc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29b413a200 0x7f29b40a31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:41.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.284+0000 7f29b8efc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29b413a200 0x7f29b40a31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52002/0 (socket says 172.21.15.12:52002) 2024-09-11T23:04:41.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.284+0000 7f29b8efc640 1 -- 172.21.15.12:0/3853154303 learned_addr learned my addr 172.21.15.12:0/3853154303 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:41.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.284+0000 7f29b8efc640 1 -- 172.21.15.12:0/3853154303 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b40ac0f0 con 0x7f29b413a200 2024-09-11T23:04:41.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.284+0000 7f29b8efc640 1 --2- 172.21.15.12:0/3853154303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29b413a200 0x7f29b40a31b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f29ac00cb40 tx=0x7f29ac00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:41.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.284+0000 7f29b17fa640 1 -- 172.21.15.12:0/3853154303 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29ac017070 con 0x7f29b413a200 2024-09-11T23:04:41.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.284+0000 7f29b17fa640 1 -- 172.21.15.12:0/3853154303 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29ac00abf0 con 0x7f29b413a200 2024-09-11T23:04:41.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.284+0000 7f29bb160640 1 -- 172.21.15.12:0/3853154303 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29b40a45d0 con 0x7f29b413a200 2024-09-11T23:04:41.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.284+0000 7f29b17fa640 1 -- 172.21.15.12:0/3853154303 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29ac012400 con 0x7f29b413a200 2024-09-11T23:04:41.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.284+0000 7f29bb160640 1 -- 172.21.15.12:0/3853154303 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29b40a6880 con 0x7f29b413a200 2024-09-11T23:04:41.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.284+0000 7f29b17fa640 1 -- 172.21.15.12:0/3853154303 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 15) ==== 44155+0+0 (secure 0 0 0) 0x7f29ac01a070 con 0x7f29b413a200 2024-09-11T23:04:41.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.284+0000 7f29bb160640 1 -- 172.21.15.12:0/3853154303 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29b413a660 con 0x7f29b413a200 2024-09-11T23:04:41.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.284+0000 7f29b17fa640 1 --2- 172.21.15.12:0/3853154303 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f2994035f00 0x7f29940383c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:41.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.284+0000 7f29b17fa640 1 -- 172.21.15.12:0/3853154303 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3275+0+0 (secure 0 0 0) 0x7f29ac048490 con 0x7f29b413a200 2024-09-11T23:04:41.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.284+0000 7f29b3fff640 1 --2- 172.21.15.12:0/3853154303 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f2994035f00 0x7f29940383c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:41.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.284+0000 7f29b3fff640 1 --2- 172.21.15.12:0/3853154303 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f2994035f00 0x7f29940383c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f299c0ad000 tx=0x7f299c008040 comp rx=0 tx=0).ready entity=mgr.4452 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:41.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.292+0000 7f29b17fa640 1 -- 172.21.15.12:0/3853154303 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f29ac01a520 con 0x7f29b413a200 2024-09-11T23:04:41.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:41.464+0000 7f29bb160640 1 -- 172.21.15.12:0/3853154303 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f29b40a7080 con 0x7f29b413a200 2024-09-11T23:04:42.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.244+0000 7f29b17fa640 1 -- 172.21.15.12:0/3853154303 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v32) ==== 97+0+0 (secure 0 0 0) 0x7f29ac0078c0 con 0x7f29b413a200 2024-09-11T23:04:42.246 INFO:teuthology.orchestra.run.smithi012.stderr: removed all blocklist entries 2024-09-11T23:04:42.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.248+0000 7f29bb160640 1 -- 172.21.15.12:0/3853154303 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f2994035f00 msgr2=0x7f29940383c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:42.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.248+0000 7f29bb160640 1 --2- 172.21.15.12:0/3853154303 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f2994035f00 0x7f29940383c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f299c0ad000 tx=0x7f299c008040 comp rx=0 tx=0).stop 2024-09-11T23:04:42.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.248+0000 7f29bb160640 1 -- 172.21.15.12:0/3853154303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29b413a200 msgr2=0x7f29b40a31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:42.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.248+0000 7f29bb160640 1 --2- 172.21.15.12:0/3853154303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29b413a200 0x7f29b40a31b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f29ac00cb40 tx=0x7f29ac00a060 comp rx=0 tx=0).stop 2024-09-11T23:04:42.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.248+0000 7f29bb160640 1 -- 172.21.15.12:0/3853154303 shutdown_connections 2024-09-11T23:04:42.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.248+0000 7f29bb160640 1 --2- 172.21.15.12:0/3853154303 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f2994035f00 0x7f29940383c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:42.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.248+0000 7f29bb160640 1 --2- 172.21.15.12:0/3853154303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29b413a200 0x7f29b40a31b0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:42.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.248+0000 7f29bb160640 1 -- 172.21.15.12:0/3853154303 >> 172.21.15.12:0/3853154303 conn(0x7f29b406da30 msgr2=0x7f29b409c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:42.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.248+0000 7f29bb160640 1 -- 172.21.15.12:0/3853154303 shutdown_connections 2024-09-11T23:04:42.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.248+0000 7f29bb160640 1 -- 172.21.15.12:0/3853154303 wait complete. 2024-09-11T23:04:42.270 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-11T23:04:42.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.388+0000 7faf78f91640 1 Processor -- start 2024-09-11T23:04:42.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.388+0000 7faf78f91640 1 -- start start 2024-09-11T23:04:42.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.392+0000 7faf78f91640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7faf740a1630 0x7faf74143370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:42.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.392+0000 7faf78f91640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf740a1c70 con 0x7faf7413b080 2024-09-11T23:04:42.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.392+0000 7faf78f91640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7faf740a1a50 con 0x7faf740a1630 2024-09-11T23:04:42.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.392+0000 7faf71d9b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7faf740a1630 0x7faf74143370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:42.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.392+0000 7faf7259c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7faf7413b080 0x7faf7413b460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47118/0 (socket says 172.21.15.12:47118) 2024-09-11T23:04:42.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.392+0000 7faf7259c640 1 -- 172.21.15.12:0/2311266646 learned_addr learned my addr 172.21.15.12:0/2311266646 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:04:42.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.392+0000 7faf71d9b640 1 -- 172.21.15.12:0/2311266646 >> v1:172.21.15.12:6789/0 conn(0x7faf7413b080 legacy=0x7faf7413b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:42.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.392+0000 7faf7159a640 1 -- 172.21.15.12:0/2311266646 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3328985417 0 0) 0x7faf740a1c70 con 0x7faf7413b080 2024-09-11T23:04:42.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.392+0000 7faf71d9b640 1 -- 172.21.15.12:0/2311266646 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf740a0ee0 con 0x7faf740a1630 2024-09-11T23:04:42.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.392+0000 7faf71d9b640 1 --2- 172.21.15.12:0/2311266646 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf740a1630 0x7faf74143370 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7faf64009d90 tx=0x7faf6401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=225ca3df56a32201 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:42.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.392+0000 7faf7159a640 1 -- 172.21.15.12:0/2311266646 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf640b2070 con 0x7faf740a1630 2024-09-11T23:04:42.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.392+0000 7faf7159a640 1 -- 172.21.15.12:0/2311266646 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf640a5740 con 0x7faf740a1630 2024-09-11T23:04:42.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.392+0000 7faf7159a640 1 -- 172.21.15.12:0/2311266646 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf640a5a40 con 0x7faf740a1630 2024-09-11T23:04:42.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.396+0000 7faf78f91640 1 -- 172.21.15.12:0/2311266646 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf740a1630 msgr2=0x7faf74143370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:42.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.396+0000 7faf78f91640 1 --2- 172.21.15.12:0/2311266646 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf740a1630 0x7faf74143370 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7faf64009d90 tx=0x7faf6401c8e0 comp rx=0 tx=0).stop 2024-09-11T23:04:42.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.396+0000 7faf78f91640 1 -- 172.21.15.12:0/2311266646 shutdown_connections 2024-09-11T23:04:42.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.396+0000 7faf78f91640 1 --2- 172.21.15.12:0/2311266646 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf740a1630 0x7faf74143370 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:42.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.396+0000 7faf78f91640 1 -- 172.21.15.12:0/2311266646 >> 172.21.15.12:0/2311266646 conn(0x7faf740a8450 msgr2=0x7faf740a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:42.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.396+0000 7faf78f91640 1 -- 172.21.15.12:0/2311266646 shutdown_connections 2024-09-11T23:04:42.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.396+0000 7faf78f91640 1 -- 172.21.15.12:0/2311266646 wait complete. 2024-09-11T23:04:42.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.396+0000 7faf78f91640 1 Processor -- start 2024-09-11T23:04:42.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.396+0000 7faf78f91640 1 -- start start 2024-09-11T23:04:42.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.396+0000 7faf78f91640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf740a1630 0x7faf741d2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:42.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.396+0000 7faf78f91640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7faf740a5280 con 0x7faf740a1630 2024-09-11T23:04:42.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.396+0000 7faf7259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf740a1630 0x7faf741d2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:42.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.396+0000 7faf7259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf740a1630 0x7faf741d2890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52022/0 (socket says 172.21.15.12:52022) 2024-09-11T23:04:42.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.396+0000 7faf7259c640 1 -- 172.21.15.12:0/372396405 learned_addr learned my addr 172.21.15.12:0/372396405 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:42.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.396+0000 7faf7259c640 1 -- 172.21.15.12:0/372396405 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf741d2460 con 0x7faf740a1630 2024-09-11T23:04:42.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.396+0000 7faf7259c640 1 --2- 172.21.15.12:0/372396405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf740a1630 0x7faf741d2890 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7faf5c00c420 tx=0x7faf5c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:42.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.396+0000 7faf6affd640 1 -- 172.21.15.12:0/372396405 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf5c018070 con 0x7faf740a1630 2024-09-11T23:04:42.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.396+0000 7faf6affd640 1 -- 172.21.15.12:0/372396405 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf5c0074d0 con 0x7faf740a1630 2024-09-11T23:04:42.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.396+0000 7faf78f91640 1 -- 172.21.15.12:0/372396405 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf740704c0 con 0x7faf740a1630 2024-09-11T23:04:42.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.396+0000 7faf6affd640 1 -- 172.21.15.12:0/372396405 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf5c004960 con 0x7faf740a1630 2024-09-11T23:04:42.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.396+0000 7faf78f91640 1 -- 172.21.15.12:0/372396405 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf740701b0 con 0x7faf740a1630 2024-09-11T23:04:42.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.400+0000 7faf78f91640 1 -- 172.21.15.12:0/372396405 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf741d2270 con 0x7faf740a1630 2024-09-11T23:04:42.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.400+0000 7faf6affd640 1 -- 172.21.15.12:0/372396405 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 15) ==== 44155+0+0 (secure 0 0 0) 0x7faf5c01b070 con 0x7faf740a1630 2024-09-11T23:04:42.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.400+0000 7faf6affd640 1 --2- 172.21.15.12:0/372396405 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7faf54035ed0 0x7faf54038390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:42.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.400+0000 7faf6affd640 1 -- 172.21.15.12:0/372396405 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 2587+0+0 (secure 0 0 0) 0x7faf5c047810 con 0x7faf740a1630 2024-09-11T23:04:42.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.400+0000 7faf71d9b640 1 --2- 172.21.15.12:0/372396405 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7faf54035ed0 0x7faf54038390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:42.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.400+0000 7faf71d9b640 1 --2- 172.21.15.12:0/372396405 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7faf54035ed0 0x7faf54038390 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7faf640af000 tx=0x7faf640a7070 comp rx=0 tx=0).ready entity=mgr.4452 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:42.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.404+0000 7faf6affd640 1 -- 172.21.15.12:0/372396405 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7faf5c011980 con 0x7faf740a1630 2024-09-11T23:04:42.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.624+0000 7faf78f91640 1 -- 172.21.15.12:0/372396405 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7faf7406bc60 con 0x7faf740a1630 2024-09-11T23:04:42.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.624+0000 7faf6affd640 1 -- 172.21.15.12:0/372396405 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v9) ==== 80+0+2534 (secure 0 0 0) 0x7faf5c004d90 con 0x7faf740a1630 2024-09-11T23:04:42.627 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:04:42.627 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T23:04:42.628 INFO:teuthology.orchestra.run.smithi012.stdout: "auth_dump": [ 2024-09-11T23:04:42.628 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:04:42.628 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.a", 2024-09-11T23:04:42.628 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCgIeJmhYe5CRAAlzmzDPKc12SodkPehqtl6w==", 2024-09-11T23:04:42.628 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-11T23:04:42.628 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2024-09-11T23:04:42.628 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2024-09-11T23:04:42.629 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2024-09-11T23:04:42.629 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-09-11T23:04:42.629 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:04:42.629 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:42.629 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:04:42.629 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.b", 2024-09-11T23:04:42.629 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCgIeJmnvKREhAAp9c3Qvihpy4qTm50E9U26Q==", 2024-09-11T23:04:42.629 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-11T23:04:42.629 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2024-09-11T23:04:42.629 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2024-09-11T23:04:42.630 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2024-09-11T23:04:42.630 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-09-11T23:04:42.630 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:04:42.630 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:42.630 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:04:42.630 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.0", 2024-09-11T23:04:42.630 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCiIeJmy2qOLxAARUVUTFfFVrdRIhNhThjbTw==", 2024-09-11T23:04:42.630 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-11T23:04:42.630 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2024-09-11T23:04:42.630 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2024-09-11T23:04:42.630 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-09-11T23:04:42.631 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:04:42.631 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:42.631 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:04:42.631 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.1", 2024-09-11T23:04:42.631 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCmIeJmuc99HxAA0QxYJ1hvAsHb4uZPlh9GdA==", 2024-09-11T23:04:42.631 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-11T23:04:42.631 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2024-09-11T23:04:42.631 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2024-09-11T23:04:42.631 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-09-11T23:04:42.631 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:04:42.631 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:42.631 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:04:42.631 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.2", 2024-09-11T23:04:42.631 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCpIeJmBDhCMBAAipbJzeGy0AughJ+PfcX8ZA==", 2024-09-11T23:04:42.632 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-11T23:04:42.632 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2024-09-11T23:04:42.632 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2024-09-11T23:04:42.632 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-09-11T23:04:42.632 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:04:42.632 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:42.632 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:04:42.632 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.0", 2024-09-11T23:04:42.632 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCgIeJmTz6nGhAAveLcJxI+RD0GsD9nnR2S/w==", 2024-09-11T23:04:42.632 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-11T23:04:42.632 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2024-09-11T23:04:42.632 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow r", 2024-09-11T23:04:42.633 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-11T23:04:42.633 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:04:42.633 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:42.633 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:04:42.633 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.1", 2024-09-11T23:04:42.633 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCgIeJmkfu2HxAAKhML2j7GrGF1q/7cuNJtSA==", 2024-09-11T23:04:42.633 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-11T23:04:42.633 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2024-09-11T23:04:42.633 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow r", 2024-09-11T23:04:42.633 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow rw", 2024-09-11T23:04:42.634 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rwx" 2024-09-11T23:04:42.634 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:04:42.634 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:42.634 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:04:42.634 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.admin", 2024-09-11T23:04:42.634 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCfIeJml/f1MBAAdf0RuoLeBB0rcTxgaS2N3w==", 2024-09-11T23:04:42.634 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-11T23:04:42.634 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2024-09-11T23:04:42.634 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2024-09-11T23:04:42.634 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2024-09-11T23:04:42.634 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-09-11T23:04:42.634 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:04:42.635 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:42.635 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:04:42.635 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.x", 2024-09-11T23:04:42.635 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCgIeJmgNCCBBAAS9gR6zgZL5ZX8chT2/0RUw==", 2024-09-11T23:04:42.635 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-11T23:04:42.635 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2024-09-11T23:04:42.635 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2024-09-11T23:04:42.635 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-09-11T23:04:42.635 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:04:42.635 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:04:42.636 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T23:04:42.636 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T23:04:42.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.628+0000 7faf78f91640 1 -- 172.21.15.12:0/372396405 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7faf54035ed0 msgr2=0x7faf54038390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:42.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.628+0000 7faf78f91640 1 --2- 172.21.15.12:0/372396405 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7faf54035ed0 0x7faf54038390 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7faf640af000 tx=0x7faf640a7070 comp rx=0 tx=0).stop 2024-09-11T23:04:42.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.628+0000 7faf78f91640 1 -- 172.21.15.12:0/372396405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf740a1630 msgr2=0x7faf741d2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:42.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.628+0000 7faf78f91640 1 --2- 172.21.15.12:0/372396405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf740a1630 0x7faf741d2890 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7faf5c00c420 tx=0x7faf5c00c8e0 comp rx=0 tx=0).stop 2024-09-11T23:04:42.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.628+0000 7faf78f91640 1 -- 172.21.15.12:0/372396405 shutdown_connections 2024-09-11T23:04:42.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.628+0000 7faf78f91640 1 --2- 172.21.15.12:0/372396405 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7faf54035ed0 0x7faf54038390 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:42.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.628+0000 7faf78f91640 1 --2- 172.21.15.12:0/372396405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf740a1630 0x7faf741d2890 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:42.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.628+0000 7faf78f91640 1 -- 172.21.15.12:0/372396405 >> 172.21.15.12:0/372396405 conn(0x7faf740a8450 msgr2=0x7faf7413dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:42.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.628+0000 7faf78f91640 1 -- 172.21.15.12:0/372396405 shutdown_connections 2024-09-11T23:04:42.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.628+0000 7faf78f91640 1 -- 172.21.15.12:0/372396405 wait complete. 2024-09-11T23:04:42.647 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-11T23:04:42.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.760+0000 7fe9c13ac640 1 Processor -- start 2024-09-11T23:04:42.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.760+0000 7fe9c13ac640 1 -- start start 2024-09-11T23:04:42.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.764+0000 7fe9c13ac640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe9bc136ca0 0x7fe9bc09ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:42.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.764+0000 7fe9c13ac640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9bc0a1ff0 con 0x7fe9bc137080 2024-09-11T23:04:42.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.764+0000 7fe9c13ac640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fe9bc0a12e0 con 0x7fe9bc136ca0 2024-09-11T23:04:42.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.764+0000 7fe9baffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe9bc136ca0 0x7fe9bc09ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:42.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.764+0000 7fe9baffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe9bc136ca0 0x7fe9bc09ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52038/0 (socket says 172.21.15.12:52038) 2024-09-11T23:04:42.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.764+0000 7fe9baffd640 1 -- 172.21.15.12:0/2785092061 learned_addr learned my addr 172.21.15.12:0/2785092061 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:42.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.764+0000 7fe9ba7fc640 1 --1- 172.21.15.12:0/2785092061 >> v1:172.21.15.12:6789/0 conn(0x7fe9bc137080 0x7fe9bc0a36a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47120/0 (socket says 172.21.15.12:47120) 2024-09-11T23:04:42.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.764+0000 7fe9baffd640 1 -- 172.21.15.12:0/2785092061 >> v1:172.21.15.12:6789/0 conn(0x7fe9bc137080 legacy=0x7fe9bc0a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:42.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.764+0000 7fe9baffd640 1 -- 172.21.15.12:0/2785092061 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9bc0a0eb0 con 0x7fe9bc136ca0 2024-09-11T23:04:42.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.764+0000 7fe9baffd640 1 --2- 172.21.15.12:0/2785092061 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9bc136ca0 0x7fe9bc09ad90 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac0097f0 tx=0x7fe9ac01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d82f8b0c51e9055b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:42.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.764+0000 7fe9b9ffb640 1 -- 172.21.15.12:0/2785092061 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9ac0ab3f0 con 0x7fe9bc136ca0 2024-09-11T23:04:42.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.764+0000 7fe9b9ffb640 1 -- 172.21.15.12:0/2785092061 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9ac0b0070 con 0x7fe9bc136ca0 2024-09-11T23:04:42.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.764+0000 7fe9b9ffb640 1 -- 172.21.15.12:0/2785092061 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9ac0ab6e0 con 0x7fe9bc136ca0 2024-09-11T23:04:42.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.764+0000 7fe9c13ac640 1 -- 172.21.15.12:0/2785092061 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9bc136ca0 msgr2=0x7fe9bc09ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:42.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.764+0000 7fe9c13ac640 1 --2- 172.21.15.12:0/2785092061 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9bc136ca0 0x7fe9bc09ad90 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac0097f0 tx=0x7fe9ac01c4e0 comp rx=0 tx=0).stop 2024-09-11T23:04:42.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.764+0000 7fe9c13ac640 1 -- 172.21.15.12:0/2785092061 shutdown_connections 2024-09-11T23:04:42.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.764+0000 7fe9c13ac640 1 --2- 172.21.15.12:0/2785092061 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9bc136ca0 0x7fe9bc09ad90 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:42.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.764+0000 7fe9c13ac640 1 -- 172.21.15.12:0/2785092061 >> 172.21.15.12:0/2785092061 conn(0x7fe9bc0a8450 msgr2=0x7fe9bc0a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:42.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.764+0000 7fe9c13ac640 1 -- 172.21.15.12:0/2785092061 shutdown_connections 2024-09-11T23:04:42.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.764+0000 7fe9c13ac640 1 -- 172.21.15.12:0/2785092061 wait complete. 2024-09-11T23:04:42.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.768+0000 7fe9c13ac640 1 Processor -- start 2024-09-11T23:04:42.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.768+0000 7fe9c13ac640 1 -- start start 2024-09-11T23:04:42.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.768+0000 7fe9c13ac640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9bc136ca0 0x7fe9bc070d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:42.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.768+0000 7fe9c13ac640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe9bc13ed10 con 0x7fe9bc136ca0 2024-09-11T23:04:42.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.768+0000 7fe9baffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9bc136ca0 0x7fe9bc070d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:42.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.768+0000 7fe9baffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9bc136ca0 0x7fe9bc070d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52054/0 (socket says 172.21.15.12:52054) 2024-09-11T23:04:42.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.768+0000 7fe9baffd640 1 -- 172.21.15.12:0/3877275034 learned_addr learned my addr 172.21.15.12:0/3877275034 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:42.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.768+0000 7fe9baffd640 1 -- 172.21.15.12:0/3877275034 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9bc11ef30 con 0x7fe9bc136ca0 2024-09-11T23:04:42.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.768+0000 7fe9baffd640 1 --2- 172.21.15.12:0/3877275034 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9bc136ca0 0x7fe9bc070d90 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac01a110 tx=0x7fe9ac01ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:42.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.768+0000 7fe9a37fe640 1 -- 172.21.15.12:0/3877275034 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9ac0abe40 con 0x7fe9bc136ca0 2024-09-11T23:04:42.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.768+0000 7fe9a37fe640 1 -- 172.21.15.12:0/3877275034 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9ac0be3f0 con 0x7fe9bc136ca0 2024-09-11T23:04:42.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.768+0000 7fe9c13ac640 1 -- 172.21.15.12:0/3877275034 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9bc073770 con 0x7fe9bc136ca0 2024-09-11T23:04:42.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.768+0000 7fe9a37fe640 1 -- 172.21.15.12:0/3877275034 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9ac0be6d0 con 0x7fe9bc136ca0 2024-09-11T23:04:42.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.768+0000 7fe9c13ac640 1 -- 172.21.15.12:0/3877275034 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9bc073460 con 0x7fe9bc136ca0 2024-09-11T23:04:42.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.768+0000 7fe9c13ac640 1 -- 172.21.15.12:0/3877275034 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9bc09ad90 con 0x7fe9bc136ca0 2024-09-11T23:04:42.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.768+0000 7fe9a37fe640 1 -- 172.21.15.12:0/3877275034 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 15) ==== 44155+0+0 (secure 0 0 0) 0x7fe9ac0c7440 con 0x7fe9bc136ca0 2024-09-11T23:04:42.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.768+0000 7fe9a37fe640 1 --2- 172.21.15.12:0/3877275034 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fe9a8035ed0 0x7fe9a8038390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:42.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.768+0000 7fe9a37fe640 1 -- 172.21.15.12:0/3877275034 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 2587+0+0 (secure 0 0 0) 0x7fe9ac0e2be0 con 0x7fe9bc136ca0 2024-09-11T23:04:42.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.768+0000 7fe9ba7fc640 1 --2- 172.21.15.12:0/3877275034 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fe9a8035ed0 0x7fe9a8038390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:42.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.772+0000 7fe9ba7fc640 1 --2- 172.21.15.12:0/3877275034 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fe9a8035ed0 0x7fe9a8038390 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0001600 tx=0x7fe9b0007a50 comp rx=0 tx=0).ready entity=mgr.4452 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:42.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.776+0000 7fe9a37fe640 1 -- 172.21.15.12:0/3877275034 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe9ac0160d0 con 0x7fe9bc136ca0 2024-09-11T23:04:42.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.936+0000 7fe9c13ac640 1 -- 172.21.15.12:0/3877275034 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fe9bc06bc60 con 0x7fe9bc136ca0 2024-09-11T23:04:42.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.936+0000 7fe9a37fe640 1 -- 172.21.15.12:0/3877275034 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v32) ==== 84+0+65 (secure 0 0 0) 0x7fe9ac0b43f0 con 0x7fe9bc136ca0 2024-09-11T23:04:42.939 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:04:42.940 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2024-09-11T23:04:42.940 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:04:42.940 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 1, 2024-09-11T23:04:42.940 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": ".mgr" 2024-09-11T23:04:42.940 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:04:42.940 INFO:teuthology.orchestra.run.smithi012.stdout:] 2024-09-11T23:04:42.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.940+0000 7fe9c13ac640 1 -- 172.21.15.12:0/3877275034 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fe9a8035ed0 msgr2=0x7fe9a8038390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:42.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.940+0000 7fe9c13ac640 1 --2- 172.21.15.12:0/3877275034 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fe9a8035ed0 0x7fe9a8038390 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0001600 tx=0x7fe9b0007a50 comp rx=0 tx=0).stop 2024-09-11T23:04:42.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.940+0000 7fe9c13ac640 1 -- 172.21.15.12:0/3877275034 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9bc136ca0 msgr2=0x7fe9bc070d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:42.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.940+0000 7fe9c13ac640 1 --2- 172.21.15.12:0/3877275034 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9bc136ca0 0x7fe9bc070d90 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac01a110 tx=0x7fe9ac01ad20 comp rx=0 tx=0).stop 2024-09-11T23:04:42.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.940+0000 7fe9c13ac640 1 -- 172.21.15.12:0/3877275034 shutdown_connections 2024-09-11T23:04:42.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.940+0000 7fe9c13ac640 1 --2- 172.21.15.12:0/3877275034 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fe9a8035ed0 0x7fe9a8038390 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:42.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.940+0000 7fe9c13ac640 1 --2- 172.21.15.12:0/3877275034 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9bc136ca0 0x7fe9bc070d90 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:42.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.940+0000 7fe9c13ac640 1 -- 172.21.15.12:0/3877275034 >> 172.21.15.12:0/3877275034 conn(0x7fe9bc0a8450 msgr2=0x7fe9bc13c260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:42.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.940+0000 7fe9c13ac640 1 -- 172.21.15.12:0/3877275034 shutdown_connections 2024-09-11T23:04:42.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:42.940+0000 7fe9c13ac640 1 -- 172.21.15.12:0/3877275034 wait complete. 2024-09-11T23:04:42.957 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T23:04:42.957 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T23:04:43.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:43.080+0000 7f0a1d408640 1 Processor -- start 2024-09-11T23:04:43.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:43.080+0000 7f0a1d408640 1 -- start start 2024-09-11T23:04:43.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:43.080+0000 7f0a1d408640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0a1809f3a0 0x7f0a1813cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:43.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:43.080+0000 7f0a1d408640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a1809f7a0 con 0x7f0a18134a30 2024-09-11T23:04:43.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:43.080+0000 7f0a1d408640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f0a1809db90 con 0x7f0a1809f3a0 2024-09-11T23:04:43.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:43.080+0000 7f0a16ffd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f0a18134a30 0x7f0a18134e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47134/0 (socket says 172.21.15.12:47134) 2024-09-11T23:04:43.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:43.080+0000 7f0a16ffd640 1 -- 172.21.15.12:0/1122970514 learned_addr learned my addr 172.21.15.12:0/1122970514 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:04:43.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:43.080+0000 7f0a167fc640 1 --2- 172.21.15.12:0/1122970514 >> v2:172.21.15.12:3300/0 conn(0x7f0a1809f3a0 0x7f0a1813cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:43.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:43.084+0000 7f0a167fc640 1 -- 172.21.15.12:0/1122970514 >> v1:172.21.15.12:6789/0 conn(0x7f0a18134a30 legacy=0x7f0a18134e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:43.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:43.084+0000 7f0a167fc640 1 -- 172.21.15.12:0/1122970514 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a1809e930 con 0x7f0a1809f3a0 2024-09-11T23:04:43.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:43.084+0000 7f0a15ffb640 1 -- 172.21.15.12:0/1122970514 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1651267162 0 0) 0x7f0a00001120 con 0x7f0a18134a30 2024-09-11T23:04:43.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:43.084+0000 7f0a167fc640 1 --2- 172.21.15.12:0/1122970514 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a1809f3a0 0x7f0a1813cd20 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f0a08009740 tx=0x7f0a0801c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61efe42c111c256c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:43.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:43.084+0000 7f0a15ffb640 1 -- 172.21.15.12:0/1122970514 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a080b0070 con 0x7f0a1809f3a0 2024-09-11T23:04:43.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:43.084+0000 7f0a15ffb640 1 -- 172.21.15.12:0/1122970514 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a080ab530 con 0x7f0a1809f3a0 2024-09-11T23:04:43.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:43.084+0000 7f0a15ffb640 1 -- 172.21.15.12:0/1122970514 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a080ab830 con 0x7f0a1809f3a0 2024-09-11T23:04:43.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:43.084+0000 7f0a1d408640 1 -- 172.21.15.12:0/1122970514 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a1809f3a0 msgr2=0x7f0a1813cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:43.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:43.084+0000 7f0a1d408640 1 --2- 172.21.15.12:0/1122970514 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a1809f3a0 0x7f0a1813cd20 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f0a08009740 tx=0x7f0a0801c390 comp rx=0 tx=0).stop 2024-09-11T23:04:43.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:43.084+0000 7f0a1d408640 1 -- 172.21.15.12:0/1122970514 shutdown_connections 2024-09-11T23:04:43.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:43.084+0000 7f0a1d408640 1 --2- 172.21.15.12:0/1122970514 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a1809f3a0 0x7f0a1813cd20 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:43.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:43.084+0000 7f0a1d408640 1 -- 172.21.15.12:0/1122970514 >> 172.21.15.12:0/1122970514 conn(0x7f0a180a85b0 msgr2=0x7f0a180a49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:43.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:43.084+0000 7f0a1d408640 1 -- 172.21.15.12:0/1122970514 shutdown_connections 2024-09-11T23:04:43.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:43.084+0000 7f0a1d408640 1 -- 172.21.15.12:0/1122970514 wait complete. 2024-09-11T23:04:43.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:43.088+0000 7f0a1d408640 1 Processor -- start 2024-09-11T23:04:43.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:43.088+0000 7f0a1d408640 1 -- start start 2024-09-11T23:04:43.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:43.088+0000 7f0a1d408640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a1809f3a0 0x7f0a181cf670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:43.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:43.088+0000 7f0a1d408640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0a1813fc00 con 0x7f0a1809f3a0 2024-09-11T23:04:43.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:43.088+0000 7f0a16ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a1809f3a0 0x7f0a181cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:43.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:43.088+0000 7f0a16ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a1809f3a0 0x7f0a181cf670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52076/0 (socket says 172.21.15.12:52076) 2024-09-11T23:04:43.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:43.088+0000 7f0a16ffd640 1 -- 172.21.15.12:0/3725526640 learned_addr learned my addr 172.21.15.12:0/3725526640 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:43.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:43.088+0000 7f0a16ffd640 1 -- 172.21.15.12:0/3725526640 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a1813ab10 con 0x7f0a1809f3a0 2024-09-11T23:04:43.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:43.088+0000 7f0a16ffd640 1 --2- 172.21.15.12:0/3725526640 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a1809f3a0 0x7f0a181cf670 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f0a0000c700 tx=0x7f0a0000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:43.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:43.088+0000 7f0a0f7fe640 1 -- 172.21.15.12:0/3725526640 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a000058e0 con 0x7f0a1809f3a0 2024-09-11T23:04:43.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:43.088+0000 7f0a0f7fe640 1 -- 172.21.15.12:0/3725526640 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a00005a80 con 0x7f0a1809f3a0 2024-09-11T23:04:43.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:43.088+0000 7f0a1d408640 1 -- 172.21.15.12:0/3725526640 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a181cf360 con 0x7f0a1809f3a0 2024-09-11T23:04:43.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:43.088+0000 7f0a0f7fe640 1 -- 172.21.15.12:0/3725526640 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a00005d60 con 0x7f0a1809f3a0 2024-09-11T23:04:43.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:43.088+0000 7f0a1d408640 1 -- 172.21.15.12:0/3725526640 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a1806f310 con 0x7f0a1809f3a0 2024-09-11T23:04:43.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:43.088+0000 7f0a1d408640 1 -- 172.21.15.12:0/3725526640 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a1806f600 con 0x7f0a1809f3a0 2024-09-11T23:04:43.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:43.088+0000 7f0a0f7fe640 1 -- 172.21.15.12:0/3725526640 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 15) ==== 44155+0+0 (secure 0 0 0) 0x7f0a00007070 con 0x7f0a1809f3a0 2024-09-11T23:04:43.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:43.088+0000 7f0a0f7fe640 1 --2- 172.21.15.12:0/3725526640 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f09f8035ed0 0x7f09f8038390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:43.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:43.088+0000 7f0a0f7fe640 1 -- 172.21.15.12:0/3725526640 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 2587+0+0 (secure 0 0 0) 0x7f0a00048110 con 0x7f0a1809f3a0 2024-09-11T23:04:43.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:43.088+0000 7f0a167fc640 1 --2- 172.21.15.12:0/3725526640 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f09f8035ed0 0x7f09f8038390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:43.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:43.088+0000 7f0a167fc640 1 --2- 172.21.15.12:0/3725526640 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f09f8035ed0 0x7f09f8038390 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0a080ad000 tx=0x7f0a08008040 comp rx=0 tx=0).ready entity=mgr.4452 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:43.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:43.092+0000 7f0a0f7fe640 1 -- 172.21.15.12:0/3725526640 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0a1809f7a0 con 0x7f0a1809f3a0 2024-09-11T23:04:43.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:43.256+0000 7f0a1d408640 1 -- 172.21.15.12:0/3725526640 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f0a1806be30 con 0x7f0a1809f3a0 2024-09-11T23:04:44.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.248+0000 7f0a0f7fe640 1 -- 172.21.15.12:0/3725526640 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v33) ==== 138+0+0 (secure 0 0 0) 0x7f0a00019300 con 0x7f0a1809f3a0 2024-09-11T23:04:44.249 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' created 2024-09-11T23:04:44.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.252+0000 7f0a1d408640 1 -- 172.21.15.12:0/3725526640 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f09f8035ed0 msgr2=0x7f09f8038390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:44.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.252+0000 7f0a1d408640 1 --2- 172.21.15.12:0/3725526640 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f09f8035ed0 0x7f09f8038390 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0a080ad000 tx=0x7f0a08008040 comp rx=0 tx=0).stop 2024-09-11T23:04:44.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.252+0000 7f0a1d408640 1 -- 172.21.15.12:0/3725526640 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a1809f3a0 msgr2=0x7f0a181cf670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:44.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.252+0000 7f0a1d408640 1 --2- 172.21.15.12:0/3725526640 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a1809f3a0 0x7f0a181cf670 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f0a0000c700 tx=0x7f0a0000cbc0 comp rx=0 tx=0).stop 2024-09-11T23:04:44.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.252+0000 7f0a1d408640 1 -- 172.21.15.12:0/3725526640 shutdown_connections 2024-09-11T23:04:44.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.252+0000 7f0a1d408640 1 --2- 172.21.15.12:0/3725526640 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f09f8035ed0 0x7f09f8038390 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:44.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.252+0000 7f0a1d408640 1 --2- 172.21.15.12:0/3725526640 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a1809f3a0 0x7f0a181cf670 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:44.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.252+0000 7f0a1d408640 1 -- 172.21.15.12:0/3725526640 >> 172.21.15.12:0/3725526640 conn(0x7f0a180a85b0 msgr2=0x7f0a18133ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:44.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.252+0000 7f0a1d408640 1 -- 172.21.15.12:0/3725526640 shutdown_connections 2024-09-11T23:04:44.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.252+0000 7f0a1d408640 1 -- 172.21.15.12:0/3725526640 wait complete. 2024-09-11T23:04:44.278 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T23:04:44.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.412+0000 7f4cb00cf640 1 Processor -- start 2024-09-11T23:04:44.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.412+0000 7f4cb00cf640 1 -- start start 2024-09-11T23:04:44.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.412+0000 7f4cb00cf640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4ca809e4e0 0x7f4ca80a1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:44.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.412+0000 7f4cb00cf640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ca80ac8a0 con 0x7f4ca809d9f0 2024-09-11T23:04:44.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.412+0000 7f4cb00cf640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f4ca80a0200 con 0x7f4ca809e4e0 2024-09-11T23:04:44.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.412+0000 7f4cad66a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4ca809e4e0 0x7f4ca80a1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:44.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.412+0000 7f4cade6b640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f4ca809d9f0 0x7f4ca809ddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51218/0 (socket says 172.21.15.12:51218) 2024-09-11T23:04:44.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.412+0000 7f4cade6b640 1 -- 172.21.15.12:0/1159733300 learned_addr learned my addr 172.21.15.12:0/1159733300 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:04:44.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.412+0000 7f4cad66a640 1 -- 172.21.15.12:0/1159733300 >> v1:172.21.15.12:6789/0 conn(0x7f4ca809d9f0 legacy=0x7f4ca809ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:44.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.412+0000 7f4cad66a640 1 -- 172.21.15.12:0/1159733300 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ca80a0cb0 con 0x7f4ca809e4e0 2024-09-11T23:04:44.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.416+0000 7f4cad66a640 1 --2- 172.21.15.12:0/1159733300 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ca809e4e0 0x7f4ca80a1a00 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f4c98009740 tx=0x7f4c9801c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa45b9a6e62adb1f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:44.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.416+0000 7f4cace69640 1 -- 172.21.15.12:0/1159733300 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c980b0070 con 0x7f4ca809e4e0 2024-09-11T23:04:44.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.416+0000 7f4cace69640 1 -- 172.21.15.12:0/1159733300 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c980ab530 con 0x7f4ca809e4e0 2024-09-11T23:04:44.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.416+0000 7f4cace69640 1 -- 172.21.15.12:0/1159733300 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c980ab830 con 0x7f4ca809e4e0 2024-09-11T23:04:44.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.416+0000 7f4cb00cf640 1 -- 172.21.15.12:0/1159733300 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ca809e4e0 msgr2=0x7f4ca80a1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:44.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.416+0000 7f4cb00cf640 1 --2- 172.21.15.12:0/1159733300 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ca809e4e0 0x7f4ca80a1a00 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f4c98009740 tx=0x7f4c9801c390 comp rx=0 tx=0).stop 2024-09-11T23:04:44.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.416+0000 7f4cb00cf640 1 -- 172.21.15.12:0/1159733300 shutdown_connections 2024-09-11T23:04:44.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.416+0000 7f4cb00cf640 1 --2- 172.21.15.12:0/1159733300 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ca809e4e0 0x7f4ca80a1a00 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:44.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.416+0000 7f4cb00cf640 1 -- 172.21.15.12:0/1159733300 >> 172.21.15.12:0/1159733300 conn(0x7f4ca806d980 msgr2=0x7f4ca806dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:44.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.416+0000 7f4cb00cf640 1 -- 172.21.15.12:0/1159733300 shutdown_connections 2024-09-11T23:04:44.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.416+0000 7f4cb00cf640 1 -- 172.21.15.12:0/1159733300 wait complete. 2024-09-11T23:04:44.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.416+0000 7f4cb00cf640 1 Processor -- start 2024-09-11T23:04:44.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.416+0000 7f4cb00cf640 1 -- start start 2024-09-11T23:04:44.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.420+0000 7f4cb00cf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ca809d9f0 0x7f4ca8123fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:44.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.420+0000 7f4cb00cf640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca8141ae0 con 0x7f4ca809d9f0 2024-09-11T23:04:44.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.420+0000 7f4cade6b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ca809d9f0 0x7f4ca8123fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:44.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.420+0000 7f4cade6b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ca809d9f0 0x7f4ca8123fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52518/0 (socket says 172.21.15.12:52518) 2024-09-11T23:04:44.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.420+0000 7f4cade6b640 1 -- 172.21.15.12:0/634792911 learned_addr learned my addr 172.21.15.12:0/634792911 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:44.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.420+0000 7f4cade6b640 1 -- 172.21.15.12:0/634792911 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ca8124680 con 0x7f4ca809d9f0 2024-09-11T23:04:44.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.420+0000 7f4cade6b640 1 --2- 172.21.15.12:0/634792911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ca809d9f0 0x7f4ca8123fb0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f4ca400c480 tx=0x7f4ca400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:44.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.420+0000 7f4c9e7fc640 1 -- 172.21.15.12:0/634792911 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ca4017070 con 0x7f4ca809d9f0 2024-09-11T23:04:44.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.420+0000 7f4c9e7fc640 1 -- 172.21.15.12:0/634792911 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ca4005c20 con 0x7f4ca809d9f0 2024-09-11T23:04:44.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.420+0000 7f4cb00cf640 1 -- 172.21.15.12:0/634792911 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ca80ac250 con 0x7f4ca809d9f0 2024-09-11T23:04:44.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.420+0000 7f4c9e7fc640 1 -- 172.21.15.12:0/634792911 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ca4007070 con 0x7f4ca809d9f0 2024-09-11T23:04:44.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.420+0000 7f4cb00cf640 1 -- 172.21.15.12:0/634792911 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ca80ab2e0 con 0x7f4ca809d9f0 2024-09-11T23:04:44.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.420+0000 7f4c9e7fc640 1 -- 172.21.15.12:0/634792911 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 15) ==== 44155+0+0 (secure 0 0 0) 0x7f4ca401a070 con 0x7f4ca809d9f0 2024-09-11T23:04:44.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.420+0000 7f4cb00cf640 1 -- 172.21.15.12:0/634792911 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ca80a1a00 con 0x7f4ca809d9f0 2024-09-11T23:04:44.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.420+0000 7f4c9e7fc640 1 --2- 172.21.15.12:0/634792911 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f4c8c035ed0 0x7f4c8c038390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:44.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.420+0000 7f4c9e7fc640 1 -- 172.21.15.12:0/634792911 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 2957+0+0 (secure 0 0 0) 0x7f4ca40478b0 con 0x7f4ca809d9f0 2024-09-11T23:04:44.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.420+0000 7f4cad66a640 1 --2- 172.21.15.12:0/634792911 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f4c8c035ed0 0x7f4c8c038390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:44.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.420+0000 7f4cad66a640 1 --2- 172.21.15.12:0/634792911 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f4c8c035ed0 0x7f4c8c038390 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4c980ad000 tx=0x7f4c980a6000 comp rx=0 tx=0).ready entity=mgr.4452 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:44.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.424+0000 7f4c9e7fc640 1 -- 172.21.15.12:0/634792911 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4ca4007210 con 0x7f4ca809d9f0 2024-09-11T23:04:44.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:44.584+0000 7f4cb00cf640 1 -- 172.21.15.12:0/634792911 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f4ca80abf40 con 0x7f4ca809d9f0 2024-09-11T23:04:45.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.256+0000 7f4c9e7fc640 1 -- 172.21.15.12:0/634792911 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v34) ==== 170+0+0 (secure 0 0 0) 0x7f4ca401b400 con 0x7f4ca809d9f0 2024-09-11T23:04:45.258 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' created 2024-09-11T23:04:45.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.260+0000 7f4cb00cf640 1 -- 172.21.15.12:0/634792911 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f4c8c035ed0 msgr2=0x7f4c8c038390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:45.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.260+0000 7f4cb00cf640 1 --2- 172.21.15.12:0/634792911 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f4c8c035ed0 0x7f4c8c038390 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4c980ad000 tx=0x7f4c980a6000 comp rx=0 tx=0).stop 2024-09-11T23:04:45.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.260+0000 7f4cb00cf640 1 -- 172.21.15.12:0/634792911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ca809d9f0 msgr2=0x7f4ca8123fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:45.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.260+0000 7f4cb00cf640 1 --2- 172.21.15.12:0/634792911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ca809d9f0 0x7f4ca8123fb0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f4ca400c480 tx=0x7f4ca400c940 comp rx=0 tx=0).stop 2024-09-11T23:04:45.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.264+0000 7f4cb00cf640 1 -- 172.21.15.12:0/634792911 shutdown_connections 2024-09-11T23:04:45.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.264+0000 7f4cb00cf640 1 --2- 172.21.15.12:0/634792911 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f4c8c035ed0 0x7f4c8c038390 secure :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4c980ad000 tx=0x7f4c980a6000 comp rx=0 tx=0).stop 2024-09-11T23:04:45.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.264+0000 7f4cb00cf640 1 --2- 172.21.15.12:0/634792911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ca809d9f0 0x7f4ca8123fb0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:45.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.264+0000 7f4cb00cf640 1 -- 172.21.15.12:0/634792911 >> 172.21.15.12:0/634792911 conn(0x7f4ca806d980 msgr2=0x7f4ca813d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:45.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.268+0000 7f4cb00cf640 1 -- 172.21.15.12:0/634792911 shutdown_connections 2024-09-11T23:04:45.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.272+0000 7f4cb00cf640 1 -- 172.21.15.12:0/634792911 wait complete. 2024-09-11T23:04:45.308 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T23:04:45.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.428+0000 7fde0fdec640 1 Processor -- start 2024-09-11T23:04:45.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.428+0000 7fde0fdec640 1 -- start start 2024-09-11T23:04:45.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.428+0000 7fde0fdec640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fde080a54f0 0x7fde080a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:45.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.428+0000 7fde0fdec640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde0809f3f0 con 0x7fde08139ba0 2024-09-11T23:04:45.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.428+0000 7fde0fdec640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fde0806e6d0 con 0x7fde080a54f0 2024-09-11T23:04:45.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.428+0000 7fde0db88640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fde080a54f0 0x7fde080a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:45.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.428+0000 7fde0d387640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fde08139ba0 0x7fde08139f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51220/0 (socket says 172.21.15.12:51220) 2024-09-11T23:04:45.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.428+0000 7fde0d387640 1 -- 172.21.15.12:0/2273469364 learned_addr learned my addr 172.21.15.12:0/2273469364 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:04:45.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.428+0000 7fde0db88640 1 -- 172.21.15.12:0/2273469364 >> v1:172.21.15.12:6789/0 conn(0x7fde08139ba0 legacy=0x7fde08139f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:45.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.428+0000 7fde0db88640 1 -- 172.21.15.12:0/2273469364 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde080a52f0 con 0x7fde080a54f0 2024-09-11T23:04:45.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.432+0000 7fde0db88640 1 --2- 172.21.15.12:0/2273469364 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde080a54f0 0x7fde080a58d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fde00009d90 tx=0x7fde0001c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=552e9d10f9da77e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:45.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.432+0000 7fde0cb86640 1 -- 172.21.15.12:0/2273469364 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde000a6560 con 0x7fde080a54f0 2024-09-11T23:04:45.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.432+0000 7fde0cb86640 1 -- 172.21.15.12:0/2273469364 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde000a6700 con 0x7fde080a54f0 2024-09-11T23:04:45.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.432+0000 7fde0cb86640 1 -- 172.21.15.12:0/2273469364 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde000a6a00 con 0x7fde080a54f0 2024-09-11T23:04:45.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.432+0000 7fde0fdec640 1 -- 172.21.15.12:0/2273469364 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde080a54f0 msgr2=0x7fde080a58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:45.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.432+0000 7fde0fdec640 1 --2- 172.21.15.12:0/2273469364 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde080a54f0 0x7fde080a58d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fde00009d90 tx=0x7fde0001c750 comp rx=0 tx=0).stop 2024-09-11T23:04:45.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.432+0000 7fde0fdec640 1 -- 172.21.15.12:0/2273469364 shutdown_connections 2024-09-11T23:04:45.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.432+0000 7fde0fdec640 1 --2- 172.21.15.12:0/2273469364 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde080a54f0 0x7fde080a58d0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:45.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.432+0000 7fde0fdec640 1 -- 172.21.15.12:0/2273469364 >> 172.21.15.12:0/2273469364 conn(0x7fde080aa140 msgr2=0x7fde080aa550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:45.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.432+0000 7fde0fdec640 1 -- 172.21.15.12:0/2273469364 shutdown_connections 2024-09-11T23:04:45.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.432+0000 7fde0fdec640 1 -- 172.21.15.12:0/2273469364 wait complete. 2024-09-11T23:04:45.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.432+0000 7fde0fdec640 1 Processor -- start 2024-09-11T23:04:45.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.432+0000 7fde0fdec640 1 -- start start 2024-09-11T23:04:45.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.432+0000 7fde0fdec640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde080a54f0 0x7fde08135da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:45.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.432+0000 7fde0fdec640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fde0809f1c0 con 0x7fde080a54f0 2024-09-11T23:04:45.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.432+0000 7fde0db88640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde080a54f0 0x7fde08135da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:45.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.432+0000 7fde0db88640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde080a54f0 0x7fde08135da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52532/0 (socket says 172.21.15.12:52532) 2024-09-11T23:04:45.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.432+0000 7fde0db88640 1 -- 172.21.15.12:0/3586535432 learned_addr learned my addr 172.21.15.12:0/3586535432 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:45.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.432+0000 7fde0db88640 1 -- 172.21.15.12:0/3586535432 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde0813e350 con 0x7fde080a54f0 2024-09-11T23:04:45.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.432+0000 7fde0db88640 1 --2- 172.21.15.12:0/3586535432 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde080a54f0 0x7fde08135da0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fde00009d90 tx=0x7fde000194f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:45.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.432+0000 7fddfe7fc640 1 -- 172.21.15.12:0/3586535432 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde000c0070 con 0x7fde080a54f0 2024-09-11T23:04:45.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.432+0000 7fddfe7fc640 1 -- 172.21.15.12:0/3586535432 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde000bb560 con 0x7fde080a54f0 2024-09-11T23:04:45.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.432+0000 7fde0fdec640 1 -- 172.21.15.12:0/3586535432 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde0813d410 con 0x7fde080a54f0 2024-09-11T23:04:45.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.432+0000 7fddfe7fc640 1 -- 172.21.15.12:0/3586535432 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde000bb840 con 0x7fde080a54f0 2024-09-11T23:04:45.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.432+0000 7fde0fdec640 1 -- 172.21.15.12:0/3586535432 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde0813d9e0 con 0x7fde080a54f0 2024-09-11T23:04:45.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.436+0000 7fddfe7fc640 1 -- 172.21.15.12:0/3586535432 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 15) ==== 44155+0+0 (secure 0 0 0) 0x7fde000c3070 con 0x7fde080a54f0 2024-09-11T23:04:45.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.436+0000 7fde0fdec640 1 -- 172.21.15.12:0/3586535432 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde0806d590 con 0x7fde080a54f0 2024-09-11T23:04:45.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.436+0000 7fddfe7fc640 1 --2- 172.21.15.12:0/3586535432 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fddf4035ed0 0x7fddf4038390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:45.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.436+0000 7fddfe7fc640 1 -- 172.21.15.12:0/3586535432 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 3339+0+0 (secure 0 0 0) 0x7fde000e3160 con 0x7fde080a54f0 2024-09-11T23:04:45.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.436+0000 7fde0d387640 1 --2- 172.21.15.12:0/3586535432 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fddf4035ed0 0x7fddf4038390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:45.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.436+0000 7fde0d387640 1 --2- 172.21.15.12:0/3586535432 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fddf4035ed0 0x7fddf4038390 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fde040017d0 tx=0x7fde04007ab0 comp rx=0 tx=0).ready entity=mgr.4452 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:45.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.440+0000 7fddfe7fc640 1 -- 172.21.15.12:0/3586535432 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fde000ac030 con 0x7fde080a54f0 2024-09-11T23:04:45.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:45.636+0000 7fde0fdec640 1 -- 172.21.15.12:0/3586535432 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fde0806bc60 con 0x7fde080a54f0 2024-09-11T23:04:46.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.272+0000 7fddfe7fc640 1 -- 172.21.15.12:0/3586535432 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v21) ==== 172+0+0 (secure 0 0 0) 0x7fde00016460 con 0x7fde080a54f0 2024-09-11T23:04:46.284 INFO:teuthology.orchestra.run.smithi012.stderr:new fs with metadata pool 6 and data pool 7 2024-09-11T23:04:46.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.288+0000 7fde0fdec640 1 -- 172.21.15.12:0/3586535432 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fddf4035ed0 msgr2=0x7fddf4038390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:46.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.288+0000 7fde0fdec640 1 --2- 172.21.15.12:0/3586535432 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fddf4035ed0 0x7fddf4038390 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fde040017d0 tx=0x7fde04007ab0 comp rx=0 tx=0).stop 2024-09-11T23:04:46.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.288+0000 7fde0fdec640 1 -- 172.21.15.12:0/3586535432 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde080a54f0 msgr2=0x7fde08135da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:46.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.288+0000 7fde0fdec640 1 --2- 172.21.15.12:0/3586535432 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde080a54f0 0x7fde08135da0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fde00009d90 tx=0x7fde000194f0 comp rx=0 tx=0).stop 2024-09-11T23:04:46.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.292+0000 7fde0fdec640 1 -- 172.21.15.12:0/3586535432 shutdown_connections 2024-09-11T23:04:46.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.292+0000 7fde0fdec640 1 --2- 172.21.15.12:0/3586535432 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fddf4035ed0 0x7fddf4038390 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:46.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.292+0000 7fde0fdec640 1 --2- 172.21.15.12:0/3586535432 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde080a54f0 0x7fde08135da0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:46.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.292+0000 7fde0fdec640 1 -- 172.21.15.12:0/3586535432 >> 172.21.15.12:0/3586535432 conn(0x7fde080aa140 msgr2=0x7fde0813f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:46.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.292+0000 7fde0fdec640 1 -- 172.21.15.12:0/3586535432 shutdown_connections 2024-09-11T23:04:46.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.292+0000 7fde0fdec640 1 -- 172.21.15.12:0/3586535432 wait complete. 2024-09-11T23:04:46.333 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:04:46.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.444+0000 7f2a40976640 1 Processor -- start 2024-09-11T23:04:46.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.448+0000 7f2a40976640 1 -- start start 2024-09-11T23:04:46.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.448+0000 7f2a40976640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2a3c0a4b80 0x7f2a3c0a7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:46.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.448+0000 7f2a40976640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a3c0a82a0 con 0x7f2a3c13a410 2024-09-11T23:04:46.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.448+0000 7f2a40976640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f2a3c0a3cb0 con 0x7f2a3c0a4b80 2024-09-11T23:04:46.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.448+0000 7f2a3a59c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f2a3c13a410 0x7f2a3c0a6af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51226/0 (socket says 172.21.15.12:51226) 2024-09-11T23:04:46.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.448+0000 7f2a3a59c640 1 -- 172.21.15.12:0/1274462242 learned_addr learned my addr 172.21.15.12:0/1274462242 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:04:46.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.448+0000 7f2a39d9b640 1 --2- 172.21.15.12:0/1274462242 >> v2:172.21.15.12:3300/0 conn(0x7f2a3c0a4b80 0x7f2a3c0a7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:46.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.448+0000 7f2a3959a640 1 -- 172.21.15.12:0/1274462242 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1932526177 0 0) 0x7f2a3c0a82a0 con 0x7f2a3c13a410 2024-09-11T23:04:46.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.448+0000 7f2a3959a640 1 -- 172.21.15.12:0/1274462242 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a28003530 con 0x7f2a3c13a410 2024-09-11T23:04:46.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.448+0000 7f2a39d9b640 1 -- 172.21.15.12:0/1274462242 >> v1:172.21.15.12:6789/0 conn(0x7f2a3c13a410 legacy=0x7f2a3c0a6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:46.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.448+0000 7f2a39d9b640 1 -- 172.21.15.12:0/1274462242 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a3c139fe0 con 0x7f2a3c0a4b80 2024-09-11T23:04:46.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.448+0000 7f2a39d9b640 1 --2- 172.21.15.12:0/1274462242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a3c0a4b80 0x7f2a3c0a7200 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f2a24009740 tx=0x7f2a2401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc457376762cd8a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:46.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.448+0000 7f2a3959a640 1 -- 172.21.15.12:0/1274462242 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a240b0070 con 0x7f2a3c0a4b80 2024-09-11T23:04:46.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.448+0000 7f2a3959a640 1 -- 172.21.15.12:0/1274462242 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a240ab530 con 0x7f2a3c0a4b80 2024-09-11T23:04:46.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.448+0000 7f2a3959a640 1 -- 172.21.15.12:0/1274462242 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a240ab830 con 0x7f2a3c0a4b80 2024-09-11T23:04:46.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.448+0000 7f2a40976640 1 -- 172.21.15.12:0/1274462242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a3c0a4b80 msgr2=0x7f2a3c0a7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:46.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.448+0000 7f2a40976640 1 --2- 172.21.15.12:0/1274462242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a3c0a4b80 0x7f2a3c0a7200 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f2a24009740 tx=0x7f2a2401c390 comp rx=0 tx=0).stop 2024-09-11T23:04:46.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.452+0000 7f2a40976640 1 -- 172.21.15.12:0/1274462242 shutdown_connections 2024-09-11T23:04:46.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.452+0000 7f2a40976640 1 --2- 172.21.15.12:0/1274462242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a3c0a4b80 0x7f2a3c0a7200 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:46.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.452+0000 7f2a40976640 1 -- 172.21.15.12:0/1274462242 >> 172.21.15.12:0/1274462242 conn(0x7f2a3c0ac2c0 msgr2=0x7f2a3c0ac6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:46.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.452+0000 7f2a40976640 1 -- 172.21.15.12:0/1274462242 shutdown_connections 2024-09-11T23:04:46.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.452+0000 7f2a40976640 1 -- 172.21.15.12:0/1274462242 wait complete. 2024-09-11T23:04:46.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.452+0000 7f2a40976640 1 Processor -- start 2024-09-11T23:04:46.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.452+0000 7f2a40976640 1 -- start start 2024-09-11T23:04:46.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.452+0000 7f2a40976640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a3c0a4b80 0x7f2a3c09b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:46.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.452+0000 7f2a40976640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2a3c0a7740 con 0x7f2a3c0a4b80 2024-09-11T23:04:46.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.452+0000 7f2a3a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a3c0a4b80 0x7f2a3c09b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:46.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.452+0000 7f2a3a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a3c0a4b80 0x7f2a3c09b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52556/0 (socket says 172.21.15.12:52556) 2024-09-11T23:04:46.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.452+0000 7f2a3a59c640 1 -- 172.21.15.12:0/3704405951 learned_addr learned my addr 172.21.15.12:0/3704405951 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:46.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.452+0000 7f2a3a59c640 1 -- 172.21.15.12:0/3704405951 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a3c1ce610 con 0x7f2a3c0a4b80 2024-09-11T23:04:46.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.452+0000 7f2a3a59c640 1 --2- 172.21.15.12:0/3704405951 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a3c0a4b80 0x7f2a3c09b240 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f2a3400cb40 tx=0x7f2a3400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:46.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.452+0000 7f2a32ffd640 1 -- 172.21.15.12:0/3704405951 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a34017070 con 0x7f2a3c0a4b80 2024-09-11T23:04:46.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.452+0000 7f2a32ffd640 1 -- 172.21.15.12:0/3704405951 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a3400abf0 con 0x7f2a3c0a4b80 2024-09-11T23:04:46.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.452+0000 7f2a40976640 1 -- 172.21.15.12:0/3704405951 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a3c09c1b0 con 0x7f2a3c0a4b80 2024-09-11T23:04:46.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.452+0000 7f2a32ffd640 1 -- 172.21.15.12:0/3704405951 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a34012400 con 0x7f2a3c0a4b80 2024-09-11T23:04:46.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.452+0000 7f2a40976640 1 -- 172.21.15.12:0/3704405951 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a3c09d180 con 0x7f2a3c0a4b80 2024-09-11T23:04:46.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.452+0000 7f2a32ffd640 1 -- 172.21.15.12:0/3704405951 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 15) ==== 44155+0+0 (secure 0 0 0) 0x7f2a3401a070 con 0x7f2a3c0a4b80 2024-09-11T23:04:46.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.452+0000 7f2a40976640 1 -- 172.21.15.12:0/3704405951 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a3c0a6af0 con 0x7f2a3c0a4b80 2024-09-11T23:04:46.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.452+0000 7f2a32ffd640 1 --2- 172.21.15.12:0/3704405951 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f2a1c035ed0 0x7f2a1c038390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:46.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.452+0000 7f2a32ffd640 1 -- 172.21.15.12:0/3704405951 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 3439+0+0 (secure 0 0 0) 0x7f2a340484f0 con 0x7f2a3c0a4b80 2024-09-11T23:04:46.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.452+0000 7f2a39d9b640 1 --2- 172.21.15.12:0/3704405951 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f2a1c035ed0 0x7f2a1c038390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:46.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.456+0000 7f2a39d9b640 1 --2- 172.21.15.12:0/3704405951 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f2a1c035ed0 0x7f2a1c038390 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2a240ad000 tx=0x7f2a24008040 comp rx=0 tx=0).ready entity=mgr.4452 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:46.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.460+0000 7f2a32ffd640 1 -- 172.21.15.12:0/3704405951 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2a3401a520 con 0x7f2a3c0a4b80 2024-09-11T23:04:46.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.624+0000 7f2a40976640 1 -- 172.21.15.12:0/3704405951 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2a3c13eef0 con 0x7f2a3c0a4b80 2024-09-11T23:04:46.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.624+0000 7f2a32ffd640 1 -- 172.21.15.12:0/3704405951 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+10688 (secure 0 0 0) 0x7f2a340078c0 con 0x7f2a3c0a4b80 2024-09-11T23:04:46.627 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:04:46.627 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":35,"fsid":"8be14356-3340-4500-91a2-4cbc6b511f65","created":"2024-09-11T23:03:10.620234+0000","modified":"2024-09-11T23:04:45.641080+0000","last_up_change":"2024-09-11T23:03:22.359028+0000","last_in_change":"2024-09-11T23:03:11.545817+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:03:23.587068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:04:43.298425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-11T23:04:44.624329+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"153b72a1-40b1-400d-93ea-333e733f9bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6817","nonce":3680911937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6819","nonce":3680911937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6823","nonce":3680911937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6821","nonce":3680911937}]},"public_addr":"172.21.15.12:6817/3680911937","cluster_addr":"172.21.15.12:6819/3680911937","heartbeat_back_addr":"172.21.15.12:6823/3680911937","heartbeat_front_addr":"172.21.15.12:6821/3680911937","state":["exists","up"]},{"osd":1,"uuid":"94669e49-ee4f-4acf-9e25-e94374dda8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6801","nonce":236825163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6803","nonce":236825163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6807","nonce":236825163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6805","nonce":236825163}]},"public_addr":"172.21.15.12:6801/236825163","cluster_addr":"172.21.15.12:6803/236825163","heartbeat_back_addr":"172.21.15.12:6807/236825163","heartbeat_front_addr":"172.21.15.12:6805/236825163","state":["exists","up"]},{"osd":2,"uuid":"826dae4d-8888-4ec5-8f00-425b3be93814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6809","nonce":3263521655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6811","nonce":3263521655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6815","nonce":3263521655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6813","nonce":3263521655}]},"public_addr":"172.21.15.12:6809/3263521655","cluster_addr":"172.21.15.12:6811/3263521655","heartbeat_back_addr":"172.21.15.12:6815/3263521655","heartbeat_front_addr":"172.21.15.12:6813/3263521655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:19.398518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.761524+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.904997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:04:46.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.628+0000 7f2a40976640 1 -- 172.21.15.12:0/3704405951 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f2a1c035ed0 msgr2=0x7f2a1c038390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:46.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.628+0000 7f2a40976640 1 --2- 172.21.15.12:0/3704405951 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f2a1c035ed0 0x7f2a1c038390 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2a240ad000 tx=0x7f2a24008040 comp rx=0 tx=0).stop 2024-09-11T23:04:46.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.628+0000 7f2a40976640 1 -- 172.21.15.12:0/3704405951 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a3c0a4b80 msgr2=0x7f2a3c09b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:46.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.628+0000 7f2a40976640 1 --2- 172.21.15.12:0/3704405951 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a3c0a4b80 0x7f2a3c09b240 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f2a3400cb40 tx=0x7f2a3400a060 comp rx=0 tx=0).stop 2024-09-11T23:04:46.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.628+0000 7f2a40976640 1 -- 172.21.15.12:0/3704405951 shutdown_connections 2024-09-11T23:04:46.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.628+0000 7f2a40976640 1 --2- 172.21.15.12:0/3704405951 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f2a1c035ed0 0x7f2a1c038390 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:46.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.628+0000 7f2a40976640 1 --2- 172.21.15.12:0/3704405951 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a3c0a4b80 0x7f2a3c09b240 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:46.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.628+0000 7f2a40976640 1 -- 172.21.15.12:0/3704405951 >> 172.21.15.12:0/3704405951 conn(0x7f2a3c0ac2c0 msgr2=0x7f2a3c139340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:46.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.628+0000 7f2a40976640 1 -- 172.21.15.12:0/3704405951 shutdown_connections 2024-09-11T23:04:46.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.628+0000 7f2a40976640 1 -- 172.21.15.12:0/3704405951 wait complete. 2024-09-11T23:04:46.646 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:04:46.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.772+0000 7f08ac6cb640 1 Processor -- start 2024-09-11T23:04:46.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.772+0000 7f08ac6cb640 1 -- start start 2024-09-11T23:04:46.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.772+0000 7f08ac6cb640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f08a4137e60 0x7f08a4138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:46.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.772+0000 7f08ac6cb640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08a409e930 con 0x7f08a409f6e0 2024-09-11T23:04:46.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.772+0000 7f08ac6cb640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f08a41379e0 con 0x7f08a4137e60 2024-09-11T23:04:46.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.776+0000 7f08a9c66640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f08a409f6e0 0x7f08a40a36a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51238/0 (socket says 172.21.15.12:51238) 2024-09-11T23:04:46.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.776+0000 7f08a9c66640 1 -- 172.21.15.12:0/4195611159 learned_addr learned my addr 172.21.15.12:0/4195611159 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:04:46.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.776+0000 7f08aa467640 1 --2- 172.21.15.12:0/4195611159 >> v2:172.21.15.12:3300/0 conn(0x7f08a4137e60 0x7f08a4138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:46.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.776+0000 7f08a9465640 1 -- 172.21.15.12:0/4195611159 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 34167222 0 0) 0x7f08a409e930 con 0x7f08a409f6e0 2024-09-11T23:04:46.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.776+0000 7f08a9465640 1 -- 172.21.15.12:0/4195611159 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f088c003530 con 0x7f08a409f6e0 2024-09-11T23:04:46.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.776+0000 7f08aa467640 1 -- 172.21.15.12:0/4195611159 >> v1:172.21.15.12:6789/0 conn(0x7f08a409f6e0 legacy=0x7f08a40a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:46.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.776+0000 7f08aa467640 1 -- 172.21.15.12:0/4195611159 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08a409d910 con 0x7f08a4137e60 2024-09-11T23:04:46.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.776+0000 7f08aa467640 1 --2- 172.21.15.12:0/4195611159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08a4137e60 0x7f08a4138240 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f089c009d90 tx=0x7f089c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faa9e6e9664a0f40 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:46.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.776+0000 7f08a9465640 1 -- 172.21.15.12:0/4195611159 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f089c0b2070 con 0x7f08a4137e60 2024-09-11T23:04:46.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.776+0000 7f08a9465640 1 -- 172.21.15.12:0/4195611159 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f089c0a5900 con 0x7f08a4137e60 2024-09-11T23:04:46.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.776+0000 7f08a9465640 1 -- 172.21.15.12:0/4195611159 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f089c0a5be0 con 0x7f08a4137e60 2024-09-11T23:04:46.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.776+0000 7f08ac6cb640 1 -- 172.21.15.12:0/4195611159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08a4137e60 msgr2=0x7f08a4138240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:46.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.776+0000 7f08ac6cb640 1 --2- 172.21.15.12:0/4195611159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08a4137e60 0x7f08a4138240 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f089c009d90 tx=0x7f089c01c970 comp rx=0 tx=0).stop 2024-09-11T23:04:46.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.776+0000 7f08ac6cb640 1 -- 172.21.15.12:0/4195611159 shutdown_connections 2024-09-11T23:04:46.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.776+0000 7f08ac6cb640 1 --2- 172.21.15.12:0/4195611159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08a4137e60 0x7f08a4138240 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:46.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.776+0000 7f08ac6cb640 1 -- 172.21.15.12:0/4195611159 >> 172.21.15.12:0/4195611159 conn(0x7f08a40a8450 msgr2=0x7f08a40a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:46.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.776+0000 7f08ac6cb640 1 -- 172.21.15.12:0/4195611159 shutdown_connections 2024-09-11T23:04:46.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.776+0000 7f08ac6cb640 1 -- 172.21.15.12:0/4195611159 wait complete. 2024-09-11T23:04:46.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.780+0000 7f08ac6cb640 1 Processor -- start 2024-09-11T23:04:46.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.780+0000 7f08ac6cb640 1 -- start start 2024-09-11T23:04:46.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.780+0000 7f08ac6cb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08a409f6e0 0x7f08a409a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:46.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.780+0000 7f08ac6cb640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f08a413fe00 con 0x7f08a409f6e0 2024-09-11T23:04:46.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.780+0000 7f08aa467640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08a409f6e0 0x7f08a409a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:46.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.780+0000 7f08aa467640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08a409f6e0 0x7f08a409a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52580/0 (socket says 172.21.15.12:52580) 2024-09-11T23:04:46.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.780+0000 7f08aa467640 1 -- 172.21.15.12:0/3342406267 learned_addr learned my addr 172.21.15.12:0/3342406267 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:46.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.780+0000 7f08aa467640 1 -- 172.21.15.12:0/3342406267 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08a409c320 con 0x7f08a409f6e0 2024-09-11T23:04:46.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.780+0000 7f08aa467640 1 --2- 172.21.15.12:0/3342406267 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08a409f6e0 0x7f08a409a9d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f089c0b0040 tx=0x7f089c019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:46.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.780+0000 7f08a2ffd640 1 -- 172.21.15.12:0/3342406267 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f089c0bd020 con 0x7f08a409f6e0 2024-09-11T23:04:46.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.780+0000 7f08a2ffd640 1 -- 172.21.15.12:0/3342406267 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f089c0b8680 con 0x7f08a409f6e0 2024-09-11T23:04:46.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.780+0000 7f08a2ffd640 1 -- 172.21.15.12:0/3342406267 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f089c0b2040 con 0x7f08a409f6e0 2024-09-11T23:04:46.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.780+0000 7f08ac6cb640 1 -- 172.21.15.12:0/3342406267 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08a411eec0 con 0x7f08a409f6e0 2024-09-11T23:04:46.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.780+0000 7f08ac6cb640 1 -- 172.21.15.12:0/3342406267 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08a413c970 con 0x7f08a409f6e0 2024-09-11T23:04:46.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.780+0000 7f08ac6cb640 1 -- 172.21.15.12:0/3342406267 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08a409c980 con 0x7f08a409f6e0 2024-09-11T23:04:46.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.780+0000 7f08a2ffd640 1 -- 172.21.15.12:0/3342406267 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 15) ==== 44155+0+0 (secure 0 0 0) 0x7f089c0c0020 con 0x7f08a409f6e0 2024-09-11T23:04:46.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.780+0000 7f08a2ffd640 1 --2- 172.21.15.12:0/3342406267 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f0890035ed0 0x7f0890038390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:46.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.780+0000 7f08a2ffd640 1 -- 172.21.15.12:0/3342406267 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 3439+0+0 (secure 0 0 0) 0x7f089c0e34c0 con 0x7f08a409f6e0 2024-09-11T23:04:46.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.780+0000 7f08a9c66640 1 --2- 172.21.15.12:0/3342406267 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f0890035ed0 0x7f0890038390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:46.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.784+0000 7f08a9c66640 1 --2- 172.21.15.12:0/3342406267 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f0890035ed0 0x7f0890038390 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0898000f70 tx=0x7f08980010b0 comp rx=0 tx=0).ready entity=mgr.4452 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:46.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.784+0000 7f08a2ffd640 1 -- 172.21.15.12:0/3342406267 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f089c0c7070 con 0x7f08a409f6e0 2024-09-11T23:04:46.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.948+0000 7f08ac6cb640 1 -- 172.21.15.12:0/3342406267 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f08a413bdb0 con 0x7f08a409f6e0 2024-09-11T23:04:47.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.952+0000 7f08a2ffd640 1 -- 172.21.15.12:0/3342406267 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+10688 (secure 0 0 0) 0x7f089c016560 con 0x7f08a409f6e0 2024-09-11T23:04:47.041 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:04:47.041 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":35,"fsid":"8be14356-3340-4500-91a2-4cbc6b511f65","created":"2024-09-11T23:03:10.620234+0000","modified":"2024-09-11T23:04:45.641080+0000","last_up_change":"2024-09-11T23:03:22.359028+0000","last_in_change":"2024-09-11T23:03:11.545817+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:03:23.587068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:04:43.298425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-11T23:04:44.624329+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"153b72a1-40b1-400d-93ea-333e733f9bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6817","nonce":3680911937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6819","nonce":3680911937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6823","nonce":3680911937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6821","nonce":3680911937}]},"public_addr":"172.21.15.12:6817/3680911937","cluster_addr":"172.21.15.12:6819/3680911937","heartbeat_back_addr":"172.21.15.12:6823/3680911937","heartbeat_front_addr":"172.21.15.12:6821/3680911937","state":["exists","up"]},{"osd":1,"uuid":"94669e49-ee4f-4acf-9e25-e94374dda8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6801","nonce":236825163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6803","nonce":236825163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6807","nonce":236825163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6805","nonce":236825163}]},"public_addr":"172.21.15.12:6801/236825163","cluster_addr":"172.21.15.12:6803/236825163","heartbeat_back_addr":"172.21.15.12:6807/236825163","heartbeat_front_addr":"172.21.15.12:6805/236825163","state":["exists","up"]},{"osd":2,"uuid":"826dae4d-8888-4ec5-8f00-425b3be93814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6809","nonce":3263521655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6811","nonce":3263521655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6815","nonce":3263521655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6813","nonce":3263521655}]},"public_addr":"172.21.15.12:6809/3263521655","cluster_addr":"172.21.15.12:6811/3263521655","heartbeat_back_addr":"172.21.15.12:6815/3263521655","heartbeat_front_addr":"172.21.15.12:6813/3263521655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:19.398518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.761524+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.904997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:04:47.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.952+0000 7f08ac6cb640 1 -- 172.21.15.12:0/3342406267 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f0890035ed0 msgr2=0x7f0890038390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:47.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.952+0000 7f08ac6cb640 1 --2- 172.21.15.12:0/3342406267 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f0890035ed0 0x7f0890038390 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0898000f70 tx=0x7f08980010b0 comp rx=0 tx=0).stop 2024-09-11T23:04:47.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.956+0000 7f08ac6cb640 1 -- 172.21.15.12:0/3342406267 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08a409f6e0 msgr2=0x7f08a409a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:47.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.956+0000 7f08ac6cb640 1 --2- 172.21.15.12:0/3342406267 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08a409f6e0 0x7f08a409a9d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f089c0b0040 tx=0x7f089c019710 comp rx=0 tx=0).stop 2024-09-11T23:04:47.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.956+0000 7f08ac6cb640 1 -- 172.21.15.12:0/3342406267 shutdown_connections 2024-09-11T23:04:47.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.956+0000 7f08ac6cb640 1 --2- 172.21.15.12:0/3342406267 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f0890035ed0 0x7f0890038390 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:47.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.956+0000 7f08ac6cb640 1 --2- 172.21.15.12:0/3342406267 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08a409f6e0 0x7f08a409a9d0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:47.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.956+0000 7f08ac6cb640 1 -- 172.21.15.12:0/3342406267 >> 172.21.15.12:0/3342406267 conn(0x7f08a40a8450 msgr2=0x7f08a4134800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:47.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.956+0000 7f08ac6cb640 1 -- 172.21.15.12:0/3342406267 shutdown_connections 2024-09-11T23:04:47.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:46.956+0000 7f08ac6cb640 1 -- 172.21.15.12:0/3342406267 wait complete. 2024-09-11T23:04:47.043 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-11T23:04:47.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:47.168+0000 7f32a61c2640 1 Processor -- start 2024-09-11T23:04:47.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:47.168+0000 7f32a61c2640 1 -- start start 2024-09-11T23:04:47.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:47.168+0000 7f32a61c2640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f32a01381c0 0x7f32a013cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:47.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:47.168+0000 7f32a61c2640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32a009d690 con 0x7f32a0137de0 2024-09-11T23:04:47.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:47.168+0000 7f32a61c2640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f32a009ea90 con 0x7f32a01381c0 2024-09-11T23:04:47.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:47.168+0000 7f329effd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f32a01381c0 0x7f32a013cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:47.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:47.168+0000 7f329f7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f32a0137de0 0x7f32a009f190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51246/0 (socket says 172.21.15.12:51246) 2024-09-11T23:04:47.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:47.168+0000 7f329f7fe640 1 -- 172.21.15.12:0/2559653611 learned_addr learned my addr 172.21.15.12:0/2559653611 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:04:47.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:47.168+0000 7f329effd640 1 -- 172.21.15.12:0/2559653611 >> v1:172.21.15.12:6789/0 conn(0x7f32a0137de0 legacy=0x7f32a009f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:47.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:47.168+0000 7f329effd640 1 -- 172.21.15.12:0/2559653611 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32a009cf00 con 0x7f32a01381c0 2024-09-11T23:04:47.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:47.168+0000 7f329effd640 1 --2- 172.21.15.12:0/2559653611 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32a01381c0 0x7f32a013cbc0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f3288009740 tx=0x7f328801c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f800be5d11a46e68 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:47.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:47.168+0000 7f329e7fc640 1 -- 172.21.15.12:0/2559653611 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32880b0070 con 0x7f32a01381c0 2024-09-11T23:04:47.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:47.168+0000 7f329e7fc640 1 -- 172.21.15.12:0/2559653611 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32880ab530 con 0x7f32a01381c0 2024-09-11T23:04:47.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:47.168+0000 7f329e7fc640 1 -- 172.21.15.12:0/2559653611 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32880ab830 con 0x7f32a01381c0 2024-09-11T23:04:47.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:47.172+0000 7f32a61c2640 1 -- 172.21.15.12:0/2559653611 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32a01381c0 msgr2=0x7f32a013cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:47.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:47.172+0000 7f32a61c2640 1 --2- 172.21.15.12:0/2559653611 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32a01381c0 0x7f32a013cbc0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f3288009740 tx=0x7f328801c390 comp rx=0 tx=0).stop 2024-09-11T23:04:47.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:47.172+0000 7f32a61c2640 1 -- 172.21.15.12:0/2559653611 shutdown_connections 2024-09-11T23:04:47.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:47.172+0000 7f32a61c2640 1 --2- 172.21.15.12:0/2559653611 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32a01381c0 0x7f32a013cbc0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:47.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:47.172+0000 7f32a61c2640 1 -- 172.21.15.12:0/2559653611 >> 172.21.15.12:0/2559653611 conn(0x7f32a00a82f0 msgr2=0x7f32a00a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:47.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:47.172+0000 7f32a61c2640 1 -- 172.21.15.12:0/2559653611 shutdown_connections 2024-09-11T23:04:47.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:47.172+0000 7f32a61c2640 1 -- 172.21.15.12:0/2559653611 wait complete. 2024-09-11T23:04:47.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:47.172+0000 7f32a61c2640 1 Processor -- start 2024-09-11T23:04:47.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:47.172+0000 7f32a61c2640 1 -- start start 2024-09-11T23:04:47.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:47.172+0000 7f32a61c2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32a0137de0 0x7f32a006fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:47.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:47.172+0000 7f32a61c2640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f32a0137860 con 0x7f32a0137de0 2024-09-11T23:04:47.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:47.172+0000 7f329f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32a0137de0 0x7f32a006fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:47.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:47.172+0000 7f329f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32a0137de0 0x7f32a006fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52596/0 (socket says 172.21.15.12:52596) 2024-09-11T23:04:47.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:47.172+0000 7f329f7fe640 1 -- 172.21.15.12:0/387662207 learned_addr learned my addr 172.21.15.12:0/387662207 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:47.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:47.172+0000 7f329f7fe640 1 -- 172.21.15.12:0/387662207 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32a011eaf0 con 0x7f32a0137de0 2024-09-11T23:04:47.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:47.172+0000 7f329f7fe640 1 --2- 172.21.15.12:0/387662207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32a0137de0 0x7f32a006fd40 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f329000cb40 tx=0x7f329000cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:47.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:47.172+0000 7f3297fff640 1 -- 172.21.15.12:0/387662207 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3290017070 con 0x7f32a0137de0 2024-09-11T23:04:47.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:47.172+0000 7f3297fff640 1 -- 172.21.15.12:0/387662207 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f329000ab30 con 0x7f32a0137de0 2024-09-11T23:04:47.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:47.172+0000 7f3297fff640 1 -- 172.21.15.12:0/387662207 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f329000ae10 con 0x7f32a0137de0 2024-09-11T23:04:47.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:47.172+0000 7f32a61c2640 1 -- 172.21.15.12:0/387662207 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32a0072550 con 0x7f32a0137de0 2024-09-11T23:04:47.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:47.172+0000 7f32a61c2640 1 -- 172.21.15.12:0/387662207 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32a0071990 con 0x7f32a0137de0 2024-09-11T23:04:47.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:47.176+0000 7f3297fff640 1 -- 172.21.15.12:0/387662207 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 15) ==== 44155+0+0 (secure 0 0 0) 0x7f329001a070 con 0x7f32a0137de0 2024-09-11T23:04:47.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:47.176+0000 7f32a61c2640 1 -- 172.21.15.12:0/387662207 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32a0071c70 con 0x7f32a0137de0 2024-09-11T23:04:47.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:47.176+0000 7f3297fff640 1 --2- 172.21.15.12:0/387662207 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f3280035ed0 0x7f3280038390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:47.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:47.176+0000 7f3297fff640 1 -- 172.21.15.12:0/387662207 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 3439+0+0 (secure 0 0 0) 0x7f32900485a0 con 0x7f32a0137de0 2024-09-11T23:04:47.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:47.176+0000 7f329effd640 1 --2- 172.21.15.12:0/387662207 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f3280035ed0 0x7f3280038390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:47.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:47.176+0000 7f329effd640 1 --2- 172.21.15.12:0/387662207 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f3280035ed0 0x7f3280038390 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f32880ad000 tx=0x7f32880a6000 comp rx=0 tx=0).ready entity=mgr.4452 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:47.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:47.180+0000 7f3297fff640 1 -- 172.21.15.12:0/387662207 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3290010300 con 0x7f32a0137de0 2024-09-11T23:04:47.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:47.384+0000 7f32a61c2640 1 -- 172.21.15.12:0/387662207 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f32a009f190 con 0x7f32a0137de0 2024-09-11T23:04:48.250 INFO:tasks.ceph.mds.b.smithi012.stderr:2024-09-11T23:04:48.248+0000 7fc8e8ed3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T23:04:48.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.280+0000 7f3297fff640 1 -- 172.21.15.12:0/387662207 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v24) ==== 118+0+0 (secure 0 0 0) 0x7f32900078c0 con 0x7f32a0137de0 2024-09-11T23:04:48.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.284+0000 7f32a61c2640 1 -- 172.21.15.12:0/387662207 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f3280035ed0 msgr2=0x7f3280038390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:48.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.284+0000 7f32a61c2640 1 --2- 172.21.15.12:0/387662207 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f3280035ed0 0x7f3280038390 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f32880ad000 tx=0x7f32880a6000 comp rx=0 tx=0).stop 2024-09-11T23:04:48.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.284+0000 7f32a61c2640 1 -- 172.21.15.12:0/387662207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32a0137de0 msgr2=0x7f32a006fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:48.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.284+0000 7f32a61c2640 1 --2- 172.21.15.12:0/387662207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32a0137de0 0x7f32a006fd40 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f329000cb40 tx=0x7f329000cf40 comp rx=0 tx=0).stop 2024-09-11T23:04:48.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.284+0000 7f32a61c2640 1 -- 172.21.15.12:0/387662207 shutdown_connections 2024-09-11T23:04:48.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.284+0000 7f32a61c2640 1 --2- 172.21.15.12:0/387662207 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f3280035ed0 0x7f3280038390 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:48.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.284+0000 7f32a61c2640 1 --2- 172.21.15.12:0/387662207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32a0137de0 0x7f32a006fd40 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:48.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.284+0000 7f32a61c2640 1 -- 172.21.15.12:0/387662207 >> 172.21.15.12:0/387662207 conn(0x7f32a00a82f0 msgr2=0x7f32a009fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:48.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.284+0000 7f32a61c2640 1 -- 172.21.15.12:0/387662207 shutdown_connections 2024-09-11T23:04:48.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.284+0000 7f32a61c2640 1 -- 172.21.15.12:0/387662207 wait complete. 2024-09-11T23:04:48.307 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-11T23:04:48.308 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-11T23:04:48.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.440+0000 7f6546346640 1 Processor -- start 2024-09-11T23:04:48.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.440+0000 7f6546346640 1 -- start start 2024-09-11T23:04:48.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.440+0000 7f6546346640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f65401381c0 0x7f654013cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:48.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.440+0000 7f6546346640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f654009d690 con 0x7f6540137de0 2024-09-11T23:04:48.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.440+0000 7f6546346640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f654009ea90 con 0x7f65401381c0 2024-09-11T23:04:48.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.440+0000 7f653ffff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f6540137de0 0x7f654009f190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51254/0 (socket says 172.21.15.12:51254) 2024-09-11T23:04:48.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.440+0000 7f653ffff640 1 -- 172.21.15.12:0/1366907961 learned_addr learned my addr 172.21.15.12:0/1366907961 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:04:48.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.440+0000 7f653f7fe640 1 --2- 172.21.15.12:0/1366907961 >> v2:172.21.15.12:3300/0 conn(0x7f65401381c0 0x7f654013cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:48.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.440+0000 7f653effd640 1 -- 172.21.15.12:0/1366907961 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1264290157 0 0) 0x7f654009d690 con 0x7f6540137de0 2024-09-11T23:04:48.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.440+0000 7f653effd640 1 -- 172.21.15.12:0/1366907961 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6528003530 con 0x7f6540137de0 2024-09-11T23:04:48.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.440+0000 7f653f7fe640 1 -- 172.21.15.12:0/1366907961 >> v1:172.21.15.12:6789/0 conn(0x7f6540137de0 legacy=0x7f654009f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:48.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.440+0000 7f653f7fe640 1 -- 172.21.15.12:0/1366907961 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f654009cf00 con 0x7f65401381c0 2024-09-11T23:04:48.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.444+0000 7f653f7fe640 1 --2- 172.21.15.12:0/1366907961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65401381c0 0x7f654013cbc0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f6534009740 tx=0x7f653401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=138a232555ebb5b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:48.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.444+0000 7f653effd640 1 -- 172.21.15.12:0/1366907961 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65340b0070 con 0x7f65401381c0 2024-09-11T23:04:48.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.444+0000 7f653effd640 1 -- 172.21.15.12:0/1366907961 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65340ab530 con 0x7f65401381c0 2024-09-11T23:04:48.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.444+0000 7f653effd640 1 -- 172.21.15.12:0/1366907961 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65340ab830 con 0x7f65401381c0 2024-09-11T23:04:48.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.444+0000 7f6546346640 1 -- 172.21.15.12:0/1366907961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65401381c0 msgr2=0x7f654013cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:48.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.444+0000 7f6546346640 1 --2- 172.21.15.12:0/1366907961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65401381c0 0x7f654013cbc0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f6534009740 tx=0x7f653401c390 comp rx=0 tx=0).stop 2024-09-11T23:04:48.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.444+0000 7f6546346640 1 -- 172.21.15.12:0/1366907961 shutdown_connections 2024-09-11T23:04:48.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.444+0000 7f6546346640 1 --2- 172.21.15.12:0/1366907961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65401381c0 0x7f654013cbc0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:48.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.444+0000 7f6546346640 1 -- 172.21.15.12:0/1366907961 >> 172.21.15.12:0/1366907961 conn(0x7f65400a82f0 msgr2=0x7f65400a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:48.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.444+0000 7f6546346640 1 -- 172.21.15.12:0/1366907961 shutdown_connections 2024-09-11T23:04:48.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.444+0000 7f6546346640 1 -- 172.21.15.12:0/1366907961 wait complete. 2024-09-11T23:04:48.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.444+0000 7f6546346640 1 Processor -- start 2024-09-11T23:04:48.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.444+0000 7f6546346640 1 -- start start 2024-09-11T23:04:48.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.444+0000 7f6546346640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6540137de0 0x7f6540071d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:48.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.444+0000 7f6546346640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6540137860 con 0x7f6540137de0 2024-09-11T23:04:48.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.444+0000 7f653ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6540137de0 0x7f6540071d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:48.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.444+0000 7f653ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6540137de0 0x7f6540071d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52616/0 (socket says 172.21.15.12:52616) 2024-09-11T23:04:48.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.444+0000 7f653ffff640 1 -- 172.21.15.12:0/2132716828 learned_addr learned my addr 172.21.15.12:0/2132716828 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:48.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.444+0000 7f653ffff640 1 -- 172.21.15.12:0/2132716828 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6540071350 con 0x7f6540137de0 2024-09-11T23:04:48.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.444+0000 7f653ffff640 1 --2- 172.21.15.12:0/2132716828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6540137de0 0x7f6540071d90 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f653000c3a0 tx=0x7f653000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:48.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.448+0000 7f653cff9640 1 -- 172.21.15.12:0/2132716828 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6530017070 con 0x7f6540137de0 2024-09-11T23:04:48.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.448+0000 7f653cff9640 1 -- 172.21.15.12:0/2132716828 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6530005c20 con 0x7f6540137de0 2024-09-11T23:04:48.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.448+0000 7f6546346640 1 -- 172.21.15.12:0/2132716828 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f654009c6a0 con 0x7f6540137de0 2024-09-11T23:04:48.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.448+0000 7f653cff9640 1 -- 172.21.15.12:0/2132716828 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65300070d0 con 0x7f6540137de0 2024-09-11T23:04:48.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.448+0000 7f6546346640 1 -- 172.21.15.12:0/2132716828 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6540072500 con 0x7f6540137de0 2024-09-11T23:04:48.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.448+0000 7f653cff9640 1 -- 172.21.15.12:0/2132716828 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 15) ==== 44155+0+0 (secure 0 0 0) 0x7f653001a070 con 0x7f6540137de0 2024-09-11T23:04:48.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.448+0000 7f6546346640 1 -- 172.21.15.12:0/2132716828 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f654009f190 con 0x7f6540137de0 2024-09-11T23:04:48.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.448+0000 7f653cff9640 1 --2- 172.21.15.12:0/2132716828 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f652c035ed0 0x7f652c038390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:48.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.448+0000 7f653cff9640 1 -- 172.21.15.12:0/2132716828 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 3439+0+0 (secure 0 0 0) 0x7f6530047b40 con 0x7f6540137de0 2024-09-11T23:04:48.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.448+0000 7f653f7fe640 1 --2- 172.21.15.12:0/2132716828 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f652c035ed0 0x7f652c038390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:48.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.448+0000 7f653f7fe640 1 --2- 172.21.15.12:0/2132716828 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f652c035ed0 0x7f652c038390 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f65340ad000 tx=0x7f65340a6000 comp rx=0 tx=0).ready entity=mgr.4452 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:48.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.452+0000 7f653cff9640 1 -- 172.21.15.12:0/2132716828 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6530019e10 con 0x7f6540137de0 2024-09-11T23:04:48.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:48.652+0000 7f6546346640 1 -- 172.21.15.12:0/2132716828 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f654009e730 con 0x7f6540137de0 2024-09-11T23:04:49.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.288+0000 7f653cff9640 1 -- 172.21.15.12:0/2132716828 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v25) ==== 122+0+0 (secure 0 0 0) 0x7f6530010e00 con 0x7f6540137de0 2024-09-11T23:04:49.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.292+0000 7f6546346640 1 -- 172.21.15.12:0/2132716828 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f652c035ed0 msgr2=0x7f652c038390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:49.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.292+0000 7f6546346640 1 --2- 172.21.15.12:0/2132716828 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f652c035ed0 0x7f652c038390 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f65340ad000 tx=0x7f65340a6000 comp rx=0 tx=0).stop 2024-09-11T23:04:49.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.292+0000 7f6546346640 1 -- 172.21.15.12:0/2132716828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6540137de0 msgr2=0x7f6540071d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:49.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.292+0000 7f6546346640 1 --2- 172.21.15.12:0/2132716828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6540137de0 0x7f6540071d90 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f653000c3a0 tx=0x7f653000c860 comp rx=0 tx=0).stop 2024-09-11T23:04:49.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.292+0000 7f6546346640 1 -- 172.21.15.12:0/2132716828 shutdown_connections 2024-09-11T23:04:49.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.292+0000 7f6546346640 1 --2- 172.21.15.12:0/2132716828 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f652c035ed0 0x7f652c038390 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:49.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.292+0000 7f6546346640 1 --2- 172.21.15.12:0/2132716828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6540137de0 0x7f6540071d90 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:49.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.292+0000 7f6546346640 1 -- 172.21.15.12:0/2132716828 >> 172.21.15.12:0/2132716828 conn(0x7f65400a82f0 msgr2=0x7f6540135860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:49.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.292+0000 7f6546346640 1 -- 172.21.15.12:0/2132716828 shutdown_connections 2024-09-11T23:04:49.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.292+0000 7f6546346640 1 -- 172.21.15.12:0/2132716828 wait complete. 2024-09-11T23:04:49.316 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-11T23:04:49.316 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:04:49.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.440+0000 7f2cb761e640 1 Processor -- start 2024-09-11T23:04:49.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.440+0000 7f2cb761e640 1 -- start start 2024-09-11T23:04:49.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.440+0000 7f2cb761e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2cb0137e60 0x7f2cb0138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:49.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.440+0000 7f2cb761e640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cb009e930 con 0x7f2cb009f6e0 2024-09-11T23:04:49.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.440+0000 7f2cb761e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f2cb01379e0 con 0x7f2cb0137e60 2024-09-11T23:04:49.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.440+0000 7f2cb53ba640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2cb0137e60 0x7f2cb0138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:49.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.440+0000 7f2cb4bb9640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f2cb009f6e0 0x7f2cb00a36a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51268/0 (socket says 172.21.15.12:51268) 2024-09-11T23:04:49.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.440+0000 7f2cb4bb9640 1 -- 172.21.15.12:0/3363345251 learned_addr learned my addr 172.21.15.12:0/3363345251 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:04:49.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.440+0000 7f2caffff640 1 -- 172.21.15.12:0/3363345251 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 477618283 0 0) 0x7f2cb009e930 con 0x7f2cb009f6e0 2024-09-11T23:04:49.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.440+0000 7f2caffff640 1 -- 172.21.15.12:0/3363345251 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c98003530 con 0x7f2cb009f6e0 2024-09-11T23:04:49.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.440+0000 7f2cb53ba640 1 -- 172.21.15.12:0/3363345251 >> v1:172.21.15.12:6789/0 conn(0x7f2cb009f6e0 legacy=0x7f2cb00a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:49.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.440+0000 7f2cb53ba640 1 -- 172.21.15.12:0/3363345251 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cb009d910 con 0x7f2cb0137e60 2024-09-11T23:04:49.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.444+0000 7f2cb53ba640 1 --2- 172.21.15.12:0/3363345251 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2cb0137e60 0x7f2cb0138240 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0009d90 tx=0x7f2ca001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c551140506b1b355 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:49.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.444+0000 7f2caffff640 1 -- 172.21.15.12:0/3363345251 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ca00b2070 con 0x7f2cb0137e60 2024-09-11T23:04:49.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.444+0000 7f2caffff640 1 -- 172.21.15.12:0/3363345251 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ca00a5900 con 0x7f2cb0137e60 2024-09-11T23:04:49.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.444+0000 7f2caffff640 1 -- 172.21.15.12:0/3363345251 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ca00a5be0 con 0x7f2cb0137e60 2024-09-11T23:04:49.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.444+0000 7f2cb761e640 1 -- 172.21.15.12:0/3363345251 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2cb0137e60 msgr2=0x7f2cb0138240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:49.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.444+0000 7f2cb761e640 1 --2- 172.21.15.12:0/3363345251 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2cb0137e60 0x7f2cb0138240 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0009d90 tx=0x7f2ca001c970 comp rx=0 tx=0).stop 2024-09-11T23:04:49.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.444+0000 7f2cb761e640 1 -- 172.21.15.12:0/3363345251 shutdown_connections 2024-09-11T23:04:49.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.444+0000 7f2cb761e640 1 --2- 172.21.15.12:0/3363345251 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2cb0137e60 0x7f2cb0138240 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:49.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.444+0000 7f2cb761e640 1 -- 172.21.15.12:0/3363345251 >> 172.21.15.12:0/3363345251 conn(0x7f2cb00a8450 msgr2=0x7f2cb00a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:49.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.444+0000 7f2cb761e640 1 -- 172.21.15.12:0/3363345251 shutdown_connections 2024-09-11T23:04:49.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.444+0000 7f2cb761e640 1 -- 172.21.15.12:0/3363345251 wait complete. 2024-09-11T23:04:49.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.448+0000 7f2cb761e640 1 Processor -- start 2024-09-11T23:04:49.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.448+0000 7f2cb761e640 1 -- start start 2024-09-11T23:04:49.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.448+0000 7f2cb761e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2cb009f6e0 0x7f2cb01cf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:49.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.448+0000 7f2cb761e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb013fe00 con 0x7f2cb009f6e0 2024-09-11T23:04:49.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.448+0000 7f2cb53ba640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2cb009f6e0 0x7f2cb01cf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:49.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.448+0000 7f2cb53ba640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2cb009f6e0 0x7f2cb01cf6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52634/0 (socket says 172.21.15.12:52634) 2024-09-11T23:04:49.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.448+0000 7f2cb53ba640 1 -- 172.21.15.12:0/3797124622 learned_addr learned my addr 172.21.15.12:0/3797124622 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:49.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.448+0000 7f2cb53ba640 1 -- 172.21.15.12:0/3797124622 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cb00713b0 con 0x7f2cb009f6e0 2024-09-11T23:04:49.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.448+0000 7f2cb53ba640 1 --2- 172.21.15.12:0/3797124622 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2cb009f6e0 0x7f2cb01cf6a0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f2ca00b0040 tx=0x7f2ca0019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:49.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.448+0000 7f2cadffb640 1 -- 172.21.15.12:0/3797124622 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ca00bd020 con 0x7f2cb009f6e0 2024-09-11T23:04:49.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.448+0000 7f2cadffb640 1 -- 172.21.15.12:0/3797124622 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ca00b8680 con 0x7f2cb009f6e0 2024-09-11T23:04:49.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.448+0000 7f2cadffb640 1 -- 172.21.15.12:0/3797124622 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ca00b2040 con 0x7f2cb009f6e0 2024-09-11T23:04:49.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.448+0000 7f2cb761e640 1 -- 172.21.15.12:0/3797124622 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cb0070600 con 0x7f2cb009f6e0 2024-09-11T23:04:49.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.448+0000 7f2cb761e640 1 -- 172.21.15.12:0/3797124622 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cb00710a0 con 0x7f2cb009f6e0 2024-09-11T23:04:49.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.448+0000 7f2cadffb640 1 -- 172.21.15.12:0/3797124622 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 15) ==== 44155+0+0 (secure 0 0 0) 0x7f2ca00c0020 con 0x7f2cb009f6e0 2024-09-11T23:04:49.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.448+0000 7f2cb761e640 1 -- 172.21.15.12:0/3797124622 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cb0072220 con 0x7f2cb009f6e0 2024-09-11T23:04:49.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.448+0000 7f2cadffb640 1 --2- 172.21.15.12:0/3797124622 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f2c9c035ed0 0x7f2c9c038390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:49.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.448+0000 7f2cadffb640 1 -- 172.21.15.12:0/3797124622 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 3439+0+0 (secure 0 0 0) 0x7f2ca00e34c0 con 0x7f2cb009f6e0 2024-09-11T23:04:49.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.448+0000 7f2cb4bb9640 1 --2- 172.21.15.12:0/3797124622 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f2c9c035ed0 0x7f2c9c038390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:49.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.448+0000 7f2cb4bb9640 1 --2- 172.21.15.12:0/3797124622 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f2c9c035ed0 0x7f2c9c038390 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4007fd0 tx=0x7f2ca4007980 comp rx=0 tx=0).ready entity=mgr.4452 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:49.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.452+0000 7f2cadffb640 1 -- 172.21.15.12:0/3797124622 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2ca00c7070 con 0x7f2cb009f6e0 2024-09-11T23:04:49.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.652+0000 7f2cb761e640 1 -- 172.21.15.12:0/3797124622 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2cb00716e0 con 0x7f2cb009f6e0 2024-09-11T23:04:49.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.656+0000 7f2cadffb640 1 -- 172.21.15.12:0/3797124622 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+3573 (secure 0 0 0) 0x7f2ca0016560 con 0x7f2cb009f6e0 2024-09-11T23:04:49.656 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:04:49.656 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":25,"btime":"2024-09-11T23:04:49:285627+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4527,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6827/1887547537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":1887547537},{"type":"v1","addr":"172.21.15.12:6827","nonce":1887547537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:04:45.641763+0000","modified":"2024-09-11T23:04:48.653841+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4528},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4528":{"gid":4528,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6829/2765393463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":2765393463},{"type":"v1","addr":"172.21.15.12:6829","nonce":2765393463}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4528,"qdb_cluster":[4528]},"id":3}]} 2024-09-11T23:04:49.656 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 25 2024-09-11T23:04:49.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.656+0000 7f2cb761e640 1 -- 172.21.15.12:0/3797124622 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f2c9c035ed0 msgr2=0x7f2c9c038390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:49.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.656+0000 7f2cb761e640 1 --2- 172.21.15.12:0/3797124622 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f2c9c035ed0 0x7f2c9c038390 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4007fd0 tx=0x7f2ca4007980 comp rx=0 tx=0).stop 2024-09-11T23:04:49.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.656+0000 7f2cb761e640 1 -- 172.21.15.12:0/3797124622 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2cb009f6e0 msgr2=0x7f2cb01cf6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:49.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.656+0000 7f2cb761e640 1 --2- 172.21.15.12:0/3797124622 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2cb009f6e0 0x7f2cb01cf6a0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f2ca00b0040 tx=0x7f2ca0019710 comp rx=0 tx=0).stop 2024-09-11T23:04:49.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.656+0000 7f2cb761e640 1 -- 172.21.15.12:0/3797124622 shutdown_connections 2024-09-11T23:04:49.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.656+0000 7f2cb761e640 1 --2- 172.21.15.12:0/3797124622 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f2c9c035ed0 0x7f2c9c038390 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:49.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.656+0000 7f2cb761e640 1 --2- 172.21.15.12:0/3797124622 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2cb009f6e0 0x7f2cb01cf6a0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:49.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.656+0000 7f2cb761e640 1 -- 172.21.15.12:0/3797124622 >> 172.21.15.12:0/3797124622 conn(0x7f2cb00a8450 msgr2=0x7f2cb0134800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:49.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.656+0000 7f2cb761e640 1 -- 172.21.15.12:0/3797124622 shutdown_connections 2024-09-11T23:04:49.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.656+0000 7f2cb761e640 1 -- 172.21.15.12:0/3797124622 wait complete. 2024-09-11T23:04:49.676 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:04:49.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.800+0000 7f33f7a33640 1 Processor -- start 2024-09-11T23:04:49.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.800+0000 7f33f7a33640 1 -- start start 2024-09-11T23:04:49.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.800+0000 7f33f7a33640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f33f0136da0 0x7f33f0137180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:49.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.800+0000 7f33f7a33640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33f01367e0 con 0x7f33f00a2ce0 2024-09-11T23:04:49.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.800+0000 7f33f7a33640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f33f00a2300 con 0x7f33f0136da0 2024-09-11T23:04:49.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.800+0000 7f33f57cf640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f33f0136da0 0x7f33f0137180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:49.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.800+0000 7f33f57cf640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f33f0136da0 0x7f33f0137180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52650/0 (socket says 172.21.15.12:52650) 2024-09-11T23:04:49.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.800+0000 7f33f57cf640 1 -- 172.21.15.12:0/2343046057 learned_addr learned my addr 172.21.15.12:0/2343046057 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:49.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.800+0000 7f33f57cf640 1 -- 172.21.15.12:0/2343046057 >> v1:172.21.15.12:6789/0 conn(0x7f33f00a2ce0 legacy=0x7f33f00a4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:49.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.800+0000 7f33f57cf640 1 -- 172.21.15.12:0/2343046057 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33f00a1000 con 0x7f33f0136da0 2024-09-11T23:04:49.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.804+0000 7f33f57cf640 1 --2- 172.21.15.12:0/2343046057 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33f0136da0 0x7f33f0137180 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f33e00097f0 tx=0x7f33e001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10e948c9c3aebb64 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:49.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.804+0000 7f33e7fff640 1 -- 172.21.15.12:0/2343046057 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33e00b0070 con 0x7f33f0136da0 2024-09-11T23:04:49.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.804+0000 7f33e7fff640 1 -- 172.21.15.12:0/2343046057 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33e00ab530 con 0x7f33f0136da0 2024-09-11T23:04:49.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.804+0000 7f33e7fff640 1 -- 172.21.15.12:0/2343046057 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33e00ab830 con 0x7f33f0136da0 2024-09-11T23:04:49.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.804+0000 7f33f7a33640 1 -- 172.21.15.12:0/2343046057 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33f0136da0 msgr2=0x7f33f0137180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:49.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.804+0000 7f33f7a33640 1 --2- 172.21.15.12:0/2343046057 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33f0136da0 0x7f33f0137180 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f33e00097f0 tx=0x7f33e001c450 comp rx=0 tx=0).stop 2024-09-11T23:04:49.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.804+0000 7f33f7a33640 1 -- 172.21.15.12:0/2343046057 shutdown_connections 2024-09-11T23:04:49.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.804+0000 7f33f7a33640 1 --2- 172.21.15.12:0/2343046057 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33f0136da0 0x7f33f0137180 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:49.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.804+0000 7f33f7a33640 1 -- 172.21.15.12:0/2343046057 >> 172.21.15.12:0/2343046057 conn(0x7f33f0068000 msgr2=0x7f33f00a5910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:49.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.804+0000 7f33f7a33640 1 -- 172.21.15.12:0/2343046057 shutdown_connections 2024-09-11T23:04:49.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.804+0000 7f33f7a33640 1 -- 172.21.15.12:0/2343046057 wait complete. 2024-09-11T23:04:49.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.804+0000 7f33f7a33640 1 Processor -- start 2024-09-11T23:04:49.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.804+0000 7f33f7a33640 1 -- start start 2024-09-11T23:04:49.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.804+0000 7f33f7a33640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33f00a2ce0 0x7f33f0138320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:49.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.804+0000 7f33f7a33640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f33f00a6400 con 0x7f33f00a2ce0 2024-09-11T23:04:49.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.804+0000 7f33f57cf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33f00a2ce0 0x7f33f0138320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:49.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.804+0000 7f33f57cf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33f00a2ce0 0x7f33f0138320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52660/0 (socket says 172.21.15.12:52660) 2024-09-11T23:04:49.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.804+0000 7f33f57cf640 1 -- 172.21.15.12:0/657294377 learned_addr learned my addr 172.21.15.12:0/657294377 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:49.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.804+0000 7f33f57cf640 1 -- 172.21.15.12:0/657294377 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33f013a1d0 con 0x7f33f00a2ce0 2024-09-11T23:04:49.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.804+0000 7f33f57cf640 1 --2- 172.21.15.12:0/657294377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33f00a2ce0 0x7f33f0138320 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f33e001a080 tx=0x7f33e001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:49.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.804+0000 7f33e5ffb640 1 -- 172.21.15.12:0/657294377 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33e00ba020 con 0x7f33f00a2ce0 2024-09-11T23:04:49.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.804+0000 7f33e5ffb640 1 -- 172.21.15.12:0/657294377 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33e00aa5d0 con 0x7f33f00a2ce0 2024-09-11T23:04:49.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.804+0000 7f33f7a33640 1 -- 172.21.15.12:0/657294377 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33f011f570 con 0x7f33f00a2ce0 2024-09-11T23:04:49.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.804+0000 7f33e5ffb640 1 -- 172.21.15.12:0/657294377 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33e00b0040 con 0x7f33f00a2ce0 2024-09-11T23:04:49.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.804+0000 7f33f7a33640 1 -- 172.21.15.12:0/657294377 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33f0072fc0 con 0x7f33f00a2ce0 2024-09-11T23:04:49.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.804+0000 7f33e5ffb640 1 -- 172.21.15.12:0/657294377 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 15) ==== 44155+0+0 (secure 0 0 0) 0x7f33e00bd020 con 0x7f33f00a2ce0 2024-09-11T23:04:49.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.808+0000 7f33f7a33640 1 -- 172.21.15.12:0/657294377 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33f013ba20 con 0x7f33f00a2ce0 2024-09-11T23:04:49.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.808+0000 7f33e5ffb640 1 --2- 172.21.15.12:0/657294377 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f33d4035f50 0x7f33d4038410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:49.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.808+0000 7f33e5ffb640 1 -- 172.21.15.12:0/657294377 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 3439+0+0 (secure 0 0 0) 0x7f33e00e2e70 con 0x7f33f00a2ce0 2024-09-11T23:04:49.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.808+0000 7f33f4fce640 1 --2- 172.21.15.12:0/657294377 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f33d4035f50 0x7f33d4038410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:49.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.808+0000 7f33f4fce640 1 --2- 172.21.15.12:0/657294377 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f33d4035f50 0x7f33d4038410 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f33e8007fd0 tx=0x7f33e8007dc0 comp rx=0 tx=0).ready entity=mgr.4452 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:49.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.812+0000 7f33e5ffb640 1 -- 172.21.15.12:0/657294377 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f33e00c4030 con 0x7f33f00a2ce0 2024-09-11T23:04:49.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.976+0000 7f33f7a33640 1 -- 172.21.15.12:0/657294377 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f33f006cd70 con 0x7f33f00a2ce0 2024-09-11T23:04:49.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.976+0000 7f33e5ffb640 1 -- 172.21.15.12:0/657294377 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) ==== 74+0+10675 (secure 0 0 0) 0x7f33e00160d0 con 0x7f33f00a2ce0 2024-09-11T23:04:49.979 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:04:49.979 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":36,"fsid":"8be14356-3340-4500-91a2-4cbc6b511f65","created":"2024-09-11T23:03:10.620234+0000","modified":"2024-09-11T23:04:47.272240+0000","last_up_change":"2024-09-11T23:03:22.359028+0000","last_in_change":"2024-09-11T23:03:11.545817+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:03:23.587068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:04:43.298425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-11T23:04:44.624329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"153b72a1-40b1-400d-93ea-333e733f9bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6817","nonce":3680911937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6819","nonce":3680911937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6823","nonce":3680911937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6821","nonce":3680911937}]},"public_addr":"172.21.15.12:6817/3680911937","cluster_addr":"172.21.15.12:6819/3680911937","heartbeat_back_addr":"172.21.15.12:6823/3680911937","heartbeat_front_addr":"172.21.15.12:6821/3680911937","state":["exists","up"]},{"osd":1,"uuid":"94669e49-ee4f-4acf-9e25-e94374dda8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6801","nonce":236825163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6803","nonce":236825163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6807","nonce":236825163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6805","nonce":236825163}]},"public_addr":"172.21.15.12:6801/236825163","cluster_addr":"172.21.15.12:6803/236825163","heartbeat_back_addr":"172.21.15.12:6807/236825163","heartbeat_front_addr":"172.21.15.12:6805/236825163","state":["exists","up"]},{"osd":2,"uuid":"826dae4d-8888-4ec5-8f00-425b3be93814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6809","nonce":3263521655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6811","nonce":3263521655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6815","nonce":3263521655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6813","nonce":3263521655}]},"public_addr":"172.21.15.12:6809/3263521655","cluster_addr":"172.21.15.12:6811/3263521655","heartbeat_back_addr":"172.21.15.12:6815/3263521655","heartbeat_front_addr":"172.21.15.12:6813/3263521655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:19.398518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.761524+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.904997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:04:49.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.980+0000 7f33f7a33640 1 -- 172.21.15.12:0/657294377 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f33d4035f50 msgr2=0x7f33d4038410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:49.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.980+0000 7f33f7a33640 1 --2- 172.21.15.12:0/657294377 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f33d4035f50 0x7f33d4038410 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f33e8007fd0 tx=0x7f33e8007dc0 comp rx=0 tx=0).stop 2024-09-11T23:04:49.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.980+0000 7f33f7a33640 1 -- 172.21.15.12:0/657294377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33f00a2ce0 msgr2=0x7f33f0138320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:49.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.980+0000 7f33f7a33640 1 --2- 172.21.15.12:0/657294377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33f00a2ce0 0x7f33f0138320 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f33e001a080 tx=0x7f33e001ac90 comp rx=0 tx=0).stop 2024-09-11T23:04:49.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.980+0000 7f33f7a33640 1 -- 172.21.15.12:0/657294377 shutdown_connections 2024-09-11T23:04:49.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.980+0000 7f33f7a33640 1 --2- 172.21.15.12:0/657294377 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f33d4035f50 0x7f33d4038410 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:49.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.980+0000 7f33f7a33640 1 --2- 172.21.15.12:0/657294377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33f00a2ce0 0x7f33f0138320 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:49.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.980+0000 7f33f7a33640 1 -- 172.21.15.12:0/657294377 >> 172.21.15.12:0/657294377 conn(0x7f33f0068000 msgr2=0x7f33f00732d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:49.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.980+0000 7f33f7a33640 1 -- 172.21.15.12:0/657294377 shutdown_connections 2024-09-11T23:04:49.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:49.980+0000 7f33f7a33640 1 -- 172.21.15.12:0/657294377 wait complete. 2024-09-11T23:04:49.997 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T23:04:49.997 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:04:50.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.108+0000 7fc9d2c03640 1 Processor -- start 2024-09-11T23:04:50.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.108+0000 7fc9d2c03640 1 -- start start 2024-09-11T23:04:50.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.108+0000 7fc9d2c03640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc9cc13a410 0x7fc9cc0a6af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:50.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.108+0000 7fc9d2c03640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9cc0a82a0 con 0x7fc9cc0a4b80 2024-09-11T23:04:50.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.108+0000 7fc9d2c03640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fc9cc0a3cb0 con 0x7fc9cc13a410 2024-09-11T23:04:50.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.108+0000 7fc9d099f640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc9cc13a410 0x7fc9cc0a6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:50.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.108+0000 7fc9cbfff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fc9cc0a4b80 0x7fc9cc0a7030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51290/0 (socket says 172.21.15.12:51290) 2024-09-11T23:04:50.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.108+0000 7fc9cbfff640 1 -- 172.21.15.12:0/1082708828 learned_addr learned my addr 172.21.15.12:0/1082708828 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:04:50.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.108+0000 7fc9d099f640 1 -- 172.21.15.12:0/1082708828 >> v1:172.21.15.12:6789/0 conn(0x7fc9cc0a4b80 legacy=0x7fc9cc0a7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:50.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.108+0000 7fc9d099f640 1 -- 172.21.15.12:0/1082708828 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9cc139fe0 con 0x7fc9cc13a410 2024-09-11T23:04:50.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.108+0000 7fc9cb7fe640 1 -- 172.21.15.12:0/1082708828 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 768461532 0 0) 0x7fc9cc0a82a0 con 0x7fc9cc0a4b80 2024-09-11T23:04:50.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.108+0000 7fc9d099f640 1 --2- 172.21.15.12:0/1082708828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9cc13a410 0x7fc9cc0a6af0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0009740 tx=0x7fc9c001c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2355eec3303ee63 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:50.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.108+0000 7fc9cb7fe640 1 -- 172.21.15.12:0/1082708828 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9c00b0070 con 0x7fc9cc13a410 2024-09-11T23:04:50.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.108+0000 7fc9cb7fe640 1 -- 172.21.15.12:0/1082708828 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9c00ab530 con 0x7fc9cc13a410 2024-09-11T23:04:50.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.108+0000 7fc9cb7fe640 1 -- 172.21.15.12:0/1082708828 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9c00ab830 con 0x7fc9cc13a410 2024-09-11T23:04:50.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.112+0000 7fc9d2c03640 1 -- 172.21.15.12:0/1082708828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9cc13a410 msgr2=0x7fc9cc0a6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:50.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.112+0000 7fc9d2c03640 1 --2- 172.21.15.12:0/1082708828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9cc13a410 0x7fc9cc0a6af0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0009740 tx=0x7fc9c001c390 comp rx=0 tx=0).stop 2024-09-11T23:04:50.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.112+0000 7fc9d2c03640 1 -- 172.21.15.12:0/1082708828 shutdown_connections 2024-09-11T23:04:50.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.112+0000 7fc9d2c03640 1 --2- 172.21.15.12:0/1082708828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9cc13a410 0x7fc9cc0a6af0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:50.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.112+0000 7fc9d2c03640 1 -- 172.21.15.12:0/1082708828 >> 172.21.15.12:0/1082708828 conn(0x7fc9cc0ac2c0 msgr2=0x7fc9cc0ac6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:50.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.112+0000 7fc9d2c03640 1 -- 172.21.15.12:0/1082708828 shutdown_connections 2024-09-11T23:04:50.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.112+0000 7fc9d2c03640 1 -- 172.21.15.12:0/1082708828 wait complete. 2024-09-11T23:04:50.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.112+0000 7fc9d2c03640 1 Processor -- start 2024-09-11T23:04:50.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.112+0000 7fc9d2c03640 1 -- start start 2024-09-11T23:04:50.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.112+0000 7fc9d2c03640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9cc0a4b80 0x7fc9cc13d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:50.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.112+0000 7fc9d2c03640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc9cc0a7740 con 0x7fc9cc0a4b80 2024-09-11T23:04:50.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.112+0000 7fc9d099f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9cc0a4b80 0x7fc9cc13d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:50.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.112+0000 7fc9d099f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9cc0a4b80 0x7fc9cc13d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52676/0 (socket says 172.21.15.12:52676) 2024-09-11T23:04:50.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.112+0000 7fc9d099f640 1 -- 172.21.15.12:0/2771789100 learned_addr learned my addr 172.21.15.12:0/2771789100 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:50.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.112+0000 7fc9d099f640 1 -- 172.21.15.12:0/2771789100 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9cc09acb0 con 0x7fc9cc0a4b80 2024-09-11T23:04:50.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.112+0000 7fc9d099f640 1 --2- 172.21.15.12:0/2771789100 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9cc0a4b80 0x7fc9cc13d270 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0019fc0 tx=0x7fc9c001abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:50.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.112+0000 7fc9c97fa640 1 -- 172.21.15.12:0/2771789100 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9c00b0040 con 0x7fc9cc0a4b80 2024-09-11T23:04:50.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.112+0000 7fc9c97fa640 1 -- 172.21.15.12:0/2771789100 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9c00abe40 con 0x7fc9cc0a4b80 2024-09-11T23:04:50.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.112+0000 7fc9d2c03640 1 -- 172.21.15.12:0/2771789100 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9cc09cf60 con 0x7fc9cc0a4b80 2024-09-11T23:04:50.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.112+0000 7fc9c97fa640 1 -- 172.21.15.12:0/2771789100 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9c00041a0 con 0x7fc9cc0a4b80 2024-09-11T23:04:50.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.112+0000 7fc9d2c03640 1 -- 172.21.15.12:0/2771789100 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9cc09a9d0 con 0x7fc9cc0a4b80 2024-09-11T23:04:50.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.112+0000 7fc9c97fa640 1 -- 172.21.15.12:0/2771789100 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 15) ==== 44155+0+0 (secure 0 0 0) 0x7fc9c0004340 con 0x7fc9cc0a4b80 2024-09-11T23:04:50.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.112+0000 7fc9d2c03640 1 -- 172.21.15.12:0/2771789100 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9cc0a6af0 con 0x7fc9cc0a4b80 2024-09-11T23:04:50.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.112+0000 7fc9c97fa640 1 --2- 172.21.15.12:0/2771789100 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fc9b8035ed0 0x7fc9b8038390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:50.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.112+0000 7fc9c97fa640 1 -- 172.21.15.12:0/2771789100 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 3439+0+0 (secure 0 0 0) 0x7fc9c00e3470 con 0x7fc9cc0a4b80 2024-09-11T23:04:50.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.112+0000 7fc9cbfff640 1 --2- 172.21.15.12:0/2771789100 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fc9b8035ed0 0x7fc9b8038390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:50.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.116+0000 7fc9cbfff640 1 --2- 172.21.15.12:0/2771789100 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fc9b8035ed0 0x7fc9b8038390 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc007fd0 tx=0x7fc9bc007920 comp rx=0 tx=0).ready entity=mgr.4452 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:50.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.124+0000 7fc9c97fa640 1 -- 172.21.15.12:0/2771789100 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc9c0016010 con 0x7fc9cc0a4b80 2024-09-11T23:04:50.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.276+0000 7fc9d2c03640 1 -- 172.21.15.12:0/2771789100 --> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc9cc138b60 con 0x7fc9b8035ed0 2024-09-11T23:04:50.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.284+0000 7fc9c97fa640 1 -- 172.21.15.12:0/2771789100 <== mgr.4452 v2:172.21.15.12:6824/718802078 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+235211 (secure 0 0 0) 0x7fc9bc0070d0 con 0x7fc9b8035ed0 2024-09-11T23:04:50.287 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:04:50.289 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-11T23:04:50.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.284+0000 7fc9d2c03640 1 -- 172.21.15.12:0/2771789100 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fc9b8035ed0 msgr2=0x7fc9b8038390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:50.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.284+0000 7fc9d2c03640 1 --2- 172.21.15.12:0/2771789100 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fc9b8035ed0 0x7fc9b8038390 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc007fd0 tx=0x7fc9bc007920 comp rx=0 tx=0).stop 2024-09-11T23:04:50.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.284+0000 7fc9d2c03640 1 -- 172.21.15.12:0/2771789100 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9cc0a4b80 msgr2=0x7fc9cc13d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:50.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.284+0000 7fc9d2c03640 1 --2- 172.21.15.12:0/2771789100 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9cc0a4b80 0x7fc9cc13d270 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0019fc0 tx=0x7fc9c001abd0 comp rx=0 tx=0).stop 2024-09-11T23:04:50.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.284+0000 7fc9d2c03640 1 -- 172.21.15.12:0/2771789100 shutdown_connections 2024-09-11T23:04:50.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.284+0000 7fc9d2c03640 1 --2- 172.21.15.12:0/2771789100 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fc9b8035ed0 0x7fc9b8038390 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:50.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.284+0000 7fc9d2c03640 1 --2- 172.21.15.12:0/2771789100 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9cc0a4b80 0x7fc9cc13d270 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:50.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.284+0000 7fc9d2c03640 1 -- 172.21.15.12:0/2771789100 >> 172.21.15.12:0/2771789100 conn(0x7fc9cc0ac2c0 msgr2=0x7fc9cc13f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:50.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.284+0000 7fc9d2c03640 1 -- 172.21.15.12:0/2771789100 shutdown_connections 2024-09-11T23:04:50.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.284+0000 7fc9d2c03640 1 -- 172.21.15.12:0/2771789100 wait complete. 2024-09-11T23:04:50.304 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-11T23:04:49.830762+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":298,"num_read_kb":503,"num_write":177,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":87248,"kb_used_data":2000,"kb_used_omap":4,"kb_used_meta":85179,"kb_avail":283028272,"statfs":{"total":289910292480,"available":289820950528,"internally_reserved":0,"allocated":2048000,"data_stored":1491595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":87223631},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.580020"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.256594+0000","last_change":"2024-09-11T23:04:44.256594+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.256594+0000","last_undegraded":"2024-09-11T23:04:44.256594+0000","last_fullsized":"2024-09-11T23:04:44.256594+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.259773+0000","last_change":"2024-09-11T23:04:44.259773+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.259773+0000","last_undegraded":"2024-09-11T23:04:44.259773+0000","last_fullsized":"2024-09-11T23:04:44.259773+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.259664+0000","last_change":"2024-09-11T23:04:44.259664+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.259664+0000","last_undegraded":"2024-09-11T23:04:44.259664+0000","last_fullsized":"2024-09-11T23:04:44.259664+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.264695+0000","last_change":"2024-09-11T23:04:44.264695+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.264695+0000","last_undegraded":"2024-09-11T23:04:44.264695+0000","last_fullsized":"2024-09-11T23:04:44.264695+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.262055+0000","last_change":"2024-09-11T23:04:44.262055+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.262055+0000","last_undegraded":"2024-09-11T23:04:44.262055+0000","last_fullsized":"2024-09-11T23:04:44.262055+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.263912+0000","last_change":"2024-09-11T23:04:44.263912+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.263912+0000","last_undegraded":"2024-09-11T23:04:44.263912+0000","last_fullsized":"2024-09-11T23:04:44.263912+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.262382+0000","last_change":"2024-09-11T23:04:44.262382+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.262382+0000","last_undegraded":"2024-09-11T23:04:44.262382+0000","last_fullsized":"2024-09-11T23:04:44.262382+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.261703+0000","last_change":"2024-09-11T23:04:44.261703+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.261703+0000","last_undegraded":"2024-09-11T23:04:44.261703+0000","last_fullsized":"2024-09-11T23:04:44.261703+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.258771+0000","last_change":"2024-09-11T23:04:44.258771+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.258771+0000","last_undegraded":"2024-09-11T23:04:44.258771+0000","last_fullsized":"2024-09-11T23:04:44.258771+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.260218+0000","last_change":"2024-09-11T23:04:44.260218+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.260218+0000","last_undegraded":"2024-09-11T23:04:44.260218+0000","last_fullsized":"2024-09-11T23:04:44.260218+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.255844+0000","last_change":"2024-09-11T23:04:44.255844+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.255844+0000","last_undegraded":"2024-09-11T23:04:44.255844+0000","last_fullsized":"2024-09-11T23:04:44.255844+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.255882+0000","last_change":"2024-09-11T23:04:44.255882+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.255882+0000","last_undegraded":"2024-09-11T23:04:44.255882+0000","last_fullsized":"2024-09-11T23:04:44.255882+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.255931+0000","last_change":"2024-09-11T23:04:44.255931+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.255931+0000","last_undegraded":"2024-09-11T23:04:44.255931+0000","last_fullsized":"2024-09-11T23:04:44.255931+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.263408+0000","last_change":"2024-09-11T23:04:44.263408+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.263408+0000","last_undegraded":"2024-09-11T23:04:44.263408+0000","last_fullsized":"2024-09-11T23:04:44.263408+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.255266+0000","last_change":"2024-09-11T23:04:44.255266+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.255266+0000","last_undegraded":"2024-09-11T23:04:44.255266+0000","last_fullsized":"2024-09-11T23:04:44.255266+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.261187+0000","last_change":"2024-09-11T23:04:44.261187+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.261187+0000","last_undegraded":"2024-09-11T23:04:44.261187+0000","last_fullsized":"2024-09-11T23:04:44.261187+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.255449+0000","last_change":"2024-09-11T23:04:44.255449+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.255449+0000","last_undegraded":"2024-09-11T23:04:44.255449+0000","last_fullsized":"2024-09-11T23:04:44.255449+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.259321+0000","last_change":"2024-09-11T23:04:44.259321+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.259321+0000","last_undegraded":"2024-09-11T23:04:44.259321+0000","last_fullsized":"2024-09-11T23:04:44.259321+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.258380+0000","last_change":"2024-09-11T23:04:44.258380+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.258380+0000","last_undegraded":"2024-09-11T23:04:44.258380+0000","last_fullsized":"2024-09-11T23:04:44.258380+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.262200+0000","last_change":"2024-09-11T23:04:44.262200+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.262200+0000","last_undegraded":"2024-09-11T23:04:44.262200+0000","last_fullsized":"2024-09-11T23:04:44.262200+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.258420+0000","last_change":"2024-09-11T23:04:44.258420+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.258420+0000","last_undegraded":"2024-09-11T23:04:44.258420+0000","last_fullsized":"2024-09-11T23:04:44.258420+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.259993+0000","last_change":"2024-09-11T23:04:44.259993+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.259993+0000","last_undegraded":"2024-09-11T23:04:44.259993+0000","last_fullsized":"2024-09-11T23:04:44.259993+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.259552+0000","last_change":"2024-09-11T23:04:44.259552+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.259552+0000","last_undegraded":"2024-09-11T23:04:44.259552+0000","last_fullsized":"2024-09-11T23:04:44.259552+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.255358+0000","last_change":"2024-09-11T23:04:44.255358+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.255358+0000","last_undegraded":"2024-09-11T23:04:44.255358+0000","last_fullsized":"2024-09-11T23:04:44.255358+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.258719+0000","last_change":"2024-09-11T23:04:44.258719+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.258719+0000","last_undegraded":"2024-09-11T23:04:44.258719+0000","last_fullsized":"2024-09-11T23:04:44.258719+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.260392+0000","last_change":"2024-09-11T23:04:44.260392+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.260392+0000","last_undegraded":"2024-09-11T23:04:44.260392+0000","last_fullsized":"2024-09-11T23:04:44.260392+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.258771+0000","last_change":"2024-09-11T23:04:44.258771+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.258771+0000","last_undegraded":"2024-09-11T23:04:44.258771+0000","last_fullsized":"2024-09-11T23:04:44.258771+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.260673+0000","last_change":"2024-09-11T23:04:44.260673+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.260673+0000","last_undegraded":"2024-09-11T23:04:44.260673+0000","last_fullsized":"2024-09-11T23:04:44.260673+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.260674+0000","last_change":"2024-09-11T23:04:44.260674+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.260674+0000","last_undegraded":"2024-09-11T23:04:44.260674+0000","last_fullsized":"2024-09-11T23:04:44.260674+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.258576+0000","last_change":"2024-09-11T23:04:44.258576+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.258576+0000","last_undegraded":"2024-09-11T23:04:44.258576+0000","last_fullsized":"2024-09-11T23:04:44.258576+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.259722+0000","last_change":"2024-09-11T23:04:44.259722+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.259722+0000","last_undegraded":"2024-09-11T23:04:44.259722+0000","last_fullsized":"2024-09-11T23:04:44.259722+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.259521+0000","last_change":"2024-09-11T23:04:44.259521+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.259521+0000","last_undegraded":"2024-09-11T23:04:44.259521+0000","last_fullsized":"2024-09-11T23:04:44.259521+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'119","reported_seq":257,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:04:44.265342+0000","last_change":"2024-09-11T23:03:26.382905+0000","last_active":"2024-09-11T23:04:44.265342+0000","last_peered":"2024-09-11T23:04:44.265342+0000","last_clean":"2024-09-11T23:04:44.265342+0000","last_became_active":"2024-09-11T23:03:26.380590+0000","last_became_peered":"2024-09-11T23:03:26.380590+0000","last_unstale":"2024-09-11T23:04:44.265342+0000","last_undegraded":"2024-09-11T23:04:44.265342+0000","last_fullsized":"2024-09-11T23:04:44.265342+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:24.361793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:24.361793+0000","last_clean_scrub_stamp":"2024-09-11T23:03:24.361793+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:46.577063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":298,"num_read_kb":503,"num_write":177,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":298,"num_read_kb":503,"num_write":177,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738387,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":103553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738387,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32040,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":872448,"data_stored":690574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738387,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27900,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343940,"statfs":{"total":96636764160,"available":96608194560,"internally_reserved":0,"allocated":888832,"data_stored":697468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:04:50.309 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:04:50.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.452+0000 7fd2a6fa7640 1 Processor -- start 2024-09-11T23:04:50.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.452+0000 7fd2a6fa7640 1 -- start start 2024-09-11T23:04:50.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.456+0000 7fd2a6fa7640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd2a009f6e0 0x7fd2a013cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:50.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.456+0000 7fd2a6fa7640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2a009e930 con 0x7fd2a0137e60 2024-09-11T23:04:50.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.456+0000 7fd2a6fa7640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fd2a01379e0 con 0x7fd2a009f6e0 2024-09-11T23:04:50.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.456+0000 7fd29ffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd2a009f6e0 0x7fd2a013cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:50.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.456+0000 7fd2a4d43640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd2a0137e60 0x7fd2a0138240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51300/0 (socket says 172.21.15.12:51300) 2024-09-11T23:04:50.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.456+0000 7fd2a4d43640 1 -- 172.21.15.12:0/2064406564 learned_addr learned my addr 172.21.15.12:0/2064406564 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:04:50.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.456+0000 7fd29f7fe640 1 -- 172.21.15.12:0/2064406564 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2833623250 0 0) 0x7fd2a009e930 con 0x7fd2a0137e60 2024-09-11T23:04:50.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.456+0000 7fd29f7fe640 1 -- 172.21.15.12:0/2064406564 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd288003530 con 0x7fd2a0137e60 2024-09-11T23:04:50.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.456+0000 7fd29ffff640 1 -- 172.21.15.12:0/2064406564 >> v1:172.21.15.12:6789/0 conn(0x7fd2a0137e60 legacy=0x7fd2a0138240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:50.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.456+0000 7fd29ffff640 1 -- 172.21.15.12:0/2064406564 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2a009d910 con 0x7fd2a009f6e0 2024-09-11T23:04:50.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.456+0000 7fd29ffff640 1 --2- 172.21.15.12:0/2064406564 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2a009f6e0 0x7fd2a013cc60 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fd294009740 tx=0x7fd29401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94dc78b259809f56 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:50.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.456+0000 7fd29f7fe640 1 -- 172.21.15.12:0/2064406564 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2940ab570 con 0x7fd2a009f6e0 2024-09-11T23:04:50.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.456+0000 7fd29f7fe640 1 -- 172.21.15.12:0/2064406564 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2940b0070 con 0x7fd2a009f6e0 2024-09-11T23:04:50.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.456+0000 7fd29f7fe640 1 -- 172.21.15.12:0/2064406564 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2940ab860 con 0x7fd2a009f6e0 2024-09-11T23:04:50.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.456+0000 7fd2a6fa7640 1 -- 172.21.15.12:0/2064406564 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2a009f6e0 msgr2=0x7fd2a013cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:50.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.456+0000 7fd2a6fa7640 1 --2- 172.21.15.12:0/2064406564 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2a009f6e0 0x7fd2a013cc60 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fd294009740 tx=0x7fd29401c420 comp rx=0 tx=0).stop 2024-09-11T23:04:50.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.456+0000 7fd2a6fa7640 1 -- 172.21.15.12:0/2064406564 shutdown_connections 2024-09-11T23:04:50.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.456+0000 7fd2a6fa7640 1 --2- 172.21.15.12:0/2064406564 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2a009f6e0 0x7fd2a013cc60 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:50.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.456+0000 7fd2a6fa7640 1 -- 172.21.15.12:0/2064406564 >> 172.21.15.12:0/2064406564 conn(0x7fd2a00a8450 msgr2=0x7fd2a00a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:50.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.456+0000 7fd2a6fa7640 1 -- 172.21.15.12:0/2064406564 shutdown_connections 2024-09-11T23:04:50.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.456+0000 7fd2a6fa7640 1 -- 172.21.15.12:0/2064406564 wait complete. 2024-09-11T23:04:50.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.460+0000 7fd2a6fa7640 1 Processor -- start 2024-09-11T23:04:50.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.460+0000 7fd2a6fa7640 1 -- start start 2024-09-11T23:04:50.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.460+0000 7fd2a6fa7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2a009f6e0 0x7fd2a0072270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:50.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.460+0000 7fd2a6fa7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a013fd50 con 0x7fd2a009f6e0 2024-09-11T23:04:50.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.460+0000 7fd2a4d43640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2a009f6e0 0x7fd2a0072270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:50.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.460+0000 7fd2a4d43640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2a009f6e0 0x7fd2a0072270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52700/0 (socket says 172.21.15.12:52700) 2024-09-11T23:04:50.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.460+0000 7fd2a4d43640 1 -- 172.21.15.12:0/1430107111 learned_addr learned my addr 172.21.15.12:0/1430107111 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:50.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.460+0000 7fd2a4d43640 1 -- 172.21.15.12:0/1430107111 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2a00710c0 con 0x7fd2a009f6e0 2024-09-11T23:04:50.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.460+0000 7fd2a4d43640 1 --2- 172.21.15.12:0/1430107111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2a009f6e0 0x7fd2a0072270 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fd29000cb40 tx=0x7fd29000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:50.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.460+0000 7fd29d7fa640 1 -- 172.21.15.12:0/1430107111 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd290017070 con 0x7fd2a009f6e0 2024-09-11T23:04:50.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.460+0000 7fd29d7fa640 1 -- 172.21.15.12:0/1430107111 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd29000abf0 con 0x7fd2a009f6e0 2024-09-11T23:04:50.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.460+0000 7fd2a6fa7640 1 -- 172.21.15.12:0/1430107111 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2a0071d80 con 0x7fd2a009f6e0 2024-09-11T23:04:50.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.460+0000 7fd29d7fa640 1 -- 172.21.15.12:0/1430107111 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd290012400 con 0x7fd2a009f6e0 2024-09-11T23:04:50.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.460+0000 7fd2a6fa7640 1 -- 172.21.15.12:0/1430107111 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2a0071380 con 0x7fd2a009f6e0 2024-09-11T23:04:50.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.460+0000 7fd29d7fa640 1 -- 172.21.15.12:0/1430107111 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 15) ==== 44155+0+0 (secure 0 0 0) 0x7fd29001a070 con 0x7fd2a009f6e0 2024-09-11T23:04:50.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.460+0000 7fd2a6fa7640 1 -- 172.21.15.12:0/1430107111 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2a00008e0 con 0x7fd2a009f6e0 2024-09-11T23:04:50.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.460+0000 7fd29d7fa640 1 --2- 172.21.15.12:0/1430107111 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fd28c035ed0 0x7fd28c038390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:50.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.460+0000 7fd29d7fa640 1 -- 172.21.15.12:0/1430107111 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 3439+0+0 (secure 0 0 0) 0x7fd290048530 con 0x7fd2a009f6e0 2024-09-11T23:04:50.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.460+0000 7fd29ffff640 1 --2- 172.21.15.12:0/1430107111 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fd28c035ed0 0x7fd28c038390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:50.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.460+0000 7fd29ffff640 1 --2- 172.21.15.12:0/1430107111 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fd28c035ed0 0x7fd28c038390 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd2940af000 tx=0x7fd2940a7000 comp rx=0 tx=0).ready entity=mgr.4452 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:50.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.464+0000 7fd29d7fa640 1 -- 172.21.15.12:0/1430107111 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd29001a520 con 0x7fd2a009f6e0 2024-09-11T23:04:50.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.616+0000 7fd2a6fa7640 1 -- 172.21.15.12:0/1430107111 --> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd2a009bf40 con 0x7fd28c035ed0 2024-09-11T23:04:50.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.628+0000 7fd29d7fa640 1 -- 172.21.15.12:0/1430107111 <== mgr.4452 v2:172.21.15.12:6824/718802078 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+235211 (secure 0 0 0) 0x7fd2940b0040 con 0x7fd28c035ed0 2024-09-11T23:04:50.632 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:04:50.633 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-11T23:04:50.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.632+0000 7fd2a6fa7640 1 -- 172.21.15.12:0/1430107111 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fd28c035ed0 msgr2=0x7fd28c038390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:50.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.632+0000 7fd2a6fa7640 1 --2- 172.21.15.12:0/1430107111 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fd28c035ed0 0x7fd28c038390 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd2940af000 tx=0x7fd2940a7000 comp rx=0 tx=0).stop 2024-09-11T23:04:50.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.632+0000 7fd2a6fa7640 1 -- 172.21.15.12:0/1430107111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2a009f6e0 msgr2=0x7fd2a0072270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:50.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.632+0000 7fd2a6fa7640 1 --2- 172.21.15.12:0/1430107111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2a009f6e0 0x7fd2a0072270 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fd29000cb40 tx=0x7fd29000a060 comp rx=0 tx=0).stop 2024-09-11T23:04:50.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.632+0000 7fd2a6fa7640 1 -- 172.21.15.12:0/1430107111 shutdown_connections 2024-09-11T23:04:50.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.632+0000 7fd2a6fa7640 1 --2- 172.21.15.12:0/1430107111 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fd28c035ed0 0x7fd28c038390 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:50.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.632+0000 7fd2a6fa7640 1 --2- 172.21.15.12:0/1430107111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2a009f6e0 0x7fd2a0072270 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:50.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.632+0000 7fd2a6fa7640 1 -- 172.21.15.12:0/1430107111 >> 172.21.15.12:0/1430107111 conn(0x7fd2a00a8450 msgr2=0x7fd2a00a14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:50.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.632+0000 7fd2a6fa7640 1 -- 172.21.15.12:0/1430107111 shutdown_connections 2024-09-11T23:04:50.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.632+0000 7fd2a6fa7640 1 -- 172.21.15.12:0/1430107111 wait complete. 2024-09-11T23:04:50.649 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-11T23:04:49.830762+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":298,"num_read_kb":503,"num_write":177,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":87248,"kb_used_data":2000,"kb_used_omap":4,"kb_used_meta":85179,"kb_avail":283028272,"statfs":{"total":289910292480,"available":289820950528,"internally_reserved":0,"allocated":2048000,"data_stored":1491595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":87223631},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.580020"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.256594+0000","last_change":"2024-09-11T23:04:44.256594+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.256594+0000","last_undegraded":"2024-09-11T23:04:44.256594+0000","last_fullsized":"2024-09-11T23:04:44.256594+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.259773+0000","last_change":"2024-09-11T23:04:44.259773+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.259773+0000","last_undegraded":"2024-09-11T23:04:44.259773+0000","last_fullsized":"2024-09-11T23:04:44.259773+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.259664+0000","last_change":"2024-09-11T23:04:44.259664+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.259664+0000","last_undegraded":"2024-09-11T23:04:44.259664+0000","last_fullsized":"2024-09-11T23:04:44.259664+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.264695+0000","last_change":"2024-09-11T23:04:44.264695+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.264695+0000","last_undegraded":"2024-09-11T23:04:44.264695+0000","last_fullsized":"2024-09-11T23:04:44.264695+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.262055+0000","last_change":"2024-09-11T23:04:44.262055+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.262055+0000","last_undegraded":"2024-09-11T23:04:44.262055+0000","last_fullsized":"2024-09-11T23:04:44.262055+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.263912+0000","last_change":"2024-09-11T23:04:44.263912+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.263912+0000","last_undegraded":"2024-09-11T23:04:44.263912+0000","last_fullsized":"2024-09-11T23:04:44.263912+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.262382+0000","last_change":"2024-09-11T23:04:44.262382+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.262382+0000","last_undegraded":"2024-09-11T23:04:44.262382+0000","last_fullsized":"2024-09-11T23:04:44.262382+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.261703+0000","last_change":"2024-09-11T23:04:44.261703+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.261703+0000","last_undegraded":"2024-09-11T23:04:44.261703+0000","last_fullsized":"2024-09-11T23:04:44.261703+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.258771+0000","last_change":"2024-09-11T23:04:44.258771+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.258771+0000","last_undegraded":"2024-09-11T23:04:44.258771+0000","last_fullsized":"2024-09-11T23:04:44.258771+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.260218+0000","last_change":"2024-09-11T23:04:44.260218+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.260218+0000","last_undegraded":"2024-09-11T23:04:44.260218+0000","last_fullsized":"2024-09-11T23:04:44.260218+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.255844+0000","last_change":"2024-09-11T23:04:44.255844+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.255844+0000","last_undegraded":"2024-09-11T23:04:44.255844+0000","last_fullsized":"2024-09-11T23:04:44.255844+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.255882+0000","last_change":"2024-09-11T23:04:44.255882+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.255882+0000","last_undegraded":"2024-09-11T23:04:44.255882+0000","last_fullsized":"2024-09-11T23:04:44.255882+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.255931+0000","last_change":"2024-09-11T23:04:44.255931+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.255931+0000","last_undegraded":"2024-09-11T23:04:44.255931+0000","last_fullsized":"2024-09-11T23:04:44.255931+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.263408+0000","last_change":"2024-09-11T23:04:44.263408+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.263408+0000","last_undegraded":"2024-09-11T23:04:44.263408+0000","last_fullsized":"2024-09-11T23:04:44.263408+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.255266+0000","last_change":"2024-09-11T23:04:44.255266+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.255266+0000","last_undegraded":"2024-09-11T23:04:44.255266+0000","last_fullsized":"2024-09-11T23:04:44.255266+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.261187+0000","last_change":"2024-09-11T23:04:44.261187+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.261187+0000","last_undegraded":"2024-09-11T23:04:44.261187+0000","last_fullsized":"2024-09-11T23:04:44.261187+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.255449+0000","last_change":"2024-09-11T23:04:44.255449+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.255449+0000","last_undegraded":"2024-09-11T23:04:44.255449+0000","last_fullsized":"2024-09-11T23:04:44.255449+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.259321+0000","last_change":"2024-09-11T23:04:44.259321+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.259321+0000","last_undegraded":"2024-09-11T23:04:44.259321+0000","last_fullsized":"2024-09-11T23:04:44.259321+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.258380+0000","last_change":"2024-09-11T23:04:44.258380+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.258380+0000","last_undegraded":"2024-09-11T23:04:44.258380+0000","last_fullsized":"2024-09-11T23:04:44.258380+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.262200+0000","last_change":"2024-09-11T23:04:44.262200+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.262200+0000","last_undegraded":"2024-09-11T23:04:44.262200+0000","last_fullsized":"2024-09-11T23:04:44.262200+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.258420+0000","last_change":"2024-09-11T23:04:44.258420+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.258420+0000","last_undegraded":"2024-09-11T23:04:44.258420+0000","last_fullsized":"2024-09-11T23:04:44.258420+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.259993+0000","last_change":"2024-09-11T23:04:44.259993+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.259993+0000","last_undegraded":"2024-09-11T23:04:44.259993+0000","last_fullsized":"2024-09-11T23:04:44.259993+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.259552+0000","last_change":"2024-09-11T23:04:44.259552+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.259552+0000","last_undegraded":"2024-09-11T23:04:44.259552+0000","last_fullsized":"2024-09-11T23:04:44.259552+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.255358+0000","last_change":"2024-09-11T23:04:44.255358+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.255358+0000","last_undegraded":"2024-09-11T23:04:44.255358+0000","last_fullsized":"2024-09-11T23:04:44.255358+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.258719+0000","last_change":"2024-09-11T23:04:44.258719+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.258719+0000","last_undegraded":"2024-09-11T23:04:44.258719+0000","last_fullsized":"2024-09-11T23:04:44.258719+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.260392+0000","last_change":"2024-09-11T23:04:44.260392+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.260392+0000","last_undegraded":"2024-09-11T23:04:44.260392+0000","last_fullsized":"2024-09-11T23:04:44.260392+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.258771+0000","last_change":"2024-09-11T23:04:44.258771+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.258771+0000","last_undegraded":"2024-09-11T23:04:44.258771+0000","last_fullsized":"2024-09-11T23:04:44.258771+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.260673+0000","last_change":"2024-09-11T23:04:44.260673+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.260673+0000","last_undegraded":"2024-09-11T23:04:44.260673+0000","last_fullsized":"2024-09-11T23:04:44.260673+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.260674+0000","last_change":"2024-09-11T23:04:44.260674+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.260674+0000","last_undegraded":"2024-09-11T23:04:44.260674+0000","last_fullsized":"2024-09-11T23:04:44.260674+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.258576+0000","last_change":"2024-09-11T23:04:44.258576+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.258576+0000","last_undegraded":"2024-09-11T23:04:44.258576+0000","last_fullsized":"2024-09-11T23:04:44.258576+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.259722+0000","last_change":"2024-09-11T23:04:44.259722+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.259722+0000","last_undegraded":"2024-09-11T23:04:44.259722+0000","last_fullsized":"2024-09-11T23:04:44.259722+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.259521+0000","last_change":"2024-09-11T23:04:44.259521+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.259521+0000","last_undegraded":"2024-09-11T23:04:44.259521+0000","last_fullsized":"2024-09-11T23:04:44.259521+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'119","reported_seq":257,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:04:44.265342+0000","last_change":"2024-09-11T23:03:26.382905+0000","last_active":"2024-09-11T23:04:44.265342+0000","last_peered":"2024-09-11T23:04:44.265342+0000","last_clean":"2024-09-11T23:04:44.265342+0000","last_became_active":"2024-09-11T23:03:26.380590+0000","last_became_peered":"2024-09-11T23:03:26.380590+0000","last_unstale":"2024-09-11T23:04:44.265342+0000","last_undegraded":"2024-09-11T23:04:44.265342+0000","last_fullsized":"2024-09-11T23:04:44.265342+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:24.361793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:24.361793+0000","last_clean_scrub_stamp":"2024-09-11T23:03:24.361793+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:46.577063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":298,"num_read_kb":503,"num_write":177,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":298,"num_read_kb":503,"num_write":177,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738387,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":103553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738387,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32040,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":872448,"data_stored":690574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738387,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27900,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343940,"statfs":{"total":96636764160,"available":96608194560,"internally_reserved":0,"allocated":888832,"data_stored":697468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:04:50.652 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:04:50.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.804+0000 7f39466f9640 1 Processor -- start 2024-09-11T23:04:50.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.808+0000 7f39466f9640 1 -- start start 2024-09-11T23:04:50.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.808+0000 7f39466f9640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f39400a4b80 0x7f39400a7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:50.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.808+0000 7f39466f9640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39400a82a0 con 0x7f394013a410 2024-09-11T23:04:50.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.808+0000 7f39466f9640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f39400a3cb0 con 0x7f39400a4b80 2024-09-11T23:04:50.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.808+0000 7f393ffff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f394013a410 0x7f39400a6af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51306/0 (socket says 172.21.15.12:51306) 2024-09-11T23:04:50.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.808+0000 7f393f7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f39400a4b80 0x7f39400a7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:50.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.808+0000 7f393ffff640 1 -- 172.21.15.12:0/531022847 learned_addr learned my addr 172.21.15.12:0/531022847 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:04:50.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.808+0000 7f393effd640 1 -- 172.21.15.12:0/531022847 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1272766446 0 0) 0x7f39400a82a0 con 0x7f394013a410 2024-09-11T23:04:50.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.808+0000 7f393effd640 1 -- 172.21.15.12:0/531022847 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3928003530 con 0x7f394013a410 2024-09-11T23:04:50.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.808+0000 7f393f7fe640 1 -- 172.21.15.12:0/531022847 >> v1:172.21.15.12:6789/0 conn(0x7f394013a410 legacy=0x7f39400a6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:50.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.808+0000 7f393f7fe640 1 -- 172.21.15.12:0/531022847 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3940139fe0 con 0x7f39400a4b80 2024-09-11T23:04:50.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.808+0000 7f393f7fe640 1 --2- 172.21.15.12:0/531022847 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39400a4b80 0x7f39400a7200 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f3934009740 tx=0x7f393401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d46da9d3059d7a61 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:50.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.808+0000 7f393effd640 1 -- 172.21.15.12:0/531022847 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39340b0070 con 0x7f39400a4b80 2024-09-11T23:04:50.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.808+0000 7f393effd640 1 -- 172.21.15.12:0/531022847 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39340ab530 con 0x7f39400a4b80 2024-09-11T23:04:50.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.808+0000 7f393effd640 1 -- 172.21.15.12:0/531022847 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39340ab830 con 0x7f39400a4b80 2024-09-11T23:04:50.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.812+0000 7f39466f9640 1 -- 172.21.15.12:0/531022847 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39400a4b80 msgr2=0x7f39400a7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:50.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.812+0000 7f39466f9640 1 --2- 172.21.15.12:0/531022847 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39400a4b80 0x7f39400a7200 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f3934009740 tx=0x7f393401c390 comp rx=0 tx=0).stop 2024-09-11T23:04:50.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.812+0000 7f39466f9640 1 -- 172.21.15.12:0/531022847 shutdown_connections 2024-09-11T23:04:50.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.812+0000 7f39466f9640 1 --2- 172.21.15.12:0/531022847 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39400a4b80 0x7f39400a7200 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:50.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.812+0000 7f39466f9640 1 -- 172.21.15.12:0/531022847 >> 172.21.15.12:0/531022847 conn(0x7f39400ac2c0 msgr2=0x7f39400ac6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:50.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.812+0000 7f39466f9640 1 -- 172.21.15.12:0/531022847 shutdown_connections 2024-09-11T23:04:50.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.812+0000 7f39466f9640 1 -- 172.21.15.12:0/531022847 wait complete. 2024-09-11T23:04:50.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.812+0000 7f39466f9640 1 Processor -- start 2024-09-11T23:04:50.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.812+0000 7f39466f9640 1 -- start start 2024-09-11T23:04:50.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.812+0000 7f39466f9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39400a4b80 0x7f394009b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:50.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.812+0000 7f39466f9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f39400a7740 con 0x7f39400a4b80 2024-09-11T23:04:50.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.812+0000 7f393ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39400a4b80 0x7f394009b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:50.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.812+0000 7f393ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39400a4b80 0x7f394009b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52718/0 (socket says 172.21.15.12:52718) 2024-09-11T23:04:50.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.812+0000 7f393ffff640 1 -- 172.21.15.12:0/2433959125 learned_addr learned my addr 172.21.15.12:0/2433959125 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:50.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.812+0000 7f393ffff640 1 -- 172.21.15.12:0/2433959125 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39401ce610 con 0x7f39400a4b80 2024-09-11T23:04:50.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.812+0000 7f393ffff640 1 --2- 172.21.15.12:0/2433959125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39400a4b80 0x7f394009b240 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f393000cb40 tx=0x7f393000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:50.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.812+0000 7f393cff9640 1 -- 172.21.15.12:0/2433959125 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3930017070 con 0x7f39400a4b80 2024-09-11T23:04:50.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.812+0000 7f393cff9640 1 -- 172.21.15.12:0/2433959125 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f393000abf0 con 0x7f39400a4b80 2024-09-11T23:04:50.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.812+0000 7f39466f9640 1 -- 172.21.15.12:0/2433959125 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f394009c1b0 con 0x7f39400a4b80 2024-09-11T23:04:50.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.812+0000 7f393cff9640 1 -- 172.21.15.12:0/2433959125 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3930012400 con 0x7f39400a4b80 2024-09-11T23:04:50.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.812+0000 7f39466f9640 1 -- 172.21.15.12:0/2433959125 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f394009d180 con 0x7f39400a4b80 2024-09-11T23:04:50.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.812+0000 7f393cff9640 1 -- 172.21.15.12:0/2433959125 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 15) ==== 44155+0+0 (secure 0 0 0) 0x7f393001a070 con 0x7f39400a4b80 2024-09-11T23:04:50.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.812+0000 7f39466f9640 1 -- 172.21.15.12:0/2433959125 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39400a6af0 con 0x7f39400a4b80 2024-09-11T23:04:50.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.812+0000 7f393cff9640 1 --2- 172.21.15.12:0/2433959125 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f392c035ed0 0x7f392c038390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:50.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.812+0000 7f393cff9640 1 -- 172.21.15.12:0/2433959125 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 3439+0+0 (secure 0 0 0) 0x7f39300484f0 con 0x7f39400a4b80 2024-09-11T23:04:50.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.812+0000 7f393f7fe640 1 --2- 172.21.15.12:0/2433959125 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f392c035ed0 0x7f392c038390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:50.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.816+0000 7f393f7fe640 1 --2- 172.21.15.12:0/2433959125 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f392c035ed0 0x7f392c038390 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f39340ad000 tx=0x7f3934008040 comp rx=0 tx=0).ready entity=mgr.4452 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:50.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.820+0000 7f393cff9640 1 -- 172.21.15.12:0/2433959125 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f393001a520 con 0x7f39400a4b80 2024-09-11T23:04:50.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.972+0000 7f39466f9640 1 -- 172.21.15.12:0/2433959125 --> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f394013eef0 con 0x7f392c035ed0 2024-09-11T23:04:50.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.984+0000 7f393cff9640 1 -- 172.21.15.12:0/2433959125 <== mgr.4452 v2:172.21.15.12:6824/718802078 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+235211 (secure 0 0 0) 0x7f394013eef0 con 0x7f392c035ed0 2024-09-11T23:04:50.986 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:04:50.987 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-11T23:04:50.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.984+0000 7f39466f9640 1 -- 172.21.15.12:0/2433959125 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f392c035ed0 msgr2=0x7f392c038390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:50.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.984+0000 7f39466f9640 1 --2- 172.21.15.12:0/2433959125 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f392c035ed0 0x7f392c038390 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f39340ad000 tx=0x7f3934008040 comp rx=0 tx=0).stop 2024-09-11T23:04:50.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.984+0000 7f39466f9640 1 -- 172.21.15.12:0/2433959125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39400a4b80 msgr2=0x7f394009b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:50.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.984+0000 7f39466f9640 1 --2- 172.21.15.12:0/2433959125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39400a4b80 0x7f394009b240 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f393000cb40 tx=0x7f393000a060 comp rx=0 tx=0).stop 2024-09-11T23:04:50.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.984+0000 7f39466f9640 1 -- 172.21.15.12:0/2433959125 shutdown_connections 2024-09-11T23:04:50.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.984+0000 7f39466f9640 1 --2- 172.21.15.12:0/2433959125 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f392c035ed0 0x7f392c038390 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:50.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.984+0000 7f39466f9640 1 --2- 172.21.15.12:0/2433959125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39400a4b80 0x7f394009b240 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:50.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.984+0000 7f39466f9640 1 -- 172.21.15.12:0/2433959125 >> 172.21.15.12:0/2433959125 conn(0x7f39400ac2c0 msgr2=0x7f3940139340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:50.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.984+0000 7f39466f9640 1 -- 172.21.15.12:0/2433959125 shutdown_connections 2024-09-11T23:04:50.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:50.984+0000 7f39466f9640 1 -- 172.21.15.12:0/2433959125 wait complete. 2024-09-11T23:04:51.003 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-11T23:04:49.830762+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":298,"num_read_kb":503,"num_write":177,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":87248,"kb_used_data":2000,"kb_used_omap":4,"kb_used_meta":85179,"kb_avail":283028272,"statfs":{"total":289910292480,"available":289820950528,"internally_reserved":0,"allocated":2048000,"data_stored":1491595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":87223631},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.580020"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.256594+0000","last_change":"2024-09-11T23:04:44.256594+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.256594+0000","last_undegraded":"2024-09-11T23:04:44.256594+0000","last_fullsized":"2024-09-11T23:04:44.256594+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.259773+0000","last_change":"2024-09-11T23:04:44.259773+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.259773+0000","last_undegraded":"2024-09-11T23:04:44.259773+0000","last_fullsized":"2024-09-11T23:04:44.259773+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.259664+0000","last_change":"2024-09-11T23:04:44.259664+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.259664+0000","last_undegraded":"2024-09-11T23:04:44.259664+0000","last_fullsized":"2024-09-11T23:04:44.259664+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.264695+0000","last_change":"2024-09-11T23:04:44.264695+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.264695+0000","last_undegraded":"2024-09-11T23:04:44.264695+0000","last_fullsized":"2024-09-11T23:04:44.264695+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.262055+0000","last_change":"2024-09-11T23:04:44.262055+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.262055+0000","last_undegraded":"2024-09-11T23:04:44.262055+0000","last_fullsized":"2024-09-11T23:04:44.262055+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.263912+0000","last_change":"2024-09-11T23:04:44.263912+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.263912+0000","last_undegraded":"2024-09-11T23:04:44.263912+0000","last_fullsized":"2024-09-11T23:04:44.263912+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.262382+0000","last_change":"2024-09-11T23:04:44.262382+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.262382+0000","last_undegraded":"2024-09-11T23:04:44.262382+0000","last_fullsized":"2024-09-11T23:04:44.262382+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.261703+0000","last_change":"2024-09-11T23:04:44.261703+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.261703+0000","last_undegraded":"2024-09-11T23:04:44.261703+0000","last_fullsized":"2024-09-11T23:04:44.261703+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.258771+0000","last_change":"2024-09-11T23:04:44.258771+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.258771+0000","last_undegraded":"2024-09-11T23:04:44.258771+0000","last_fullsized":"2024-09-11T23:04:44.258771+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.260218+0000","last_change":"2024-09-11T23:04:44.260218+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.260218+0000","last_undegraded":"2024-09-11T23:04:44.260218+0000","last_fullsized":"2024-09-11T23:04:44.260218+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.255844+0000","last_change":"2024-09-11T23:04:44.255844+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.255844+0000","last_undegraded":"2024-09-11T23:04:44.255844+0000","last_fullsized":"2024-09-11T23:04:44.255844+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.255882+0000","last_change":"2024-09-11T23:04:44.255882+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.255882+0000","last_undegraded":"2024-09-11T23:04:44.255882+0000","last_fullsized":"2024-09-11T23:04:44.255882+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.255931+0000","last_change":"2024-09-11T23:04:44.255931+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.255931+0000","last_undegraded":"2024-09-11T23:04:44.255931+0000","last_fullsized":"2024-09-11T23:04:44.255931+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.263408+0000","last_change":"2024-09-11T23:04:44.263408+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.263408+0000","last_undegraded":"2024-09-11T23:04:44.263408+0000","last_fullsized":"2024-09-11T23:04:44.263408+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.255266+0000","last_change":"2024-09-11T23:04:44.255266+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.255266+0000","last_undegraded":"2024-09-11T23:04:44.255266+0000","last_fullsized":"2024-09-11T23:04:44.255266+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.261187+0000","last_change":"2024-09-11T23:04:44.261187+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.261187+0000","last_undegraded":"2024-09-11T23:04:44.261187+0000","last_fullsized":"2024-09-11T23:04:44.261187+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.255449+0000","last_change":"2024-09-11T23:04:44.255449+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.255449+0000","last_undegraded":"2024-09-11T23:04:44.255449+0000","last_fullsized":"2024-09-11T23:04:44.255449+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.259321+0000","last_change":"2024-09-11T23:04:44.259321+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.259321+0000","last_undegraded":"2024-09-11T23:04:44.259321+0000","last_fullsized":"2024-09-11T23:04:44.259321+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.258380+0000","last_change":"2024-09-11T23:04:44.258380+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.258380+0000","last_undegraded":"2024-09-11T23:04:44.258380+0000","last_fullsized":"2024-09-11T23:04:44.258380+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.262200+0000","last_change":"2024-09-11T23:04:44.262200+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.262200+0000","last_undegraded":"2024-09-11T23:04:44.262200+0000","last_fullsized":"2024-09-11T23:04:44.262200+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.258420+0000","last_change":"2024-09-11T23:04:44.258420+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.258420+0000","last_undegraded":"2024-09-11T23:04:44.258420+0000","last_fullsized":"2024-09-11T23:04:44.258420+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.259993+0000","last_change":"2024-09-11T23:04:44.259993+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.259993+0000","last_undegraded":"2024-09-11T23:04:44.259993+0000","last_fullsized":"2024-09-11T23:04:44.259993+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.259552+0000","last_change":"2024-09-11T23:04:44.259552+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.259552+0000","last_undegraded":"2024-09-11T23:04:44.259552+0000","last_fullsized":"2024-09-11T23:04:44.259552+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.255358+0000","last_change":"2024-09-11T23:04:44.255358+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.255358+0000","last_undegraded":"2024-09-11T23:04:44.255358+0000","last_fullsized":"2024-09-11T23:04:44.255358+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.258719+0000","last_change":"2024-09-11T23:04:44.258719+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.258719+0000","last_undegraded":"2024-09-11T23:04:44.258719+0000","last_fullsized":"2024-09-11T23:04:44.258719+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.260392+0000","last_change":"2024-09-11T23:04:44.260392+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.260392+0000","last_undegraded":"2024-09-11T23:04:44.260392+0000","last_fullsized":"2024-09-11T23:04:44.260392+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.258771+0000","last_change":"2024-09-11T23:04:44.258771+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.258771+0000","last_undegraded":"2024-09-11T23:04:44.258771+0000","last_fullsized":"2024-09-11T23:04:44.258771+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.260673+0000","last_change":"2024-09-11T23:04:44.260673+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.260673+0000","last_undegraded":"2024-09-11T23:04:44.260673+0000","last_fullsized":"2024-09-11T23:04:44.260673+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.260674+0000","last_change":"2024-09-11T23:04:44.260674+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.260674+0000","last_undegraded":"2024-09-11T23:04:44.260674+0000","last_fullsized":"2024-09-11T23:04:44.260674+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.258576+0000","last_change":"2024-09-11T23:04:44.258576+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.258576+0000","last_undegraded":"2024-09-11T23:04:44.258576+0000","last_fullsized":"2024-09-11T23:04:44.258576+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.259722+0000","last_change":"2024-09-11T23:04:44.259722+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.259722+0000","last_undegraded":"2024-09-11T23:04:44.259722+0000","last_fullsized":"2024-09-11T23:04:44.259722+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.259521+0000","last_change":"2024-09-11T23:04:44.259521+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.259521+0000","last_undegraded":"2024-09-11T23:04:44.259521+0000","last_fullsized":"2024-09-11T23:04:44.259521+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'119","reported_seq":257,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:04:44.265342+0000","last_change":"2024-09-11T23:03:26.382905+0000","last_active":"2024-09-11T23:04:44.265342+0000","last_peered":"2024-09-11T23:04:44.265342+0000","last_clean":"2024-09-11T23:04:44.265342+0000","last_became_active":"2024-09-11T23:03:26.380590+0000","last_became_peered":"2024-09-11T23:03:26.380590+0000","last_unstale":"2024-09-11T23:04:44.265342+0000","last_undegraded":"2024-09-11T23:04:44.265342+0000","last_fullsized":"2024-09-11T23:04:44.265342+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:24.361793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:24.361793+0000","last_clean_scrub_stamp":"2024-09-11T23:03:24.361793+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:46.577063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":298,"num_read_kb":503,"num_write":177,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":298,"num_read_kb":503,"num_write":177,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738387,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":103553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738387,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32040,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":872448,"data_stored":690574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738387,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27900,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343940,"statfs":{"total":96636764160,"available":96608194560,"internally_reserved":0,"allocated":888832,"data_stored":697468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:04:51.007 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3f is not active+clean 2024-09-11T23:04:51.007 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.007 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3e is not active+clean 2024-09-11T23:04:51.007 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.007 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3d is not active+clean 2024-09-11T23:04:51.007 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.007 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3c is not active+clean 2024-09-11T23:04:51.007 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.007 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3b is not active+clean 2024-09-11T23:04:51.007 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.008 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3a is not active+clean 2024-09-11T23:04:51.008 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.008 INFO:tasks.ceph.ceph_manager.ceph:PG 7.39 is not active+clean 2024-09-11T23:04:51.008 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.008 INFO:tasks.ceph.ceph_manager.ceph:PG 7.38 is not active+clean 2024-09-11T23:04:51.008 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.008 INFO:tasks.ceph.ceph_manager.ceph:PG 7.37 is not active+clean 2024-09-11T23:04:51.008 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.009 INFO:tasks.ceph.ceph_manager.ceph:PG 7.36 is not active+clean 2024-09-11T23:04:51.009 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.009 INFO:tasks.ceph.ceph_manager.ceph:PG 7.35 is not active+clean 2024-09-11T23:04:51.009 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.009 INFO:tasks.ceph.ceph_manager.ceph:PG 7.34 is not active+clean 2024-09-11T23:04:51.009 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.009 INFO:tasks.ceph.ceph_manager.ceph:PG 7.33 is not active+clean 2024-09-11T23:04:51.009 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.010 INFO:tasks.ceph.ceph_manager.ceph:PG 7.32 is not active+clean 2024-09-11T23:04:51.010 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.010 INFO:tasks.ceph.ceph_manager.ceph:PG 7.31 is not active+clean 2024-09-11T23:04:51.010 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.010 INFO:tasks.ceph.ceph_manager.ceph:PG 7.30 is not active+clean 2024-09-11T23:04:51.011 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.011 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2f is not active+clean 2024-09-11T23:04:51.011 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.011 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2e is not active+clean 2024-09-11T23:04:51.011 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.011 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2d is not active+clean 2024-09-11T23:04:51.011 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.012 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2c is not active+clean 2024-09-11T23:04:51.012 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.012 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2b is not active+clean 2024-09-11T23:04:51.012 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.013 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2a is not active+clean 2024-09-11T23:04:51.014 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.014 INFO:tasks.ceph.ceph_manager.ceph:PG 7.29 is not active+clean 2024-09-11T23:04:51.014 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.014 INFO:tasks.ceph.ceph_manager.ceph:PG 7.28 is not active+clean 2024-09-11T23:04:51.014 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.014 INFO:tasks.ceph.ceph_manager.ceph:PG 7.27 is not active+clean 2024-09-11T23:04:51.015 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.015 INFO:tasks.ceph.ceph_manager.ceph:PG 7.26 is not active+clean 2024-09-11T23:04:51.015 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.016 INFO:tasks.ceph.ceph_manager.ceph:PG 7.25 is not active+clean 2024-09-11T23:04:51.016 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.016 INFO:tasks.ceph.ceph_manager.ceph:PG 7.24 is not active+clean 2024-09-11T23:04:51.016 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.016 INFO:tasks.ceph.ceph_manager.ceph:PG 7.23 is not active+clean 2024-09-11T23:04:51.016 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.016 INFO:tasks.ceph.ceph_manager.ceph:PG 7.22 is not active+clean 2024-09-11T23:04:51.016 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.016 INFO:tasks.ceph.ceph_manager.ceph:PG 7.21 is not active+clean 2024-09-11T23:04:51.016 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.017 INFO:tasks.ceph.ceph_manager.ceph:PG 7.20 is not active+clean 2024-09-11T23:04:51.017 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.017 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1e is not active+clean 2024-09-11T23:04:51.017 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.017 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1f is not active+clean 2024-09-11T23:04:51.017 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:04:44.256594+0000', 'last_change': '2024-09-11T23:04:44.256594+0000', 'last_active': '2024-09-11T23:04:44.243353+0000', 'last_peered': '2024-09-11T23:04:44.243353+0000', 'last_clean': '2024-09-11T23:04:44.243353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:44.256594+0000', 'last_undegraded': '2024-09-11T23:04:44.256594+0000', 'last_fullsized': '2024-09-11T23:04:44.256594+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T23:04:51.017 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1f is not active+clean 2024-09-11T23:04:51.017 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.017 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1e is not active+clean 2024-09-11T23:04:51.017 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:04:44.259773+0000', 'last_change': '2024-09-11T23:04:44.259773+0000', 'last_active': '2024-09-11T23:04:44.243353+0000', 'last_peered': '2024-09-11T23:04:44.243353+0000', 'last_clean': '2024-09-11T23:04:44.243353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:44.259773+0000', 'last_undegraded': '2024-09-11T23:04:44.259773+0000', 'last_fullsized': '2024-09-11T23:04:44.259773+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T23:04:51.017 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1c is not active+clean 2024-09-11T23:04:51.018 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.018 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1d is not active+clean 2024-09-11T23:04:51.018 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:04:44.259664+0000', 'last_change': '2024-09-11T23:04:44.259664+0000', 'last_active': '2024-09-11T23:04:44.243353+0000', 'last_peered': '2024-09-11T23:04:44.243353+0000', 'last_clean': '2024-09-11T23:04:44.243353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:44.259664+0000', 'last_undegraded': '2024-09-11T23:04:44.259664+0000', 'last_fullsized': '2024-09-11T23:04:44.259664+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T23:04:51.018 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1d is not active+clean 2024-09-11T23:04:51.018 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.018 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1c is not active+clean 2024-09-11T23:04:51.018 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:04:44.264695+0000', 'last_change': '2024-09-11T23:04:44.264695+0000', 'last_active': '2024-09-11T23:04:44.243353+0000', 'last_peered': '2024-09-11T23:04:44.243353+0000', 'last_clean': '2024-09-11T23:04:44.243353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:44.264695+0000', 'last_undegraded': '2024-09-11T23:04:44.264695+0000', 'last_fullsized': '2024-09-11T23:04:44.264695+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T23:04:51.018 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1a is not active+clean 2024-09-11T23:04:51.018 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.019 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1b is not active+clean 2024-09-11T23:04:51.019 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:04:44.262055+0000', 'last_change': '2024-09-11T23:04:44.262055+0000', 'last_active': '2024-09-11T23:04:44.243353+0000', 'last_peered': '2024-09-11T23:04:44.243353+0000', 'last_clean': '2024-09-11T23:04:44.243353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:44.262055+0000', 'last_undegraded': '2024-09-11T23:04:44.262055+0000', 'last_fullsized': '2024-09-11T23:04:44.262055+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:04:51.019 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1b is not active+clean 2024-09-11T23:04:51.019 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.019 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1a is not active+clean 2024-09-11T23:04:51.019 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:04:44.263912+0000', 'last_change': '2024-09-11T23:04:44.263912+0000', 'last_active': '2024-09-11T23:04:44.243353+0000', 'last_peered': '2024-09-11T23:04:44.243353+0000', 'last_clean': '2024-09-11T23:04:44.243353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:44.263912+0000', 'last_undegraded': '2024-09-11T23:04:44.263912+0000', 'last_fullsized': '2024-09-11T23:04:44.263912+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:04:51.019 INFO:tasks.ceph.ceph_manager.ceph:PG 7.18 is not active+clean 2024-09-11T23:04:51.019 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.019 INFO:tasks.ceph.ceph_manager.ceph:PG 6.19 is not active+clean 2024-09-11T23:04:51.019 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:04:44.262382+0000', 'last_change': '2024-09-11T23:04:44.262382+0000', 'last_active': '2024-09-11T23:04:44.243353+0000', 'last_peered': '2024-09-11T23:04:44.243353+0000', 'last_clean': '2024-09-11T23:04:44.243353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:44.262382+0000', 'last_undegraded': '2024-09-11T23:04:44.262382+0000', 'last_fullsized': '2024-09-11T23:04:44.262382+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:04:51.020 INFO:tasks.ceph.ceph_manager.ceph:PG 7.19 is not active+clean 2024-09-11T23:04:51.020 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.020 INFO:tasks.ceph.ceph_manager.ceph:PG 6.18 is not active+clean 2024-09-11T23:04:51.020 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:04:44.261703+0000', 'last_change': '2024-09-11T23:04:44.261703+0000', 'last_active': '2024-09-11T23:04:44.243353+0000', 'last_peered': '2024-09-11T23:04:44.243353+0000', 'last_clean': '2024-09-11T23:04:44.243353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:44.261703+0000', 'last_undegraded': '2024-09-11T23:04:44.261703+0000', 'last_fullsized': '2024-09-11T23:04:44.261703+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:04:51.020 INFO:tasks.ceph.ceph_manager.ceph:PG 7.16 is not active+clean 2024-09-11T23:04:51.020 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.020 INFO:tasks.ceph.ceph_manager.ceph:PG 6.17 is not active+clean 2024-09-11T23:04:51.020 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:04:44.258771+0000', 'last_change': '2024-09-11T23:04:44.258771+0000', 'last_active': '2024-09-11T23:04:44.243353+0000', 'last_peered': '2024-09-11T23:04:44.243353+0000', 'last_clean': '2024-09-11T23:04:44.243353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:44.258771+0000', 'last_undegraded': '2024-09-11T23:04:44.258771+0000', 'last_fullsized': '2024-09-11T23:04:44.258771+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T23:04:51.020 INFO:tasks.ceph.ceph_manager.ceph:PG 7.17 is not active+clean 2024-09-11T23:04:51.020 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.020 INFO:tasks.ceph.ceph_manager.ceph:PG 6.16 is not active+clean 2024-09-11T23:04:51.021 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:04:44.260218+0000', 'last_change': '2024-09-11T23:04:44.260218+0000', 'last_active': '2024-09-11T23:04:44.243353+0000', 'last_peered': '2024-09-11T23:04:44.243353+0000', 'last_clean': '2024-09-11T23:04:44.243353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:44.260218+0000', 'last_undegraded': '2024-09-11T23:04:44.260218+0000', 'last_fullsized': '2024-09-11T23:04:44.260218+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:04:51.021 INFO:tasks.ceph.ceph_manager.ceph:PG 7.14 is not active+clean 2024-09-11T23:04:51.021 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.021 INFO:tasks.ceph.ceph_manager.ceph:PG 6.15 is not active+clean 2024-09-11T23:04:51.021 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:04:44.255844+0000', 'last_change': '2024-09-11T23:04:44.255844+0000', 'last_active': '2024-09-11T23:04:44.243353+0000', 'last_peered': '2024-09-11T23:04:44.243353+0000', 'last_clean': '2024-09-11T23:04:44.243353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:44.255844+0000', 'last_undegraded': '2024-09-11T23:04:44.255844+0000', 'last_fullsized': '2024-09-11T23:04:44.255844+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T23:04:51.021 INFO:tasks.ceph.ceph_manager.ceph:PG 7.15 is not active+clean 2024-09-11T23:04:51.021 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.021 INFO:tasks.ceph.ceph_manager.ceph:PG 6.14 is not active+clean 2024-09-11T23:04:51.022 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:04:44.255882+0000', 'last_change': '2024-09-11T23:04:44.255882+0000', 'last_active': '2024-09-11T23:04:44.243353+0000', 'last_peered': '2024-09-11T23:04:44.243353+0000', 'last_clean': '2024-09-11T23:04:44.243353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:44.255882+0000', 'last_undegraded': '2024-09-11T23:04:44.255882+0000', 'last_fullsized': '2024-09-11T23:04:44.255882+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T23:04:51.022 INFO:tasks.ceph.ceph_manager.ceph:PG 7.12 is not active+clean 2024-09-11T23:04:51.022 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.022 INFO:tasks.ceph.ceph_manager.ceph:PG 6.13 is not active+clean 2024-09-11T23:04:51.022 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:04:44.255931+0000', 'last_change': '2024-09-11T23:04:44.255931+0000', 'last_active': '2024-09-11T23:04:44.243353+0000', 'last_peered': '2024-09-11T23:04:44.243353+0000', 'last_clean': '2024-09-11T23:04:44.243353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:44.255931+0000', 'last_undegraded': '2024-09-11T23:04:44.255931+0000', 'last_fullsized': '2024-09-11T23:04:44.255931+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T23:04:51.022 INFO:tasks.ceph.ceph_manager.ceph:PG 7.13 is not active+clean 2024-09-11T23:04:51.024 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.024 INFO:tasks.ceph.ceph_manager.ceph:PG 6.12 is not active+clean 2024-09-11T23:04:51.024 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:04:44.263408+0000', 'last_change': '2024-09-11T23:04:44.263408+0000', 'last_active': '2024-09-11T23:04:44.243353+0000', 'last_peered': '2024-09-11T23:04:44.243353+0000', 'last_clean': '2024-09-11T23:04:44.243353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:44.263408+0000', 'last_undegraded': '2024-09-11T23:04:44.263408+0000', 'last_fullsized': '2024-09-11T23:04:44.263408+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:04:51.024 INFO:tasks.ceph.ceph_manager.ceph:PG 7.10 is not active+clean 2024-09-11T23:04:51.025 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.025 INFO:tasks.ceph.ceph_manager.ceph:PG 6.11 is not active+clean 2024-09-11T23:04:51.025 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:04:44.255266+0000', 'last_change': '2024-09-11T23:04:44.255266+0000', 'last_active': '2024-09-11T23:04:44.243353+0000', 'last_peered': '2024-09-11T23:04:44.243353+0000', 'last_clean': '2024-09-11T23:04:44.243353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:44.255266+0000', 'last_undegraded': '2024-09-11T23:04:44.255266+0000', 'last_fullsized': '2024-09-11T23:04:44.255266+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T23:04:51.025 INFO:tasks.ceph.ceph_manager.ceph:PG 7.11 is not active+clean 2024-09-11T23:04:51.025 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.025 INFO:tasks.ceph.ceph_manager.ceph:PG 6.10 is not active+clean 2024-09-11T23:04:51.025 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:04:44.261187+0000', 'last_change': '2024-09-11T23:04:44.261187+0000', 'last_active': '2024-09-11T23:04:44.243353+0000', 'last_peered': '2024-09-11T23:04:44.243353+0000', 'last_clean': '2024-09-11T23:04:44.243353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:44.261187+0000', 'last_undegraded': '2024-09-11T23:04:44.261187+0000', 'last_fullsized': '2024-09-11T23:04:44.261187+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:04:51.025 INFO:tasks.ceph.ceph_manager.ceph:PG 7.e is not active+clean 2024-09-11T23:04:51.025 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.025 INFO:tasks.ceph.ceph_manager.ceph:PG 6.f is not active+clean 2024-09-11T23:04:51.026 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:04:44.255449+0000', 'last_change': '2024-09-11T23:04:44.255449+0000', 'last_active': '2024-09-11T23:04:44.243353+0000', 'last_peered': '2024-09-11T23:04:44.243353+0000', 'last_clean': '2024-09-11T23:04:44.243353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:44.255449+0000', 'last_undegraded': '2024-09-11T23:04:44.255449+0000', 'last_fullsized': '2024-09-11T23:04:44.255449+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T23:04:51.026 INFO:tasks.ceph.ceph_manager.ceph:PG 7.f is not active+clean 2024-09-11T23:04:51.026 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.026 INFO:tasks.ceph.ceph_manager.ceph:PG 6.e is not active+clean 2024-09-11T23:04:51.026 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:04:44.259321+0000', 'last_change': '2024-09-11T23:04:44.259321+0000', 'last_active': '2024-09-11T23:04:44.243353+0000', 'last_peered': '2024-09-11T23:04:44.243353+0000', 'last_clean': '2024-09-11T23:04:44.243353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:44.259321+0000', 'last_undegraded': '2024-09-11T23:04:44.259321+0000', 'last_fullsized': '2024-09-11T23:04:44.259321+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T23:04:51.026 INFO:tasks.ceph.ceph_manager.ceph:PG 7.c is not active+clean 2024-09-11T23:04:51.026 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.026 INFO:tasks.ceph.ceph_manager.ceph:PG 6.d is not active+clean 2024-09-11T23:04:51.026 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:04:44.258380+0000', 'last_change': '2024-09-11T23:04:44.258380+0000', 'last_active': '2024-09-11T23:04:44.243353+0000', 'last_peered': '2024-09-11T23:04:44.243353+0000', 'last_clean': '2024-09-11T23:04:44.243353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:44.258380+0000', 'last_undegraded': '2024-09-11T23:04:44.258380+0000', 'last_fullsized': '2024-09-11T23:04:44.258380+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T23:04:51.026 INFO:tasks.ceph.ceph_manager.ceph:PG 7.d is not active+clean 2024-09-11T23:04:51.027 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.027 INFO:tasks.ceph.ceph_manager.ceph:PG 6.c is not active+clean 2024-09-11T23:04:51.027 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:04:44.262200+0000', 'last_change': '2024-09-11T23:04:44.262200+0000', 'last_active': '2024-09-11T23:04:44.243353+0000', 'last_peered': '2024-09-11T23:04:44.243353+0000', 'last_clean': '2024-09-11T23:04:44.243353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:44.262200+0000', 'last_undegraded': '2024-09-11T23:04:44.262200+0000', 'last_fullsized': '2024-09-11T23:04:44.262200+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T23:04:51.027 INFO:tasks.ceph.ceph_manager.ceph:PG 7.a is not active+clean 2024-09-11T23:04:51.027 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.027 INFO:tasks.ceph.ceph_manager.ceph:PG 6.b is not active+clean 2024-09-11T23:04:51.027 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:04:44.258420+0000', 'last_change': '2024-09-11T23:04:44.258420+0000', 'last_active': '2024-09-11T23:04:44.243353+0000', 'last_peered': '2024-09-11T23:04:44.243353+0000', 'last_clean': '2024-09-11T23:04:44.243353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:44.258420+0000', 'last_undegraded': '2024-09-11T23:04:44.258420+0000', 'last_fullsized': '2024-09-11T23:04:44.258420+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T23:04:51.027 INFO:tasks.ceph.ceph_manager.ceph:PG 7.b is not active+clean 2024-09-11T23:04:51.027 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.027 INFO:tasks.ceph.ceph_manager.ceph:PG 6.a is not active+clean 2024-09-11T23:04:51.027 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:04:44.259993+0000', 'last_change': '2024-09-11T23:04:44.259993+0000', 'last_active': '2024-09-11T23:04:44.243353+0000', 'last_peered': '2024-09-11T23:04:44.243353+0000', 'last_clean': '2024-09-11T23:04:44.243353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:44.259993+0000', 'last_undegraded': '2024-09-11T23:04:44.259993+0000', 'last_fullsized': '2024-09-11T23:04:44.259993+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:04:51.028 INFO:tasks.ceph.ceph_manager.ceph:PG 7.8 is not active+clean 2024-09-11T23:04:51.028 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.028 INFO:tasks.ceph.ceph_manager.ceph:PG 6.9 is not active+clean 2024-09-11T23:04:51.028 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:04:44.259552+0000', 'last_change': '2024-09-11T23:04:44.259552+0000', 'last_active': '2024-09-11T23:04:44.243353+0000', 'last_peered': '2024-09-11T23:04:44.243353+0000', 'last_clean': '2024-09-11T23:04:44.243353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:44.259552+0000', 'last_undegraded': '2024-09-11T23:04:44.259552+0000', 'last_fullsized': '2024-09-11T23:04:44.259552+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:04:51.028 INFO:tasks.ceph.ceph_manager.ceph:PG 7.9 is not active+clean 2024-09-11T23:04:51.028 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.028 INFO:tasks.ceph.ceph_manager.ceph:PG 6.8 is not active+clean 2024-09-11T23:04:51.028 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:04:44.255358+0000', 'last_change': '2024-09-11T23:04:44.255358+0000', 'last_active': '2024-09-11T23:04:44.243353+0000', 'last_peered': '2024-09-11T23:04:44.243353+0000', 'last_clean': '2024-09-11T23:04:44.243353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:44.255358+0000', 'last_undegraded': '2024-09-11T23:04:44.255358+0000', 'last_fullsized': '2024-09-11T23:04:44.255358+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T23:04:51.028 INFO:tasks.ceph.ceph_manager.ceph:PG 7.7 is not active+clean 2024-09-11T23:04:51.028 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.029 INFO:tasks.ceph.ceph_manager.ceph:PG 6.6 is not active+clean 2024-09-11T23:04:51.029 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:04:44.258719+0000', 'last_change': '2024-09-11T23:04:44.258719+0000', 'last_active': '2024-09-11T23:04:44.243353+0000', 'last_peered': '2024-09-11T23:04:44.243353+0000', 'last_clean': '2024-09-11T23:04:44.243353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:44.258719+0000', 'last_undegraded': '2024-09-11T23:04:44.258719+0000', 'last_fullsized': '2024-09-11T23:04:44.258719+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T23:04:51.029 INFO:tasks.ceph.ceph_manager.ceph:PG 7.4 is not active+clean 2024-09-11T23:04:51.029 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.029 INFO:tasks.ceph.ceph_manager.ceph:PG 6.5 is not active+clean 2024-09-11T23:04:51.029 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:04:44.260392+0000', 'last_change': '2024-09-11T23:04:44.260392+0000', 'last_active': '2024-09-11T23:04:44.243353+0000', 'last_peered': '2024-09-11T23:04:44.243353+0000', 'last_clean': '2024-09-11T23:04:44.243353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:44.260392+0000', 'last_undegraded': '2024-09-11T23:04:44.260392+0000', 'last_fullsized': '2024-09-11T23:04:44.260392+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:04:51.029 INFO:tasks.ceph.ceph_manager.ceph:PG 7.5 is not active+clean 2024-09-11T23:04:51.029 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.029 INFO:tasks.ceph.ceph_manager.ceph:PG 6.4 is not active+clean 2024-09-11T23:04:51.029 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:04:44.258771+0000', 'last_change': '2024-09-11T23:04:44.258771+0000', 'last_active': '2024-09-11T23:04:44.243353+0000', 'last_peered': '2024-09-11T23:04:44.243353+0000', 'last_clean': '2024-09-11T23:04:44.243353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:44.258771+0000', 'last_undegraded': '2024-09-11T23:04:44.258771+0000', 'last_fullsized': '2024-09-11T23:04:44.258771+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T23:04:51.030 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2 is not active+clean 2024-09-11T23:04:51.030 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.030 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3 is not active+clean 2024-09-11T23:04:51.030 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:04:44.260673+0000', 'last_change': '2024-09-11T23:04:44.260673+0000', 'last_active': '2024-09-11T23:04:44.243353+0000', 'last_peered': '2024-09-11T23:04:44.243353+0000', 'last_clean': '2024-09-11T23:04:44.243353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:44.260673+0000', 'last_undegraded': '2024-09-11T23:04:44.260673+0000', 'last_fullsized': '2024-09-11T23:04:44.260673+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:04:51.030 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3 is not active+clean 2024-09-11T23:04:51.030 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.030 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2 is not active+clean 2024-09-11T23:04:51.030 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:04:44.260674+0000', 'last_change': '2024-09-11T23:04:44.260674+0000', 'last_active': '2024-09-11T23:04:44.243353+0000', 'last_peered': '2024-09-11T23:04:44.243353+0000', 'last_clean': '2024-09-11T23:04:44.243353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:44.260674+0000', 'last_undegraded': '2024-09-11T23:04:44.260674+0000', 'last_fullsized': '2024-09-11T23:04:44.260674+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T23:04:51.030 INFO:tasks.ceph.ceph_manager.ceph:PG 7.0 is not active+clean 2024-09-11T23:04:51.030 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.030 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1 is not active+clean 2024-09-11T23:04:51.031 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:04:44.258576+0000', 'last_change': '2024-09-11T23:04:44.258576+0000', 'last_active': '2024-09-11T23:04:44.243353+0000', 'last_peered': '2024-09-11T23:04:44.243353+0000', 'last_clean': '2024-09-11T23:04:44.243353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:44.258576+0000', 'last_undegraded': '2024-09-11T23:04:44.258576+0000', 'last_fullsized': '2024-09-11T23:04:44.258576+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T23:04:51.031 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1 is not active+clean 2024-09-11T23:04:51.031 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.031 INFO:tasks.ceph.ceph_manager.ceph:PG 6.0 is not active+clean 2024-09-11T23:04:51.031 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:04:44.259722+0000', 'last_change': '2024-09-11T23:04:44.259722+0000', 'last_active': '2024-09-11T23:04:44.243353+0000', 'last_peered': '2024-09-11T23:04:44.243353+0000', 'last_clean': '2024-09-11T23:04:44.243353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:44.259722+0000', 'last_undegraded': '2024-09-11T23:04:44.259722+0000', 'last_fullsized': '2024-09-11T23:04:44.259722+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:04:51.031 INFO:tasks.ceph.ceph_manager.ceph:PG 7.6 is not active+clean 2024-09-11T23:04:51.031 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:04:45.250330+0000', 'last_change': '2024-09-11T23:04:45.250330+0000', 'last_active': '2024-09-11T23:04:45.250330+0000', 'last_peered': '2024-09-11T23:04:45.250330+0000', 'last_clean': '2024-09-11T23:04:45.250330+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:45.250330+0000', 'last_undegraded': '2024-09-11T23:04:45.250330+0000', 'last_fullsized': '2024-09-11T23:04:45.250330+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:45.250330+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:04:51.031 INFO:tasks.ceph.ceph_manager.ceph:PG 6.7 is not active+clean 2024-09-11T23:04:51.031 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:04:44.259521+0000', 'last_change': '2024-09-11T23:04:44.259521+0000', 'last_active': '2024-09-11T23:04:44.243353+0000', 'last_peered': '2024-09-11T23:04:44.243353+0000', 'last_clean': '2024-09-11T23:04:44.243353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:04:44.259521+0000', 'last_undegraded': '2024-09-11T23:04:44.259521+0000', 'last_fullsized': '2024-09-11T23:04:44.259521+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'last_clean_scrub_stamp': '2024-09-11T23:04:44.243353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:04:51.032 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-11T23:04:51.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.168+0000 7f7a3e5ea640 1 Processor -- start 2024-09-11T23:04:51.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.168+0000 7f7a3e5ea640 1 -- start start 2024-09-11T23:04:51.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.168+0000 7f7a3e5ea640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7a38137e60 0x7f7a38138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:51.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.168+0000 7f7a3e5ea640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a3809e930 con 0x7f7a3809f6e0 2024-09-11T23:04:51.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.168+0000 7f7a3e5ea640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f7a381379e0 con 0x7f7a38137e60 2024-09-11T23:04:51.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.168+0000 7f7a377fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f7a3809f6e0 0x7f7a380a36a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51316/0 (socket says 172.21.15.12:51316) 2024-09-11T23:04:51.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.168+0000 7f7a37fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7a38137e60 0x7f7a38138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:51.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.168+0000 7f7a377fe640 1 -- 172.21.15.12:0/1169741183 learned_addr learned my addr 172.21.15.12:0/1169741183 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:04:51.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.168+0000 7f7a37fff640 1 -- 172.21.15.12:0/1169741183 >> v1:172.21.15.12:6789/0 conn(0x7f7a3809f6e0 legacy=0x7f7a380a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:51.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.168+0000 7f7a37fff640 1 -- 172.21.15.12:0/1169741183 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a3809d910 con 0x7f7a38137e60 2024-09-11T23:04:51.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.172+0000 7f7a37fff640 1 --2- 172.21.15.12:0/1169741183 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a38137e60 0x7f7a38138240 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f7a28009d90 tx=0x7f7a2801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bd40628ea731dd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:51.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.172+0000 7f7a36ffd640 1 -- 172.21.15.12:0/1169741183 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a280b2070 con 0x7f7a38137e60 2024-09-11T23:04:51.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.172+0000 7f7a36ffd640 1 -- 172.21.15.12:0/1169741183 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a280a5900 con 0x7f7a38137e60 2024-09-11T23:04:51.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.172+0000 7f7a36ffd640 1 -- 172.21.15.12:0/1169741183 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a280a5c00 con 0x7f7a38137e60 2024-09-11T23:04:51.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.172+0000 7f7a3e5ea640 1 -- 172.21.15.12:0/1169741183 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a38137e60 msgr2=0x7f7a38138240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:51.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.172+0000 7f7a3e5ea640 1 --2- 172.21.15.12:0/1169741183 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a38137e60 0x7f7a38138240 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f7a28009d90 tx=0x7f7a2801c970 comp rx=0 tx=0).stop 2024-09-11T23:04:51.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.172+0000 7f7a3e5ea640 1 -- 172.21.15.12:0/1169741183 shutdown_connections 2024-09-11T23:04:51.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.172+0000 7f7a3e5ea640 1 --2- 172.21.15.12:0/1169741183 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a38137e60 0x7f7a38138240 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:51.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.172+0000 7f7a3e5ea640 1 -- 172.21.15.12:0/1169741183 >> 172.21.15.12:0/1169741183 conn(0x7f7a380a8450 msgr2=0x7f7a380a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:51.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.172+0000 7f7a3e5ea640 1 -- 172.21.15.12:0/1169741183 shutdown_connections 2024-09-11T23:04:51.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.172+0000 7f7a3e5ea640 1 -- 172.21.15.12:0/1169741183 wait complete. 2024-09-11T23:04:51.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.172+0000 7f7a3e5ea640 1 Processor -- start 2024-09-11T23:04:51.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.172+0000 7f7a3e5ea640 1 -- start start 2024-09-11T23:04:51.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.172+0000 7f7a3e5ea640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a3809f6e0 0x7f7a38138ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:51.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.172+0000 7f7a3e5ea640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7a3813fe00 con 0x7f7a3809f6e0 2024-09-11T23:04:51.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.172+0000 7f7a37fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a3809f6e0 0x7f7a38138ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:51.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.172+0000 7f7a37fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a3809f6e0 0x7f7a38138ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52738/0 (socket says 172.21.15.12:52738) 2024-09-11T23:04:51.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.172+0000 7f7a37fff640 1 -- 172.21.15.12:0/426701483 learned_addr learned my addr 172.21.15.12:0/426701483 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:51.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.172+0000 7f7a37fff640 1 -- 172.21.15.12:0/426701483 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a3813a330 con 0x7f7a3809f6e0 2024-09-11T23:04:51.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.172+0000 7f7a37fff640 1 --2- 172.21.15.12:0/426701483 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a3809f6e0 0x7f7a38138ad0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7a280a58d0 tx=0x7f7a28019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:51.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.172+0000 7f7a34ff9640 1 -- 172.21.15.12:0/426701483 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a280bd020 con 0x7f7a3809f6e0 2024-09-11T23:04:51.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.172+0000 7f7a34ff9640 1 -- 172.21.15.12:0/426701483 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a280ad670 con 0x7f7a3809f6e0 2024-09-11T23:04:51.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.172+0000 7f7a3e5ea640 1 -- 172.21.15.12:0/426701483 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a38139a40 con 0x7f7a3809f6e0 2024-09-11T23:04:51.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.172+0000 7f7a34ff9640 1 -- 172.21.15.12:0/426701483 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a280b2040 con 0x7f7a3809f6e0 2024-09-11T23:04:51.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.172+0000 7f7a3e5ea640 1 -- 172.21.15.12:0/426701483 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a380a6dc0 con 0x7f7a3809f6e0 2024-09-11T23:04:51.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.176+0000 7f7a3e5ea640 1 -- 172.21.15.12:0/426701483 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a38139c10 con 0x7f7a3809f6e0 2024-09-11T23:04:51.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.176+0000 7f7a34ff9640 1 -- 172.21.15.12:0/426701483 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 15) ==== 44155+0+0 (secure 0 0 0) 0x7f7a280c0020 con 0x7f7a3809f6e0 2024-09-11T23:04:51.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.176+0000 7f7a34ff9640 1 --2- 172.21.15.12:0/426701483 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f7a18035ed0 0x7f7a18038390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:51.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.176+0000 7f7a34ff9640 1 -- 172.21.15.12:0/426701483 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 3439+0+0 (secure 0 0 0) 0x7f7a280e3890 con 0x7f7a3809f6e0 2024-09-11T23:04:51.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.176+0000 7f7a377fe640 1 --2- 172.21.15.12:0/426701483 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f7a18035ed0 0x7f7a18038390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:51.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.176+0000 7f7a377fe640 1 --2- 172.21.15.12:0/426701483 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f7a18035ed0 0x7f7a18038390 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7a20001610 tx=0x7f7a20007ad0 comp rx=0 tx=0).ready entity=mgr.4452 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:51.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.180+0000 7f7a34ff9640 1 -- 172.21.15.12:0/426701483 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7a280c7030 con 0x7f7a3809f6e0 2024-09-11T23:04:51.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.396+0000 7f7a3e5ea640 1 -- 172.21.15.12:0/426701483 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f7a3806bc60 con 0x7f7a3809f6e0 2024-09-11T23:04:51.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.396+0000 7f7a34ff9640 1 -- 172.21.15.12:0/426701483 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1719 (secure 0 0 0) 0x7f7a28016560 con 0x7f7a3809f6e0 2024-09-11T23:04:51.399 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:04:51.399 INFO:teuthology.orchestra.run.smithi012.stdout:{"fsid":"8be14356-3340-4500-91a2-4cbc6b511f65","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":100,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":36,"num_osds":3,"num_up_osds":3,"osd_up_since":1726095802,"num_in_osds":3,"osd_in_since":1726095791,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":89341952,"bytes_avail":289820950528,"bytes_total":289910292480,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":25,"btime":"2024-09-11T23:04:49:285627+0000","id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"b","status":"up:active","gid":4528}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-09-11T23:04:34.830720+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-11T23:04:51.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.400+0000 7f7a3e5ea640 1 -- 172.21.15.12:0/426701483 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f7a18035ed0 msgr2=0x7f7a18038390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:51.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.400+0000 7f7a3e5ea640 1 --2- 172.21.15.12:0/426701483 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f7a18035ed0 0x7f7a18038390 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7a20001610 tx=0x7f7a20007ad0 comp rx=0 tx=0).stop 2024-09-11T23:04:51.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.400+0000 7f7a3e5ea640 1 -- 172.21.15.12:0/426701483 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a3809f6e0 msgr2=0x7f7a38138ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:51.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.400+0000 7f7a3e5ea640 1 --2- 172.21.15.12:0/426701483 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a3809f6e0 0x7f7a38138ad0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7a280a58d0 tx=0x7f7a28019710 comp rx=0 tx=0).stop 2024-09-11T23:04:51.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.400+0000 7f7a3e5ea640 1 -- 172.21.15.12:0/426701483 shutdown_connections 2024-09-11T23:04:51.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.400+0000 7f7a3e5ea640 1 --2- 172.21.15.12:0/426701483 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f7a18035ed0 0x7f7a18038390 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:51.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.400+0000 7f7a3e5ea640 1 --2- 172.21.15.12:0/426701483 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a3809f6e0 0x7f7a38138ad0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:51.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.400+0000 7f7a3e5ea640 1 -- 172.21.15.12:0/426701483 >> 172.21.15.12:0/426701483 conn(0x7f7a380a8450 msgr2=0x7f7a38136f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:51.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.400+0000 7f7a3e5ea640 1 -- 172.21.15.12:0/426701483 shutdown_connections 2024-09-11T23:04:51.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.400+0000 7f7a3e5ea640 1 -- 172.21.15.12:0/426701483 wait complete. 2024-09-11T23:04:51.417 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-11T23:04:51.417 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:04:51.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.532+0000 7f7944177640 1 Processor -- start 2024-09-11T23:04:51.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.532+0000 7f7944177640 1 -- start start 2024-09-11T23:04:51.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.532+0000 7f7944177640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f793c13a220 0x7f793c13a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:51.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.532+0000 7f7944177640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f793c139d60 con 0x7f793c0a0bc0 2024-09-11T23:04:51.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.532+0000 7f7944177640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f793c072c90 con 0x7f793c13a220 2024-09-11T23:04:51.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.536+0000 7f7941f13640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f793c13a220 0x7f793c13a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:51.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.536+0000 7f7941712640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f793c0a0bc0 0x7f793c0a36a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51324/0 (socket says 172.21.15.12:51324) 2024-09-11T23:04:51.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.536+0000 7f7941712640 1 -- 172.21.15.12:0/3678350945 learned_addr learned my addr 172.21.15.12:0/3678350945 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:04:51.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.536+0000 7f7941f13640 1 -- 172.21.15.12:0/3678350945 >> v1:172.21.15.12:6789/0 conn(0x7f793c0a0bc0 legacy=0x7f793c0a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:51.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.536+0000 7f7941f13640 1 -- 172.21.15.12:0/3678350945 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f793c13ab40 con 0x7f793c13a220 2024-09-11T23:04:51.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.536+0000 7f7941f13640 1 --2- 172.21.15.12:0/3678350945 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f793c13a220 0x7f793c13a600 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f793c13ad10 tx=0x7f793801c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed6d26fefc858863 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:51.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.536+0000 7f7940f11640 1 -- 172.21.15.12:0/3678350945 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79380b0070 con 0x7f793c13a220 2024-09-11T23:04:51.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.536+0000 7f7940f11640 1 -- 172.21.15.12:0/3678350945 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79380ab530 con 0x7f793c13a220 2024-09-11T23:04:51.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.536+0000 7f7940f11640 1 -- 172.21.15.12:0/3678350945 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79380ab830 con 0x7f793c13a220 2024-09-11T23:04:51.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.536+0000 7f7944177640 1 -- 172.21.15.12:0/3678350945 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f793c13a220 msgr2=0x7f793c13a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:51.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.536+0000 7f7944177640 1 --2- 172.21.15.12:0/3678350945 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f793c13a220 0x7f793c13a600 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f793c13ad10 tx=0x7f793801c390 comp rx=0 tx=0).stop 2024-09-11T23:04:51.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.536+0000 7f7944177640 1 -- 172.21.15.12:0/3678350945 shutdown_connections 2024-09-11T23:04:51.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.536+0000 7f7944177640 1 --2- 172.21.15.12:0/3678350945 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f793c13a220 0x7f793c13a600 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:51.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.536+0000 7f7944177640 1 -- 172.21.15.12:0/3678350945 >> 172.21.15.12:0/3678350945 conn(0x7f793c0a8450 msgr2=0x7f793c0a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:51.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.536+0000 7f7944177640 1 -- 172.21.15.12:0/3678350945 shutdown_connections 2024-09-11T23:04:51.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.536+0000 7f7944177640 1 -- 172.21.15.12:0/3678350945 wait complete. 2024-09-11T23:04:51.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.540+0000 7f7944177640 1 Processor -- start 2024-09-11T23:04:51.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.540+0000 7f7944177640 1 -- start start 2024-09-11T23:04:51.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.540+0000 7f7944177640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f793c0a0bc0 0x7f793c09afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:51.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.540+0000 7f7944177640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f793c142110 con 0x7f793c0a0bc0 2024-09-11T23:04:51.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.540+0000 7f7941f13640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f793c0a0bc0 0x7f793c09afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:51.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.540+0000 7f7941f13640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f793c0a0bc0 0x7f793c09afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52750/0 (socket says 172.21.15.12:52750) 2024-09-11T23:04:51.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.540+0000 7f7941f13640 1 -- 172.21.15.12:0/1404223864 learned_addr learned my addr 172.21.15.12:0/1404223864 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:51.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.540+0000 7f7941f13640 1 -- 172.21.15.12:0/1404223864 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f793c13b420 con 0x7f793c0a0bc0 2024-09-11T23:04:51.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.540+0000 7f7941f13640 1 --2- 172.21.15.12:0/1404223864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f793c0a0bc0 0x7f793c09afb0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f79380ae040 tx=0x7f793801abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:51.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.540+0000 7f79327fc640 1 -- 172.21.15.12:0/1404223864 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79380b0050 con 0x7f793c0a0bc0 2024-09-11T23:04:51.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.540+0000 7f79327fc640 1 -- 172.21.15.12:0/1404223864 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79380b1040 con 0x7f793c0a0bc0 2024-09-11T23:04:51.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.540+0000 7f7944177640 1 -- 172.21.15.12:0/1404223864 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f793c13fc10 con 0x7f793c0a0bc0 2024-09-11T23:04:51.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.540+0000 7f79327fc640 1 -- 172.21.15.12:0/1404223864 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79380b5780 con 0x7f793c0a0bc0 2024-09-11T23:04:51.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.540+0000 7f7944177640 1 -- 172.21.15.12:0/1404223864 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f793c09e700 con 0x7f793c0a0bc0 2024-09-11T23:04:51.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.540+0000 7f7944177640 1 -- 172.21.15.12:0/1404223864 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f793c0008e0 con 0x7f793c0a0bc0 2024-09-11T23:04:51.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.540+0000 7f79327fc640 1 -- 172.21.15.12:0/1404223864 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 15) ==== 44155+0+0 (secure 0 0 0) 0x7f79380be030 con 0x7f793c0a0bc0 2024-09-11T23:04:51.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.540+0000 7f79327fc640 1 --2- 172.21.15.12:0/1404223864 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f7920035ed0 0x7f7920038390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:51.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.540+0000 7f79327fc640 1 -- 172.21.15.12:0/1404223864 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 3439+0+0 (secure 0 0 0) 0x7f79380bc070 con 0x7f793c0a0bc0 2024-09-11T23:04:51.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.540+0000 7f7941712640 1 --2- 172.21.15.12:0/1404223864 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f7920035ed0 0x7f7920038390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:51.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.540+0000 7f7941712640 1 --2- 172.21.15.12:0/1404223864 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f7920035ed0 0x7f7920038390 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f792c001610 tx=0x7f792c007ad0 comp rx=0 tx=0).ready entity=mgr.4452 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:51.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.544+0000 7f79327fc640 1 -- 172.21.15.12:0/1404223864 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f79380c5060 con 0x7f793c0a0bc0 2024-09-11T23:04:51.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.704+0000 7f7944177640 1 -- 172.21.15.12:0/1404223864 --> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f793c139190 con 0x7f7920035ed0 2024-09-11T23:04:51.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.720+0000 7f79327fc640 1 -- 172.21.15.12:0/1404223864 <== mgr.4452 v2:172.21.15.12:6824/718802078 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+235211 (secure 0 0 0) 0x7f792c0058c0 con 0x7f7920035ed0 2024-09-11T23:04:51.725 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:04:51.727 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-11T23:04:51.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.724+0000 7f7944177640 1 -- 172.21.15.12:0/1404223864 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f7920035ed0 msgr2=0x7f7920038390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:51.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.724+0000 7f7944177640 1 --2- 172.21.15.12:0/1404223864 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f7920035ed0 0x7f7920038390 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f792c001610 tx=0x7f792c007ad0 comp rx=0 tx=0).stop 2024-09-11T23:04:51.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.724+0000 7f7944177640 1 -- 172.21.15.12:0/1404223864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f793c0a0bc0 msgr2=0x7f793c09afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:51.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.724+0000 7f7944177640 1 --2- 172.21.15.12:0/1404223864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f793c0a0bc0 0x7f793c09afb0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f79380ae040 tx=0x7f793801abd0 comp rx=0 tx=0).stop 2024-09-11T23:04:51.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.724+0000 7f7944177640 1 -- 172.21.15.12:0/1404223864 shutdown_connections 2024-09-11T23:04:51.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.724+0000 7f7944177640 1 --2- 172.21.15.12:0/1404223864 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f7920035ed0 0x7f7920038390 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:51.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.724+0000 7f7944177640 1 --2- 172.21.15.12:0/1404223864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f793c0a0bc0 0x7f793c09afb0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:51.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.724+0000 7f7944177640 1 -- 172.21.15.12:0/1404223864 >> 172.21.15.12:0/1404223864 conn(0x7f793c0a8450 msgr2=0x7f793c133b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:51.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.724+0000 7f7944177640 1 -- 172.21.15.12:0/1404223864 shutdown_connections 2024-09-11T23:04:51.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:51.724+0000 7f7944177640 1 -- 172.21.15.12:0/1404223864 wait complete. 2024-09-11T23:04:51.745 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-11T23:04:49.830762+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":298,"num_read_kb":503,"num_write":177,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":87248,"kb_used_data":2000,"kb_used_omap":4,"kb_used_meta":85179,"kb_avail":283028272,"statfs":{"total":289910292480,"available":289820950528,"internally_reserved":0,"allocated":2048000,"data_stored":1491595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":87223631},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.580020"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.256594+0000","last_change":"2024-09-11T23:04:44.256594+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.256594+0000","last_undegraded":"2024-09-11T23:04:44.256594+0000","last_fullsized":"2024-09-11T23:04:44.256594+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.259773+0000","last_change":"2024-09-11T23:04:44.259773+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.259773+0000","last_undegraded":"2024-09-11T23:04:44.259773+0000","last_fullsized":"2024-09-11T23:04:44.259773+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.259664+0000","last_change":"2024-09-11T23:04:44.259664+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.259664+0000","last_undegraded":"2024-09-11T23:04:44.259664+0000","last_fullsized":"2024-09-11T23:04:44.259664+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.264695+0000","last_change":"2024-09-11T23:04:44.264695+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.264695+0000","last_undegraded":"2024-09-11T23:04:44.264695+0000","last_fullsized":"2024-09-11T23:04:44.264695+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.262055+0000","last_change":"2024-09-11T23:04:44.262055+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.262055+0000","last_undegraded":"2024-09-11T23:04:44.262055+0000","last_fullsized":"2024-09-11T23:04:44.262055+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.263912+0000","last_change":"2024-09-11T23:04:44.263912+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.263912+0000","last_undegraded":"2024-09-11T23:04:44.263912+0000","last_fullsized":"2024-09-11T23:04:44.263912+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.262382+0000","last_change":"2024-09-11T23:04:44.262382+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.262382+0000","last_undegraded":"2024-09-11T23:04:44.262382+0000","last_fullsized":"2024-09-11T23:04:44.262382+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.261703+0000","last_change":"2024-09-11T23:04:44.261703+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.261703+0000","last_undegraded":"2024-09-11T23:04:44.261703+0000","last_fullsized":"2024-09-11T23:04:44.261703+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.258771+0000","last_change":"2024-09-11T23:04:44.258771+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.258771+0000","last_undegraded":"2024-09-11T23:04:44.258771+0000","last_fullsized":"2024-09-11T23:04:44.258771+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.260218+0000","last_change":"2024-09-11T23:04:44.260218+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.260218+0000","last_undegraded":"2024-09-11T23:04:44.260218+0000","last_fullsized":"2024-09-11T23:04:44.260218+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.255844+0000","last_change":"2024-09-11T23:04:44.255844+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.255844+0000","last_undegraded":"2024-09-11T23:04:44.255844+0000","last_fullsized":"2024-09-11T23:04:44.255844+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.255882+0000","last_change":"2024-09-11T23:04:44.255882+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.255882+0000","last_undegraded":"2024-09-11T23:04:44.255882+0000","last_fullsized":"2024-09-11T23:04:44.255882+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.255931+0000","last_change":"2024-09-11T23:04:44.255931+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.255931+0000","last_undegraded":"2024-09-11T23:04:44.255931+0000","last_fullsized":"2024-09-11T23:04:44.255931+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.263408+0000","last_change":"2024-09-11T23:04:44.263408+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.263408+0000","last_undegraded":"2024-09-11T23:04:44.263408+0000","last_fullsized":"2024-09-11T23:04:44.263408+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.255266+0000","last_change":"2024-09-11T23:04:44.255266+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.255266+0000","last_undegraded":"2024-09-11T23:04:44.255266+0000","last_fullsized":"2024-09-11T23:04:44.255266+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.261187+0000","last_change":"2024-09-11T23:04:44.261187+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.261187+0000","last_undegraded":"2024-09-11T23:04:44.261187+0000","last_fullsized":"2024-09-11T23:04:44.261187+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.255449+0000","last_change":"2024-09-11T23:04:44.255449+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.255449+0000","last_undegraded":"2024-09-11T23:04:44.255449+0000","last_fullsized":"2024-09-11T23:04:44.255449+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.259321+0000","last_change":"2024-09-11T23:04:44.259321+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.259321+0000","last_undegraded":"2024-09-11T23:04:44.259321+0000","last_fullsized":"2024-09-11T23:04:44.259321+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.258380+0000","last_change":"2024-09-11T23:04:44.258380+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.258380+0000","last_undegraded":"2024-09-11T23:04:44.258380+0000","last_fullsized":"2024-09-11T23:04:44.258380+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.262200+0000","last_change":"2024-09-11T23:04:44.262200+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.262200+0000","last_undegraded":"2024-09-11T23:04:44.262200+0000","last_fullsized":"2024-09-11T23:04:44.262200+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.258420+0000","last_change":"2024-09-11T23:04:44.258420+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.258420+0000","last_undegraded":"2024-09-11T23:04:44.258420+0000","last_fullsized":"2024-09-11T23:04:44.258420+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.259993+0000","last_change":"2024-09-11T23:04:44.259993+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.259993+0000","last_undegraded":"2024-09-11T23:04:44.259993+0000","last_fullsized":"2024-09-11T23:04:44.259993+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.259552+0000","last_change":"2024-09-11T23:04:44.259552+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.259552+0000","last_undegraded":"2024-09-11T23:04:44.259552+0000","last_fullsized":"2024-09-11T23:04:44.259552+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.255358+0000","last_change":"2024-09-11T23:04:44.255358+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.255358+0000","last_undegraded":"2024-09-11T23:04:44.255358+0000","last_fullsized":"2024-09-11T23:04:44.255358+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.258719+0000","last_change":"2024-09-11T23:04:44.258719+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.258719+0000","last_undegraded":"2024-09-11T23:04:44.258719+0000","last_fullsized":"2024-09-11T23:04:44.258719+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.260392+0000","last_change":"2024-09-11T23:04:44.260392+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.260392+0000","last_undegraded":"2024-09-11T23:04:44.260392+0000","last_fullsized":"2024-09-11T23:04:44.260392+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.258771+0000","last_change":"2024-09-11T23:04:44.258771+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.258771+0000","last_undegraded":"2024-09-11T23:04:44.258771+0000","last_fullsized":"2024-09-11T23:04:44.258771+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.260673+0000","last_change":"2024-09-11T23:04:44.260673+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.260673+0000","last_undegraded":"2024-09-11T23:04:44.260673+0000","last_fullsized":"2024-09-11T23:04:44.260673+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.260674+0000","last_change":"2024-09-11T23:04:44.260674+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.260674+0000","last_undegraded":"2024-09-11T23:04:44.260674+0000","last_fullsized":"2024-09-11T23:04:44.260674+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.258576+0000","last_change":"2024-09-11T23:04:44.258576+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.258576+0000","last_undegraded":"2024-09-11T23:04:44.258576+0000","last_fullsized":"2024-09-11T23:04:44.258576+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.259722+0000","last_change":"2024-09-11T23:04:44.259722+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.259722+0000","last_undegraded":"2024-09-11T23:04:44.259722+0000","last_fullsized":"2024-09-11T23:04:44.259722+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:04:45.250330+0000","last_change":"2024-09-11T23:04:45.250330+0000","last_active":"2024-09-11T23:04:45.250330+0000","last_peered":"2024-09-11T23:04:45.250330+0000","last_clean":"2024-09-11T23:04:45.250330+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:45.250330+0000","last_undegraded":"2024-09-11T23:04:45.250330+0000","last_fullsized":"2024-09-11T23:04:45.250330+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-11T23:04:44.259521+0000","last_change":"2024-09-11T23:04:44.259521+0000","last_active":"2024-09-11T23:04:44.243353+0000","last_peered":"2024-09-11T23:04:44.243353+0000","last_clean":"2024-09-11T23:04:44.243353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:04:44.259521+0000","last_undegraded":"2024-09-11T23:04:44.259521+0000","last_fullsized":"2024-09-11T23:04:44.259521+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'119","reported_seq":257,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:04:44.265342+0000","last_change":"2024-09-11T23:03:26.382905+0000","last_active":"2024-09-11T23:04:44.265342+0000","last_peered":"2024-09-11T23:04:44.265342+0000","last_clean":"2024-09-11T23:04:44.265342+0000","last_became_active":"2024-09-11T23:03:26.380590+0000","last_became_peered":"2024-09-11T23:03:26.380590+0000","last_unstale":"2024-09-11T23:04:44.265342+0000","last_undegraded":"2024-09-11T23:04:44.265342+0000","last_fullsized":"2024-09-11T23:04:44.265342+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:24.361793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:24.361793+0000","last_clean_scrub_stamp":"2024-09-11T23:03:24.361793+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:46.577063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":298,"num_read_kb":503,"num_write":177,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":298,"num_read_kb":503,"num_write":177,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738387,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":103553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738387,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32040,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":872448,"data_stored":690574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738387,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27900,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343940,"statfs":{"total":96636764160,"available":96608194560,"internally_reserved":0,"allocated":888832,"data_stored":697468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:04:54.593 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:04:54.749 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:04:54.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:54.884+0000 7f550ca8a640 1 Processor -- start 2024-09-11T23:04:54.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:54.884+0000 7f550ca8a640 1 -- start start 2024-09-11T23:04:54.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:54.884+0000 7f550ca8a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5508137e60 0x7f5508138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:54.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:54.884+0000 7f550ca8a640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f550809e930 con 0x7f550809f6e0 2024-09-11T23:04:54.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:54.884+0000 7f550ca8a640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f55081379e0 con 0x7f5508137e60 2024-09-11T23:04:54.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:54.884+0000 7f5505d9b640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f550809f6e0 0x7f55080a36a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42640/0 (socket says 172.21.15.12:42640) 2024-09-11T23:04:54.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:54.884+0000 7f5505d9b640 1 -- 172.21.15.12:0/249580552 learned_addr learned my addr 172.21.15.12:0/249580552 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:04:54.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:54.884+0000 7f550659c640 1 --2- 172.21.15.12:0/249580552 >> v2:172.21.15.12:3300/0 conn(0x7f5508137e60 0x7f5508138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:54.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:54.884+0000 7f550659c640 1 -- 172.21.15.12:0/249580552 >> v1:172.21.15.12:6789/0 conn(0x7f550809f6e0 legacy=0x7f55080a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:54.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:54.884+0000 7f550659c640 1 -- 172.21.15.12:0/249580552 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f550809d910 con 0x7f5508137e60 2024-09-11T23:04:54.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:54.888+0000 7f550659c640 1 --2- 172.21.15.12:0/249580552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5508137e60 0x7f5508138240 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f54f8009d90 tx=0x7f54f801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87662e7aed54b6fc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:54.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:54.888+0000 7f550559a640 1 -- 172.21.15.12:0/249580552 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54f80b2070 con 0x7f5508137e60 2024-09-11T23:04:54.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:54.888+0000 7f550559a640 1 -- 172.21.15.12:0/249580552 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54f80a5900 con 0x7f5508137e60 2024-09-11T23:04:54.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:54.888+0000 7f550559a640 1 -- 172.21.15.12:0/249580552 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54f80a5c00 con 0x7f5508137e60 2024-09-11T23:04:54.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:54.888+0000 7f550ca8a640 1 -- 172.21.15.12:0/249580552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5508137e60 msgr2=0x7f5508138240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:54.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:54.888+0000 7f550ca8a640 1 --2- 172.21.15.12:0/249580552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5508137e60 0x7f5508138240 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f54f8009d90 tx=0x7f54f801c970 comp rx=0 tx=0).stop 2024-09-11T23:04:54.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:54.888+0000 7f550ca8a640 1 -- 172.21.15.12:0/249580552 shutdown_connections 2024-09-11T23:04:54.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:54.888+0000 7f550ca8a640 1 --2- 172.21.15.12:0/249580552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5508137e60 0x7f5508138240 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:54.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:54.888+0000 7f550ca8a640 1 -- 172.21.15.12:0/249580552 >> 172.21.15.12:0/249580552 conn(0x7f55080a8450 msgr2=0x7f55080a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:54.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:54.888+0000 7f550ca8a640 1 -- 172.21.15.12:0/249580552 shutdown_connections 2024-09-11T23:04:54.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:54.888+0000 7f550ca8a640 1 -- 172.21.15.12:0/249580552 wait complete. 2024-09-11T23:04:54.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:54.888+0000 7f550ca8a640 1 Processor -- start 2024-09-11T23:04:54.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:54.888+0000 7f550ca8a640 1 -- start start 2024-09-11T23:04:54.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:54.888+0000 7f550ca8a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f550809f6e0 0x7f5508071d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:54.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:54.888+0000 7f550ca8a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f550813fe00 con 0x7f550809f6e0 2024-09-11T23:04:54.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:54.888+0000 7f550659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f550809f6e0 0x7f5508071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:54.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:54.888+0000 7f550659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f550809f6e0 0x7f5508071d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58134/0 (socket says 172.21.15.12:58134) 2024-09-11T23:04:54.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:54.888+0000 7f550659c640 1 -- 172.21.15.12:0/1828627473 learned_addr learned my addr 172.21.15.12:0/1828627473 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:54.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:54.888+0000 7f550659c640 1 -- 172.21.15.12:0/1828627473 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5508120b60 con 0x7f550809f6e0 2024-09-11T23:04:54.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:54.888+0000 7f550659c640 1 --2- 172.21.15.12:0/1828627473 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f550809f6e0 0x7f5508071d00 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f54f80a58d0 tx=0x7f54f8019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:54.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:54.888+0000 7f54f6ffd640 1 -- 172.21.15.12:0/1828627473 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54f80bd020 con 0x7f550809f6e0 2024-09-11T23:04:54.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:54.888+0000 7f54f6ffd640 1 -- 172.21.15.12:0/1828627473 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54f80ad670 con 0x7f550809f6e0 2024-09-11T23:04:54.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:54.888+0000 7f550ca8a640 1 -- 172.21.15.12:0/1828627473 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5508120270 con 0x7f550809f6e0 2024-09-11T23:04:54.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:54.888+0000 7f54f6ffd640 1 -- 172.21.15.12:0/1828627473 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54f80b2040 con 0x7f550809f6e0 2024-09-11T23:04:54.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:54.888+0000 7f550ca8a640 1 -- 172.21.15.12:0/1828627473 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f550811ff60 con 0x7f550809f6e0 2024-09-11T23:04:54.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:54.892+0000 7f54f6ffd640 1 -- 172.21.15.12:0/1828627473 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 15) ==== 44155+0+0 (secure 0 0 0) 0x7f54f80c0020 con 0x7f550809f6e0 2024-09-11T23:04:54.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:54.892+0000 7f550ca8a640 1 -- 172.21.15.12:0/1828627473 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f550811e730 con 0x7f550809f6e0 2024-09-11T23:04:54.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:54.892+0000 7f54f6ffd640 1 --2- 172.21.15.12:0/1828627473 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f54e8035ed0 0x7f54e8038390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:54.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:54.892+0000 7f54f6ffd640 1 -- 172.21.15.12:0/1828627473 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 3439+0+0 (secure 0 0 0) 0x7f54f80e38b0 con 0x7f550809f6e0 2024-09-11T23:04:54.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:54.892+0000 7f5505d9b640 1 --2- 172.21.15.12:0/1828627473 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f54e8035ed0 0x7f54e8038390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:54.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:54.892+0000 7f5505d9b640 1 --2- 172.21.15.12:0/1828627473 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f54e8035ed0 0x7f54e8038390 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f54fc001610 tx=0x7f54fc007ad0 comp rx=0 tx=0).ready entity=mgr.4452 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:54.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:54.896+0000 7f54f6ffd640 1 -- 172.21.15.12:0/1828627473 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f54f80c7030 con 0x7f550809f6e0 2024-09-11T23:04:55.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.056+0000 7f550ca8a640 1 -- 172.21.15.12:0/1828627473 --> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f55080a14b0 con 0x7f54e8035ed0 2024-09-11T23:04:55.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.072+0000 7f54f6ffd640 1 -- 172.21.15.12:0/1828627473 <== mgr.4452 v2:172.21.15.12:6824/718802078 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245980 (secure 0 0 0) 0x7f54fc0058c0 con 0x7f54e8035ed0 2024-09-11T23:04:55.076 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:04:55.078 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-11T23:04:55.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.076+0000 7f550ca8a640 1 -- 172.21.15.12:0/1828627473 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f54e8035ed0 msgr2=0x7f54e8038390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:55.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.076+0000 7f550ca8a640 1 --2- 172.21.15.12:0/1828627473 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f54e8035ed0 0x7f54e8038390 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f54fc001610 tx=0x7f54fc007ad0 comp rx=0 tx=0).stop 2024-09-11T23:04:55.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.076+0000 7f550ca8a640 1 -- 172.21.15.12:0/1828627473 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f550809f6e0 msgr2=0x7f5508071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:55.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.076+0000 7f550ca8a640 1 --2- 172.21.15.12:0/1828627473 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f550809f6e0 0x7f5508071d00 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f54f80a58d0 tx=0x7f54f8019710 comp rx=0 tx=0).stop 2024-09-11T23:04:55.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.076+0000 7f550ca8a640 1 -- 172.21.15.12:0/1828627473 shutdown_connections 2024-09-11T23:04:55.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.076+0000 7f550ca8a640 1 --2- 172.21.15.12:0/1828627473 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f54e8035ed0 0x7f54e8038390 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:55.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.076+0000 7f550ca8a640 1 --2- 172.21.15.12:0/1828627473 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f550809f6e0 0x7f5508071d00 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:55.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.076+0000 7f550ca8a640 1 -- 172.21.15.12:0/1828627473 >> 172.21.15.12:0/1828627473 conn(0x7f55080a8450 msgr2=0x7f55080a7470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:55.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.076+0000 7f550ca8a640 1 -- 172.21.15.12:0/1828627473 shutdown_connections 2024-09-11T23:04:55.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.076+0000 7f550ca8a640 1 -- 172.21.15.12:0/1828627473 wait complete. 2024-09-11T23:04:55.095 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-11T23:04:53.832197+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":298,"num_read_kb":503,"num_write":222,"num_write_kb":1908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91572,"kb_used_data":2160,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283023948,"statfs":{"total":289910292480,"available":289816522752,"internally_reserved":0,"allocated":2211840,"data_stored":1544236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002574"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:48.602355+0000","last_change":"2024-09-11T23:04:46.318408+0000","last_active":"2024-09-11T23:04:48.602355+0000","last_peered":"2024-09-11T23:04:48.602355+0000","last_clean":"2024-09-11T23:04:48.602355+0000","last_became_active":"2024-09-11T23:04:46.310368+0000","last_became_peered":"2024-09-11T23:04:46.310368+0000","last_unstale":"2024-09-11T23:04:48.602355+0000","last_undegraded":"2024-09-11T23:04:48.602355+0000","last_fullsized":"2024-09-11T23:04:48.602355+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:10.365921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.297833+0000","last_change":"2024-09-11T23:04:46.327199+0000","last_active":"2024-09-11T23:04:47.297833+0000","last_peered":"2024-09-11T23:04:47.297833+0000","last_clean":"2024-09-11T23:04:47.297833+0000","last_became_active":"2024-09-11T23:04:46.326311+0000","last_became_peered":"2024-09-11T23:04:46.326311+0000","last_unstale":"2024-09-11T23:04:47.297833+0000","last_undegraded":"2024-09-11T23:04:47.297833+0000","last_fullsized":"2024-09-11T23:04:47.297833+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:13.700148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.284056+0000","last_change":"2024-09-11T23:04:46.297471+0000","last_active":"2024-09-11T23:04:47.284056+0000","last_peered":"2024-09-11T23:04:47.284056+0000","last_clean":"2024-09-11T23:04:47.284056+0000","last_became_active":"2024-09-11T23:04:46.297150+0000","last_became_peered":"2024-09-11T23:04:46.297150+0000","last_unstale":"2024-09-11T23:04:47.284056+0000","last_undegraded":"2024-09-11T23:04:47.284056+0000","last_fullsized":"2024-09-11T23:04:47.284056+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:13.700148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:48.601418+0000","last_change":"2024-09-11T23:04:46.302736+0000","last_active":"2024-09-11T23:04:48.601418+0000","last_peered":"2024-09-11T23:04:48.601418+0000","last_clean":"2024-09-11T23:04:48.601418+0000","last_became_active":"2024-09-11T23:04:46.302383+0000","last_became_peered":"2024-09-11T23:04:46.302383+0000","last_unstale":"2024-09-11T23:04:48.601418+0000","last_undegraded":"2024-09-11T23:04:48.601418+0000","last_fullsized":"2024-09-11T23:04:48.601418+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:14.376187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:48.600934+0000","last_change":"2024-09-11T23:04:46.305232+0000","last_active":"2024-09-11T23:04:48.600934+0000","last_peered":"2024-09-11T23:04:48.600934+0000","last_clean":"2024-09-11T23:04:48.600934+0000","last_became_active":"2024-09-11T23:04:46.300680+0000","last_became_peered":"2024-09-11T23:04:46.300680+0000","last_unstale":"2024-09-11T23:04:48.600934+0000","last_undegraded":"2024-09-11T23:04:48.600934+0000","last_fullsized":"2024-09-11T23:04:48.600934+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:41.593257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:48.600128+0000","last_change":"2024-09-11T23:04:46.303213+0000","last_active":"2024-09-11T23:04:48.600128+0000","last_peered":"2024-09-11T23:04:48.600128+0000","last_clean":"2024-09-11T23:04:48.600128+0000","last_became_active":"2024-09-11T23:04:46.302373+0000","last_became_peered":"2024-09-11T23:04:46.302373+0000","last_unstale":"2024-09-11T23:04:48.600128+0000","last_undegraded":"2024-09-11T23:04:48.600128+0000","last_fullsized":"2024-09-11T23:04:48.600128+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:46.286258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:48.599759+0000","last_change":"2024-09-11T23:04:46.309627+0000","last_active":"2024-09-11T23:04:48.599759+0000","last_peered":"2024-09-11T23:04:48.599759+0000","last_clean":"2024-09-11T23:04:48.599759+0000","last_became_active":"2024-09-11T23:04:46.305521+0000","last_became_peered":"2024-09-11T23:04:46.305521+0000","last_unstale":"2024-09-11T23:04:48.599759+0000","last_undegraded":"2024-09-11T23:04:48.599759+0000","last_fullsized":"2024-09-11T23:04:48.599759+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:23.073316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:48.599404+0000","last_change":"2024-09-11T23:04:46.319132+0000","last_active":"2024-09-11T23:04:48.599404+0000","last_peered":"2024-09-11T23:04:48.599404+0000","last_clean":"2024-09-11T23:04:48.599404+0000","last_became_active":"2024-09-11T23:04:46.318804+0000","last_became_peered":"2024-09-11T23:04:46.318804+0000","last_unstale":"2024-09-11T23:04:48.599404+0000","last_undegraded":"2024-09-11T23:04:48.599404+0000","last_fullsized":"2024-09-11T23:04:48.599404+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:06.293898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:48.602642+0000","last_change":"2024-09-11T23:04:46.315753+0000","last_active":"2024-09-11T23:04:48.602642+0000","last_peered":"2024-09-11T23:04:48.602642+0000","last_clean":"2024-09-11T23:04:48.602642+0000","last_became_active":"2024-09-11T23:04:46.310113+0000","last_became_peered":"2024-09-11T23:04:46.310113+0000","last_unstale":"2024-09-11T23:04:48.602642+0000","last_undegraded":"2024-09-11T23:04:48.602642+0000","last_fullsized":"2024-09-11T23:04:48.602642+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:04.541423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:48.602059+0000","last_change":"2024-09-11T23:04:46.300732+0000","last_active":"2024-09-11T23:04:48.602059+0000","last_peered":"2024-09-11T23:04:48.602059+0000","last_clean":"2024-09-11T23:04:48.602059+0000","last_became_active":"2024-09-11T23:04:46.300435+0000","last_became_peered":"2024-09-11T23:04:46.300435+0000","last_unstale":"2024-09-11T23:04:48.602059+0000","last_undegraded":"2024-09-11T23:04:48.602059+0000","last_fullsized":"2024-09-11T23:04:48.602059+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:18.745052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:48.602341+0000","last_change":"2024-09-11T23:04:46.315762+0000","last_active":"2024-09-11T23:04:48.602341+0000","last_peered":"2024-09-11T23:04:48.602341+0000","last_clean":"2024-09-11T23:04:48.602341+0000","last_became_active":"2024-09-11T23:04:46.313293+0000","last_became_peered":"2024-09-11T23:04:46.313293+0000","last_unstale":"2024-09-11T23:04:48.602341+0000","last_undegraded":"2024-09-11T23:04:48.602341+0000","last_fullsized":"2024-09-11T23:04:48.602341+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:06.364501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.297334+0000","last_change":"2024-09-11T23:04:46.325110+0000","last_active":"2024-09-11T23:04:47.297334+0000","last_peered":"2024-09-11T23:04:47.297334+0000","last_clean":"2024-09-11T23:04:47.297334+0000","last_became_active":"2024-09-11T23:04:46.324558+0000","last_became_peered":"2024-09-11T23:04:46.324558+0000","last_unstale":"2024-09-11T23:04:47.297334+0000","last_undegraded":"2024-09-11T23:04:47.297334+0000","last_fullsized":"2024-09-11T23:04:47.297334+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:22.103808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.298260+0000","last_change":"2024-09-11T23:04:46.316413+0000","last_active":"2024-09-11T23:04:47.298260+0000","last_peered":"2024-09-11T23:04:47.298260+0000","last_clean":"2024-09-11T23:04:47.298260+0000","last_became_active":"2024-09-11T23:04:46.316020+0000","last_became_peered":"2024-09-11T23:04:46.316020+0000","last_unstale":"2024-09-11T23:04:47.298260+0000","last_undegraded":"2024-09-11T23:04:47.298260+0000","last_fullsized":"2024-09-11T23:04:47.298260+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:26.438762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:48.600408+0000","last_change":"2024-09-11T23:04:46.302655+0000","last_active":"2024-09-11T23:04:48.600408+0000","last_peered":"2024-09-11T23:04:48.600408+0000","last_clean":"2024-09-11T23:04:48.600408+0000","last_became_active":"2024-09-11T23:04:46.302072+0000","last_became_peered":"2024-09-11T23:04:46.302072+0000","last_unstale":"2024-09-11T23:04:48.600408+0000","last_undegraded":"2024-09-11T23:04:48.600408+0000","last_fullsized":"2024-09-11T23:04:48.600408+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:04.479635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.296787+0000","last_change":"2024-09-11T23:04:46.294302+0000","last_active":"2024-09-11T23:04:47.296787+0000","last_peered":"2024-09-11T23:04:47.296787+0000","last_clean":"2024-09-11T23:04:47.296787+0000","last_became_active":"2024-09-11T23:04:46.294005+0000","last_became_peered":"2024-09-11T23:04:46.294005+0000","last_unstale":"2024-09-11T23:04:47.296787+0000","last_undegraded":"2024-09-11T23:04:47.296787+0000","last_fullsized":"2024-09-11T23:04:47.296787+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:46.062475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:48.599490+0000","last_change":"2024-09-11T23:04:46.292375+0000","last_active":"2024-09-11T23:04:48.599490+0000","last_peered":"2024-09-11T23:04:48.599490+0000","last_clean":"2024-09-11T23:04:48.599490+0000","last_became_active":"2024-09-11T23:04:46.292063+0000","last_became_peered":"2024-09-11T23:04:46.292063+0000","last_unstale":"2024-09-11T23:04:48.599490+0000","last_undegraded":"2024-09-11T23:04:48.599490+0000","last_fullsized":"2024-09-11T23:04:48.599490+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:34.883131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.298467+0000","last_change":"2024-09-11T23:04:46.326089+0000","last_active":"2024-09-11T23:04:47.298467+0000","last_peered":"2024-09-11T23:04:47.298467+0000","last_clean":"2024-09-11T23:04:47.298467+0000","last_became_active":"2024-09-11T23:04:46.325794+0000","last_became_peered":"2024-09-11T23:04:46.325794+0000","last_unstale":"2024-09-11T23:04:47.298467+0000","last_undegraded":"2024-09-11T23:04:47.298467+0000","last_fullsized":"2024-09-11T23:04:47.298467+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:33.658422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.284855+0000","last_change":"2024-09-11T23:04:46.316600+0000","last_active":"2024-09-11T23:04:47.284855+0000","last_peered":"2024-09-11T23:04:47.284855+0000","last_clean":"2024-09-11T23:04:47.284855+0000","last_became_active":"2024-09-11T23:04:46.316342+0000","last_became_peered":"2024-09-11T23:04:46.316342+0000","last_unstale":"2024-09-11T23:04:47.284855+0000","last_undegraded":"2024-09-11T23:04:47.284855+0000","last_fullsized":"2024-09-11T23:04:47.284855+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:35.190963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:48.602801+0000","last_change":"2024-09-11T23:04:46.302357+0000","last_active":"2024-09-11T23:04:48.602801+0000","last_peered":"2024-09-11T23:04:48.602801+0000","last_clean":"2024-09-11T23:04:48.602801+0000","last_became_active":"2024-09-11T23:04:46.300136+0000","last_became_peered":"2024-09-11T23:04:46.300136+0000","last_unstale":"2024-09-11T23:04:48.602801+0000","last_undegraded":"2024-09-11T23:04:48.602801+0000","last_fullsized":"2024-09-11T23:04:48.602801+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:05.590116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.297439+0000","last_change":"2024-09-11T23:04:46.325750+0000","last_active":"2024-09-11T23:04:47.297439+0000","last_peered":"2024-09-11T23:04:47.297439+0000","last_clean":"2024-09-11T23:04:47.297439+0000","last_became_active":"2024-09-11T23:04:46.325162+0000","last_became_peered":"2024-09-11T23:04:46.325162+0000","last_unstale":"2024-09-11T23:04:47.297439+0000","last_undegraded":"2024-09-11T23:04:47.297439+0000","last_fullsized":"2024-09-11T23:04:47.297439+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:42:04.891291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.298820+0000","last_change":"2024-09-11T23:04:46.325121+0000","last_active":"2024-09-11T23:04:47.298820+0000","last_peered":"2024-09-11T23:04:47.298820+0000","last_clean":"2024-09-11T23:04:47.298820+0000","last_became_active":"2024-09-11T23:04:46.324845+0000","last_became_peered":"2024-09-11T23:04:46.324845+0000","last_unstale":"2024-09-11T23:04:47.298820+0000","last_undegraded":"2024-09-11T23:04:47.298820+0000","last_fullsized":"2024-09-11T23:04:47.298820+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:40:40.557329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:48.600580+0000","last_change":"2024-09-11T23:04:46.305516+0000","last_active":"2024-09-11T23:04:48.600580+0000","last_peered":"2024-09-11T23:04:48.600580+0000","last_clean":"2024-09-11T23:04:48.600580+0000","last_became_active":"2024-09-11T23:04:46.305081+0000","last_became_peered":"2024-09-11T23:04:46.305081+0000","last_unstale":"2024-09-11T23:04:48.600580+0000","last_undegraded":"2024-09-11T23:04:48.600580+0000","last_fullsized":"2024-09-11T23:04:48.600580+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:14.633756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:48.599944+0000","last_change":"2024-09-11T23:04:46.309407+0000","last_active":"2024-09-11T23:04:48.599944+0000","last_peered":"2024-09-11T23:04:48.599944+0000","last_clean":"2024-09-11T23:04:48.599944+0000","last_became_active":"2024-09-11T23:04:46.305205+0000","last_became_peered":"2024-09-11T23:04:46.305205+0000","last_unstale":"2024-09-11T23:04:48.599944+0000","last_undegraded":"2024-09-11T23:04:48.599944+0000","last_fullsized":"2024-09-11T23:04:48.599944+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:16.071563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.296975+0000","last_change":"2024-09-11T23:04:46.317887+0000","last_active":"2024-09-11T23:04:47.296975+0000","last_peered":"2024-09-11T23:04:47.296975+0000","last_clean":"2024-09-11T23:04:47.296975+0000","last_became_active":"2024-09-11T23:04:46.302562+0000","last_became_peered":"2024-09-11T23:04:46.302562+0000","last_unstale":"2024-09-11T23:04:47.296975+0000","last_undegraded":"2024-09-11T23:04:47.296975+0000","last_fullsized":"2024-09-11T23:04:47.296975+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:57.781311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:48.602908+0000","last_change":"2024-09-11T23:04:46.310580+0000","last_active":"2024-09-11T23:04:48.602908+0000","last_peered":"2024-09-11T23:04:48.602908+0000","last_clean":"2024-09-11T23:04:48.602908+0000","last_became_active":"2024-09-11T23:04:46.303113+0000","last_became_peered":"2024-09-11T23:04:46.303113+0000","last_unstale":"2024-09-11T23:04:48.602908+0000","last_undegraded":"2024-09-11T23:04:48.602908+0000","last_fullsized":"2024-09-11T23:04:48.602908+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:57.299176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.298010+0000","last_change":"2024-09-11T23:04:46.322057+0000","last_active":"2024-09-11T23:04:47.298010+0000","last_peered":"2024-09-11T23:04:47.298010+0000","last_clean":"2024-09-11T23:04:47.298010+0000","last_became_active":"2024-09-11T23:04:46.321757+0000","last_became_peered":"2024-09-11T23:04:46.321757+0000","last_unstale":"2024-09-11T23:04:47.298010+0000","last_undegraded":"2024-09-11T23:04:47.298010+0000","last_fullsized":"2024-09-11T23:04:47.298010+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:35.190963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:48.601936+0000","last_change":"2024-09-11T23:04:46.312949+0000","last_active":"2024-09-11T23:04:48.601936+0000","last_peered":"2024-09-11T23:04:48.601936+0000","last_clean":"2024-09-11T23:04:48.601936+0000","last_became_active":"2024-09-11T23:04:46.302019+0000","last_became_peered":"2024-09-11T23:04:46.302019+0000","last_unstale":"2024-09-11T23:04:48.601936+0000","last_undegraded":"2024-09-11T23:04:48.601936+0000","last_fullsized":"2024-09-11T23:04:48.601936+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:36:58.972672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.297569+0000","last_change":"2024-09-11T23:04:46.322235+0000","last_active":"2024-09-11T23:04:47.297569+0000","last_peered":"2024-09-11T23:04:47.297569+0000","last_clean":"2024-09-11T23:04:47.297569+0000","last_became_active":"2024-09-11T23:04:46.318694+0000","last_became_peered":"2024-09-11T23:04:46.318694+0000","last_unstale":"2024-09-11T23:04:47.297569+0000","last_undegraded":"2024-09-11T23:04:47.297569+0000","last_fullsized":"2024-09-11T23:04:47.297569+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:08.154174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:48.601351+0000","last_change":"2024-09-11T23:04:46.309119+0000","last_active":"2024-09-11T23:04:48.601351+0000","last_peered":"2024-09-11T23:04:48.601351+0000","last_clean":"2024-09-11T23:04:48.601351+0000","last_became_active":"2024-09-11T23:04:46.305535+0000","last_became_peered":"2024-09-11T23:04:46.305535+0000","last_unstale":"2024-09-11T23:04:48.601351+0000","last_undegraded":"2024-09-11T23:04:48.601351+0000","last_fullsized":"2024-09-11T23:04:48.601351+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:01.790895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.297104+0000","last_change":"2024-09-11T23:04:46.324495+0000","last_active":"2024-09-11T23:04:47.297104+0000","last_peered":"2024-09-11T23:04:47.297104+0000","last_clean":"2024-09-11T23:04:47.297104+0000","last_became_active":"2024-09-11T23:04:46.324164+0000","last_became_peered":"2024-09-11T23:04:46.324164+0000","last_unstale":"2024-09-11T23:04:47.297104+0000","last_undegraded":"2024-09-11T23:04:47.297104+0000","last_fullsized":"2024-09-11T23:04:47.297104+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:18.942042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.282743+0000","last_change":"2024-09-11T23:04:46.318259+0000","last_active":"2024-09-11T23:04:47.282743+0000","last_peered":"2024-09-11T23:04:47.282743+0000","last_clean":"2024-09-11T23:04:47.282743+0000","last_became_active":"2024-09-11T23:04:46.317792+0000","last_became_peered":"2024-09-11T23:04:46.317792+0000","last_unstale":"2024-09-11T23:04:47.282743+0000","last_undegraded":"2024-09-11T23:04:47.282743+0000","last_fullsized":"2024-09-11T23:04:47.282743+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:57.781311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.296778+0000","last_change":"2024-09-11T23:04:46.316259+0000","last_active":"2024-09-11T23:04:47.296778+0000","last_peered":"2024-09-11T23:04:47.296778+0000","last_clean":"2024-09-11T23:04:47.296778+0000","last_became_active":"2024-09-11T23:04:46.303687+0000","last_became_peered":"2024-09-11T23:04:46.303687+0000","last_unstale":"2024-09-11T23:04:47.296778+0000","last_undegraded":"2024-09-11T23:04:47.296778+0000","last_fullsized":"2024-09-11T23:04:47.296778+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:57.879933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.285078+0000","last_change":"2024-09-11T23:04:46.303423+0000","last_active":"2024-09-11T23:04:47.285078+0000","last_peered":"2024-09-11T23:04:47.285078+0000","last_clean":"2024-09-11T23:04:47.285078+0000","last_became_active":"2024-09-11T23:04:46.302883+0000","last_became_peered":"2024-09-11T23:04:46.302883+0000","last_unstale":"2024-09-11T23:04:47.285078+0000","last_undegraded":"2024-09-11T23:04:47.285078+0000","last_fullsized":"2024-09-11T23:04:47.285078+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:26.438762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"35'4","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.298634+0000","last_change":"2024-09-11T23:04:45.300320+0000","last_active":"2024-09-11T23:04:47.298634+0000","last_peered":"2024-09-11T23:04:47.298634+0000","last_clean":"2024-09-11T23:04:47.298634+0000","last_became_active":"2024-09-11T23:04:45.300023+0000","last_became_peered":"2024-09-11T23:04:45.300023+0000","last_unstale":"2024-09-11T23:04:47.298634+0000","last_undegraded":"2024-09-11T23:04:47.298634+0000","last_fullsized":"2024-09-11T23:04:47.298634+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:21.535311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:48.602867+0000","last_change":"2024-09-11T23:04:46.318822+0000","last_active":"2024-09-11T23:04:48.602867+0000","last_peered":"2024-09-11T23:04:48.602867+0000","last_clean":"2024-09-11T23:04:48.602867+0000","last_became_active":"2024-09-11T23:04:46.310782+0000","last_became_peered":"2024-09-11T23:04:46.310782+0000","last_unstale":"2024-09-11T23:04:48.602867+0000","last_undegraded":"2024-09-11T23:04:48.602867+0000","last_fullsized":"2024-09-11T23:04:48.602867+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:24.029506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"35'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.285070+0000","last_change":"2024-09-11T23:04:45.295255+0000","last_active":"2024-09-11T23:04:47.285070+0000","last_peered":"2024-09-11T23:04:47.285070+0000","last_clean":"2024-09-11T23:04:47.285070+0000","last_became_active":"2024-09-11T23:04:45.293741+0000","last_became_peered":"2024-09-11T23:04:45.293741+0000","last_unstale":"2024-09-11T23:04:47.285070+0000","last_undegraded":"2024-09-11T23:04:47.285070+0000","last_fullsized":"2024-09-11T23:04:47.285070+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:47.401560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.297634+0000","last_change":"2024-09-11T23:04:46.321983+0000","last_active":"2024-09-11T23:04:47.297634+0000","last_peered":"2024-09-11T23:04:47.297634+0000","last_clean":"2024-09-11T23:04:47.297634+0000","last_became_active":"2024-09-11T23:04:46.318618+0000","last_became_peered":"2024-09-11T23:04:46.318618+0000","last_unstale":"2024-09-11T23:04:47.297634+0000","last_undegraded":"2024-09-11T23:04:47.297634+0000","last_fullsized":"2024-09-11T23:04:47.297634+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:31.865881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.284246+0000","last_change":"2024-09-11T23:04:45.291351+0000","last_active":"2024-09-11T23:04:47.284246+0000","last_peered":"2024-09-11T23:04:47.284246+0000","last_clean":"2024-09-11T23:04:47.284246+0000","last_became_active":"2024-09-11T23:04:45.290803+0000","last_became_peered":"2024-09-11T23:04:45.290803+0000","last_unstale":"2024-09-11T23:04:47.284246+0000","last_undegraded":"2024-09-11T23:04:47.284246+0000","last_fullsized":"2024-09-11T23:04:47.284246+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:21.574886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.284121+0000","last_change":"2024-09-11T23:04:46.319460+0000","last_active":"2024-09-11T23:04:47.284121+0000","last_peered":"2024-09-11T23:04:47.284121+0000","last_clean":"2024-09-11T23:04:47.284121+0000","last_became_active":"2024-09-11T23:04:46.318424+0000","last_became_peered":"2024-09-11T23:04:46.318424+0000","last_unstale":"2024-09-11T23:04:47.284121+0000","last_undegraded":"2024-09-11T23:04:47.284121+0000","last_fullsized":"2024-09-11T23:04:47.284121+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:11.312361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.283346+0000","last_change":"2024-09-11T23:04:45.298753+0000","last_active":"2024-09-11T23:04:47.283346+0000","last_peered":"2024-09-11T23:04:47.283346+0000","last_clean":"2024-09-11T23:04:47.283346+0000","last_became_active":"2024-09-11T23:04:45.293365+0000","last_became_peered":"2024-09-11T23:04:45.293365+0000","last_unstale":"2024-09-11T23:04:47.283346+0000","last_undegraded":"2024-09-11T23:04:47.283346+0000","last_fullsized":"2024-09-11T23:04:47.283346+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:30.192602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.297524+0000","last_change":"2024-09-11T23:04:46.326881+0000","last_active":"2024-09-11T23:04:47.297524+0000","last_peered":"2024-09-11T23:04:47.297524+0000","last_clean":"2024-09-11T23:04:47.297524+0000","last_became_active":"2024-09-11T23:04:46.326341+0000","last_became_peered":"2024-09-11T23:04:46.326341+0000","last_unstale":"2024-09-11T23:04:47.297524+0000","last_undegraded":"2024-09-11T23:04:47.297524+0000","last_fullsized":"2024-09-11T23:04:47.297524+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:33.670979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1b","version":"35'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:48.601896+0000","last_change":"2024-09-11T23:04:45.296095+0000","last_active":"2024-09-11T23:04:48.601896+0000","last_peered":"2024-09-11T23:04:48.601896+0000","last_clean":"2024-09-11T23:04:48.601896+0000","last_became_active":"2024-09-11T23:04:45.295473+0000","last_became_peered":"2024-09-11T23:04:45.295473+0000","last_unstale":"2024-09-11T23:04:48.601896+0000","last_undegraded":"2024-09-11T23:04:48.601896+0000","last_fullsized":"2024-09-11T23:04:48.601896+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:30.858904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:48.601572+0000","last_change":"2024-09-11T23:04:46.300077+0000","last_active":"2024-09-11T23:04:48.601572+0000","last_peered":"2024-09-11T23:04:48.601572+0000","last_clean":"2024-09-11T23:04:48.601572+0000","last_became_active":"2024-09-11T23:04:46.299088+0000","last_became_peered":"2024-09-11T23:04:46.299088+0000","last_unstale":"2024-09-11T23:04:48.601572+0000","last_undegraded":"2024-09-11T23:04:48.601572+0000","last_fullsized":"2024-09-11T23:04:48.601572+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:40.359020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"35'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:48.600759+0000","last_change":"2024-09-11T23:04:45.281392+0000","last_active":"2024-09-11T23:04:48.600759+0000","last_peered":"2024-09-11T23:04:48.600759+0000","last_clean":"2024-09-11T23:04:48.600759+0000","last_became_active":"2024-09-11T23:04:45.281085+0000","last_became_peered":"2024-09-11T23:04:45.281085+0000","last_unstale":"2024-09-11T23:04:48.600759+0000","last_undegraded":"2024-09-11T23:04:48.600759+0000","last_fullsized":"2024-09-11T23:04:48.600759+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:55.332488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:48.599803+0000","last_change":"2024-09-11T23:04:46.294410+0000","last_active":"2024-09-11T23:04:48.599803+0000","last_peered":"2024-09-11T23:04:48.599803+0000","last_clean":"2024-09-11T23:04:48.599803+0000","last_became_active":"2024-09-11T23:04:46.294110+0000","last_became_peered":"2024-09-11T23:04:46.294110+0000","last_unstale":"2024-09-11T23:04:48.599803+0000","last_undegraded":"2024-09-11T23:04:48.599803+0000","last_fullsized":"2024-09-11T23:04:48.599803+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:25.425271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:48.600086+0000","last_change":"2024-09-11T23:04:45.291550+0000","last_active":"2024-09-11T23:04:48.600086+0000","last_peered":"2024-09-11T23:04:48.600086+0000","last_clean":"2024-09-11T23:04:48.600086+0000","last_became_active":"2024-09-11T23:04:45.288657+0000","last_became_peered":"2024-09-11T23:04:45.288657+0000","last_unstale":"2024-09-11T23:04:48.600086+0000","last_undegraded":"2024-09-11T23:04:48.600086+0000","last_fullsized":"2024-09-11T23:04:48.600086+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:10.305384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.283339+0000","last_change":"2024-09-11T23:04:46.294044+0000","last_active":"2024-09-11T23:04:47.283339+0000","last_peered":"2024-09-11T23:04:47.283339+0000","last_clean":"2024-09-11T23:04:47.283339+0000","last_became_active":"2024-09-11T23:04:46.293776+0000","last_became_peered":"2024-09-11T23:04:46.293776+0000","last_unstale":"2024-09-11T23:04:47.283339+0000","last_undegraded":"2024-09-11T23:04:47.283339+0000","last_fullsized":"2024-09-11T23:04:47.283339+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:33.670979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:48.599659+0000","last_change":"2024-09-11T23:04:45.281525+0000","last_active":"2024-09-11T23:04:48.599659+0000","last_peered":"2024-09-11T23:04:48.599659+0000","last_clean":"2024-09-11T23:04:48.599659+0000","last_became_active":"2024-09-11T23:04:45.281038+0000","last_became_peered":"2024-09-11T23:04:45.281038+0000","last_unstale":"2024-09-11T23:04:48.599659+0000","last_undegraded":"2024-09-11T23:04:48.599659+0000","last_fullsized":"2024-09-11T23:04:48.599659+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:54.058055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.285020+0000","last_change":"2024-09-11T23:04:46.302523+0000","last_active":"2024-09-11T23:04:47.285020+0000","last_peered":"2024-09-11T23:04:47.285020+0000","last_clean":"2024-09-11T23:04:47.285020+0000","last_became_active":"2024-09-11T23:04:46.302177+0000","last_became_peered":"2024-09-11T23:04:46.302177+0000","last_unstale":"2024-09-11T23:04:47.285020+0000","last_undegraded":"2024-09-11T23:04:47.285020+0000","last_fullsized":"2024-09-11T23:04:47.285020+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:04.381683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.283691+0000","last_change":"2024-09-11T23:04:45.294857+0000","last_active":"2024-09-11T23:04:47.283691+0000","last_peered":"2024-09-11T23:04:47.283691+0000","last_clean":"2024-09-11T23:04:47.283691+0000","last_became_active":"2024-09-11T23:04:45.292853+0000","last_became_peered":"2024-09-11T23:04:45.292853+0000","last_unstale":"2024-09-11T23:04:47.283691+0000","last_undegraded":"2024-09-11T23:04:47.283691+0000","last_fullsized":"2024-09-11T23:04:47.283691+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:24.272501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.283631+0000","last_change":"2024-09-11T23:04:46.318066+0000","last_active":"2024-09-11T23:04:47.283631+0000","last_peered":"2024-09-11T23:04:47.283631+0000","last_clean":"2024-09-11T23:04:47.283631+0000","last_became_active":"2024-09-11T23:04:46.317529+0000","last_became_peered":"2024-09-11T23:04:46.317529+0000","last_unstale":"2024-09-11T23:04:47.283631+0000","last_undegraded":"2024-09-11T23:04:47.283631+0000","last_fullsized":"2024-09-11T23:04:47.283631+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:08.154174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:48.602400+0000","last_change":"2024-09-11T23:04:45.282485+0000","last_active":"2024-09-11T23:04:48.602400+0000","last_peered":"2024-09-11T23:04:48.602400+0000","last_clean":"2024-09-11T23:04:48.602400+0000","last_became_active":"2024-09-11T23:04:45.282192+0000","last_became_peered":"2024-09-11T23:04:45.282192+0000","last_unstale":"2024-09-11T23:04:48.602400+0000","last_undegraded":"2024-09-11T23:04:48.602400+0000","last_fullsized":"2024-09-11T23:04:48.602400+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:08.131578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.283287+0000","last_change":"2024-09-11T23:04:46.301279+0000","last_active":"2024-09-11T23:04:47.283287+0000","last_peered":"2024-09-11T23:04:47.283287+0000","last_clean":"2024-09-11T23:04:47.283287+0000","last_became_active":"2024-09-11T23:04:46.301000+0000","last_became_peered":"2024-09-11T23:04:46.301000+0000","last_unstale":"2024-09-11T23:04:47.283287+0000","last_undegraded":"2024-09-11T23:04:47.283287+0000","last_fullsized":"2024-09-11T23:04:47.283287+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:42:04.891291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.15","version":"35'3","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.298607+0000","last_change":"2024-09-11T23:04:45.297825+0000","last_active":"2024-09-11T23:04:47.298607+0000","last_peered":"2024-09-11T23:04:47.298607+0000","last_clean":"2024-09-11T23:04:47.298607+0000","last_became_active":"2024-09-11T23:04:45.296383+0000","last_became_peered":"2024-09-11T23:04:45.296383+0000","last_unstale":"2024-09-11T23:04:47.298607+0000","last_undegraded":"2024-09-11T23:04:47.298607+0000","last_fullsized":"2024-09-11T23:04:47.298607+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:42.801527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.298408+0000","last_change":"2024-09-11T23:04:46.304086+0000","last_active":"2024-09-11T23:04:47.298408+0000","last_peered":"2024-09-11T23:04:47.298408+0000","last_clean":"2024-09-11T23:04:47.298408+0000","last_became_active":"2024-09-11T23:04:46.303805+0000","last_became_peered":"2024-09-11T23:04:46.303805+0000","last_unstale":"2024-09-11T23:04:47.298408+0000","last_undegraded":"2024-09-11T23:04:47.298408+0000","last_fullsized":"2024-09-11T23:04:47.298408+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:06.111336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"35'6","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.297840+0000","last_change":"2024-09-11T23:04:45.297552+0000","last_active":"2024-09-11T23:04:47.297840+0000","last_peered":"2024-09-11T23:04:47.297840+0000","last_clean":"2024-09-11T23:04:47.297840+0000","last_became_active":"2024-09-11T23:04:45.297265+0000","last_became_peered":"2024-09-11T23:04:45.297265+0000","last_unstale":"2024-09-11T23:04:47.297840+0000","last_undegraded":"2024-09-11T23:04:47.297840+0000","last_fullsized":"2024-09-11T23:04:47.297840+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:05.305481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.283274+0000","last_change":"2024-09-11T23:04:46.303775+0000","last_active":"2024-09-11T23:04:47.283274+0000","last_peered":"2024-09-11T23:04:47.283274+0000","last_clean":"2024-09-11T23:04:47.283274+0000","last_became_active":"2024-09-11T23:04:46.303500+0000","last_became_peered":"2024-09-11T23:04:46.303500+0000","last_unstale":"2024-09-11T23:04:47.283274+0000","last_undegraded":"2024-09-11T23:04:47.283274+0000","last_fullsized":"2024-09-11T23:04:47.283274+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:22.103808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.298947+0000","last_change":"2024-09-11T23:04:45.285357+0000","last_active":"2024-09-11T23:04:47.298947+0000","last_peered":"2024-09-11T23:04:47.298947+0000","last_clean":"2024-09-11T23:04:47.298947+0000","last_became_active":"2024-09-11T23:04:45.281608+0000","last_became_peered":"2024-09-11T23:04:45.281608+0000","last_unstale":"2024-09-11T23:04:47.298947+0000","last_undegraded":"2024-09-11T23:04:47.298947+0000","last_fullsized":"2024-09-11T23:04:47.298947+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:54.908265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:48.601746+0000","last_change":"2024-09-11T23:04:46.298699+0000","last_active":"2024-09-11T23:04:48.601746+0000","last_peered":"2024-09-11T23:04:48.601746+0000","last_clean":"2024-09-11T23:04:48.601746+0000","last_became_active":"2024-09-11T23:04:46.296442+0000","last_became_peered":"2024-09-11T23:04:46.296442+0000","last_unstale":"2024-09-11T23:04:48.601746+0000","last_undegraded":"2024-09-11T23:04:48.601746+0000","last_fullsized":"2024-09-11T23:04:48.601746+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:45.578284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:48.600812+0000","last_change":"2024-09-11T23:04:45.293202+0000","last_active":"2024-09-11T23:04:48.600812+0000","last_peered":"2024-09-11T23:04:48.600812+0000","last_clean":"2024-09-11T23:04:48.600812+0000","last_became_active":"2024-09-11T23:04:45.292892+0000","last_became_peered":"2024-09-11T23:04:45.292892+0000","last_unstale":"2024-09-11T23:04:48.600812+0000","last_undegraded":"2024-09-11T23:04:48.600812+0000","last_fullsized":"2024-09-11T23:04:48.600812+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:21.096831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.282821+0000","last_change":"2024-09-11T23:04:46.291296+0000","last_active":"2024-09-11T23:04:47.282821+0000","last_peered":"2024-09-11T23:04:47.282821+0000","last_clean":"2024-09-11T23:04:47.282821+0000","last_became_active":"2024-09-11T23:04:46.290797+0000","last_became_peered":"2024-09-11T23:04:46.290797+0000","last_unstale":"2024-09-11T23:04:47.282821+0000","last_undegraded":"2024-09-11T23:04:47.282821+0000","last_fullsized":"2024-09-11T23:04:47.282821+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:18.942042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.297174+0000","last_change":"2024-09-11T23:04:45.296296+0000","last_active":"2024-09-11T23:04:47.297174+0000","last_peered":"2024-09-11T23:04:47.297174+0000","last_clean":"2024-09-11T23:04:47.297174+0000","last_became_active":"2024-09-11T23:04:45.296002+0000","last_became_peered":"2024-09-11T23:04:45.296002+0000","last_unstale":"2024-09-11T23:04:47.297174+0000","last_undegraded":"2024-09-11T23:04:47.297174+0000","last_fullsized":"2024-09-11T23:04:47.297174+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:32.556160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.297088+0000","last_change":"2024-09-11T23:04:46.326062+0000","last_active":"2024-09-11T23:04:47.297088+0000","last_peered":"2024-09-11T23:04:47.297088+0000","last_clean":"2024-09-11T23:04:47.297088+0000","last_became_active":"2024-09-11T23:04:46.325734+0000","last_became_peered":"2024-09-11T23:04:46.325734+0000","last_unstale":"2024-09-11T23:04:47.297088+0000","last_undegraded":"2024-09-11T23:04:47.297088+0000","last_fullsized":"2024-09-11T23:04:47.297088+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:55.065032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"35'8","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:48.599975+0000","last_change":"2024-09-11T23:04:45.291040+0000","last_active":"2024-09-11T23:04:48.599975+0000","last_peered":"2024-09-11T23:04:48.599975+0000","last_clean":"2024-09-11T23:04:48.599975+0000","last_became_active":"2024-09-11T23:04:45.290561+0000","last_became_peered":"2024-09-11T23:04:45.290561+0000","last_unstale":"2024-09-11T23:04:48.599975+0000","last_undegraded":"2024-09-11T23:04:48.599975+0000","last_fullsized":"2024-09-11T23:04:48.599975+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:32.664002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.298160+0000","last_change":"2024-09-11T23:04:46.317542+0000","last_active":"2024-09-11T23:04:47.298160+0000","last_peered":"2024-09-11T23:04:47.298160+0000","last_clean":"2024-09-11T23:04:47.298160+0000","last_became_active":"2024-09-11T23:04:46.316806+0000","last_became_peered":"2024-09-11T23:04:46.316806+0000","last_unstale":"2024-09-11T23:04:47.298160+0000","last_undegraded":"2024-09-11T23:04:47.298160+0000","last_fullsized":"2024-09-11T23:04:47.298160+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:04.381683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"35'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.298699+0000","last_change":"2024-09-11T23:04:45.283727+0000","last_active":"2024-09-11T23:04:47.298699+0000","last_peered":"2024-09-11T23:04:47.298699+0000","last_clean":"2024-09-11T23:04:47.298699+0000","last_became_active":"2024-09-11T23:04:45.283180+0000","last_became_peered":"2024-09-11T23:04:45.283180+0000","last_unstale":"2024-09-11T23:04:47.298699+0000","last_undegraded":"2024-09-11T23:04:47.298699+0000","last_fullsized":"2024-09-11T23:04:47.298699+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:53.245910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:48.603427+0000","last_change":"2024-09-11T23:04:46.300634+0000","last_active":"2024-09-11T23:04:48.603427+0000","last_peered":"2024-09-11T23:04:48.603427+0000","last_clean":"2024-09-11T23:04:48.603427+0000","last_became_active":"2024-09-11T23:04:46.300237+0000","last_became_peered":"2024-09-11T23:04:46.300237+0000","last_unstale":"2024-09-11T23:04:48.603427+0000","last_undegraded":"2024-09-11T23:04:48.603427+0000","last_fullsized":"2024-09-11T23:04:48.603427+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:37.667809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.285219+0000","last_change":"2024-09-11T23:04:45.287996+0000","last_active":"2024-09-11T23:04:47.285219+0000","last_peered":"2024-09-11T23:04:47.285219+0000","last_clean":"2024-09-11T23:04:47.285219+0000","last_became_active":"2024-09-11T23:04:45.286798+0000","last_became_peered":"2024-09-11T23:04:45.286798+0000","last_unstale":"2024-09-11T23:04:47.285219+0000","last_undegraded":"2024-09-11T23:04:47.285219+0000","last_fullsized":"2024-09-11T23:04:47.285219+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:21.516047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.297844+0000","last_change":"2024-09-11T23:04:46.322461+0000","last_active":"2024-09-11T23:04:47.297844+0000","last_peered":"2024-09-11T23:04:47.297844+0000","last_clean":"2024-09-11T23:04:47.297844+0000","last_became_active":"2024-09-11T23:04:46.321529+0000","last_became_peered":"2024-09-11T23:04:46.321529+0000","last_unstale":"2024-09-11T23:04:47.297844+0000","last_undegraded":"2024-09-11T23:04:47.297844+0000","last_fullsized":"2024-09-11T23:04:47.297844+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:11.312361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"35'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.284507+0000","last_change":"2024-09-11T23:04:45.298340+0000","last_active":"2024-09-11T23:04:47.284507+0000","last_peered":"2024-09-11T23:04:47.284507+0000","last_clean":"2024-09-11T23:04:47.284507+0000","last_became_active":"2024-09-11T23:04:45.293597+0000","last_became_peered":"2024-09-11T23:04:45.293597+0000","last_unstale":"2024-09-11T23:04:47.284507+0000","last_undegraded":"2024-09-11T23:04:47.284507+0000","last_fullsized":"2024-09-11T23:04:47.284507+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:11.217943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.284427+0000","last_change":"2024-09-11T23:04:46.304850+0000","last_active":"2024-09-11T23:04:47.284427+0000","last_peered":"2024-09-11T23:04:47.284427+0000","last_clean":"2024-09-11T23:04:47.284427+0000","last_became_active":"2024-09-11T23:04:46.304479+0000","last_became_peered":"2024-09-11T23:04:46.304479+0000","last_unstale":"2024-09-11T23:04:47.284427+0000","last_undegraded":"2024-09-11T23:04:47.284427+0000","last_fullsized":"2024-09-11T23:04:47.284427+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:09.138555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.283433+0000","last_change":"2024-09-11T23:04:45.298317+0000","last_active":"2024-09-11T23:04:47.283433+0000","last_peered":"2024-09-11T23:04:47.283433+0000","last_clean":"2024-09-11T23:04:47.283433+0000","last_became_active":"2024-09-11T23:04:45.293939+0000","last_became_peered":"2024-09-11T23:04:45.293939+0000","last_unstale":"2024-09-11T23:04:47.283433+0000","last_undegraded":"2024-09-11T23:04:47.283433+0000","last_fullsized":"2024-09-11T23:04:47.283433+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:30.293738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.297899+0000","last_change":"2024-09-11T23:04:46.326774+0000","last_active":"2024-09-11T23:04:47.297899+0000","last_peered":"2024-09-11T23:04:47.297899+0000","last_clean":"2024-09-11T23:04:47.297899+0000","last_became_active":"2024-09-11T23:04:46.326246+0000","last_became_peered":"2024-09-11T23:04:46.326246+0000","last_unstale":"2024-09-11T23:04:47.297899+0000","last_undegraded":"2024-09-11T23:04:47.297899+0000","last_fullsized":"2024-09-11T23:04:47.297899+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:09.138555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.284522+0000","last_change":"2024-09-11T23:04:45.294359+0000","last_active":"2024-09-11T23:04:47.284522+0000","last_peered":"2024-09-11T23:04:47.284522+0000","last_clean":"2024-09-11T23:04:47.284522+0000","last_became_active":"2024-09-11T23:04:45.293592+0000","last_became_peered":"2024-09-11T23:04:45.293592+0000","last_unstale":"2024-09-11T23:04:47.284522+0000","last_undegraded":"2024-09-11T23:04:47.284522+0000","last_fullsized":"2024-09-11T23:04:47.284522+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:11.282148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.282799+0000","last_change":"2024-09-11T23:04:46.295090+0000","last_active":"2024-09-11T23:04:47.282799+0000","last_peered":"2024-09-11T23:04:47.282799+0000","last_clean":"2024-09-11T23:04:47.282799+0000","last_became_active":"2024-09-11T23:04:46.294809+0000","last_became_peered":"2024-09-11T23:04:46.294809+0000","last_unstale":"2024-09-11T23:04:47.282799+0000","last_undegraded":"2024-09-11T23:04:47.282799+0000","last_fullsized":"2024-09-11T23:04:47.282799+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:55.065032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:48.601108+0000","last_change":"2024-09-11T23:04:45.282514+0000","last_active":"2024-09-11T23:04:48.601108+0000","last_peered":"2024-09-11T23:04:48.601108+0000","last_clean":"2024-09-11T23:04:48.601108+0000","last_became_active":"2024-09-11T23:04:45.282208+0000","last_became_peered":"2024-09-11T23:04:45.282208+0000","last_unstale":"2024-09-11T23:04:48.601108+0000","last_undegraded":"2024-09-11T23:04:48.601108+0000","last_fullsized":"2024-09-11T23:04:48.601108+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:42:03.884314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.296601+0000","last_change":"2024-09-11T23:04:46.317503+0000","last_active":"2024-09-11T23:04:47.296601+0000","last_peered":"2024-09-11T23:04:47.296601+0000","last_clean":"2024-09-11T23:04:47.296601+0000","last_became_active":"2024-09-11T23:04:46.316769+0000","last_became_peered":"2024-09-11T23:04:46.316769+0000","last_unstale":"2024-09-11T23:04:47.296601+0000","last_undegraded":"2024-09-11T23:04:47.296601+0000","last_fullsized":"2024-09-11T23:04:47.296601+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:20.489333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:48.600143+0000","last_change":"2024-09-11T23:04:45.289256+0000","last_active":"2024-09-11T23:04:48.600143+0000","last_peered":"2024-09-11T23:04:48.600143+0000","last_clean":"2024-09-11T23:04:48.600143+0000","last_became_active":"2024-09-11T23:04:45.288748+0000","last_became_peered":"2024-09-11T23:04:45.288748+0000","last_unstale":"2024-09-11T23:04:48.600143+0000","last_undegraded":"2024-09-11T23:04:48.600143+0000","last_fullsized":"2024-09-11T23:04:48.600143+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:07.147196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:48.599979+0000","last_change":"2024-09-11T23:04:46.313005+0000","last_active":"2024-09-11T23:04:48.599979+0000","last_peered":"2024-09-11T23:04:48.599979+0000","last_clean":"2024-09-11T23:04:48.599979+0000","last_became_active":"2024-09-11T23:04:46.309136+0000","last_became_peered":"2024-09-11T23:04:46.309136+0000","last_unstale":"2024-09-11T23:04:48.599979+0000","last_undegraded":"2024-09-11T23:04:48.599979+0000","last_fullsized":"2024-09-11T23:04:48.599979+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:38.815486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.296465+0000","last_change":"2024-09-11T23:04:45.297149+0000","last_active":"2024-09-11T23:04:47.296465+0000","last_peered":"2024-09-11T23:04:47.296465+0000","last_clean":"2024-09-11T23:04:47.296465+0000","last_became_active":"2024-09-11T23:04:45.296339+0000","last_became_peered":"2024-09-11T23:04:45.296339+0000","last_unstale":"2024-09-11T23:04:47.296465+0000","last_undegraded":"2024-09-11T23:04:47.296465+0000","last_fullsized":"2024-09-11T23:04:47.296465+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:39.026235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.283721+0000","last_change":"2024-09-11T23:04:46.297755+0000","last_active":"2024-09-11T23:04:47.283721+0000","last_peered":"2024-09-11T23:04:47.283721+0000","last_clean":"2024-09-11T23:04:47.283721+0000","last_became_active":"2024-09-11T23:04:46.293603+0000","last_became_peered":"2024-09-11T23:04:46.293603+0000","last_unstale":"2024-09-11T23:04:47.283721+0000","last_undegraded":"2024-09-11T23:04:47.283721+0000","last_fullsized":"2024-09-11T23:04:47.283721+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:31.865881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"36'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.285249+0000","last_change":"2024-09-11T23:04:45.287761+0000","last_active":"2024-09-11T23:04:47.285249+0000","last_peered":"2024-09-11T23:04:47.285249+0000","last_clean":"2024-09-11T23:04:47.285249+0000","last_became_active":"2024-09-11T23:04:45.286454+0000","last_became_peered":"2024-09-11T23:04:45.286454+0000","last_unstale":"2024-09-11T23:04:47.285249+0000","last_undegraded":"2024-09-11T23:04:47.285249+0000","last_fullsized":"2024-09-11T23:04:47.285249+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:01.543559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:48.601436+0000","last_change":"2024-09-11T23:04:46.305208+0000","last_active":"2024-09-11T23:04:48.601436+0000","last_peered":"2024-09-11T23:04:48.601436+0000","last_clean":"2024-09-11T23:04:48.601436+0000","last_became_active":"2024-09-11T23:04:46.302083+0000","last_became_peered":"2024-09-11T23:04:46.302083+0000","last_unstale":"2024-09-11T23:04:48.601436+0000","last_undegraded":"2024-09-11T23:04:48.601436+0000","last_fullsized":"2024-09-11T23:04:48.601436+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:26.819867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:48.602868+0000","last_change":"2024-09-11T23:04:45.288188+0000","last_active":"2024-09-11T23:04:48.602868+0000","last_peered":"2024-09-11T23:04:48.602868+0000","last_clean":"2024-09-11T23:04:48.602868+0000","last_became_active":"2024-09-11T23:04:45.287709+0000","last_became_peered":"2024-09-11T23:04:45.287709+0000","last_unstale":"2024-09-11T23:04:48.602868+0000","last_undegraded":"2024-09-11T23:04:48.602868+0000","last_fullsized":"2024-09-11T23:04:48.602868+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:03.374706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.298676+0000","last_change":"2024-09-11T23:04:46.324555+0000","last_active":"2024-09-11T23:04:47.298676+0000","last_peered":"2024-09-11T23:04:47.298676+0000","last_clean":"2024-09-11T23:04:47.298676+0000","last_became_active":"2024-09-11T23:04:46.324272+0000","last_became_peered":"2024-09-11T23:04:46.324272+0000","last_unstale":"2024-09-11T23:04:47.298676+0000","last_undegraded":"2024-09-11T23:04:47.298676+0000","last_fullsized":"2024-09-11T23:04:47.298676+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:21.068619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.283533+0000","last_change":"2024-09-11T23:04:45.291185+0000","last_active":"2024-09-11T23:04:47.283533+0000","last_peered":"2024-09-11T23:04:47.283533+0000","last_clean":"2024-09-11T23:04:47.283533+0000","last_became_active":"2024-09-11T23:04:45.290872+0000","last_became_peered":"2024-09-11T23:04:45.290872+0000","last_unstale":"2024-09-11T23:04:47.283533+0000","last_undegraded":"2024-09-11T23:04:47.283533+0000","last_fullsized":"2024-09-11T23:04:47.283533+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:37.312674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.298273+0000","last_change":"2024-09-11T23:04:46.294456+0000","last_active":"2024-09-11T23:04:47.298273+0000","last_peered":"2024-09-11T23:04:47.298273+0000","last_clean":"2024-09-11T23:04:47.298273+0000","last_became_active":"2024-09-11T23:04:46.294179+0000","last_became_peered":"2024-09-11T23:04:46.294179+0000","last_unstale":"2024-09-11T23:04:47.298273+0000","last_undegraded":"2024-09-11T23:04:47.298273+0000","last_fullsized":"2024-09-11T23:04:47.298273+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:00.992500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:48.602191+0000","last_change":"2024-09-11T23:04:45.295884+0000","last_active":"2024-09-11T23:04:48.602191+0000","last_peered":"2024-09-11T23:04:48.602191+0000","last_clean":"2024-09-11T23:04:48.602191+0000","last_became_active":"2024-09-11T23:04:45.294402+0000","last_became_peered":"2024-09-11T23:04:45.294402+0000","last_unstale":"2024-09-11T23:04:48.602191+0000","last_undegraded":"2024-09-11T23:04:48.602191+0000","last_fullsized":"2024-09-11T23:04:48.602191+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:12.693171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:48.601999+0000","last_change":"2024-09-11T23:04:46.296765+0000","last_active":"2024-09-11T23:04:48.601999+0000","last_peered":"2024-09-11T23:04:48.601999+0000","last_clean":"2024-09-11T23:04:48.601999+0000","last_became_active":"2024-09-11T23:04:46.296396+0000","last_became_peered":"2024-09-11T23:04:46.296396+0000","last_unstale":"2024-09-11T23:04:48.601999+0000","last_undegraded":"2024-09-11T23:04:48.601999+0000","last_fullsized":"2024-09-11T23:04:48.601999+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:24.956388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.283293+0000","last_change":"2024-09-11T23:04:45.294541+0000","last_active":"2024-09-11T23:04:47.283293+0000","last_peered":"2024-09-11T23:04:47.283293+0000","last_clean":"2024-09-11T23:04:47.283293+0000","last_became_active":"2024-09-11T23:04:45.294242+0000","last_became_peered":"2024-09-11T23:04:45.294242+0000","last_unstale":"2024-09-11T23:04:47.283293+0000","last_undegraded":"2024-09-11T23:04:47.283293+0000","last_fullsized":"2024-09-11T23:04:47.283293+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:42.801527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.282929+0000","last_change":"2024-09-11T23:04:46.291068+0000","last_active":"2024-09-11T23:04:47.282929+0000","last_peered":"2024-09-11T23:04:47.282929+0000","last_clean":"2024-09-11T23:04:47.282929+0000","last_became_active":"2024-09-11T23:04:46.290401+0000","last_became_peered":"2024-09-11T23:04:46.290401+0000","last_unstale":"2024-09-11T23:04:47.282929+0000","last_undegraded":"2024-09-11T23:04:47.282929+0000","last_fullsized":"2024-09-11T23:04:47.282929+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:56.339465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.282802+0000","last_change":"2024-09-11T23:04:45.287742+0000","last_active":"2024-09-11T23:04:47.282802+0000","last_peered":"2024-09-11T23:04:47.282802+0000","last_clean":"2024-09-11T23:04:47.282802+0000","last_became_active":"2024-09-11T23:04:45.287427+0000","last_became_peered":"2024-09-11T23:04:45.287427+0000","last_unstale":"2024-09-11T23:04:47.282802+0000","last_undegraded":"2024-09-11T23:04:47.282802+0000","last_fullsized":"2024-09-11T23:04:47.282802+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:12:05.734167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.297201+0000","last_change":"2024-09-11T23:04:46.303925+0000","last_active":"2024-09-11T23:04:47.297201+0000","last_peered":"2024-09-11T23:04:47.297201+0000","last_clean":"2024-09-11T23:04:47.297201+0000","last_became_active":"2024-09-11T23:04:46.303641+0000","last_became_peered":"2024-09-11T23:04:46.303641+0000","last_unstale":"2024-09-11T23:04:47.297201+0000","last_undegraded":"2024-09-11T23:04:47.297201+0000","last_fullsized":"2024-09-11T23:04:47.297201+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:56.339465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:48.599990+0000","last_change":"2024-09-11T23:04:45.290849+0000","last_active":"2024-09-11T23:04:48.599990+0000","last_peered":"2024-09-11T23:04:48.599990+0000","last_clean":"2024-09-11T23:04:48.599990+0000","last_became_active":"2024-09-11T23:04:45.290218+0000","last_became_peered":"2024-09-11T23:04:45.290218+0000","last_unstale":"2024-09-11T23:04:48.599990+0000","last_undegraded":"2024-09-11T23:04:48.599990+0000","last_fullsized":"2024-09-11T23:04:48.599990+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:17.935064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:48.602745+0000","last_change":"2024-09-11T23:04:46.299931+0000","last_active":"2024-09-11T23:04:48.602745+0000","last_peered":"2024-09-11T23:04:48.602745+0000","last_clean":"2024-09-11T23:04:48.602745+0000","last_became_active":"2024-09-11T23:04:46.299104+0000","last_became_peered":"2024-09-11T23:04:46.299104+0000","last_unstale":"2024-09-11T23:04:48.602745+0000","last_undegraded":"2024-09-11T23:04:48.602745+0000","last_fullsized":"2024-09-11T23:04:48.602745+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:26.287271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:48.603312+0000","last_change":"2024-09-11T23:04:45.293809+0000","last_active":"2024-09-11T23:04:48.603312+0000","last_peered":"2024-09-11T23:04:48.603312+0000","last_clean":"2024-09-11T23:04:48.603312+0000","last_became_active":"2024-09-11T23:04:45.293303+0000","last_became_peered":"2024-09-11T23:04:45.293303+0000","last_unstale":"2024-09-11T23:04:48.603312+0000","last_undegraded":"2024-09-11T23:04:48.603312+0000","last_fullsized":"2024-09-11T23:04:48.603312+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:34.183985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'119","reported_seq":263,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T23:04:47.282979+0000","last_change":"2024-09-11T23:03:26.382905+0000","last_active":"2024-09-11T23:04:47.282979+0000","last_peered":"2024-09-11T23:04:47.282979+0000","last_clean":"2024-09-11T23:04:47.282979+0000","last_became_active":"2024-09-11T23:03:26.380590+0000","last_became_peered":"2024-09-11T23:03:26.380590+0000","last_unstale":"2024-09-11T23:04:47.282979+0000","last_undegraded":"2024-09-11T23:04:47.282979+0000","last_fullsized":"2024-09-11T23:04:47.282979+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:24.361793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:24.361793+0000","last_clean_scrub_stamp":"2024-09-11T23:03:24.361793+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:46.577063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":298,"num_read_kb":503,"num_write":177,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":298,"num_read_kb":503,"num_write":177,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738388,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":348160,"data_stored":121900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738388,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":925696,"data_stored":710054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738388,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":937984,"data_stored":712282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:04:55.100 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T23:04:55.100 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-11T23:04:55.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.268+0000 7f3397823640 1 Processor -- start 2024-09-11T23:04:55.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.268+0000 7f3397823640 1 -- start start 2024-09-11T23:04:55.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.268+0000 7f3397823640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3390133610 0x7f33901339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:55.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.268+0000 7f3397823640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3390133200 con 0x7f339009f5a0 2024-09-11T23:04:55.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.268+0000 7f3397823640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f3390073a80 con 0x7f3390133610 2024-09-11T23:04:55.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.268+0000 7f33955bf640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3390133610 0x7f33901339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:55.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.268+0000 7f3394dbe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f339009f5a0 0x7f33901366e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42650/0 (socket says 172.21.15.12:42650) 2024-09-11T23:04:55.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.268+0000 7f33955bf640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3390133610 0x7f33901339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58152/0 (socket says 172.21.15.12:58152) 2024-09-11T23:04:55.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.268+0000 7f3394dbe640 1 -- 172.21.15.12:0/3513574147 learned_addr learned my addr 172.21.15.12:0/3513574147 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:04:55.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.268+0000 7f33955bf640 1 -- 172.21.15.12:0/3513574147 >> v1:172.21.15.12:6789/0 conn(0x7f339009f5a0 legacy=0x7f33901366e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:55.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.268+0000 7f33955bf640 1 -- 172.21.15.12:0/3513574147 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3390073170 con 0x7f3390133610 2024-09-11T23:04:55.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.268+0000 7f338ffff640 1 -- 172.21.15.12:0/3513574147 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 481468266 0 0) 0x7f3390133200 con 0x7f339009f5a0 2024-09-11T23:04:55.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.272+0000 7f33955bf640 1 --2- 172.21.15.12:0/3513574147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3390133610 0x7f33901339f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f337c009740 tx=0x7f337c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f4c51f61a023d1b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:55.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.272+0000 7f338ffff640 1 -- 172.21.15.12:0/3513574147 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f337c0b0070 con 0x7f3390133610 2024-09-11T23:04:55.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.272+0000 7f338ffff640 1 -- 172.21.15.12:0/3513574147 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f337c0ab530 con 0x7f3390133610 2024-09-11T23:04:55.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.272+0000 7f338ffff640 1 -- 172.21.15.12:0/3513574147 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f337c0ab830 con 0x7f3390133610 2024-09-11T23:04:55.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.272+0000 7f3397823640 1 -- 172.21.15.12:0/3513574147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3390133610 msgr2=0x7f33901339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:55.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.272+0000 7f3397823640 1 --2- 172.21.15.12:0/3513574147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3390133610 0x7f33901339f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f337c009740 tx=0x7f337c01c420 comp rx=0 tx=0).stop 2024-09-11T23:04:55.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.272+0000 7f3397823640 1 -- 172.21.15.12:0/3513574147 shutdown_connections 2024-09-11T23:04:55.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.272+0000 7f3397823640 1 --2- 172.21.15.12:0/3513574147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3390133610 0x7f33901339f0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:55.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.272+0000 7f3397823640 1 -- 172.21.15.12:0/3513574147 >> 172.21.15.12:0/3513574147 conn(0x7f339009a9d0 msgr2=0x7f339009cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:55.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.272+0000 7f3397823640 1 -- 172.21.15.12:0/3513574147 shutdown_connections 2024-09-11T23:04:55.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.272+0000 7f3397823640 1 -- 172.21.15.12:0/3513574147 wait complete. 2024-09-11T23:04:55.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.272+0000 7f3397823640 1 Processor -- start 2024-09-11T23:04:55.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.272+0000 7f3397823640 1 -- start start 2024-09-11T23:04:55.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.272+0000 7f3397823640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f339009f5a0 0x7f33900a1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:55.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.272+0000 7f3397823640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f339013ec00 con 0x7f339009f5a0 2024-09-11T23:04:55.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.272+0000 7f33955bf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f339009f5a0 0x7f33900a1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:55.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.272+0000 7f33955bf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f339009f5a0 0x7f33900a1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58158/0 (socket says 172.21.15.12:58158) 2024-09-11T23:04:55.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.272+0000 7f33955bf640 1 -- 172.21.15.12:0/141721491 learned_addr learned my addr 172.21.15.12:0/141721491 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:55.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.276+0000 7f33955bf640 1 -- 172.21.15.12:0/141721491 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33900a4d20 con 0x7f339009f5a0 2024-09-11T23:04:55.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.276+0000 7f33955bf640 1 --2- 172.21.15.12:0/141721491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f339009f5a0 0x7f33900a1850 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f337c01a050 tx=0x7f337c01ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:55.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.276+0000 7f338dffb640 1 -- 172.21.15.12:0/141721491 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f337c0b0050 con 0x7f339009f5a0 2024-09-11T23:04:55.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.276+0000 7f338dffb640 1 -- 172.21.15.12:0/141721491 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f337c0b1040 con 0x7f339009f5a0 2024-09-11T23:04:55.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.276+0000 7f3397823640 1 -- 172.21.15.12:0/141721491 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33900a5bc0 con 0x7f339009f5a0 2024-09-11T23:04:55.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.276+0000 7f338dffb640 1 -- 172.21.15.12:0/141721491 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f337c004150 con 0x7f339009f5a0 2024-09-11T23:04:55.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.276+0000 7f3397823640 1 -- 172.21.15.12:0/141721491 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33900a48f0 con 0x7f339009f5a0 2024-09-11T23:04:55.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.276+0000 7f338dffb640 1 -- 172.21.15.12:0/141721491 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 15) ==== 44155+0+0 (secure 0 0 0) 0x7f337c0be060 con 0x7f339009f5a0 2024-09-11T23:04:55.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.276+0000 7f338dffb640 1 --2- 172.21.15.12:0/141721491 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f3374035ed0 0x7f3374038390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:55.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.276+0000 7f338dffb640 1 -- 172.21.15.12:0/141721491 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 3439+0+0 (secure 0 0 0) 0x7f337c0e2340 con 0x7f339009f5a0 2024-09-11T23:04:55.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.276+0000 7f3397823640 1 -- 172.21.15.12:0/141721491 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33900a3a30 con 0x7f339009f5a0 2024-09-11T23:04:55.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.276+0000 7f3394dbe640 1 --2- 172.21.15.12:0/141721491 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f3374035ed0 0x7f3374038390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:55.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.276+0000 7f3394dbe640 1 --2- 172.21.15.12:0/141721491 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f3374035ed0 0x7f3374038390 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3384000f90 tx=0x7f3384007ca0 comp rx=0 tx=0).ready entity=mgr.4452 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:55.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.280+0000 7f338dffb640 1 -- 172.21.15.12:0/141721491 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f337c016010 con 0x7f339009f5a0 2024-09-11T23:04:55.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.504+0000 7f3397823640 1 -- 172.21.15.12:0/141721491 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f339006be50 con 0x7f339009f5a0 2024-09-11T23:04:55.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.508+0000 7f338dffb640 1 -- 172.21.15.12:0/141721491 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v10) ==== 190+0+147 (secure 0 0 0) 0x7f337c0b63b0 con 0x7f339009f5a0 2024-09-11T23:04:55.511 INFO:teuthology.orchestra.run.smithi012.stdout:[client.0] 2024-09-11T23:04:55.511 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCgIeJmTz6nGhAAveLcJxI+RD0GsD9nnR2S/w== 2024-09-11T23:04:55.511 INFO:teuthology.orchestra.run.smithi012.stdout: caps mds = "allow" 2024-09-11T23:04:55.511 INFO:teuthology.orchestra.run.smithi012.stdout: caps mon = "allow r" 2024-09-11T23:04:55.511 INFO:teuthology.orchestra.run.smithi012.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-11T23:04:55.513 INFO:teuthology.orchestra.run.smithi012.stderr:updated caps for client.0 2024-09-11T23:04:55.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.512+0000 7f3397823640 1 -- 172.21.15.12:0/141721491 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f3374035ed0 msgr2=0x7f3374038390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:55.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.512+0000 7f3397823640 1 --2- 172.21.15.12:0/141721491 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f3374035ed0 0x7f3374038390 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3384000f90 tx=0x7f3384007ca0 comp rx=0 tx=0).stop 2024-09-11T23:04:55.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.512+0000 7f3397823640 1 -- 172.21.15.12:0/141721491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f339009f5a0 msgr2=0x7f33900a1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:55.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.512+0000 7f3397823640 1 --2- 172.21.15.12:0/141721491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f339009f5a0 0x7f33900a1850 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f337c01a050 tx=0x7f337c01ac60 comp rx=0 tx=0).stop 2024-09-11T23:04:55.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.512+0000 7f3397823640 1 -- 172.21.15.12:0/141721491 shutdown_connections 2024-09-11T23:04:55.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.512+0000 7f3397823640 1 --2- 172.21.15.12:0/141721491 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f3374035ed0 0x7f3374038390 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:55.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.512+0000 7f3397823640 1 --2- 172.21.15.12:0/141721491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f339009f5a0 0x7f33900a1850 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:55.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.512+0000 7f3397823640 1 -- 172.21.15.12:0/141721491 >> 172.21.15.12:0/141721491 conn(0x7f339009a9d0 msgr2=0x7f33901324f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:55.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.512+0000 7f3397823640 1 -- 172.21.15.12:0/141721491 shutdown_connections 2024-09-11T23:04:55.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.512+0000 7f3397823640 1 -- 172.21.15.12:0/141721491 wait complete. 2024-09-11T23:04:55.530 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:04:55.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.644+0000 7fadf81cb640 1 Processor -- start 2024-09-11T23:04:55.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.644+0000 7fadf81cb640 1 -- start start 2024-09-11T23:04:55.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.648+0000 7fadf81cb640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fadf013a410 0x7fadf00a6af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:55.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.648+0000 7fadf81cb640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadf00a82a0 con 0x7fadf00a4b80 2024-09-11T23:04:55.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.648+0000 7fadf81cb640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fadf00a3cb0 con 0x7fadf013a410 2024-09-11T23:04:55.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.648+0000 7fadf5f67640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fadf013a410 0x7fadf00a6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:55.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.648+0000 7fadf5766640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fadf00a4b80 0x7fadf00a7030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42664/0 (socket says 172.21.15.12:42664) 2024-09-11T23:04:55.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.648+0000 7fadf5766640 1 -- 172.21.15.12:0/4198158568 learned_addr learned my addr 172.21.15.12:0/4198158568 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:04:55.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.648+0000 7fadf5f67640 1 -- 172.21.15.12:0/4198158568 >> v1:172.21.15.12:6789/0 conn(0x7fadf00a4b80 legacy=0x7fadf00a7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:55.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.648+0000 7fadf5f67640 1 -- 172.21.15.12:0/4198158568 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadf0139fe0 con 0x7fadf013a410 2024-09-11T23:04:55.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.648+0000 7fadf4f65640 1 -- 172.21.15.12:0/4198158568 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 876456682 0 0) 0x7fadf00a82a0 con 0x7fadf00a4b80 2024-09-11T23:04:55.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.648+0000 7fadf5f67640 1 --2- 172.21.15.12:0/4198158568 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fadf013a410 0x7fadf00a6af0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fadec009740 tx=0x7fadec01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8b5589ef0c869bd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:55.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.648+0000 7fadf4f65640 1 -- 172.21.15.12:0/4198158568 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadec0b0070 con 0x7fadf013a410 2024-09-11T23:04:55.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.648+0000 7fadf4f65640 1 -- 172.21.15.12:0/4198158568 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadec0ab530 con 0x7fadf013a410 2024-09-11T23:04:55.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.648+0000 7fadf4f65640 1 -- 172.21.15.12:0/4198158568 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadec0ab830 con 0x7fadf013a410 2024-09-11T23:04:55.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.648+0000 7fadf81cb640 1 -- 172.21.15.12:0/4198158568 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fadf013a410 msgr2=0x7fadf00a6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:55.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.648+0000 7fadf81cb640 1 --2- 172.21.15.12:0/4198158568 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fadf013a410 0x7fadf00a6af0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fadec009740 tx=0x7fadec01c390 comp rx=0 tx=0).stop 2024-09-11T23:04:55.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.648+0000 7fadf81cb640 1 -- 172.21.15.12:0/4198158568 shutdown_connections 2024-09-11T23:04:55.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.648+0000 7fadf81cb640 1 --2- 172.21.15.12:0/4198158568 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fadf013a410 0x7fadf00a6af0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:55.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.648+0000 7fadf81cb640 1 -- 172.21.15.12:0/4198158568 >> 172.21.15.12:0/4198158568 conn(0x7fadf00ac2c0 msgr2=0x7fadf00ac6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:55.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.652+0000 7fadf81cb640 1 -- 172.21.15.12:0/4198158568 shutdown_connections 2024-09-11T23:04:55.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.652+0000 7fadf81cb640 1 -- 172.21.15.12:0/4198158568 wait complete. 2024-09-11T23:04:55.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.652+0000 7fadf81cb640 1 Processor -- start 2024-09-11T23:04:55.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.652+0000 7fadf81cb640 1 -- start start 2024-09-11T23:04:55.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.652+0000 7fadf81cb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fadf00a4b80 0x7fadf009b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:55.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.652+0000 7fadf81cb640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fadf00a7740 con 0x7fadf00a4b80 2024-09-11T23:04:55.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.652+0000 7fadf5f67640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fadf00a4b80 0x7fadf009b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:55.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.652+0000 7fadf5f67640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fadf00a4b80 0x7fadf009b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58178/0 (socket says 172.21.15.12:58178) 2024-09-11T23:04:55.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.652+0000 7fadf5f67640 1 -- 172.21.15.12:0/665277883 learned_addr learned my addr 172.21.15.12:0/665277883 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:55.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.652+0000 7fadf5f67640 1 -- 172.21.15.12:0/665277883 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadf013eef0 con 0x7fadf00a4b80 2024-09-11T23:04:55.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.652+0000 7fadf5f67640 1 --2- 172.21.15.12:0/665277883 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fadf00a4b80 0x7fadf009b1d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fadec0ae040 tx=0x7fadec01abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:55.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.652+0000 7fade67fc640 1 -- 172.21.15.12:0/665277883 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadec0b0050 con 0x7fadf00a4b80 2024-09-11T23:04:55.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.652+0000 7fade67fc640 1 -- 172.21.15.12:0/665277883 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadec0b1040 con 0x7fadf00a4b80 2024-09-11T23:04:55.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.652+0000 7fadf81cb640 1 -- 172.21.15.12:0/665277883 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadf01ce500 con 0x7fadf00a4b80 2024-09-11T23:04:55.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.652+0000 7fade67fc640 1 -- 172.21.15.12:0/665277883 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadec0b5780 con 0x7fadf00a4b80 2024-09-11T23:04:55.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.652+0000 7fadf81cb640 1 -- 172.21.15.12:0/665277883 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadf009d110 con 0x7fadf00a4b80 2024-09-11T23:04:55.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.652+0000 7fade67fc640 1 -- 172.21.15.12:0/665277883 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 15) ==== 44155+0+0 (secure 0 0 0) 0x7fadec0be030 con 0x7fadf00a4b80 2024-09-11T23:04:55.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.652+0000 7fadf81cb640 1 -- 172.21.15.12:0/665277883 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadf00a6af0 con 0x7fadf00a4b80 2024-09-11T23:04:55.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.652+0000 7fade67fc640 1 --2- 172.21.15.12:0/665277883 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fadd4035ed0 0x7fadd4038390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:55.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.652+0000 7fade67fc640 1 -- 172.21.15.12:0/665277883 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 3439+0+0 (secure 0 0 0) 0x7fadec0bc070 con 0x7fadf00a4b80 2024-09-11T23:04:55.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.652+0000 7fadf5766640 1 --2- 172.21.15.12:0/665277883 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fadd4035ed0 0x7fadd4038390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:55.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.652+0000 7fadf5766640 1 --2- 172.21.15.12:0/665277883 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fadd4035ed0 0x7fadd4038390 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fade0007fd0 tx=0x7fade0007920 comp rx=0 tx=0).ready entity=mgr.4452 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:55.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.656+0000 7fade67fc640 1 -- 172.21.15.12:0/665277883 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fadec0c5060 con 0x7fadf00a4b80 2024-09-11T23:04:55.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.852+0000 7fadf81cb640 1 -- 172.21.15.12:0/665277883 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fadf00a2e90 con 0x7fadf00a4b80 2024-09-11T23:04:55.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.852+0000 7fade67fc640 1 -- 172.21.15.12:0/665277883 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+3573 (secure 0 0 0) 0x7fadec016010 con 0x7fadf00a4b80 2024-09-11T23:04:55.857 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:04:55.857 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":25,"btime":"2024-09-11T23:04:49:285627+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4527,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6827/1887547537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":1887547537},{"type":"v1","addr":"172.21.15.12:6827","nonce":1887547537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:04:45.641763+0000","modified":"2024-09-11T23:04:48.653841+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4528},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4528":{"gid":4528,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6829/2765393463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":2765393463},{"type":"v1","addr":"172.21.15.12:6829","nonce":2765393463}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4528,"qdb_cluster":[4528]},"id":3}]} 2024-09-11T23:04:55.859 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 25 2024-09-11T23:04:55.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.856+0000 7fadf81cb640 1 -- 172.21.15.12:0/665277883 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fadd4035ed0 msgr2=0x7fadd4038390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:55.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.856+0000 7fadf81cb640 1 --2- 172.21.15.12:0/665277883 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fadd4035ed0 0x7fadd4038390 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fade0007fd0 tx=0x7fade0007920 comp rx=0 tx=0).stop 2024-09-11T23:04:55.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.856+0000 7fadf81cb640 1 -- 172.21.15.12:0/665277883 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fadf00a4b80 msgr2=0x7fadf009b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:55.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.856+0000 7fadf81cb640 1 --2- 172.21.15.12:0/665277883 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fadf00a4b80 0x7fadf009b1d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fadec0ae040 tx=0x7fadec01abd0 comp rx=0 tx=0).stop 2024-09-11T23:04:55.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.856+0000 7fadf81cb640 1 -- 172.21.15.12:0/665277883 shutdown_connections 2024-09-11T23:04:55.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.856+0000 7fadf81cb640 1 --2- 172.21.15.12:0/665277883 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fadd4035ed0 0x7fadd4038390 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:55.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.856+0000 7fadf81cb640 1 --2- 172.21.15.12:0/665277883 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fadf00a4b80 0x7fadf009b1d0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:55.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.856+0000 7fadf81cb640 1 -- 172.21.15.12:0/665277883 >> 172.21.15.12:0/665277883 conn(0x7fadf00ac2c0 msgr2=0x7fadf013f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:55.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.856+0000 7fadf81cb640 1 -- 172.21.15.12:0/665277883 shutdown_connections 2024-09-11T23:04:55.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:55.856+0000 7fadf81cb640 1 -- 172.21.15.12:0/665277883 wait complete. 2024-09-11T23:04:56.074 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T23:04:45.641763+0000', 'modified': '2024-09-11T23:04:48.653841+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4528}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4528': {'gid': 4528, 'name': 'b', 'rank': 0, 'incarnation': 21, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.12:6829/2765393463', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6828', 'nonce': 2765393463}, {'type': 'v1', 'addr': '172.21.15.12:6829', 'nonce': 2765393463}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4528, 'qdb_cluster': [4528]} 2024-09-11T23:04:56.075 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T23:04:56.075 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-11T23:04:56.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.204+0000 7f6d07c80640 1 Processor -- start 2024-09-11T23:04:56.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.204+0000 7f6d07c80640 1 -- start start 2024-09-11T23:04:56.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.204+0000 7f6d07c80640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6d001381c0 0x7f6d0013cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:56.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.204+0000 7f6d07c80640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d0009d690 con 0x7f6d00137de0 2024-09-11T23:04:56.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.204+0000 7f6d07c80640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f6d0009ea90 con 0x7f6d001381c0 2024-09-11T23:04:56.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.204+0000 7f6d05a1c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f6d00137de0 0x7f6d0009f190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42674/0 (socket says 172.21.15.12:42674) 2024-09-11T23:04:56.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.204+0000 7f6d05a1c640 1 -- 172.21.15.12:0/2322380617 learned_addr learned my addr 172.21.15.12:0/2322380617 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:04:56.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.204+0000 7f6d0521b640 1 --2- 172.21.15.12:0/2322380617 >> v2:172.21.15.12:3300/0 conn(0x7f6d001381c0 0x7f6d0013cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:56.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.204+0000 7f6d04a1a640 1 -- 172.21.15.12:0/2322380617 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3064561386 0 0) 0x7f6d0009d690 con 0x7f6d00137de0 2024-09-11T23:04:56.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.204+0000 7f6d04a1a640 1 -- 172.21.15.12:0/2322380617 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ce8003530 con 0x7f6d00137de0 2024-09-11T23:04:56.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.204+0000 7f6d0521b640 1 -- 172.21.15.12:0/2322380617 >> v1:172.21.15.12:6789/0 conn(0x7f6d00137de0 legacy=0x7f6d0009f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:56.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.204+0000 7f6d0521b640 1 -- 172.21.15.12:0/2322380617 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d0009cf00 con 0x7f6d001381c0 2024-09-11T23:04:56.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.208+0000 7f6d0521b640 1 --2- 172.21.15.12:0/2322380617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d001381c0 0x7f6d0013cbc0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4009d90 tx=0x7f6cf401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=650f0eee6affcab3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:56.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.208+0000 7f6d04a1a640 1 -- 172.21.15.12:0/2322380617 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cf40b2070 con 0x7f6d001381c0 2024-09-11T23:04:56.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.208+0000 7f6d04a1a640 1 -- 172.21.15.12:0/2322380617 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cf40a5760 con 0x7f6d001381c0 2024-09-11T23:04:56.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.208+0000 7f6d04a1a640 1 -- 172.21.15.12:0/2322380617 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cf40a5a60 con 0x7f6d001381c0 2024-09-11T23:04:56.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.208+0000 7f6d07c80640 1 -- 172.21.15.12:0/2322380617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d001381c0 msgr2=0x7f6d0013cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:56.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.208+0000 7f6d07c80640 1 --2- 172.21.15.12:0/2322380617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d001381c0 0x7f6d0013cbc0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4009d90 tx=0x7f6cf401c8e0 comp rx=0 tx=0).stop 2024-09-11T23:04:56.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.208+0000 7f6d07c80640 1 -- 172.21.15.12:0/2322380617 shutdown_connections 2024-09-11T23:04:56.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.208+0000 7f6d07c80640 1 --2- 172.21.15.12:0/2322380617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d001381c0 0x7f6d0013cbc0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:56.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.208+0000 7f6d07c80640 1 -- 172.21.15.12:0/2322380617 >> 172.21.15.12:0/2322380617 conn(0x7f6d000a82f0 msgr2=0x7f6d000a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:56.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.208+0000 7f6d07c80640 1 -- 172.21.15.12:0/2322380617 shutdown_connections 2024-09-11T23:04:56.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.208+0000 7f6d07c80640 1 -- 172.21.15.12:0/2322380617 wait complete. 2024-09-11T23:04:56.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.208+0000 7f6d07c80640 1 Processor -- start 2024-09-11T23:04:56.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.208+0000 7f6d07c80640 1 -- start start 2024-09-11T23:04:56.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.208+0000 7f6d07c80640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d00137de0 0x7f6d001cc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:56.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.208+0000 7f6d07c80640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6d00137860 con 0x7f6d00137de0 2024-09-11T23:04:56.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.208+0000 7f6d05a1c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d00137de0 0x7f6d001cc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:56.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.208+0000 7f6d05a1c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d00137de0 0x7f6d001cc3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58196/0 (socket says 172.21.15.12:58196) 2024-09-11T23:04:56.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.208+0000 7f6d05a1c640 1 -- 172.21.15.12:0/1743180856 learned_addr learned my addr 172.21.15.12:0/1743180856 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:56.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.208+0000 7f6d05a1c640 1 -- 172.21.15.12:0/1743180856 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d00073530 con 0x7f6d00137de0 2024-09-11T23:04:56.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.208+0000 7f6d05a1c640 1 --2- 172.21.15.12:0/1743180856 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d00137de0 0x7f6d001cc3b0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f6cf000c3a0 tx=0x7f6cf000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:56.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.212+0000 7f6cfe7fc640 1 -- 172.21.15.12:0/1743180856 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cf0017070 con 0x7f6d00137de0 2024-09-11T23:04:56.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.212+0000 7f6cfe7fc640 1 -- 172.21.15.12:0/1743180856 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cf0005c20 con 0x7f6d00137de0 2024-09-11T23:04:56.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.212+0000 7f6d07c80640 1 -- 172.21.15.12:0/1743180856 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d001cbf80 con 0x7f6d00137de0 2024-09-11T23:04:56.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.212+0000 7f6cfe7fc640 1 -- 172.21.15.12:0/1743180856 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cf00070d0 con 0x7f6d00137de0 2024-09-11T23:04:56.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.212+0000 7f6d07c80640 1 -- 172.21.15.12:0/1743180856 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d000722b0 con 0x7f6d00137de0 2024-09-11T23:04:56.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.212+0000 7f6cfe7fc640 1 -- 172.21.15.12:0/1743180856 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 15) ==== 44155+0+0 (secure 0 0 0) 0x7f6cf001a070 con 0x7f6d00137de0 2024-09-11T23:04:56.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.212+0000 7f6cfe7fc640 1 --2- 172.21.15.12:0/1743180856 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f6cec035ed0 0x7f6cec038390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:56.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.212+0000 7f6cfe7fc640 1 -- 172.21.15.12:0/1743180856 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 3439+0+0 (secure 0 0 0) 0x7f6cf0047b40 con 0x7f6d00137de0 2024-09-11T23:04:56.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.212+0000 7f6d0521b640 1 --2- 172.21.15.12:0/1743180856 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f6cec035ed0 0x7f6cec038390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:56.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.212+0000 7f6d0521b640 1 --2- 172.21.15.12:0/1743180856 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f6cec035ed0 0x7f6cec038390 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6cf40af000 tx=0x7f6cf40a7070 comp rx=0 tx=0).ready entity=mgr.4452 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:56.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.212+0000 7f6d0ad3c000 1 Processor -- start 2024-09-11T23:04:56.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.212+0000 7f6d0ad3c000 1 -- start start 2024-09-11T23:04:56.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.212+0000 7f6d0ad3c000 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562900af3d30 0x562900afcb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:56.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.212+0000 7f6d0ad3c000 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5629009deb60 con 0x562900af3d30 2024-09-11T23:04:56.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.212+0000 7f6d05a1c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562900af3d30 0x562900afcb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:56.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.212+0000 7f6d05a1c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562900af3d30 0x562900afcb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58202/0 (socket says 172.21.15.12:58202) 2024-09-11T23:04:56.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.212+0000 7f6d05a1c640 1 -- 172.21.15.12:0/1899147757 learned_addr learned my addr 172.21.15.12:0/1899147757 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:56.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.212+0000 7f6d05a1c640 1 -- 172.21.15.12:0/1899147757 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629008fde50 con 0x562900af3d30 2024-09-11T23:04:56.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.212+0000 7f6d05a1c640 1 --2- 172.21.15.12:0/1899147757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562900af3d30 0x562900afcb40 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f6cf00468a0 tx=0x7f6cf0010f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71a316adcdc1551b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:56.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.212+0000 7f6ce77fe640 1 -- 172.21.15.12:0/1899147757 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cf0038390 con 0x562900af3d30 2024-09-11T23:04:56.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.216+0000 7f6ce77fe640 1 -- 172.21.15.12:0/1899147757 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cf001b3b0 con 0x562900af3d30 2024-09-11T23:04:56.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.216+0000 7f6ce77fe640 1 -- 172.21.15.12:0/1899147757 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cf0045250 con 0x562900af3d30 2024-09-11T23:04:56.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.216+0000 7f6d0ad3c000 1 -- 172.21.15.12:0/1899147757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562900af3d30 msgr2=0x562900afcb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:56.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.216+0000 7f6d0ad3c000 1 --2- 172.21.15.12:0/1899147757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562900af3d30 0x562900afcb40 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f6cf00468a0 tx=0x7f6cf0010f90 comp rx=0 tx=0).stop 2024-09-11T23:04:56.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.216+0000 7f6d0ad3c000 1 -- 172.21.15.12:0/1899147757 shutdown_connections 2024-09-11T23:04:56.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.216+0000 7f6d0ad3c000 1 --2- 172.21.15.12:0/1899147757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562900af3d30 0x562900afcb40 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:56.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.216+0000 7f6d0ad3c000 1 -- 172.21.15.12:0/1899147757 >> 172.21.15.12:0/1899147757 conn(0x562900aee680 msgr2=0x562900af3620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:56.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.216+0000 7f6d0ad3c000 1 -- 172.21.15.12:0/1899147757 shutdown_connections 2024-09-11T23:04:56.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.216+0000 7f6d0ad3c000 1 -- 172.21.15.12:0/1899147757 wait complete. 2024-09-11T23:04:56.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.216+0000 7f6d0ad3c000 1 -- start start 2024-09-11T23:04:56.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.216+0000 7f6d0ad3c000 1 Processor -- start 2024-09-11T23:04:56.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.216+0000 7f6d0ad3c000 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562900af3d30 0x562900afc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:56.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.216+0000 7f6d0ad3c000 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5629008ebed0 con 0x562900af3d30 2024-09-11T23:04:56.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.216+0000 7f6d0ad3c000 10 client.0 _ll_register_callbacks cb 0x562900ae2820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:04:56.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.216+0000 7f6d05a1c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562900af3d30 0x562900afc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:56.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.216+0000 7f6d05a1c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562900af3d30 0x562900afc5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58204/0 (socket says 172.21.15.12:58204) 2024-09-11T23:04:56.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.216+0000 7f6d05a1c640 1 -- 172.21.15.12:0/1410892281 learned_addr learned my addr 172.21.15.12:0/1410892281 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:56.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.216+0000 7f6d05a1c640 1 -- 172.21.15.12:0/1410892281 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629008ec120 con 0x562900af3d30 2024-09-11T23:04:56.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.216+0000 7f6d05a1c640 1 --2- 172.21.15.12:0/1410892281 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562900af3d30 0x562900afc5a0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0010d90 tx=0x7f6cf001bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfa4217ca2981b06 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:56.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.216+0000 7f6ce4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-11T23:04:56.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.216+0000 7f6ce4ff9640 1 -- 172.21.15.12:0/1410892281 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cf00199b0 con 0x562900af3d30 2024-09-11T23:04:56.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.216+0000 7f6ce4ff9640 1 -- 172.21.15.12:0/1410892281 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(36..36 src has 1..36) ==== 3439+0+0 (secure 0 0 0) 0x7f6cf0029060 con 0x562900af3d30 2024-09-11T23:04:56.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.216+0000 7f6d0ad3c000 1 -- 172.21.15.12:0/1410892281 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6cf001b3b0 con 0x562900af3d30 2024-09-11T23:04:56.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.216+0000 7f6ce4ff9640 1 -- 172.21.15.12:0/1410892281 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6cf0038390 con 0x562900af3d30 2024-09-11T23:04:56.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.216+0000 7f6d0ad3c000 10 client.4592 fetch_fsmap learned FSMap version 25 2024-09-11T23:04:56.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.216+0000 7f6d0ad3c000 1 -- 172.21.15.12:0/1410892281 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x5629008e5450 con 0x562900af3d30 2024-09-11T23:04:56.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.216+0000 7f6ce4ff9640 1 -- 172.21.15.12:0/1410892281 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cf001b3b0 con 0x562900af3d30 2024-09-11T23:04:56.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.216+0000 7f6ce4ff9640 1 -- 172.21.15.12:0/1410892281 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 25) ==== 2292+0+0 (secure 0 0 0) 0x7f6cf0035ce0 con 0x562900af3d30 2024-09-11T23:04:56.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.216+0000 7f6d0ad3c000 10 client.4592 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T23:04:56.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.216+0000 7f6d0ad3c000 10 client.4592 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T23:04:56.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.216+0000 7f6d0ad3c000 20 client.4592 populate_metadata read hostname 'smithi012' 2024-09-11T23:04:56.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.216+0000 7f6d0ad3c000 1 --2- 172.21.15.12:0/1410892281 >> [v2:172.21.15.12:6828/2765393463,v1:172.21.15.12:6829/2765393463] conn(0x562900b21920 0x562900b1fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:56.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.216+0000 7f6d0ad3c000 4 client.4592 mds_command: new command op to 4528 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:04:56.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.216+0000 7f6d0ad3c000 1 -- 172.21.15.12:0/1410892281 --> [v2:172.21.15.12:6828/2765393463,v1:172.21.15.12:6829/2765393463] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5629008dfc00 con 0x562900b21920 2024-09-11T23:04:56.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.216+0000 7f6d0521b640 1 --2- 172.21.15.12:0/1410892281 >> [v2:172.21.15.12:6828/2765393463,v1:172.21.15.12:6829/2765393463] conn(0x562900b21920 0x562900b1fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:56.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.216+0000 7f6d0521b640 1 --2- 172.21.15.12:0/1410892281 >> [v2:172.21.15.12:6828/2765393463,v1:172.21.15.12:6829/2765393463] conn(0x562900b21920 0x562900b1fed0 crc :-1 s=READY pgs=6 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2150f0ac0cbbe0a server_cookie=56d44587b92e97 in_seq=0 out_seq=0 2024-09-11T23:04:56.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.216+0000 7f6ce4ff9640 10 client.4592 ms_handle_connect on v2:172.21.15.12:6828/2765393463 2024-09-11T23:04:56.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.220+0000 7f6ce4ff9640 1 -- 172.21.15.12:0/1410892281 <== mds.0 v2:172.21.15.12:6828/2765393463 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5629008dfc00 con 0x562900b21920 2024-09-11T23:04:56.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.220+0000 7f6ce4ff9640 10 client.4592 handle_command_reply: tid=0 2024-09-11T23:04:56.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.220+0000 7f6d0ad3c000 1 client.4592 shutdown 2024-09-11T23:04:56.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.220+0000 7f6d0ad3c000 1 -- 172.21.15.12:0/1410892281 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562900af3d30 msgr2=0x562900afc5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:56.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.220+0000 7f6d0ad3c000 1 --2- 172.21.15.12:0/1410892281 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562900af3d30 0x562900afc5a0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0010d90 tx=0x7f6cf001bf50 comp rx=0 tx=0).stop 2024-09-11T23:04:56.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.220+0000 7f6d0ad3c000 1 -- 172.21.15.12:0/1410892281 shutdown_connections 2024-09-11T23:04:56.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.220+0000 7f6d0ad3c000 1 --2- 172.21.15.12:0/1410892281 >> [v2:172.21.15.12:6828/2765393463,v1:172.21.15.12:6829/2765393463] conn(0x562900b21920 0x562900b1fed0 crc :-1 s=READY pgs=6 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:56.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.220+0000 7f6d0ad3c000 1 --2- 172.21.15.12:0/1410892281 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562900af3d30 0x562900afc5a0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:56.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.220+0000 7f6ce4ff9640 0 client.4592 ms_handle_reset on v2:172.21.15.12:6828/2765393463 2024-09-11T23:04:56.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.220+0000 7f6d0ad3c000 1 -- 172.21.15.12:0/1410892281 >> 172.21.15.12:0/1410892281 conn(0x562900aee680 msgr2=0x562900af3620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:56.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.220+0000 7f6d0ad3c000 1 -- 172.21.15.12:0/1410892281 shutdown_connections 2024-09-11T23:04:56.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.220+0000 7f6d0ad3c000 1 -- 172.21.15.12:0/1410892281 wait complete. 2024-09-11T23:04:56.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.220+0000 7f6d0ad3c000 20 client.4592 trim_cache size 0 max 16384 2024-09-11T23:04:56.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.236+0000 7f6d0ad3c000 1 Processor -- start 2024-09-11T23:04:56.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.236+0000 7f6d0ad3c000 1 -- start start 2024-09-11T23:04:56.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.236+0000 7f6d0ad3c000 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562900af3d30 0x562900afc220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:56.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.236+0000 7f6d0ad3c000 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6d000a1600 con 0x562900af3d30 2024-09-11T23:04:56.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.236+0000 7f6d05a1c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562900af3d30 0x562900afc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:56.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.236+0000 7f6d05a1c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562900af3d30 0x562900afc220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58206/0 (socket says 172.21.15.12:58206) 2024-09-11T23:04:56.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.236+0000 7f6d05a1c640 1 -- 172.21.15.12:0/1695360498 learned_addr learned my addr 172.21.15.12:0/1695360498 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:56.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.236+0000 7f6d05a1c640 1 -- 172.21.15.12:0/1695360498 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629008ccfd0 con 0x562900af3d30 2024-09-11T23:04:56.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.240+0000 7f6d05a1c640 1 --2- 172.21.15.12:0/1695360498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562900af3d30 0x562900afc220 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0010fd0 tx=0x7f6cf0022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c7b49d8726ed99a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:56.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.240+0000 7f6ce6ffd640 1 -- 172.21.15.12:0/1695360498 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cf0011a70 con 0x562900af3d30 2024-09-11T23:04:56.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.240+0000 7f6ce6ffd640 1 -- 172.21.15.12:0/1695360498 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cf001b3b0 con 0x562900af3d30 2024-09-11T23:04:56.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.240+0000 7f6ce6ffd640 1 -- 172.21.15.12:0/1695360498 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cf0007270 con 0x562900af3d30 2024-09-11T23:04:56.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.240+0000 7f6d0ad3c000 1 -- 172.21.15.12:0/1695360498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562900af3d30 msgr2=0x562900afc220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:56.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.240+0000 7f6d0ad3c000 1 --2- 172.21.15.12:0/1695360498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562900af3d30 0x562900afc220 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0010fd0 tx=0x7f6cf0022000 comp rx=0 tx=0).stop 2024-09-11T23:04:56.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.240+0000 7f6d0ad3c000 1 -- 172.21.15.12:0/1695360498 shutdown_connections 2024-09-11T23:04:56.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.240+0000 7f6d0ad3c000 1 --2- 172.21.15.12:0/1695360498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562900af3d30 0x562900afc220 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:56.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.240+0000 7f6d0ad3c000 1 -- 172.21.15.12:0/1695360498 >> 172.21.15.12:0/1695360498 conn(0x562900aee680 msgr2=0x562900afbb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:56.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.240+0000 7f6d0ad3c000 1 -- 172.21.15.12:0/1695360498 shutdown_connections 2024-09-11T23:04:56.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.240+0000 7f6d0ad3c000 1 -- 172.21.15.12:0/1695360498 wait complete. 2024-09-11T23:04:56.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.240+0000 7f6d0ad3c000 1 -- start start 2024-09-11T23:04:56.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.240+0000 7f6d0ad3c000 1 Processor -- start 2024-09-11T23:04:56.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.240+0000 7f6d0ad3c000 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562900af3d30 0x562900b2ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:56.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.240+0000 7f6d0ad3c000 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x562900945c70 con 0x562900af3d30 2024-09-11T23:04:56.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.240+0000 7f6d0ad3c000 10 client.0 _ll_register_callbacks cb 0x7f6cf0010b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:04:56.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.240+0000 7f6d05a1c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562900af3d30 0x562900b2ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:56.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.240+0000 7f6d05a1c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562900af3d30 0x562900b2ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58220/0 (socket says 172.21.15.12:58220) 2024-09-11T23:04:56.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.240+0000 7f6d05a1c640 1 -- 172.21.15.12:0/1609640950 learned_addr learned my addr 172.21.15.12:0/1609640950 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:56.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.240+0000 7f6d05a1c640 1 -- 172.21.15.12:0/1609640950 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629009c8750 con 0x562900af3d30 2024-09-11T23:04:56.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.240+0000 7f6d05a1c640 1 --2- 172.21.15.12:0/1609640950 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562900af3d30 0x562900b2ea00 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0010d90 tx=0x7f6cf0019880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=418f872765aae74 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:56.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.240+0000 7f6ce4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-11T23:04:56.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.240+0000 7f6ce4ff9640 1 -- 172.21.15.12:0/1609640950 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cf0011360 con 0x562900af3d30 2024-09-11T23:04:56.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.240+0000 7f6ce4ff9640 1 -- 172.21.15.12:0/1609640950 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(36..36 src has 1..36) ==== 3439+0+0 (secure 0 0 0) 0x7f6cf003e040 con 0x562900af3d30 2024-09-11T23:04:56.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.240+0000 7f6d0ad3c000 1 -- 172.21.15.12:0/1609640950 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6cf001b3b0 con 0x562900af3d30 2024-09-11T23:04:56.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.240+0000 7f6ce4ff9640 1 -- 172.21.15.12:0/1609640950 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6cf0011500 con 0x562900af3d30 2024-09-11T23:04:56.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.240+0000 7f6d0ad3c000 10 client.4594 fetch_fsmap learned FSMap version 25 2024-09-11T23:04:56.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.240+0000 7f6d0ad3c000 1 -- 172.21.15.12:0/1609640950 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x5629008d3a30 con 0x562900af3d30 2024-09-11T23:04:56.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.240+0000 7f6ce4ff9640 1 -- 172.21.15.12:0/1609640950 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cf001b3b0 con 0x562900af3d30 2024-09-11T23:04:56.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.240+0000 7f6ce4ff9640 1 -- 172.21.15.12:0/1609640950 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 25) ==== 2292+0+0 (secure 0 0 0) 0x7f6cf00116e0 con 0x562900af3d30 2024-09-11T23:04:56.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.240+0000 7f6d0ad3c000 10 client.4594 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T23:04:56.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.240+0000 7f6d0ad3c000 10 client.4594 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T23:04:56.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.240+0000 7f6d0ad3c000 20 client.4594 populate_metadata read hostname 'smithi012' 2024-09-11T23:04:56.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.240+0000 7f6d0ad3c000 1 --2- 172.21.15.12:0/1609640950 >> [v2:172.21.15.12:6828/2765393463,v1:172.21.15.12:6829/2765393463] conn(0x562900afaec0 0x562900b2ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:56.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.240+0000 7f6d0ad3c000 4 client.4594 mds_command: new command op to 4528 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:04:56.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.240+0000 7f6d0ad3c000 1 -- 172.21.15.12:0/1609640950 --> [v2:172.21.15.12:6828/2765393463,v1:172.21.15.12:6829/2765393463] -- command(tid 0: {"prefix": "status"}) -- 0x5629009533a0 con 0x562900afaec0 2024-09-11T23:04:56.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.240+0000 7f6d0521b640 1 --2- 172.21.15.12:0/1609640950 >> [v2:172.21.15.12:6828/2765393463,v1:172.21.15.12:6829/2765393463] conn(0x562900afaec0 0x562900b2ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:56.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.240+0000 7f6ce4ff9640 10 client.4594 ms_handle_connect on v2:172.21.15.12:6828/2765393463 2024-09-11T23:04:56.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.240+0000 7f6d0521b640 1 --2- 172.21.15.12:0/1609640950 >> [v2:172.21.15.12:6828/2765393463,v1:172.21.15.12:6829/2765393463] conn(0x562900afaec0 0x562900b2ef40 crc :-1 s=READY pgs=7 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4402d9891e27d98 server_cookie=5e849320299d9072 in_seq=0 out_seq=0 2024-09-11T23:04:56.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.240+0000 7f6ce4ff9640 1 -- 172.21.15.12:0/1609640950 <== mds.0 v2:172.21.15.12:6828/2765393463 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5629009533a0 con 0x562900afaec0 2024-09-11T23:04:56.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.240+0000 7f6ce4ff9640 10 client.4594 handle_command_reply: tid=0 2024-09-11T23:04:56.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.240+0000 7f6d0ad3c000 1 client.4594 shutdown 2024-09-11T23:04:56.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.244+0000 7f6d0ad3c000 1 -- 172.21.15.12:0/1609640950 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562900af3d30 msgr2=0x562900b2ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:56.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.244+0000 7f6d0ad3c000 1 --2- 172.21.15.12:0/1609640950 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562900af3d30 0x562900b2ea00 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0010d90 tx=0x7f6cf0019880 comp rx=0 tx=0).stop 2024-09-11T23:04:56.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.244+0000 7f6d0ad3c000 1 -- 172.21.15.12:0/1609640950 shutdown_connections 2024-09-11T23:04:56.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.244+0000 7f6d0ad3c000 1 --2- 172.21.15.12:0/1609640950 >> [v2:172.21.15.12:6828/2765393463,v1:172.21.15.12:6829/2765393463] conn(0x562900afaec0 0x562900b2ef40 crc :-1 s=READY pgs=7 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:56.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.244+0000 7f6d0ad3c000 1 --2- 172.21.15.12:0/1609640950 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562900af3d30 0x562900b2ea00 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:56.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.244+0000 7f6d0ad3c000 1 -- 172.21.15.12:0/1609640950 >> 172.21.15.12:0/1609640950 conn(0x562900aee680 msgr2=0x562900afc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:56.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.244+0000 7f6ce4ff9640 0 client.4594 ms_handle_reset on v2:172.21.15.12:6828/2765393463 2024-09-11T23:04:56.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.244+0000 7f6d0ad3c000 1 -- 172.21.15.12:0/1609640950 shutdown_connections 2024-09-11T23:04:56.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.244+0000 7f6d0ad3c000 1 -- 172.21.15.12:0/1609640950 wait complete. 2024-09-11T23:04:56.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.244+0000 7f6d0ad3c000 20 client.4594 trim_cache size 0 max 16384 2024-09-11T23:04:56.248 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T23:04:56.248 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "8be14356-3340-4500-91a2-4cbc6b511f65", 2024-09-11T23:04:56.248 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 0, 2024-09-11T23:04:56.248 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4528, 2024-09-11T23:04:56.248 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-09-11T23:04:56.248 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-09-11T23:04:56.248 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-09-11T23:04:56.248 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 9.9705873139999994, 2024-09-11T23:04:56.248 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 25, 2024-09-11T23:04:56.249 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 36, 2024-09-11T23:04:56.249 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 36, 2024-09-11T23:04:56.249 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 15.016974963999999 2024-09-11T23:04:56.249 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T23:04:56.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.244+0000 7f6d07c80640 1 -- 172.21.15.12:0/1743180856 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f6cec035ed0 msgr2=0x7f6cec038390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:56.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.244+0000 7f6d07c80640 1 --2- 172.21.15.12:0/1743180856 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f6cec035ed0 0x7f6cec038390 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6cf40af000 tx=0x7f6cf40a7070 comp rx=0 tx=0).stop 2024-09-11T23:04:56.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.244+0000 7f6d07c80640 1 -- 172.21.15.12:0/1743180856 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d00137de0 msgr2=0x7f6d001cc3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:56.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.244+0000 7f6d07c80640 1 --2- 172.21.15.12:0/1743180856 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d00137de0 0x7f6d001cc3b0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f6cf000c3a0 tx=0x7f6cf000c860 comp rx=0 tx=0).stop 2024-09-11T23:04:56.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.244+0000 7f6d07c80640 1 -- 172.21.15.12:0/1743180856 shutdown_connections 2024-09-11T23:04:56.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.244+0000 7f6d07c80640 1 --2- 172.21.15.12:0/1743180856 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f6cec035ed0 0x7f6cec038390 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:56.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.244+0000 7f6d07c80640 1 --2- 172.21.15.12:0/1743180856 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d00137de0 0x7f6d001cc3b0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:56.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.244+0000 7f6d07c80640 1 -- 172.21.15.12:0/1743180856 >> 172.21.15.12:0/1743180856 conn(0x7f6d000a82f0 msgr2=0x7f6d00135860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:56.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.244+0000 7f6d07c80640 1 -- 172.21.15.12:0/1743180856 shutdown_connections 2024-09-11T23:04:56.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.244+0000 7f6d07c80640 1 -- 172.21.15.12:0/1743180856 wait complete. 2024-09-11T23:04:56.261 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T23:04:56.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.368+0000 7f985b498640 1 Processor -- start 2024-09-11T23:04:56.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.368+0000 7f985b498640 1 -- start start 2024-09-11T23:04:56.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.372+0000 7f985b498640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9854136ca0 0x7f985409ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:56.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.372+0000 7f985b498640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98540a1ff0 con 0x7f9854137080 2024-09-11T23:04:56.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.372+0000 7f985b498640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f98540a12e0 con 0x7f9854136ca0 2024-09-11T23:04:56.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.372+0000 7f9859234640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9854136ca0 0x7f985409ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:56.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.372+0000 7f9858a33640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f9854137080 0x7f98540a36a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42678/0 (socket says 172.21.15.12:42678) 2024-09-11T23:04:56.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.372+0000 7f9858a33640 1 -- 172.21.15.12:0/3876449979 learned_addr learned my addr 172.21.15.12:0/3876449979 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:04:56.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.372+0000 7f9859234640 1 -- 172.21.15.12:0/3876449979 >> v1:172.21.15.12:6789/0 conn(0x7f9854137080 legacy=0x7f98540a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:56.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.372+0000 7f9859234640 1 -- 172.21.15.12:0/3876449979 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98540a0eb0 con 0x7f9854136ca0 2024-09-11T23:04:56.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.372+0000 7f984bfff640 1 -- 172.21.15.12:0/3876449979 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3635952937 0 0) 0x7f98540a1ff0 con 0x7f9854137080 2024-09-11T23:04:56.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.372+0000 7f9859234640 1 --2- 172.21.15.12:0/3876449979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9854136ca0 0x7f985409ad90 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f9850009740 tx=0x7f985001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b48d0fc9dfddb4c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:56.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.372+0000 7f984bfff640 1 -- 172.21.15.12:0/3876449979 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98500b0070 con 0x7f9854136ca0 2024-09-11T23:04:56.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.372+0000 7f984bfff640 1 -- 172.21.15.12:0/3876449979 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98500ab400 con 0x7f9854136ca0 2024-09-11T23:04:56.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.372+0000 7f984bfff640 1 -- 172.21.15.12:0/3876449979 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98500ab700 con 0x7f9854136ca0 2024-09-11T23:04:56.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.372+0000 7f985b498640 1 -- 172.21.15.12:0/3876449979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9854136ca0 msgr2=0x7f985409ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:56.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.372+0000 7f985b498640 1 --2- 172.21.15.12:0/3876449979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9854136ca0 0x7f985409ad90 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f9850009740 tx=0x7f985001c420 comp rx=0 tx=0).stop 2024-09-11T23:04:56.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.372+0000 7f985b498640 1 -- 172.21.15.12:0/3876449979 shutdown_connections 2024-09-11T23:04:56.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.372+0000 7f985b498640 1 --2- 172.21.15.12:0/3876449979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9854136ca0 0x7f985409ad90 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:56.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.372+0000 7f985b498640 1 -- 172.21.15.12:0/3876449979 >> 172.21.15.12:0/3876449979 conn(0x7f98540a8450 msgr2=0x7f98540a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:56.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.372+0000 7f985b498640 1 -- 172.21.15.12:0/3876449979 shutdown_connections 2024-09-11T23:04:56.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.372+0000 7f985b498640 1 -- 172.21.15.12:0/3876449979 wait complete. 2024-09-11T23:04:56.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.376+0000 7f985b498640 1 Processor -- start 2024-09-11T23:04:56.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.376+0000 7f985b498640 1 -- start start 2024-09-11T23:04:56.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.376+0000 7f985b498640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9854136ca0 0x7f985406f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:56.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.376+0000 7f985b498640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f985409f310 con 0x7f9854136ca0 2024-09-11T23:04:56.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.376+0000 7f9859234640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9854136ca0 0x7f985406f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:56.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.376+0000 7f9859234640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9854136ca0 0x7f985406f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58244/0 (socket says 172.21.15.12:58244) 2024-09-11T23:04:56.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.376+0000 7f9859234640 1 -- 172.21.15.12:0/141707147 learned_addr learned my addr 172.21.15.12:0/141707147 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:56.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.376+0000 7f9859234640 1 -- 172.21.15.12:0/141707147 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f985411e3f0 con 0x7f9854136ca0 2024-09-11T23:04:56.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.376+0000 7f9859234640 1 --2- 172.21.15.12:0/141707147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9854136ca0 0x7f985406f260 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f98500ae040 tx=0x7f985001ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:56.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.376+0000 7f9849ffb640 1 -- 172.21.15.12:0/141707147 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98500b0050 con 0x7f9854136ca0 2024-09-11T23:04:56.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.376+0000 7f9849ffb640 1 -- 172.21.15.12:0/141707147 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98500b1040 con 0x7f9854136ca0 2024-09-11T23:04:56.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.376+0000 7f985b498640 1 -- 172.21.15.12:0/141707147 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9854072cc0 con 0x7f9854136ca0 2024-09-11T23:04:56.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.376+0000 7f9849ffb640 1 -- 172.21.15.12:0/141707147 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98500b7580 con 0x7f9854136ca0 2024-09-11T23:04:56.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.376+0000 7f985b498640 1 -- 172.21.15.12:0/141707147 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9854070e10 con 0x7f9854136ca0 2024-09-11T23:04:56.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.376+0000 7f985b498640 1 -- 172.21.15.12:0/141707147 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98541359d0 con 0x7f9854136ca0 2024-09-11T23:04:56.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.376+0000 7f9849ffb640 1 -- 172.21.15.12:0/141707147 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 15) ==== 44155+0+0 (secure 0 0 0) 0x7f98500be030 con 0x7f9854136ca0 2024-09-11T23:04:56.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.376+0000 7f9849ffb640 1 --2- 172.21.15.12:0/141707147 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f9838035ed0 0x7f9838038390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:56.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.376+0000 7f9849ffb640 1 -- 172.21.15.12:0/141707147 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 3439+0+0 (secure 0 0 0) 0x7f98500bc070 con 0x7f9854136ca0 2024-09-11T23:04:56.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.376+0000 7f9858a33640 1 --2- 172.21.15.12:0/141707147 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f9838035ed0 0x7f9838038390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:56.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.376+0000 7f9858a33640 1 --2- 172.21.15.12:0/141707147 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f9838035ed0 0x7f9838038390 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9844007fd0 tx=0x7f9844007920 comp rx=0 tx=0).ready entity=mgr.4452 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:56.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.380+0000 7f9849ffb640 1 -- 172.21.15.12:0/141707147 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f98500c5060 con 0x7f9854136ca0 2024-09-11T23:04:56.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.580+0000 7f985b498640 1 -- 172.21.15.12:0/141707147 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f985409ad70 con 0x7f9854136ca0 2024-09-11T23:04:56.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.580+0000 7f9849ffb640 1 -- 172.21.15.12:0/141707147 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) ==== 53+0+73 (secure 0 0 0) 0x7f9850016010 con 0x7f9854136ca0 2024-09-11T23:04:56.584 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T23:04:56.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.584+0000 7f985b498640 1 -- 172.21.15.12:0/141707147 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f9838035ed0 msgr2=0x7f9838038390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:56.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.584+0000 7f985b498640 1 --2- 172.21.15.12:0/141707147 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f9838035ed0 0x7f9838038390 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9844007fd0 tx=0x7f9844007920 comp rx=0 tx=0).stop 2024-09-11T23:04:56.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.584+0000 7f985b498640 1 -- 172.21.15.12:0/141707147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9854136ca0 msgr2=0x7f985406f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:56.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.584+0000 7f985b498640 1 --2- 172.21.15.12:0/141707147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9854136ca0 0x7f985406f260 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f98500ae040 tx=0x7f985001ac60 comp rx=0 tx=0).stop 2024-09-11T23:04:56.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.584+0000 7f985b498640 1 -- 172.21.15.12:0/141707147 shutdown_connections 2024-09-11T23:04:56.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.584+0000 7f985b498640 1 --2- 172.21.15.12:0/141707147 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f9838035ed0 0x7f9838038390 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:56.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.584+0000 7f985b498640 1 --2- 172.21.15.12:0/141707147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9854136ca0 0x7f985406f260 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:56.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.584+0000 7f985b498640 1 -- 172.21.15.12:0/141707147 >> 172.21.15.12:0/141707147 conn(0x7f98540a8450 msgr2=0x7f985409e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:56.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.584+0000 7f985b498640 1 -- 172.21.15.12:0/141707147 shutdown_connections 2024-09-11T23:04:56.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56.584+0000 7f985b498640 1 -- 172.21.15.12:0/141707147 wait complete. 2024-09-11T23:04:56.602 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-11T23:04:56.602 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:04:56.603 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi012.front.sepia.ceph.com 2024-09-11T23:04:56.603 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T23:04:56.603 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T23:04:56.603 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-11T23:04:56.603 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T23:04:56.603 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:04:56.603 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:04:56.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:56.603 DEBUG:teuthology.orchestra.run.smithi012:> ip addr 2024-09-11T23:04:56.609 INFO:teuthology.orchestra.run.smithi012.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:04:56.609 INFO:teuthology.orchestra.run.smithi012.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:04:56.610 INFO:teuthology.orchestra.run.smithi012.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:04:56.610 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:04:56.610 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 ::1/128 scope host 2024-09-11T23:04:56.610 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:04:56.610 INFO:teuthology.orchestra.run.smithi012.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:04:56.610 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a4 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:04:56.610 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f0 2024-09-11T23:04:56.610 INFO:teuthology.orchestra.run.smithi012.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:04:56.610 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a5 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:04:56.610 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f1 2024-09-11T23:04:56.610 INFO:teuthology.orchestra.run.smithi012.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:04:56.611 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:ea brd ff:ff:ff:ff:ff:ff 2024-09-11T23:04:56.611 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f0 2024-09-11T23:04:56.611 INFO:teuthology.orchestra.run.smithi012.stdout: inet 172.21.15.12/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-11T23:04:56.611 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft 42444sec preferred_lft 42444sec 2024-09-11T23:04:56.611 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::ae1f:6bff:fef8:25ea/64 scope link 2024-09-11T23:04:56.611 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:04:56.611 INFO:teuthology.orchestra.run.smithi012.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:04:56.611 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:eb brd ff:ff:ff:ff:ff:ff 2024-09-11T23:04:56.611 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f1 2024-09-11T23:04:56.611 INFO:teuthology.orchestra.run.smithi012.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-11T23:04:56.611 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 02:42:d6:75:63:83 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:04:56.611 INFO:teuthology.orchestra.run.smithi012.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-11T23:04:56.611 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:04:56.612 INFO:teuthology.orchestra.run.smithi012.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:04:56.612 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-11T23:04:56.612 INFO:teuthology.orchestra.run.smithi012.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T23:04:56.612 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:04:56.612 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-11T23:04:56.612 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:04:56.612 INFO:teuthology.orchestra.run.smithi012.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:04:56.612 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:04:56.612 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-11T23:04:56.612 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:04:56.612 INFO:teuthology.orchestra.run.smithi012.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:04:56.612 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:04:56.613 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-11T23:04:56.613 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:04:56.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:56.613 DEBUG:teuthology.orchestra.run.smithi012:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:04:56.661 INFO:teuthology.orchestra.run.smithi012.stdout:1 2024-09-11T23:04:56.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:56.662 DEBUG:teuthology.orchestra.run.smithi012:> route 2024-09-11T23:04:56.711 INFO:teuthology.orchestra.run.smithi012.stdout:Kernel IP routing table 2024-09-11T23:04:56.711 INFO:teuthology.orchestra.run.smithi012.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:04:56.711 INFO:teuthology.orchestra.run.smithi012.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-11T23:04:56.711 INFO:teuthology.orchestra.run.smithi012.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-11T23:04:56.711 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-11T23:04:56.711 INFO:teuthology.orchestra.run.smithi012.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:04:56.712 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:04:56.712 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-09-11T23:04:56.712 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-11T23:04:56.712 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-11T23:04:56.712 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-11T23:04:56.712 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-09-11T23:04:56.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:04:56.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:04:56.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:56.838 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2024-09-11T23:04:56.844 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 1) 2024-09-11T23:04:56.844 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T23:04:56.844 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:04:56.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:56.845 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set brx.0 up 2024-09-11T23:04:56.904 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-11T23:04:56.904 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:04:56.904 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T23:04:56.953 INFO:teuthology.orchestra.run.smithi012.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:04:56.953 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:04:56.953 DEBUG:teuthology.orchestra.run.smithi012:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:04:57.000 DEBUG:teuthology.orchestra.run.smithi012:> sudo modprobe fuse 2024-09-11T23:04:57.058 DEBUG:teuthology.orchestra.run.smithi012:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:04:57.106 INFO:teuthology.orchestra.run.smithi012.stdout:/sys 2024-09-11T23:04:57.106 INFO:teuthology.orchestra.run.smithi012.stdout:/proc 2024-09-11T23:04:57.106 INFO:teuthology.orchestra.run.smithi012.stdout:/dev 2024-09-11T23:04:57.106 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/pts 2024-09-11T23:04:57.106 INFO:teuthology.orchestra.run.smithi012.stdout:/run 2024-09-11T23:04:57.106 INFO:teuthology.orchestra.run.smithi012.stdout:/ 2024-09-11T23:04:57.106 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/security 2024-09-11T23:04:57.106 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/shm 2024-09-11T23:04:57.106 INFO:teuthology.orchestra.run.smithi012.stdout:/run/lock 2024-09-11T23:04:57.107 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup 2024-09-11T23:04:57.107 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/pstore 2024-09-11T23:04:57.107 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/bpf 2024-09-11T23:04:57.107 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:04:57.107 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/hugepages 2024-09-11T23:04:57.107 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/mqueue 2024-09-11T23:04:57.107 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/debug 2024-09-11T23:04:57.107 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/tracing 2024-09-11T23:04:57.107 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/fs/nfsd 2024-09-11T23:04:57.107 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/fuse/connections 2024-09-11T23:04:57.107 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/config 2024-09-11T23:04:57.107 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:04:57.107 INFO:teuthology.orchestra.run.smithi012.stdout:/run/rpc_pipefs 2024-09-11T23:04:57.107 INFO:teuthology.orchestra.run.smithi012.stdout:/run/user/1000 2024-09-11T23:04:57.108 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph 2024-09-11T23:04:57.108 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:04:57.108 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:04:57.108 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:04:57.108 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns 2024-09-11T23:04:57.108 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:04:57.108 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:04:57.108 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:04:57.108 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:04:57.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:57.109 DEBUG:teuthology.orchestra.run.smithi012:> ls /sys/fs/fuse/connections 2024-09-11T23:04:57.157 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-11T23:04:57.157 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-11T23:04:57.201 DEBUG:teuthology.orchestra.run.smithi012:> sudo modprobe fuse 2024-09-11T23:04:57.217 DEBUG:teuthology.orchestra.run.smithi012:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:04:57.265 INFO:teuthology.orchestra.run.smithi012.stdout:/sys 2024-09-11T23:04:57.266 INFO:teuthology.orchestra.run.smithi012.stdout:/proc 2024-09-11T23:04:57.266 INFO:teuthology.orchestra.run.smithi012.stdout:/dev 2024-09-11T23:04:57.266 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/pts 2024-09-11T23:04:57.266 INFO:teuthology.orchestra.run.smithi012.stdout:/run 2024-09-11T23:04:57.266 INFO:teuthology.orchestra.run.smithi012.stdout:/ 2024-09-11T23:04:57.266 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/security 2024-09-11T23:04:57.266 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/shm 2024-09-11T23:04:57.266 INFO:teuthology.orchestra.run.smithi012.stdout:/run/lock 2024-09-11T23:04:57.266 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup 2024-09-11T23:04:57.266 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/pstore 2024-09-11T23:04:57.266 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/bpf 2024-09-11T23:04:57.266 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:04:57.267 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/hugepages 2024-09-11T23:04:57.267 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/mqueue 2024-09-11T23:04:57.267 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/debug 2024-09-11T23:04:57.267 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/tracing 2024-09-11T23:04:57.267 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/fs/nfsd 2024-09-11T23:04:57.267 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/fuse/connections 2024-09-11T23:04:57.267 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/config 2024-09-11T23:04:57.267 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:04:57.267 INFO:teuthology.orchestra.run.smithi012.stdout:/run/rpc_pipefs 2024-09-11T23:04:57.267 INFO:teuthology.orchestra.run.smithi012.stdout:/run/user/1000 2024-09-11T23:04:57.267 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph 2024-09-11T23:04:57.267 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:04:57.267 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:04:57.268 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:04:57.268 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns 2024-09-11T23:04:57.268 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:04:57.268 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:04:57.268 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:04:57.268 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:04:57.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:57.268 DEBUG:teuthology.orchestra.run.smithi012:> ls /sys/fs/fuse/connections 2024-09-11T23:04:57.280 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi012.stderr:2024-09-11T23:04:57.280+0000 7fd389388580 -1 init, newargv = 0x55905cc3e4b0 newargc=15 2024-09-11T23:04:57.280 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi012.stderr:ceph-fuse[36762]: starting ceph client 2024-09-11T23:04:57.285 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi012.stderr:ceph-fuse[36762]: starting fuse 2024-09-11T23:04:58.386 DEBUG:teuthology.orchestra.run.smithi012:> sudo modprobe fuse 2024-09-11T23:04:58.403 DEBUG:teuthology.orchestra.run.smithi012:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:04:58.451 INFO:teuthology.orchestra.run.smithi012.stdout:/sys 2024-09-11T23:04:58.451 INFO:teuthology.orchestra.run.smithi012.stdout:/proc 2024-09-11T23:04:58.451 INFO:teuthology.orchestra.run.smithi012.stdout:/dev 2024-09-11T23:04:58.451 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/pts 2024-09-11T23:04:58.451 INFO:teuthology.orchestra.run.smithi012.stdout:/run 2024-09-11T23:04:58.452 INFO:teuthology.orchestra.run.smithi012.stdout:/ 2024-09-11T23:04:58.452 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/security 2024-09-11T23:04:58.452 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/shm 2024-09-11T23:04:58.452 INFO:teuthology.orchestra.run.smithi012.stdout:/run/lock 2024-09-11T23:04:58.452 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup 2024-09-11T23:04:58.452 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/pstore 2024-09-11T23:04:58.452 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/bpf 2024-09-11T23:04:58.452 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:04:58.452 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/hugepages 2024-09-11T23:04:58.452 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/mqueue 2024-09-11T23:04:58.452 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/debug 2024-09-11T23:04:58.452 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/tracing 2024-09-11T23:04:58.452 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/fs/nfsd 2024-09-11T23:04:58.453 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/fuse/connections 2024-09-11T23:04:58.453 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/config 2024-09-11T23:04:58.453 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:04:58.453 INFO:teuthology.orchestra.run.smithi012.stdout:/run/rpc_pipefs 2024-09-11T23:04:58.453 INFO:teuthology.orchestra.run.smithi012.stdout:/run/user/1000 2024-09-11T23:04:58.453 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph 2024-09-11T23:04:58.453 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:04:58.453 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:04:58.453 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:04:58.453 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns 2024-09-11T23:04:58.453 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:04:58.453 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:04:58.453 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:04:58.454 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:04:58.454 INFO:teuthology.orchestra.run.smithi012.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-11T23:04:58.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:58.455 DEBUG:teuthology.orchestra.run.smithi012:> ls /sys/fs/fuse/connections 2024-09-11T23:04:58.501 INFO:teuthology.orchestra.run.smithi012.stdout:45 2024-09-11T23:04:58.501 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-11T23:04:58.502 DEBUG:teuthology.orchestra.run.smithi012:> sudo stdin-killer -- python3 -c ' 2024-09-11T23:04:58.502 DEBUG:teuthology.orchestra.run.smithi012:> import glob 2024-09-11T23:04:58.502 DEBUG:teuthology.orchestra.run.smithi012:> import re 2024-09-11T23:04:58.502 DEBUG:teuthology.orchestra.run.smithi012:> import os 2024-09-11T23:04:58.502 DEBUG:teuthology.orchestra.run.smithi012:> import subprocess 2024-09-11T23:04:58.502 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:04:58.502 DEBUG:teuthology.orchestra.run.smithi012:> def _find_admin_socket(client_name): 2024-09-11T23:04:58.502 DEBUG:teuthology.orchestra.run.smithi012:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-11T23:04:58.502 DEBUG:teuthology.orchestra.run.smithi012:> files = glob.glob(asok_path) 2024-09-11T23:04:58.502 DEBUG:teuthology.orchestra.run.smithi012:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-11T23:04:58.502 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:04:58.502 DEBUG:teuthology.orchestra.run.smithi012:> # Given a non-glob path, it better be there 2024-09-11T23:04:58.503 DEBUG:teuthology.orchestra.run.smithi012:> if "*" not in asok_path: 2024-09-11T23:04:58.503 DEBUG:teuthology.orchestra.run.smithi012:> assert(len(files) == 1) 2024-09-11T23:04:58.503 DEBUG:teuthology.orchestra.run.smithi012:> return files[0] 2024-09-11T23:04:58.503 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:04:58.503 DEBUG:teuthology.orchestra.run.smithi012:> for f in files: 2024-09-11T23:04:58.503 DEBUG:teuthology.orchestra.run.smithi012:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T23:04:58.503 DEBUG:teuthology.orchestra.run.smithi012:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T23:04:58.503 DEBUG:teuthology.orchestra.run.smithi012:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T23:04:58.503 DEBUG:teuthology.orchestra.run.smithi012:> contents = proc_f.read() 2024-09-11T23:04:58.503 DEBUG:teuthology.orchestra.run.smithi012:> if mountpoint in contents: 2024-09-11T23:04:58.503 DEBUG:teuthology.orchestra.run.smithi012:> return f 2024-09-11T23:04:58.503 DEBUG:teuthology.orchestra.run.smithi012:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T23:04:58.503 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:04:58.503 DEBUG:teuthology.orchestra.run.smithi012:> print(_find_admin_socket("client.0")) 2024-09-11T23:04:58.503 DEBUG:teuthology.orchestra.run.smithi012:> ' 2024-09-11T23:04:58.628 INFO:teuthology.orchestra.run.smithi012.stdout:/var/run/ceph/ceph-client.0.36762.asok 2024-09-11T23:04:58.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:04:58.641 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.36762.asok 2024-09-11T23:04:58.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:58.641 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.36762.asok status 2024-09-11T23:04:58.798 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T23:04:58.799 INFO:teuthology.orchestra.run.smithi012.stdout: "metadata": { 2024-09-11T23:04:58.799 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-11T23:04:58.799 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T23:04:58.799 INFO:teuthology.orchestra.run.smithi012.stdout: "entity_id": "0", 2024-09-11T23:04:58.799 INFO:teuthology.orchestra.run.smithi012.stdout: "hostname": "smithi012", 2024-09-11T23:04:58.799 INFO:teuthology.orchestra.run.smithi012.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-11T23:04:58.799 INFO:teuthology.orchestra.run.smithi012.stdout: "pid": "36762", 2024-09-11T23:04:58.799 INFO:teuthology.orchestra.run.smithi012.stdout: "root": "/" 2024-09-11T23:04:58.799 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:58.799 INFO:teuthology.orchestra.run.smithi012.stdout: "dentry_count": 0, 2024-09-11T23:04:58.799 INFO:teuthology.orchestra.run.smithi012.stdout: "dentry_pinned_count": 0, 2024-09-11T23:04:58.800 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4600, 2024-09-11T23:04:58.800 INFO:teuthology.orchestra.run.smithi012.stdout: "inst": { 2024-09-11T23:04:58.800 INFO:teuthology.orchestra.run.smithi012.stdout: "name": { 2024-09-11T23:04:58.800 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "client", 2024-09-11T23:04:58.800 INFO:teuthology.orchestra.run.smithi012.stdout: "num": 4600 2024-09-11T23:04:58.800 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:58.800 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": { 2024-09-11T23:04:58.800 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T23:04:58.800 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "192.168.0.1:0", 2024-09-11T23:04:58.800 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2848936842 2024-09-11T23:04:58.800 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:04:58.800 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:58.800 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": { 2024-09-11T23:04:58.801 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T23:04:58.801 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "192.168.0.1:0", 2024-09-11T23:04:58.801 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2848936842 2024-09-11T23:04:58.801 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:04:58.801 INFO:teuthology.orchestra.run.smithi012.stdout: "inst_str": "client.4600 192.168.0.1:0/2848936842", 2024-09-11T23:04:58.801 INFO:teuthology.orchestra.run.smithi012.stdout: "addr_str": "192.168.0.1:0/2848936842", 2024-09-11T23:04:58.801 INFO:teuthology.orchestra.run.smithi012.stdout: "inode_count": 1, 2024-09-11T23:04:58.801 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_epoch": 25, 2024-09-11T23:04:58.801 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_epoch": 36, 2024-09-11T23:04:58.801 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_epoch_barrier": 0, 2024-09-11T23:04:58.801 INFO:teuthology.orchestra.run.smithi012.stdout: "blocklisted": false, 2024-09-11T23:04:58.801 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs" 2024-09-11T23:04:58.801 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T23:04:58.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:58.813 DEBUG:teuthology.orchestra.run.smithi012:> stat --file-system '--printf=%T 2024-09-11T23:04:58.813 DEBUG:teuthology.orchestra.run.smithi012:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-11T23:04:58.819 INFO:teuthology.orchestra.run.smithi012.stdout:fuseblk 2024-09-11T23:04:58.819 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-11T23:04:58.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:58.819 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:04:58.874 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T23:04:59.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.048+0000 7f4293828640 1 Processor -- start 2024-09-11T23:04:59.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.052+0000 7f4293828640 1 -- start start 2024-09-11T23:04:59.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.052+0000 7f4293828640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f428c13e3d0 0x7f428c13e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:59.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.052+0000 7f4293828640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f428c0a5090 con 0x7f428c13ecf0 2024-09-11T23:04:59.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.052+0000 7f4293828640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f428c0a35f0 con 0x7f428c13e3d0 2024-09-11T23:04:59.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.052+0000 7f42915c4640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f428c13e3d0 0x7f428c13e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:59.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.052+0000 7f4290dc3640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f428c13ecf0 0x7f428c0a6af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42690/0 (socket says 172.21.15.12:42690) 2024-09-11T23:04:59.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.052+0000 7f4290dc3640 1 -- 172.21.15.12:0/1038573262 learned_addr learned my addr 172.21.15.12:0/1038573262 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:04:59.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.052+0000 7f42915c4640 1 -- 172.21.15.12:0/1038573262 >> v1:172.21.15.12:6789/0 conn(0x7f428c13ecf0 legacy=0x7f428c0a6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:59.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.052+0000 7f428bfff640 1 -- 172.21.15.12:0/1038573262 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2889719632 0 0) 0x7f428c0a5090 con 0x7f428c13ecf0 2024-09-11T23:04:59.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.052+0000 7f42915c4640 1 -- 172.21.15.12:0/1038573262 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f428c06e4f0 con 0x7f428c13e3d0 2024-09-11T23:04:59.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.052+0000 7f42915c4640 1 --2- 172.21.15.12:0/1038573262 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f428c13e3d0 0x7f428c13e7b0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4284009740 tx=0x7f428401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abfa6762594c0792 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:59.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.052+0000 7f428bfff640 1 -- 172.21.15.12:0/1038573262 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42840b0070 con 0x7f428c13e3d0 2024-09-11T23:04:59.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.052+0000 7f428bfff640 1 -- 172.21.15.12:0/1038573262 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42840ab530 con 0x7f428c13e3d0 2024-09-11T23:04:59.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.052+0000 7f428bfff640 1 -- 172.21.15.12:0/1038573262 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42840ab830 con 0x7f428c13e3d0 2024-09-11T23:04:59.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.056+0000 7f4293828640 1 -- 172.21.15.12:0/1038573262 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f428c13e3d0 msgr2=0x7f428c13e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:59.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.056+0000 7f4293828640 1 --2- 172.21.15.12:0/1038573262 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f428c13e3d0 0x7f428c13e7b0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4284009740 tx=0x7f428401c390 comp rx=0 tx=0).stop 2024-09-11T23:04:59.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.056+0000 7f4293828640 1 -- 172.21.15.12:0/1038573262 shutdown_connections 2024-09-11T23:04:59.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.056+0000 7f4293828640 1 --2- 172.21.15.12:0/1038573262 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f428c13e3d0 0x7f428c13e7b0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:59.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.056+0000 7f4293828640 1 -- 172.21.15.12:0/1038573262 >> 172.21.15.12:0/1038573262 conn(0x7f428c0ac2c0 msgr2=0x7f428c0ac6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:59.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.056+0000 7f4293828640 1 -- 172.21.15.12:0/1038573262 shutdown_connections 2024-09-11T23:04:59.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.056+0000 7f4293828640 1 -- 172.21.15.12:0/1038573262 wait complete. 2024-09-11T23:04:59.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.056+0000 7f4293828640 1 Processor -- start 2024-09-11T23:04:59.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.056+0000 7f4293828640 1 -- start start 2024-09-11T23:04:59.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.056+0000 7f4293828640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f428c13e3d0 0x7f428c09ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:59.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.056+0000 7f4293828640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f428c1464d0 con 0x7f428c13e3d0 2024-09-11T23:04:59.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.056+0000 7f42915c4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f428c13e3d0 0x7f428c09ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:59.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.056+0000 7f42915c4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f428c13e3d0 0x7f428c09ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58256/0 (socket says 172.21.15.12:58256) 2024-09-11T23:04:59.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.056+0000 7f42915c4640 1 -- 172.21.15.12:0/979700860 learned_addr learned my addr 172.21.15.12:0/979700860 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:04:59.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.056+0000 7f42915c4640 1 -- 172.21.15.12:0/979700860 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f428c09b260 con 0x7f428c13e3d0 2024-09-11T23:04:59.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.056+0000 7f42915c4640 1 --2- 172.21.15.12:0/979700860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f428c13e3d0 0x7f428c09ac20 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f4284019fc0 tx=0x7f428401abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:59.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.056+0000 7f4289ffb640 1 -- 172.21.15.12:0/979700860 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42840bb070 con 0x7f428c13e3d0 2024-09-11T23:04:59.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.056+0000 7f4289ffb640 1 -- 172.21.15.12:0/979700860 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42840abe40 con 0x7f428c13e3d0 2024-09-11T23:04:59.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.056+0000 7f4293828640 1 -- 172.21.15.12:0/979700860 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f428c142d00 con 0x7f428c13e3d0 2024-09-11T23:04:59.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.056+0000 7f4289ffb640 1 -- 172.21.15.12:0/979700860 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42840b0040 con 0x7f428c13e3d0 2024-09-11T23:04:59.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.056+0000 7f4293828640 1 -- 172.21.15.12:0/979700860 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f428c1429f0 con 0x7f428c13e3d0 2024-09-11T23:04:59.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.056+0000 7f4293828640 1 -- 172.21.15.12:0/979700860 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f428c13e7b0 con 0x7f428c13e3d0 2024-09-11T23:04:59.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.056+0000 7f4289ffb640 1 -- 172.21.15.12:0/979700860 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 15) ==== 44155+0+0 (secure 0 0 0) 0x7f4284004150 con 0x7f428c13e3d0 2024-09-11T23:04:59.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.060+0000 7f4289ffb640 1 --2- 172.21.15.12:0/979700860 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f4278035ed0 0x7f4278038390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:04:59.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.060+0000 7f4289ffb640 1 -- 172.21.15.12:0/979700860 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 3439+0+0 (secure 0 0 0) 0x7f42840e2e60 con 0x7f428c13e3d0 2024-09-11T23:04:59.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.060+0000 7f4290dc3640 1 --2- 172.21.15.12:0/979700860 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f4278035ed0 0x7f4278038390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:04:59.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.060+0000 7f4290dc3640 1 --2- 172.21.15.12:0/979700860 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f4278035ed0 0x7f4278038390 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4280000f90 tx=0x7f42800016c0 comp rx=0 tx=0).ready entity=mgr.4452 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:04:59.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.064+0000 7f4289ffb640 1 -- 172.21.15.12:0/979700860 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4284016010 con 0x7f428c13e3d0 2024-09-11T23:04:59.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.264+0000 7f4293828640 1 -- 172.21.15.12:0/979700860 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f428c073390 con 0x7f428c13e3d0 2024-09-11T23:04:59.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.264+0000 7f4289ffb640 1 -- 172.21.15.12:0/979700860 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) ==== 53+0+73 (secure 0 0 0) 0x7f42840b7420 con 0x7f428c13e3d0 2024-09-11T23:04:59.268 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T23:04:59.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.268+0000 7f4293828640 1 -- 172.21.15.12:0/979700860 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f4278035ed0 msgr2=0x7f4278038390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:59.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.268+0000 7f4293828640 1 --2- 172.21.15.12:0/979700860 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f4278035ed0 0x7f4278038390 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4280000f90 tx=0x7f42800016c0 comp rx=0 tx=0).stop 2024-09-11T23:04:59.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.268+0000 7f4293828640 1 -- 172.21.15.12:0/979700860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f428c13e3d0 msgr2=0x7f428c09ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:04:59.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.268+0000 7f4293828640 1 --2- 172.21.15.12:0/979700860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f428c13e3d0 0x7f428c09ac20 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f4284019fc0 tx=0x7f428401abd0 comp rx=0 tx=0).stop 2024-09-11T23:04:59.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.268+0000 7f4293828640 1 -- 172.21.15.12:0/979700860 shutdown_connections 2024-09-11T23:04:59.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.268+0000 7f4293828640 1 --2- 172.21.15.12:0/979700860 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f4278035ed0 0x7f4278038390 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:59.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.268+0000 7f4293828640 1 --2- 172.21.15.12:0/979700860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f428c13e3d0 0x7f428c09ac20 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:04:59.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.268+0000 7f4293828640 1 -- 172.21.15.12:0/979700860 >> 172.21.15.12:0/979700860 conn(0x7f428c0ac2c0 msgr2=0x7f428c0a67e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:04:59.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.268+0000 7f4293828640 1 -- 172.21.15.12:0/979700860 shutdown_connections 2024-09-11T23:04:59.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59.268+0000 7f4293828640 1 -- 172.21.15.12:0/979700860 wait complete. 2024-09-11T23:04:59.287 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-11T23:04:59.287 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:04:59.287 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi012.front.sepia.ceph.com 2024-09-11T23:04:59.287 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-11T23:04:59.287 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-11T23:04:59.287 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-11T23:04:59.287 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T23:04:59.287 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:04:59.287 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:04:59.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:59.288 DEBUG:teuthology.orchestra.run.smithi012:> ip addr 2024-09-11T23:04:59.295 INFO:teuthology.orchestra.run.smithi012.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:04:59.295 INFO:teuthology.orchestra.run.smithi012.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:04:59.295 INFO:teuthology.orchestra.run.smithi012.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:04:59.295 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:04:59.295 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 ::1/128 scope host 2024-09-11T23:04:59.295 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:04:59.295 INFO:teuthology.orchestra.run.smithi012.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:04:59.295 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a4 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:04:59.295 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f0 2024-09-11T23:04:59.296 INFO:teuthology.orchestra.run.smithi012.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:04:59.296 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a5 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:04:59.296 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f1 2024-09-11T23:04:59.296 INFO:teuthology.orchestra.run.smithi012.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:04:59.296 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:ea brd ff:ff:ff:ff:ff:ff 2024-09-11T23:04:59.296 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f0 2024-09-11T23:04:59.296 INFO:teuthology.orchestra.run.smithi012.stdout: inet 172.21.15.12/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-11T23:04:59.296 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft 42442sec preferred_lft 42442sec 2024-09-11T23:04:59.296 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::ae1f:6bff:fef8:25ea/64 scope link 2024-09-11T23:04:59.296 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:04:59.296 INFO:teuthology.orchestra.run.smithi012.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:04:59.296 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:eb brd ff:ff:ff:ff:ff:ff 2024-09-11T23:04:59.296 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f1 2024-09-11T23:04:59.297 INFO:teuthology.orchestra.run.smithi012.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-11T23:04:59.297 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 02:42:d6:75:63:83 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:04:59.297 INFO:teuthology.orchestra.run.smithi012.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-11T23:04:59.297 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:04:59.297 INFO:teuthology.orchestra.run.smithi012.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:04:59.297 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-11T23:04:59.297 INFO:teuthology.orchestra.run.smithi012.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T23:04:59.297 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:04:59.297 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-11T23:04:59.297 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:04:59.297 INFO:teuthology.orchestra.run.smithi012.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:04:59.297 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:04:59.297 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-11T23:04:59.297 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:04:59.298 INFO:teuthology.orchestra.run.smithi012.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:04:59.298 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:04:59.298 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-11T23:04:59.298 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:04:59.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:59.298 DEBUG:teuthology.orchestra.run.smithi012:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:04:59.347 INFO:teuthology.orchestra.run.smithi012.stdout:1 2024-09-11T23:04:59.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:59.349 DEBUG:teuthology.orchestra.run.smithi012:> route 2024-09-11T23:04:59.398 INFO:teuthology.orchestra.run.smithi012.stdout:Kernel IP routing table 2024-09-11T23:04:59.398 INFO:teuthology.orchestra.run.smithi012.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:04:59.399 INFO:teuthology.orchestra.run.smithi012.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-11T23:04:59.399 INFO:teuthology.orchestra.run.smithi012.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-11T23:04:59.399 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-11T23:04:59.399 INFO:teuthology.orchestra.run.smithi012.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:04:59.399 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:04:59.399 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-09-11T23:04:59.399 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-11T23:04:59.399 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-11T23:04:59.399 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-11T23:04:59.400 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-09-11T23:04:59.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:04:59.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:04:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:04:59.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:59.529 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2024-09-11T23:04:59.534 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 1) 2024-09-11T23:04:59.534 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T23:04:59.535 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:04:59.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:59.535 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set brx.1 up 2024-09-11T23:04:59.588 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-11T23:04:59.588 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:04:59.588 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-11T23:04:59.637 INFO:teuthology.orchestra.run.smithi012.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:04:59.637 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:04:59.638 DEBUG:teuthology.orchestra.run.smithi012:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-11T23:04:59.684 DEBUG:teuthology.orchestra.run.smithi012:> sudo modprobe fuse 2024-09-11T23:04:59.742 DEBUG:teuthology.orchestra.run.smithi012:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:04:59.790 INFO:teuthology.orchestra.run.smithi012.stdout:/sys 2024-09-11T23:04:59.790 INFO:teuthology.orchestra.run.smithi012.stdout:/proc 2024-09-11T23:04:59.791 INFO:teuthology.orchestra.run.smithi012.stdout:/dev 2024-09-11T23:04:59.791 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/pts 2024-09-11T23:04:59.791 INFO:teuthology.orchestra.run.smithi012.stdout:/run 2024-09-11T23:04:59.791 INFO:teuthology.orchestra.run.smithi012.stdout:/ 2024-09-11T23:04:59.791 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/security 2024-09-11T23:04:59.791 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/shm 2024-09-11T23:04:59.791 INFO:teuthology.orchestra.run.smithi012.stdout:/run/lock 2024-09-11T23:04:59.791 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup 2024-09-11T23:04:59.791 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/pstore 2024-09-11T23:04:59.791 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/bpf 2024-09-11T23:04:59.791 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:04:59.791 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/hugepages 2024-09-11T23:04:59.791 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/mqueue 2024-09-11T23:04:59.791 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/debug 2024-09-11T23:04:59.792 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/tracing 2024-09-11T23:04:59.792 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/fs/nfsd 2024-09-11T23:04:59.792 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/fuse/connections 2024-09-11T23:04:59.792 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/config 2024-09-11T23:04:59.792 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:04:59.792 INFO:teuthology.orchestra.run.smithi012.stdout:/run/rpc_pipefs 2024-09-11T23:04:59.792 INFO:teuthology.orchestra.run.smithi012.stdout:/run/user/1000 2024-09-11T23:04:59.792 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph 2024-09-11T23:04:59.792 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:04:59.792 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:04:59.792 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:04:59.792 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns 2024-09-11T23:04:59.792 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:04:59.793 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:04:59.793 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:04:59.793 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:04:59.793 INFO:teuthology.orchestra.run.smithi012.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-11T23:04:59.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:59.794 DEBUG:teuthology.orchestra.run.smithi012:> ls /sys/fs/fuse/connections 2024-09-11T23:04:59.841 INFO:teuthology.orchestra.run.smithi012.stdout:45 2024-09-11T23:04:59.841 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [45] 2024-09-11T23:04:59.841 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-11T23:04:59.885 DEBUG:teuthology.orchestra.run.smithi012:> sudo modprobe fuse 2024-09-11T23:04:59.902 DEBUG:teuthology.orchestra.run.smithi012:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:04:59.949 INFO:teuthology.orchestra.run.smithi012.stdout:/sys 2024-09-11T23:04:59.950 INFO:teuthology.orchestra.run.smithi012.stdout:/proc 2024-09-11T23:04:59.950 INFO:teuthology.orchestra.run.smithi012.stdout:/dev 2024-09-11T23:04:59.950 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/pts 2024-09-11T23:04:59.950 INFO:teuthology.orchestra.run.smithi012.stdout:/run 2024-09-11T23:04:59.950 INFO:teuthology.orchestra.run.smithi012.stdout:/ 2024-09-11T23:04:59.950 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/security 2024-09-11T23:04:59.950 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/shm 2024-09-11T23:04:59.950 INFO:teuthology.orchestra.run.smithi012.stdout:/run/lock 2024-09-11T23:04:59.950 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup 2024-09-11T23:04:59.950 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/pstore 2024-09-11T23:04:59.950 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/bpf 2024-09-11T23:04:59.950 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:04:59.951 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/hugepages 2024-09-11T23:04:59.951 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/mqueue 2024-09-11T23:04:59.951 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/debug 2024-09-11T23:04:59.951 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/tracing 2024-09-11T23:04:59.951 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/fs/nfsd 2024-09-11T23:04:59.951 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/fuse/connections 2024-09-11T23:04:59.951 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/config 2024-09-11T23:04:59.951 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:04:59.951 INFO:teuthology.orchestra.run.smithi012.stdout:/run/rpc_pipefs 2024-09-11T23:04:59.951 INFO:teuthology.orchestra.run.smithi012.stdout:/run/user/1000 2024-09-11T23:04:59.951 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph 2024-09-11T23:04:59.951 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:04:59.951 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:04:59.951 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:04:59.951 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns 2024-09-11T23:04:59.952 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:04:59.952 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:04:59.952 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:04:59.952 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:04:59.952 INFO:teuthology.orchestra.run.smithi012.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-11T23:04:59.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:04:59.952 DEBUG:teuthology.orchestra.run.smithi012:> ls /sys/fs/fuse/connections 2024-09-11T23:04:59.971 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi012.stderr:2024-09-11T23:04:59.968+0000 7fac1a05d580 -1 init, newargv = 0x560b2b381bf0 newargc=15 2024-09-11T23:04:59.971 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi012.stderr:ceph-fuse[36873]: starting ceph client 2024-09-11T23:04:59.975 INFO:teuthology.orchestra.run.smithi012.stdout:45 2024-09-11T23:04:59.976 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi012.stderr:ceph-fuse[36873]: starting fuse 2024-09-11T23:05:01.077 DEBUG:teuthology.orchestra.run.smithi012:> sudo modprobe fuse 2024-09-11T23:05:01.093 DEBUG:teuthology.orchestra.run.smithi012:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:05:01.146 INFO:teuthology.orchestra.run.smithi012.stdout:/sys 2024-09-11T23:05:01.146 INFO:teuthology.orchestra.run.smithi012.stdout:/proc 2024-09-11T23:05:01.146 INFO:teuthology.orchestra.run.smithi012.stdout:/dev 2024-09-11T23:05:01.146 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/pts 2024-09-11T23:05:01.146 INFO:teuthology.orchestra.run.smithi012.stdout:/run 2024-09-11T23:05:01.146 INFO:teuthology.orchestra.run.smithi012.stdout:/ 2024-09-11T23:05:01.146 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/security 2024-09-11T23:05:01.146 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/shm 2024-09-11T23:05:01.147 INFO:teuthology.orchestra.run.smithi012.stdout:/run/lock 2024-09-11T23:05:01.147 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup 2024-09-11T23:05:01.147 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/pstore 2024-09-11T23:05:01.147 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/bpf 2024-09-11T23:05:01.147 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:05:01.147 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/hugepages 2024-09-11T23:05:01.147 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/mqueue 2024-09-11T23:05:01.147 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/debug 2024-09-11T23:05:01.147 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/tracing 2024-09-11T23:05:01.147 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/fs/nfsd 2024-09-11T23:05:01.147 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/fuse/connections 2024-09-11T23:05:01.147 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/config 2024-09-11T23:05:01.147 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:05:01.148 INFO:teuthology.orchestra.run.smithi012.stdout:/run/rpc_pipefs 2024-09-11T23:05:01.148 INFO:teuthology.orchestra.run.smithi012.stdout:/run/user/1000 2024-09-11T23:05:01.148 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph 2024-09-11T23:05:01.148 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:05:01.148 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:05:01.148 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:05:01.148 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns 2024-09-11T23:05:01.148 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:05:01.148 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:05:01.148 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:05:01.148 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:05:01.148 INFO:teuthology.orchestra.run.smithi012.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-11T23:05:01.148 INFO:teuthology.orchestra.run.smithi012.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-11T23:05:01.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:05:01.149 DEBUG:teuthology.orchestra.run.smithi012:> ls /sys/fs/fuse/connections 2024-09-11T23:05:01.197 INFO:teuthology.orchestra.run.smithi012.stdout:45 2024-09-11T23:05:01.197 INFO:teuthology.orchestra.run.smithi012.stdout:46 2024-09-11T23:05:01.197 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45, 46] 2024-09-11T23:05:01.197 DEBUG:teuthology.orchestra.run.smithi012:> sudo stdin-killer -- python3 -c ' 2024-09-11T23:05:01.197 DEBUG:teuthology.orchestra.run.smithi012:> import glob 2024-09-11T23:05:01.197 DEBUG:teuthology.orchestra.run.smithi012:> import re 2024-09-11T23:05:01.197 DEBUG:teuthology.orchestra.run.smithi012:> import os 2024-09-11T23:05:01.198 DEBUG:teuthology.orchestra.run.smithi012:> import subprocess 2024-09-11T23:05:01.198 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:05:01.198 DEBUG:teuthology.orchestra.run.smithi012:> def _find_admin_socket(client_name): 2024-09-11T23:05:01.198 DEBUG:teuthology.orchestra.run.smithi012:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-11T23:05:01.198 DEBUG:teuthology.orchestra.run.smithi012:> files = glob.glob(asok_path) 2024-09-11T23:05:01.198 DEBUG:teuthology.orchestra.run.smithi012:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-11T23:05:01.198 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:05:01.198 DEBUG:teuthology.orchestra.run.smithi012:> # Given a non-glob path, it better be there 2024-09-11T23:05:01.198 DEBUG:teuthology.orchestra.run.smithi012:> if "*" not in asok_path: 2024-09-11T23:05:01.198 DEBUG:teuthology.orchestra.run.smithi012:> assert(len(files) == 1) 2024-09-11T23:05:01.198 DEBUG:teuthology.orchestra.run.smithi012:> return files[0] 2024-09-11T23:05:01.198 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:05:01.198 DEBUG:teuthology.orchestra.run.smithi012:> for f in files: 2024-09-11T23:05:01.198 DEBUG:teuthology.orchestra.run.smithi012:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T23:05:01.198 DEBUG:teuthology.orchestra.run.smithi012:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T23:05:01.199 DEBUG:teuthology.orchestra.run.smithi012:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T23:05:01.199 DEBUG:teuthology.orchestra.run.smithi012:> contents = proc_f.read() 2024-09-11T23:05:01.199 DEBUG:teuthology.orchestra.run.smithi012:> if mountpoint in contents: 2024-09-11T23:05:01.199 DEBUG:teuthology.orchestra.run.smithi012:> return f 2024-09-11T23:05:01.199 DEBUG:teuthology.orchestra.run.smithi012:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T23:05:01.199 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:05:01.199 DEBUG:teuthology.orchestra.run.smithi012:> print(_find_admin_socket("client.1")) 2024-09-11T23:05:01.199 DEBUG:teuthology.orchestra.run.smithi012:> ' 2024-09-11T23:05:01.327 INFO:teuthology.orchestra.run.smithi012.stdout:/var/run/ceph/ceph-client.1.36873.asok 2024-09-11T23:05:01.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:05:01.339 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.36873.asok 2024-09-11T23:05:01.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:05:01.339 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.36873.asok status 2024-09-11T23:05:01.494 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T23:05:01.494 INFO:teuthology.orchestra.run.smithi012.stdout: "metadata": { 2024-09-11T23:05:01.494 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-11T23:05:01.494 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T23:05:01.494 INFO:teuthology.orchestra.run.smithi012.stdout: "entity_id": "1", 2024-09-11T23:05:01.494 INFO:teuthology.orchestra.run.smithi012.stdout: "hostname": "smithi012", 2024-09-11T23:05:01.495 INFO:teuthology.orchestra.run.smithi012.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-11T23:05:01.495 INFO:teuthology.orchestra.run.smithi012.stdout: "pid": "36873", 2024-09-11T23:05:01.495 INFO:teuthology.orchestra.run.smithi012.stdout: "root": "/" 2024-09-11T23:05:01.495 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:05:01.495 INFO:teuthology.orchestra.run.smithi012.stdout: "dentry_count": 0, 2024-09-11T23:05:01.495 INFO:teuthology.orchestra.run.smithi012.stdout: "dentry_pinned_count": 0, 2024-09-11T23:05:01.495 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4606, 2024-09-11T23:05:01.495 INFO:teuthology.orchestra.run.smithi012.stdout: "inst": { 2024-09-11T23:05:01.495 INFO:teuthology.orchestra.run.smithi012.stdout: "name": { 2024-09-11T23:05:01.495 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "client", 2024-09-11T23:05:01.495 INFO:teuthology.orchestra.run.smithi012.stdout: "num": 4606 2024-09-11T23:05:01.495 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:05:01.495 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": { 2024-09-11T23:05:01.496 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T23:05:01.496 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "192.168.0.2:0", 2024-09-11T23:05:01.496 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2534748481 2024-09-11T23:05:01.496 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:05:01.496 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:05:01.496 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": { 2024-09-11T23:05:01.496 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T23:05:01.496 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "192.168.0.2:0", 2024-09-11T23:05:01.496 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2534748481 2024-09-11T23:05:01.496 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:05:01.496 INFO:teuthology.orchestra.run.smithi012.stdout: "inst_str": "client.4606 192.168.0.2:0/2534748481", 2024-09-11T23:05:01.496 INFO:teuthology.orchestra.run.smithi012.stdout: "addr_str": "192.168.0.2:0/2534748481", 2024-09-11T23:05:01.496 INFO:teuthology.orchestra.run.smithi012.stdout: "inode_count": 1, 2024-09-11T23:05:01.497 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_epoch": 25, 2024-09-11T23:05:01.497 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_epoch": 36, 2024-09-11T23:05:01.497 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_epoch_barrier": 0, 2024-09-11T23:05:01.497 INFO:teuthology.orchestra.run.smithi012.stdout: "blocklisted": false, 2024-09-11T23:05:01.497 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs" 2024-09-11T23:05:01.497 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T23:05:01.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:05:01.509 DEBUG:teuthology.orchestra.run.smithi012:> stat --file-system '--printf=%T 2024-09-11T23:05:01.509 DEBUG:teuthology.orchestra.run.smithi012:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-11T23:05:01.515 INFO:teuthology.orchestra.run.smithi012.stdout:fuseblk 2024-09-11T23:05:01.515 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-11T23:05:01.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:05:01.515 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-11T23:05:01.568 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable stats 2024-09-11T23:05:01.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:01.740+0000 7fa791351640 1 Processor -- start 2024-09-11T23:05:01.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:01.740+0000 7fa791351640 1 -- start start 2024-09-11T23:05:01.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:01.744+0000 7fa791351640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa78c136da0 0x7fa78c137180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:01.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:01.744+0000 7fa791351640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa78c0a1e90 con 0x7fa78c09ac20 2024-09-11T23:05:01.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:01.744+0000 7fa791351640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fa78c1376c0 con 0x7fa78c136da0 2024-09-11T23:05:01.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:01.744+0000 7fa78a7fc640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa78c09ac20 0x7fa78c0a36a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42706/0 (socket says 172.21.15.12:42706) 2024-09-11T23:05:01.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:01.744+0000 7fa78affd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa78c136da0 0x7fa78c137180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:01.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:01.744+0000 7fa78a7fc640 1 -- 172.21.15.12:0/2851075312 learned_addr learned my addr 172.21.15.12:0/2851075312 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:01.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:01.744+0000 7fa78affd640 1 -- 172.21.15.12:0/2851075312 >> v1:172.21.15.12:6789/0 conn(0x7fa78c09ac20 legacy=0x7fa78c0a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:01.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:01.744+0000 7fa78affd640 1 -- 172.21.15.12:0/2851075312 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa78c0a0650 con 0x7fa78c136da0 2024-09-11T23:05:01.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:01.744+0000 7fa789ffb640 1 -- 172.21.15.12:0/2851075312 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1561898692 0 0) 0x7fa78c0a1e90 con 0x7fa78c09ac20 2024-09-11T23:05:01.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:01.744+0000 7fa78affd640 1 --2- 172.21.15.12:0/2851075312 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa78c136da0 0x7fa78c137180 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fa77c009d90 tx=0x7fa77c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82c062f83e43d559 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:01.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:01.744+0000 7fa789ffb640 1 -- 172.21.15.12:0/2851075312 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa77c0b2070 con 0x7fa78c136da0 2024-09-11T23:05:01.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:01.744+0000 7fa789ffb640 1 -- 172.21.15.12:0/2851075312 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa77c0a56e0 con 0x7fa78c136da0 2024-09-11T23:05:01.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:01.744+0000 7fa789ffb640 1 -- 172.21.15.12:0/2851075312 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa77c0a59e0 con 0x7fa78c136da0 2024-09-11T23:05:01.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:01.744+0000 7fa791351640 1 -- 172.21.15.12:0/2851075312 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa78c136da0 msgr2=0x7fa78c137180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:01.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:01.744+0000 7fa791351640 1 --2- 172.21.15.12:0/2851075312 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa78c136da0 0x7fa78c137180 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fa77c009d90 tx=0x7fa77c01c970 comp rx=0 tx=0).stop 2024-09-11T23:05:01.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:01.744+0000 7fa791351640 1 -- 172.21.15.12:0/2851075312 shutdown_connections 2024-09-11T23:05:01.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:01.744+0000 7fa791351640 1 --2- 172.21.15.12:0/2851075312 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa78c136da0 0x7fa78c137180 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:01.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:01.744+0000 7fa791351640 1 -- 172.21.15.12:0/2851075312 >> 172.21.15.12:0/2851075312 conn(0x7fa78c0a82f0 msgr2=0x7fa78c0a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:01.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:01.744+0000 7fa791351640 1 -- 172.21.15.12:0/2851075312 shutdown_connections 2024-09-11T23:05:01.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:01.744+0000 7fa791351640 1 -- 172.21.15.12:0/2851075312 wait complete. 2024-09-11T23:05:01.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:01.748+0000 7fa791351640 1 Processor -- start 2024-09-11T23:05:01.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:01.748+0000 7fa791351640 1 -- start start 2024-09-11T23:05:01.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:01.748+0000 7fa791351640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa78c09ac20 0x7fa78c071d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:01.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:01.748+0000 7fa791351640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa78c13ee20 con 0x7fa78c09ac20 2024-09-11T23:05:01.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:01.748+0000 7fa78affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa78c09ac20 0x7fa78c071d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:01.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:01.748+0000 7fa78affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa78c09ac20 0x7fa78c071d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58268/0 (socket says 172.21.15.12:58268) 2024-09-11T23:05:01.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:01.748+0000 7fa78affd640 1 -- 172.21.15.12:0/2464431569 learned_addr learned my addr 172.21.15.12:0/2464431569 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:01.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:01.748+0000 7fa78affd640 1 -- 172.21.15.12:0/2464431569 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa78c09fbd0 con 0x7fa78c09ac20 2024-09-11T23:05:01.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:01.748+0000 7fa78affd640 1 --2- 172.21.15.12:0/2464431569 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa78c09ac20 0x7fa78c071d80 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fa77c01c9b0 tx=0x7fa77c019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:01.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:01.748+0000 7fa7737fe640 1 -- 172.21.15.12:0/2464431569 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa77c0bd030 con 0x7fa78c09ac20 2024-09-11T23:05:01.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:01.748+0000 7fa7737fe640 1 -- 172.21.15.12:0/2464431569 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa77c0b85a0 con 0x7fa78c09ac20 2024-09-11T23:05:01.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:01.748+0000 7fa7737fe640 1 -- 172.21.15.12:0/2464431569 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa77c0b2040 con 0x7fa78c09ac20 2024-09-11T23:05:01.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:01.748+0000 7fa791351640 1 -- 172.21.15.12:0/2464431569 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa78c120a00 con 0x7fa78c09ac20 2024-09-11T23:05:01.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:01.748+0000 7fa791351640 1 -- 172.21.15.12:0/2464431569 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa78c11e650 con 0x7fa78c09ac20 2024-09-11T23:05:01.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:01.748+0000 7fa791351640 1 -- 172.21.15.12:0/2464431569 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa78c1210e0 con 0x7fa78c09ac20 2024-09-11T23:05:01.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:01.748+0000 7fa7737fe640 1 -- 172.21.15.12:0/2464431569 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 15) ==== 44155+0+0 (secure 0 0 0) 0x7fa77c0c0070 con 0x7fa78c09ac20 2024-09-11T23:05:01.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:01.748+0000 7fa7737fe640 1 --2- 172.21.15.12:0/2464431569 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fa778035e80 0x7fa778038340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:01.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:01.748+0000 7fa7737fe640 1 -- 172.21.15.12:0/2464431569 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 3439+0+0 (secure 0 0 0) 0x7fa77c0be070 con 0x7fa78c09ac20 2024-09-11T23:05:01.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:01.748+0000 7fa78a7fc640 1 --2- 172.21.15.12:0/2464431569 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fa778035e80 0x7fa778038340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:01.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:01.748+0000 7fa78a7fc640 1 --2- 172.21.15.12:0/2464431569 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fa778035e80 0x7fa778038340 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa780007fd0 tx=0x7fa780007920 comp rx=0 tx=0).ready entity=mgr.4452 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:01.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:01.756+0000 7fa7737fe640 1 -- 172.21.15.12:0/2464431569 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa77c016560 con 0x7fa78c09ac20 2024-09-11T23:05:01.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:01.960+0000 7fa791351640 1 -- 172.21.15.12:0/2464431569 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "stats"} v 0) -- 0x7fa78c06bc60 con 0x7fa78c09ac20 2024-09-11T23:05:02.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:02.908+0000 7fa7737fe640 1 -- 172.21.15.12:0/2464431569 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "stats"}]=0 v16) ==== 84+0+0 (secure 0 0 0) 0x7fa77c0c2810 con 0x7fa78c09ac20 2024-09-11T23:05:02.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:02.912+0000 7fa791351640 1 -- 172.21.15.12:0/2464431569 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fa778035e80 msgr2=0x7fa778038340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:02.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:02.912+0000 7fa791351640 1 --2- 172.21.15.12:0/2464431569 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fa778035e80 0x7fa778038340 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa780007fd0 tx=0x7fa780007920 comp rx=0 tx=0).stop 2024-09-11T23:05:02.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:02.912+0000 7fa791351640 1 -- 172.21.15.12:0/2464431569 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa78c09ac20 msgr2=0x7fa78c071d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:02.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:02.912+0000 7fa791351640 1 --2- 172.21.15.12:0/2464431569 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa78c09ac20 0x7fa78c071d80 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fa77c01c9b0 tx=0x7fa77c019710 comp rx=0 tx=0).stop 2024-09-11T23:05:02.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:02.912+0000 7fa791351640 1 -- 172.21.15.12:0/2464431569 shutdown_connections 2024-09-11T23:05:02.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:02.912+0000 7fa791351640 1 --2- 172.21.15.12:0/2464431569 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fa778035e80 0x7fa778038340 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:02.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:02.912+0000 7fa791351640 1 --2- 172.21.15.12:0/2464431569 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa78c09ac20 0x7fa78c071d80 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:02.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:02.912+0000 7fa791351640 1 -- 172.21.15.12:0/2464431569 >> 172.21.15.12:0/2464431569 conn(0x7fa78c0a82f0 msgr2=0x7fa78c0a6720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:02.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:02.912+0000 7fa791351640 1 -- 172.21.15.12:0/2464431569 shutdown_connections 2024-09-11T23:05:02.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:02.912+0000 7fa791351640 1 -- 172.21.15.12:0/2464431569 wait complete. 2024-09-11T23:05:02.936 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T23:05:02.936 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:05:02.943 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:05:03.044 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:03.044+0000 7fbbb2f9a180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T23:05:03.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.104+0000 7f5eaa119640 1 Processor -- start 2024-09-11T23:05:03.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.104+0000 7f5eaa119640 1 -- start start 2024-09-11T23:05:03.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.104+0000 7f5eaa119640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5ea409fc40 0x7f5ea413ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:03.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.104+0000 7f5eaa119640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ea40a1c00 con 0x7f5ea413a200 2024-09-11T23:05:03.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.104+0000 7f5eaa119640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f5ea40a0e40 con 0x7f5ea409fc40 2024-09-11T23:05:03.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.104+0000 7f5ea2ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5ea409fc40 0x7f5ea413ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:03.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.104+0000 7f5ea37fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f5ea413a200 0x7f5ea413a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42730/0 (socket says 172.21.15.12:42730) 2024-09-11T23:05:03.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.104+0000 7f5ea37fe640 1 -- 172.21.15.12:0/2677426980 learned_addr learned my addr 172.21.15.12:0/2677426980 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:03.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.104+0000 7f5ea27fc640 1 -- 172.21.15.12:0/2677426980 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1565886164 0 0) 0x7f5ea40a1c00 con 0x7f5ea413a200 2024-09-11T23:05:03.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.104+0000 7f5ea27fc640 1 -- 172.21.15.12:0/2677426980 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e8c003530 con 0x7f5ea413a200 2024-09-11T23:05:03.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.104+0000 7f5ea2ffd640 1 -- 172.21.15.12:0/2677426980 >> v1:172.21.15.12:6789/0 conn(0x7f5ea413a200 legacy=0x7f5ea413a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:03.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.104+0000 7f5ea2ffd640 1 -- 172.21.15.12:0/2677426980 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ea409f350 con 0x7f5ea409fc40 2024-09-11T23:05:03.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.108+0000 7f5ea2ffd640 1 --2- 172.21.15.12:0/2677426980 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ea409fc40 0x7f5ea413ef80 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f5e94009740 tx=0x7f5e9401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8788ceb72f55bc77 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:03.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.108+0000 7f5ea27fc640 1 -- 172.21.15.12:0/2677426980 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e940b0070 con 0x7f5ea409fc40 2024-09-11T23:05:03.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.108+0000 7f5ea27fc640 1 -- 172.21.15.12:0/2677426980 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e940ab530 con 0x7f5ea409fc40 2024-09-11T23:05:03.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.108+0000 7f5ea27fc640 1 -- 172.21.15.12:0/2677426980 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e940ab810 con 0x7f5ea409fc40 2024-09-11T23:05:03.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.108+0000 7f5eaa119640 1 -- 172.21.15.12:0/2677426980 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ea409fc40 msgr2=0x7f5ea413ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:03.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.108+0000 7f5eaa119640 1 --2- 172.21.15.12:0/2677426980 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ea409fc40 0x7f5ea413ef80 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f5e94009740 tx=0x7f5e9401c390 comp rx=0 tx=0).stop 2024-09-11T23:05:03.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.108+0000 7f5eaa119640 1 -- 172.21.15.12:0/2677426980 shutdown_connections 2024-09-11T23:05:03.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.108+0000 7f5eaa119640 1 --2- 172.21.15.12:0/2677426980 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ea409fc40 0x7f5ea413ef80 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:03.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.108+0000 7f5eaa119640 1 -- 172.21.15.12:0/2677426980 >> 172.21.15.12:0/2677426980 conn(0x7f5ea406da30 msgr2=0x7f5ea406de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:03.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.108+0000 7f5eaa119640 1 -- 172.21.15.12:0/2677426980 shutdown_connections 2024-09-11T23:05:03.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.108+0000 7f5eaa119640 1 -- 172.21.15.12:0/2677426980 wait complete. 2024-09-11T23:05:03.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.108+0000 7f5eaa119640 1 Processor -- start 2024-09-11T23:05:03.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.108+0000 7f5eaa119640 1 -- start start 2024-09-11T23:05:03.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.108+0000 7f5eaa119640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ea413a200 0x7f5ea40a31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:03.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.108+0000 7f5eaa119640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea4141ce0 con 0x7f5ea413a200 2024-09-11T23:05:03.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.108+0000 7f5ea37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ea413a200 0x7f5ea40a31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:03.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.108+0000 7f5ea37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ea413a200 0x7f5ea40a31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58320/0 (socket says 172.21.15.12:58320) 2024-09-11T23:05:03.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.108+0000 7f5ea37fe640 1 -- 172.21.15.12:0/1309447093 learned_addr learned my addr 172.21.15.12:0/1309447093 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:03.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.108+0000 7f5ea37fe640 1 -- 172.21.15.12:0/1309447093 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ea40a6900 con 0x7f5ea413a200 2024-09-11T23:05:03.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.108+0000 7f5ea37fe640 1 --2- 172.21.15.12:0/1309447093 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ea413a200 0x7f5ea40a31b0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f5e9800c3d0 tx=0x7f5e9800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:03.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.112+0000 7f5e8bfff640 1 -- 172.21.15.12:0/1309447093 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e98017070 con 0x7f5ea413a200 2024-09-11T23:05:03.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.112+0000 7f5e8bfff640 1 -- 172.21.15.12:0/1309447093 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e98005ce0 con 0x7f5ea413a200 2024-09-11T23:05:03.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.112+0000 7f5eaa119640 1 -- 172.21.15.12:0/1309447093 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ea40a61b0 con 0x7f5ea413a200 2024-09-11T23:05:03.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.112+0000 7f5e8bfff640 1 -- 172.21.15.12:0/1309447093 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e980070d0 con 0x7f5ea413a200 2024-09-11T23:05:03.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.112+0000 7f5eaa119640 1 -- 172.21.15.12:0/1309447093 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ea409bd90 con 0x7f5ea413a200 2024-09-11T23:05:03.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.112+0000 7f5eaa119640 1 -- 172.21.15.12:0/1309447093 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ea413a660 con 0x7f5ea413a200 2024-09-11T23:05:03.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.112+0000 7f5e8bfff640 1 -- 172.21.15.12:0/1309447093 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 44164+0+0 (secure 0 0 0) 0x7f5e9801a070 con 0x7f5ea413a200 2024-09-11T23:05:03.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.112+0000 7f5e8bfff640 1 --2- 172.21.15.12:0/1309447093 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f5e90035f20 0x7f5e900383e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:03.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.112+0000 7f5e8bfff640 1 -- 172.21.15.12:0/1309447093 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 3439+0+0 (secure 0 0 0) 0x7f5e98047c40 con 0x7f5ea413a200 2024-09-11T23:05:03.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.112+0000 7f5ea2ffd640 1 -- 172.21.15.12:0/1309447093 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f5e90035f20 msgr2=0x7f5e900383e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6824/718802078 2024-09-11T23:05:03.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.112+0000 7f5ea2ffd640 1 --2- 172.21.15.12:0/1309447093 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f5e90035f20 0x7f5e900383e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:05:03.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.116+0000 7f5e8bfff640 1 -- 172.21.15.12:0/1309447093 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5ea40a6900 con 0x7f5ea413a200 2024-09-11T23:05:03.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.288+0000 7f5eaa119640 1 -- 172.21.15.12:0/1309447093 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5ea4073580 con 0x7f5ea413a200 2024-09-11T23:05:03.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.288+0000 7f5e8bfff640 1 -- 172.21.15.12:0/1309447093 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v36) ==== 80+0+0 (secure 0 0 0) 0x7f5e98019e10 con 0x7f5ea413a200 2024-09-11T23:05:03.292 INFO:teuthology.orchestra.run.smithi012.stderr:listed 0 entries 2024-09-11T23:05:03.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.292+0000 7f5eaa119640 1 -- 172.21.15.12:0/1309447093 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f5e90035f20 msgr2=0x7f5e900383e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:05:03.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.292+0000 7f5eaa119640 1 --2- 172.21.15.12:0/1309447093 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f5e90035f20 0x7f5e900383e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:03.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.292+0000 7f5eaa119640 1 -- 172.21.15.12:0/1309447093 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ea413a200 msgr2=0x7f5ea40a31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:03.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.292+0000 7f5eaa119640 1 --2- 172.21.15.12:0/1309447093 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ea413a200 0x7f5ea40a31b0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f5e9800c3d0 tx=0x7f5e9800c890 comp rx=0 tx=0).stop 2024-09-11T23:05:03.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.292+0000 7f5eaa119640 1 -- 172.21.15.12:0/1309447093 shutdown_connections 2024-09-11T23:05:03.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.292+0000 7f5eaa119640 1 --2- 172.21.15.12:0/1309447093 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f5e90035f20 0x7f5e900383e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:03.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.292+0000 7f5eaa119640 1 --2- 172.21.15.12:0/1309447093 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ea413a200 0x7f5ea40a31b0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:03.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.292+0000 7f5eaa119640 1 -- 172.21.15.12:0/1309447093 >> 172.21.15.12:0/1309447093 conn(0x7f5ea406da30 msgr2=0x7f5ea409ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:03.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.292+0000 7f5eaa119640 1 -- 172.21.15.12:0/1309447093 shutdown_connections 2024-09-11T23:05:03.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.292+0000 7f5eaa119640 1 -- 172.21.15.12:0/1309447093 wait complete. 2024-09-11T23:05:03.313 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T23:05:03.313 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:05:03.318 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:05:03.440 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:03.436+0000 7fbbb2f9a180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T23:05:03.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.472+0000 7efefd346640 1 Processor -- start 2024-09-11T23:05:03.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.472+0000 7efefd346640 1 -- start start 2024-09-11T23:05:03.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.472+0000 7efefd346640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efef813ceb0 0x7efef813f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:03.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.472+0000 7efefd346640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efef809f3f0 con 0x7efef80a54f0 2024-09-11T23:05:03.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.472+0000 7efefd346640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7efef806e6d0 con 0x7efef813ceb0 2024-09-11T23:05:03.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.472+0000 7efef67fc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efef813ceb0 0x7efef813f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:03.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.472+0000 7efef6ffd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7efef80a54f0 0x7efef80a58d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42738/0 (socket says 172.21.15.12:42738) 2024-09-11T23:05:03.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.472+0000 7efef6ffd640 1 -- 172.21.15.12:0/2315526688 learned_addr learned my addr 172.21.15.12:0/2315526688 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:03.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.472+0000 7efef5ffb640 1 -- 172.21.15.12:0/2315526688 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2029767830 0 0) 0x7efef809f3f0 con 0x7efef80a54f0 2024-09-11T23:05:03.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.472+0000 7efef5ffb640 1 -- 172.21.15.12:0/2315526688 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efee4003530 con 0x7efef80a54f0 2024-09-11T23:05:03.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.472+0000 7efef67fc640 1 -- 172.21.15.12:0/2315526688 >> v1:172.21.15.12:6789/0 conn(0x7efef80a54f0 legacy=0x7efef80a58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:03.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.472+0000 7efef67fc640 1 -- 172.21.15.12:0/2315526688 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efef80a52f0 con 0x7efef813ceb0 2024-09-11T23:05:03.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.476+0000 7efef67fc640 1 --2- 172.21.15.12:0/2315526688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efef813ceb0 0x7efef813f2a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7efee8009740 tx=0x7efee801c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7c7ec35edacb350 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:03.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.476+0000 7efef5ffb640 1 -- 172.21.15.12:0/2315526688 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efee80b0070 con 0x7efef813ceb0 2024-09-11T23:05:03.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.476+0000 7efef5ffb640 1 -- 172.21.15.12:0/2315526688 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efee80ab530 con 0x7efef813ceb0 2024-09-11T23:05:03.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.476+0000 7efef5ffb640 1 -- 172.21.15.12:0/2315526688 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efee80ab810 con 0x7efef813ceb0 2024-09-11T23:05:03.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.476+0000 7efefd346640 1 -- 172.21.15.12:0/2315526688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efef813ceb0 msgr2=0x7efef813f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:03.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.476+0000 7efefd346640 1 --2- 172.21.15.12:0/2315526688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efef813ceb0 0x7efef813f2a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7efee8009740 tx=0x7efee801c390 comp rx=0 tx=0).stop 2024-09-11T23:05:03.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.476+0000 7efefd346640 1 -- 172.21.15.12:0/2315526688 shutdown_connections 2024-09-11T23:05:03.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.476+0000 7efefd346640 1 --2- 172.21.15.12:0/2315526688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efef813ceb0 0x7efef813f2a0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:03.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.476+0000 7efefd346640 1 -- 172.21.15.12:0/2315526688 >> 172.21.15.12:0/2315526688 conn(0x7efef80aa140 msgr2=0x7efef80aa550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:03.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.476+0000 7efefd346640 1 -- 172.21.15.12:0/2315526688 shutdown_connections 2024-09-11T23:05:03.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.476+0000 7efefd346640 1 -- 172.21.15.12:0/2315526688 wait complete. 2024-09-11T23:05:03.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.476+0000 7efefd346640 1 Processor -- start 2024-09-11T23:05:03.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.476+0000 7efefd346640 1 -- start start 2024-09-11T23:05:03.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.476+0000 7efefd346640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efef80a54f0 0x7efef81ce220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:03.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.476+0000 7efefd346640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7efef806d110 con 0x7efef80a54f0 2024-09-11T23:05:03.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.476+0000 7efef6ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efef80a54f0 0x7efef81ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:03.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.476+0000 7efef6ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efef80a54f0 0x7efef81ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58336/0 (socket says 172.21.15.12:58336) 2024-09-11T23:05:03.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.476+0000 7efef6ffd640 1 -- 172.21.15.12:0/3872682572 learned_addr learned my addr 172.21.15.12:0/3872682572 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:03.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.476+0000 7efef6ffd640 1 -- 172.21.15.12:0/3872682572 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efef81cddf0 con 0x7efef80a54f0 2024-09-11T23:05:03.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.476+0000 7efef6ffd640 1 --2- 172.21.15.12:0/3872682572 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efef80a54f0 0x7efef81ce220 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7efee000c3d0 tx=0x7efee000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:03.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.476+0000 7efeef7fe640 1 -- 172.21.15.12:0/3872682572 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efee0017070 con 0x7efef80a54f0 2024-09-11T23:05:03.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.476+0000 7efeef7fe640 1 -- 172.21.15.12:0/3872682572 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efee0005ce0 con 0x7efef80a54f0 2024-09-11T23:05:03.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.476+0000 7efefd346640 1 -- 172.21.15.12:0/3872682572 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efef80a15d0 con 0x7efef80a54f0 2024-09-11T23:05:03.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.476+0000 7efeef7fe640 1 -- 172.21.15.12:0/3872682572 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efee00070d0 con 0x7efef80a54f0 2024-09-11T23:05:03.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.476+0000 7efefd346640 1 -- 172.21.15.12:0/3872682572 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efef80a42e0 con 0x7efef80a54f0 2024-09-11T23:05:03.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.476+0000 7efeef7fe640 1 -- 172.21.15.12:0/3872682572 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 44164+0+0 (secure 0 0 0) 0x7efee001a070 con 0x7efef80a54f0 2024-09-11T23:05:03.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.480+0000 7efefd346640 1 -- 172.21.15.12:0/3872682572 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efef80a58d0 con 0x7efef80a54f0 2024-09-11T23:05:03.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.480+0000 7efeef7fe640 1 --2- 172.21.15.12:0/3872682572 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7efed8035f20 0x7efed80383e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:03.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.480+0000 7efeef7fe640 1 -- 172.21.15.12:0/3872682572 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 3439+0+0 (secure 0 0 0) 0x7efee0047c40 con 0x7efef80a54f0 2024-09-11T23:05:03.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.480+0000 7efef67fc640 1 -- 172.21.15.12:0/3872682572 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7efed8035f20 msgr2=0x7efed80383e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6824/718802078 2024-09-11T23:05:03.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.480+0000 7efef67fc640 1 --2- 172.21.15.12:0/3872682572 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7efed8035f20 0x7efed80383e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:05:03.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.484+0000 7efeef7fe640 1 -- 172.21.15.12:0/3872682572 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7efee0019e10 con 0x7efef80a54f0 2024-09-11T23:05:03.579 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:03.576+0000 7fbbb2f9a180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T23:05:03.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.656+0000 7efefd346640 1 -- 172.21.15.12:0/3872682572 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7efef806bc60 con 0x7efef80a54f0 2024-09-11T23:05:03.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.656+0000 7efeef7fe640 1 -- 172.21.15.12:0/3872682572 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v36) ==== 80+0+0 (secure 0 0 0) 0x7efee001b8d0 con 0x7efef80a54f0 2024-09-11T23:05:03.658 INFO:teuthology.orchestra.run.smithi012.stderr:listed 0 entries 2024-09-11T23:05:03.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.660+0000 7efefd346640 1 -- 172.21.15.12:0/3872682572 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7efed8035f20 msgr2=0x7efed80383e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:05:03.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.660+0000 7efefd346640 1 --2- 172.21.15.12:0/3872682572 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7efed8035f20 0x7efed80383e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:03.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.660+0000 7efefd346640 1 -- 172.21.15.12:0/3872682572 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efef80a54f0 msgr2=0x7efef81ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:03.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.660+0000 7efefd346640 1 --2- 172.21.15.12:0/3872682572 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efef80a54f0 0x7efef81ce220 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7efee000c3d0 tx=0x7efee000c890 comp rx=0 tx=0).stop 2024-09-11T23:05:03.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.660+0000 7efefd346640 1 -- 172.21.15.12:0/3872682572 shutdown_connections 2024-09-11T23:05:03.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.660+0000 7efefd346640 1 --2- 172.21.15.12:0/3872682572 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7efed8035f20 0x7efed80383e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:03.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.660+0000 7efefd346640 1 --2- 172.21.15.12:0/3872682572 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efef80a54f0 0x7efef81ce220 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:03.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.660+0000 7efefd346640 1 -- 172.21.15.12:0/3872682572 >> 172.21.15.12:0/3872682572 conn(0x7efef80aa140 msgr2=0x7efef813c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:03.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.660+0000 7efefd346640 1 -- 172.21.15.12:0/3872682572 shutdown_connections 2024-09-11T23:05:03.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.660+0000 7efefd346640 1 -- 172.21.15.12:0/3872682572 wait complete. 2024-09-11T23:05:03.677 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi012.front.sepia.ceph.com... 2024-09-11T23:05:03.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:05:03.677 DEBUG:teuthology.orchestra.run.smithi012:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-11T23:05:03.688 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi012.stderr:ceph-fuse[36873]: fuse finished with error 0 and tester_r 0 2024-09-11T23:05:03.689 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:05:03.763 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi012.front.sepia.ceph.com 2024-09-11T23:05:03.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:05:03.763 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-11T23:05:03.769 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-11T23:05:03.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.928+0000 7f0f820ae640 1 Processor -- start 2024-09-11T23:05:03.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.928+0000 7f0f820ae640 1 -- start start 2024-09-11T23:05:03.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.928+0000 7f0f820ae640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0f7c09bdc0 0x7f0f7c13ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:03.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.928+0000 7f0f820ae640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f7c09fd30 con 0x7f0f7c133820 2024-09-11T23:05:03.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.928+0000 7f0f820ae640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f0f7c073ca0 con 0x7f0f7c09bdc0 2024-09-11T23:05:03.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.928+0000 7f0f7affd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0f7c09bdc0 0x7f0f7c13ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:03.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.928+0000 7f0f7b7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f0f7c133820 0x7f0f7c133c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42752/0 (socket says 172.21.15.12:42752) 2024-09-11T23:05:03.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.928+0000 7f0f7b7fe640 1 -- 172.21.15.12:0/973848720 learned_addr learned my addr 172.21.15.12:0/973848720 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:03.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.928+0000 7f0f7affd640 1 -- 172.21.15.12:0/973848720 >> v1:172.21.15.12:6789/0 conn(0x7f0f7c133820 legacy=0x7f0f7c133c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:03.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.928+0000 7f0f7affd640 1 -- 172.21.15.12:0/973848720 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f7c072e90 con 0x7f0f7c09bdc0 2024-09-11T23:05:03.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.932+0000 7f0f7affd640 1 --2- 172.21.15.12:0/973848720 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f7c09bdc0 0x7f0f7c13ba80 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0f64009740 tx=0x7f0f6401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=836dd33230d3f4cf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:03.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.932+0000 7f0f7a7fc640 1 -- 172.21.15.12:0/973848720 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f640b0070 con 0x7f0f7c09bdc0 2024-09-11T23:05:03.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.932+0000 7f0f7a7fc640 1 -- 172.21.15.12:0/973848720 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f640ab530 con 0x7f0f7c09bdc0 2024-09-11T23:05:03.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.932+0000 7f0f7a7fc640 1 -- 172.21.15.12:0/973848720 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f640ab830 con 0x7f0f7c09bdc0 2024-09-11T23:05:03.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.932+0000 7f0f820ae640 1 -- 172.21.15.12:0/973848720 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f7c09bdc0 msgr2=0x7f0f7c13ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:03.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.932+0000 7f0f820ae640 1 --2- 172.21.15.12:0/973848720 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f7c09bdc0 0x7f0f7c13ba80 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0f64009740 tx=0x7f0f6401c390 comp rx=0 tx=0).stop 2024-09-11T23:05:03.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.932+0000 7f0f820ae640 1 -- 172.21.15.12:0/973848720 shutdown_connections 2024-09-11T23:05:03.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.932+0000 7f0f820ae640 1 --2- 172.21.15.12:0/973848720 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f7c09bdc0 0x7f0f7c13ba80 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:03.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.932+0000 7f0f820ae640 1 -- 172.21.15.12:0/973848720 >> 172.21.15.12:0/973848720 conn(0x7f0f7c09add0 msgr2=0x7f0f7c09b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:03.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.932+0000 7f0f820ae640 1 -- 172.21.15.12:0/973848720 shutdown_connections 2024-09-11T23:05:03.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.932+0000 7f0f820ae640 1 -- 172.21.15.12:0/973848720 wait complete. 2024-09-11T23:05:03.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.932+0000 7f0f820ae640 1 Processor -- start 2024-09-11T23:05:03.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.932+0000 7f0f820ae640 1 -- start start 2024-09-11T23:05:03.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.932+0000 7f0f820ae640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f7c133820 0x7f0f7c139de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:03.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.932+0000 7f0f820ae640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0f7c13e960 con 0x7f0f7c133820 2024-09-11T23:05:03.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.932+0000 7f0f7b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f7c133820 0x7f0f7c139de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:03.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.932+0000 7f0f7b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f7c133820 0x7f0f7c139de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58344/0 (socket says 172.21.15.12:58344) 2024-09-11T23:05:03.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.932+0000 7f0f7b7fe640 1 -- 172.21.15.12:0/571974085 learned_addr learned my addr 172.21.15.12:0/571974085 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:03.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.932+0000 7f0f7b7fe640 1 -- 172.21.15.12:0/571974085 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f7c0a2bf0 con 0x7f0f7c133820 2024-09-11T23:05:03.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.932+0000 7f0f7b7fe640 1 --2- 172.21.15.12:0/571974085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f7c133820 0x7f0f7c139de0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c00c480 tx=0x7f0f6c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:03.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.932+0000 7f0f73fff640 1 -- 172.21.15.12:0/571974085 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f6c017070 con 0x7f0f7c133820 2024-09-11T23:05:03.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.932+0000 7f0f73fff640 1 -- 172.21.15.12:0/571974085 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f6c005c20 con 0x7f0f7c133820 2024-09-11T23:05:03.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.932+0000 7f0f73fff640 1 -- 172.21.15.12:0/571974085 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f6c007070 con 0x7f0f7c133820 2024-09-11T23:05:03.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.932+0000 7f0f820ae640 1 -- 172.21.15.12:0/571974085 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f7c0a2e90 con 0x7f0f7c133820 2024-09-11T23:05:03.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.932+0000 7f0f820ae640 1 -- 172.21.15.12:0/571974085 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f7c070d60 con 0x7f0f7c133820 2024-09-11T23:05:03.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.936+0000 7f0f820ae640 1 -- 172.21.15.12:0/571974085 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f7c0a3e60 con 0x7f0f7c133820 2024-09-11T23:05:03.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.936+0000 7f0f73fff640 1 -- 172.21.15.12:0/571974085 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 44164+0+0 (secure 0 0 0) 0x7f0f6c01a070 con 0x7f0f7c133820 2024-09-11T23:05:03.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.936+0000 7f0f73fff640 1 --2- 172.21.15.12:0/571974085 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f0f5c035f20 0x7f0f5c0383e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:03.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.936+0000 7f0f7affd640 1 -- 172.21.15.12:0/571974085 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f0f5c035f20 msgr2=0x7f0f5c0383e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6824/718802078 2024-09-11T23:05:03.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.936+0000 7f0f73fff640 1 -- 172.21.15.12:0/571974085 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 3439+0+0 (secure 0 0 0) 0x7f0f6c047ad0 con 0x7f0f7c133820 2024-09-11T23:05:03.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.936+0000 7f0f7affd640 1 --2- 172.21.15.12:0/571974085 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f0f5c035f20 0x7f0f5c0383e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:05:03.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:03.940+0000 7f0f73fff640 1 -- 172.21.15.12:0/571974085 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0f7c0a3e60 con 0x7f0f7c133820 2024-09-11T23:05:04.030 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:04.028+0000 7fbbb2f9a180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T23:05:04.084 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:04.080+0000 7fbbb2f9a180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T23:05:04.135 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:04.132+0000 7fbbb2f9a180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T23:05:04.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:04.140+0000 7f0f7affd640 1 -- 172.21.15.12:0/571974085 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f0f5c035f20 msgr2=0x7f0f5c0383e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6824/718802078 2024-09-11T23:05:04.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:04.140+0000 7f0f7affd640 1 --2- 172.21.15.12:0/571974085 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f0f5c035f20 0x7f0f5c0383e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T23:05:04.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:04.140+0000 7f0f820ae640 1 -- 172.21.15.12:0/571974085 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f0f7c133c00 con 0x7f0f7c133820 2024-09-11T23:05:04.212 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:04.212+0000 7fbbb2f9a180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T23:05:04.264 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:04.260+0000 7fbbb2f9a180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T23:05:04.340 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:04.340+0000 7fbbb2f9a180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T23:05:04.393 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:04.392+0000 7fbbb2f9a180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T23:05:04.538 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:04.536+0000 7fbbb2f9a180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T23:05:04.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:04.544+0000 7f0f7affd640 1 -- 172.21.15.12:0/571974085 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f0f5c035f20 msgr2=0x7f0f5c0383e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6824/718802078 2024-09-11T23:05:04.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:04.544+0000 7f0f7affd640 1 --2- 172.21.15.12:0/571974085 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f0f5c035f20 0x7f0f5c0383e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T23:05:04.591 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:04.588+0000 7fbbb2f9a180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T23:05:04.817 INFO:tasks.ceph.mgr.x.smithi012.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-11T23:05:04.817 INFO:tasks.ceph.mgr.x.smithi012.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-11T23:05:04.817 INFO:tasks.ceph.mgr.x.smithi012.stderr: from numpy import show_config as show_numpy_config 2024-09-11T23:05:04.825 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:04.824+0000 7fbbb2f9a180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T23:05:04.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:04.916+0000 7f0f73fff640 1 -- 172.21.15.12:0/571974085 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v26) ==== 136+0+0 (secure 0 0 0) 0x7f0f6c007210 con 0x7f0f7c133820 2024-09-11T23:05:04.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:04.916+0000 7f0f820ae640 1 -- 172.21.15.12:0/571974085 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f0f5c035f20 msgr2=0x7f0f5c0383e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:05:04.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:04.916+0000 7f0f820ae640 1 --2- 172.21.15.12:0/571974085 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f0f5c035f20 0x7f0f5c0383e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:04.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:04.916+0000 7f0f820ae640 1 -- 172.21.15.12:0/571974085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f7c133820 msgr2=0x7f0f7c139de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:04.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:04.916+0000 7f0f820ae640 1 --2- 172.21.15.12:0/571974085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f7c133820 0x7f0f7c139de0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c00c480 tx=0x7f0f6c00c940 comp rx=0 tx=0).stop 2024-09-11T23:05:04.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:04.916+0000 7f0f820ae640 1 -- 172.21.15.12:0/571974085 shutdown_connections 2024-09-11T23:05:04.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:04.916+0000 7f0f820ae640 1 --2- 172.21.15.12:0/571974085 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f0f5c035f20 0x7f0f5c0383e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:04.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:04.916+0000 7f0f820ae640 1 --2- 172.21.15.12:0/571974085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f7c133820 0x7f0f7c139de0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:04.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:04.916+0000 7f0f820ae640 1 -- 172.21.15.12:0/571974085 >> 172.21.15.12:0/571974085 conn(0x7f0f7c09add0 msgr2=0x7f0f7c1303e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:04.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:04.916+0000 7f0f820ae640 1 -- 172.21.15.12:0/571974085 shutdown_connections 2024-09-11T23:05:04.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:04.916+0000 7f0f820ae640 1 -- 172.21.15.12:0/571974085 wait complete. 2024-09-11T23:05:04.934 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-11T23:05:04.966 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:04.964+0000 7fbbb2f9a180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:05:05.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.060+0000 7f504bbee640 1 Processor -- start 2024-09-11T23:05:05.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.060+0000 7f504bbee640 1 -- start start 2024-09-11T23:05:05.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.064+0000 7f504bbee640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5044070090 0x7f5044067a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:05.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.064+0000 7f504bbee640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50440727b0 con 0x7f5044070470 2024-09-11T23:05:05.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.064+0000 7f504bbee640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f5044072a50 con 0x7f5044070090 2024-09-11T23:05:05.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.064+0000 7f504998a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5044070090 0x7f5044067a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:05.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.064+0000 7f5049189640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f5044070470 0x7f5044070880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:53534/0 (socket says 172.21.15.12:53534) 2024-09-11T23:05:05.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.064+0000 7f5049189640 1 -- 172.21.15.12:0/3493909762 learned_addr learned my addr 172.21.15.12:0/3493909762 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:05.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.064+0000 7f504998a640 1 -- 172.21.15.12:0/3493909762 >> v1:172.21.15.12:6789/0 conn(0x7f5044070470 legacy=0x7f5044070880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:05.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.064+0000 7f5048988640 1 -- 172.21.15.12:0/3493909762 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3364990277 0 0) 0x7f50440727b0 con 0x7f5044070470 2024-09-11T23:05:05.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.064+0000 7f504998a640 1 -- 172.21.15.12:0/3493909762 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5044071f10 con 0x7f5044070090 2024-09-11T23:05:05.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.064+0000 7f504998a640 1 --2- 172.21.15.12:0/3493909762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5044070090 0x7f5044067a00 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f5040009740 tx=0x7f504001c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=713c6eaa281ab789 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:05.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.064+0000 7f5048988640 1 -- 172.21.15.12:0/3493909762 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50400b0070 con 0x7f5044070090 2024-09-11T23:05:05.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.064+0000 7f5048988640 1 -- 172.21.15.12:0/3493909762 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50400ab530 con 0x7f5044070090 2024-09-11T23:05:05.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.064+0000 7f5048988640 1 -- 172.21.15.12:0/3493909762 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50400ab830 con 0x7f5044070090 2024-09-11T23:05:05.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.064+0000 7f504bbee640 1 -- 172.21.15.12:0/3493909762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5044070090 msgr2=0x7f5044067a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:05.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.064+0000 7f504bbee640 1 --2- 172.21.15.12:0/3493909762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5044070090 0x7f5044067a00 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f5040009740 tx=0x7f504001c390 comp rx=0 tx=0).stop 2024-09-11T23:05:05.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.064+0000 7f504bbee640 1 -- 172.21.15.12:0/3493909762 shutdown_connections 2024-09-11T23:05:05.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.064+0000 7f504bbee640 1 --2- 172.21.15.12:0/3493909762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5044070090 0x7f5044067a00 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:05.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.064+0000 7f504bbee640 1 -- 172.21.15.12:0/3493909762 >> 172.21.15.12:0/3493909762 conn(0x7f504409b910 msgr2=0x7f504409dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:05.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.064+0000 7f504bbee640 1 -- 172.21.15.12:0/3493909762 shutdown_connections 2024-09-11T23:05:05.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.064+0000 7f504bbee640 1 -- 172.21.15.12:0/3493909762 wait complete. 2024-09-11T23:05:05.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.068+0000 7f504bbee640 1 Processor -- start 2024-09-11T23:05:05.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.068+0000 7f504bbee640 1 -- start start 2024-09-11T23:05:05.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.068+0000 7f504bbee640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5044070090 0x7f50441ce3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:05.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.068+0000 7f504bbee640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5044141db0 con 0x7f5044070090 2024-09-11T23:05:05.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.068+0000 7f504998a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5044070090 0x7f50441ce3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:05.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.068+0000 7f504998a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5044070090 0x7f50441ce3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59812/0 (socket says 172.21.15.12:59812) 2024-09-11T23:05:05.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.068+0000 7f504998a640 1 -- 172.21.15.12:0/315990642 learned_addr learned my addr 172.21.15.12:0/315990642 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:05.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.068+0000 7f504998a640 1 -- 172.21.15.12:0/315990642 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50440a8760 con 0x7f5044070090 2024-09-11T23:05:05.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.068+0000 7f504998a640 1 --2- 172.21.15.12:0/315990642 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5044070090 0x7f50441ce3c0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f50400ae040 tx=0x7f504001abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:05.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.068+0000 7f503a7fc640 1 -- 172.21.15.12:0/315990642 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50400b0050 con 0x7f5044070090 2024-09-11T23:05:05.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.068+0000 7f503a7fc640 1 -- 172.21.15.12:0/315990642 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50400b1040 con 0x7f5044070090 2024-09-11T23:05:05.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.068+0000 7f503a7fc640 1 -- 172.21.15.12:0/315990642 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50400b5780 con 0x7f5044070090 2024-09-11T23:05:05.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.068+0000 7f504bbee640 1 -- 172.21.15.12:0/315990642 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50440a6c00 con 0x7f5044070090 2024-09-11T23:05:05.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.068+0000 7f504bbee640 1 -- 172.21.15.12:0/315990642 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50440a6920 con 0x7f5044070090 2024-09-11T23:05:05.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.068+0000 7f504bbee640 1 -- 172.21.15.12:0/315990642 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50440a8450 con 0x7f5044070090 2024-09-11T23:05:05.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.068+0000 7f503a7fc640 1 -- 172.21.15.12:0/315990642 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 44164+0+0 (secure 0 0 0) 0x7f50400be030 con 0x7f5044070090 2024-09-11T23:05:05.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.068+0000 7f503a7fc640 1 --2- 172.21.15.12:0/315990642 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f5028035f20 0x7f50280383e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:05.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.068+0000 7f503a7fc640 1 -- 172.21.15.12:0/315990642 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 3439+0+0 (secure 0 0 0) 0x7f50400bc070 con 0x7f5044070090 2024-09-11T23:05:05.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.068+0000 7f5049189640 1 -- 172.21.15.12:0/315990642 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f5028035f20 msgr2=0x7f50280383e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6824/718802078 2024-09-11T23:05:05.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.068+0000 7f5049189640 1 --2- 172.21.15.12:0/315990642 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f5028035f20 0x7f50280383e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:05:05.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.076+0000 7f503a7fc640 1 -- 172.21.15.12:0/315990642 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f50400c5060 con 0x7f5044070090 2024-09-11T23:05:05.082 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:05.080+0000 7fbbb2f9a180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T23:05:05.148 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:05.144+0000 7fbbb2f9a180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T23:05:05.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.240+0000 7f504bbee640 1 -- 172.21.15.12:0/315990642 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f5044067a00 con 0x7f5044070090 2024-09-11T23:05:05.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.240+0000 7f503a7fc640 1 -- 172.21.15.12:0/315990642 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v36) ==== 84+0+207 (secure 0 0 0) 0x7f50400a4e20 con 0x7f5044070090 2024-09-11T23:05:05.241 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:05:05.242 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2024-09-11T23:05:05.242 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:05:05.242 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 1, 2024-09-11T23:05:05.242 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": ".mgr" 2024-09-11T23:05:05.242 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:05:05.242 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:05:05.242 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 6, 2024-09-11T23:05:05.242 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": "cephfs_metadata" 2024-09-11T23:05:05.242 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:05:05.242 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:05:05.243 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 7, 2024-09-11T23:05:05.243 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": "cephfs_data" 2024-09-11T23:05:05.243 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:05:05.243 INFO:teuthology.orchestra.run.smithi012.stdout:] 2024-09-11T23:05:05.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.240+0000 7f504bbee640 1 -- 172.21.15.12:0/315990642 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f5028035f20 msgr2=0x7f50280383e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:05:05.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.240+0000 7f504bbee640 1 --2- 172.21.15.12:0/315990642 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f5028035f20 0x7f50280383e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:05.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.240+0000 7f504bbee640 1 -- 172.21.15.12:0/315990642 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5044070090 msgr2=0x7f50441ce3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:05.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.240+0000 7f504bbee640 1 --2- 172.21.15.12:0/315990642 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5044070090 0x7f50441ce3c0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f50400ae040 tx=0x7f504001abd0 comp rx=0 tx=0).stop 2024-09-11T23:05:05.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.240+0000 7f504bbee640 1 -- 172.21.15.12:0/315990642 shutdown_connections 2024-09-11T23:05:05.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.240+0000 7f504bbee640 1 --2- 172.21.15.12:0/315990642 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f5028035f20 0x7f50280383e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:05.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.240+0000 7f504bbee640 1 --2- 172.21.15.12:0/315990642 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5044070090 0x7f50441ce3c0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:05.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.240+0000 7f504bbee640 1 -- 172.21.15.12:0/315990642 >> 172.21.15.12:0/315990642 conn(0x7f504409b910 msgr2=0x7f504409d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:05.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.240+0000 7f504bbee640 1 -- 172.21.15.12:0/315990642 shutdown_connections 2024-09-11T23:05:05.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.240+0000 7f504bbee640 1 -- 172.21.15.12:0/315990642 wait complete. 2024-09-11T23:05:05.259 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs_b' 2024-09-11T23:05:05.260 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_b_metadata --pg_num_min 64 2024-09-11T23:05:05.289 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:05.288+0000 7fbbb2f9a180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:05:05.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.408+0000 7f2111b91640 1 Processor -- start 2024-09-11T23:05:05.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.408+0000 7f2111b91640 1 -- start start 2024-09-11T23:05:05.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.408+0000 7f2111b91640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f210c139b60 0x7f210c13bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:05.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.408+0000 7f2111b91640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f210c0a1e90 con 0x7f210c133b00 2024-09-11T23:05:05.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.408+0000 7f2111b91640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f210c0a30c0 con 0x7f210c139b60 2024-09-11T23:05:05.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.408+0000 7f210b7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f210c133b00 0x7f210c133ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:53536/0 (socket says 172.21.15.12:53536) 2024-09-11T23:05:05.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.408+0000 7f210b7fe640 1 -- 172.21.15.12:0/1608826027 learned_addr learned my addr 172.21.15.12:0/1608826027 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:05.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.408+0000 7f2103fff640 1 --2- 172.21.15.12:0/1608826027 >> v2:172.21.15.12:3300/0 conn(0x7f210c139b60 0x7f210c13bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:05.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.408+0000 7f210affd640 1 -- 172.21.15.12:0/1608826027 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3154516895 0 0) 0x7f210c0a1e90 con 0x7f210c133b00 2024-09-11T23:05:05.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.408+0000 7f210affd640 1 -- 172.21.15.12:0/1608826027 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20f8003530 con 0x7f210c133b00 2024-09-11T23:05:05.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.408+0000 7f2103fff640 1 -- 172.21.15.12:0/1608826027 >> v1:172.21.15.12:6789/0 conn(0x7f210c133b00 legacy=0x7f210c133ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:05.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.408+0000 7f2103fff640 1 -- 172.21.15.12:0/1608826027 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f210c0a11d0 con 0x7f210c139b60 2024-09-11T23:05:05.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.412+0000 7f2103fff640 1 --2- 172.21.15.12:0/1608826027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f210c139b60 0x7f210c13bf50 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f20f4009740 tx=0x7f20f401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c34a6cc189441cb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:05.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.412+0000 7f210affd640 1 -- 172.21.15.12:0/1608826027 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20f40b0070 con 0x7f210c139b60 2024-09-11T23:05:05.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.412+0000 7f210affd640 1 -- 172.21.15.12:0/1608826027 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20f40ab530 con 0x7f210c139b60 2024-09-11T23:05:05.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.412+0000 7f210affd640 1 -- 172.21.15.12:0/1608826027 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20f40ab830 con 0x7f210c139b60 2024-09-11T23:05:05.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.412+0000 7f2111b91640 1 -- 172.21.15.12:0/1608826027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f210c139b60 msgr2=0x7f210c13bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:05.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.412+0000 7f2111b91640 1 --2- 172.21.15.12:0/1608826027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f210c139b60 0x7f210c13bf50 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f20f4009740 tx=0x7f20f401c390 comp rx=0 tx=0).stop 2024-09-11T23:05:05.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.412+0000 7f2111b91640 1 -- 172.21.15.12:0/1608826027 shutdown_connections 2024-09-11T23:05:05.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.412+0000 7f2111b91640 1 --2- 172.21.15.12:0/1608826027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f210c139b60 0x7f210c13bf50 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:05.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.412+0000 7f2111b91640 1 -- 172.21.15.12:0/1608826027 >> 172.21.15.12:0/1608826027 conn(0x7f210c068000 msgr2=0x7f210c0a59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:05.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.412+0000 7f2111b91640 1 -- 172.21.15.12:0/1608826027 shutdown_connections 2024-09-11T23:05:05.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.412+0000 7f2111b91640 1 -- 172.21.15.12:0/1608826027 wait complete. 2024-09-11T23:05:05.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.412+0000 7f2111b91640 1 Processor -- start 2024-09-11T23:05:05.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.412+0000 7f2111b91640 1 -- start start 2024-09-11T23:05:05.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.416+0000 7f2111b91640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f210c133b00 0x7f210c06bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:05.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.416+0000 7f2111b91640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f210c0a0540 con 0x7f210c133b00 2024-09-11T23:05:05.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.416+0000 7f210b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f210c133b00 0x7f210c06bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:05.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.416+0000 7f210b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f210c133b00 0x7f210c06bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59824/0 (socket says 172.21.15.12:59824) 2024-09-11T23:05:05.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.416+0000 7f210b7fe640 1 -- 172.21.15.12:0/473035372 learned_addr learned my addr 172.21.15.12:0/473035372 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:05.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.416+0000 7f210b7fe640 1 -- 172.21.15.12:0/473035372 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f210c09f520 con 0x7f210c133b00 2024-09-11T23:05:05.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.416+0000 7f210b7fe640 1 --2- 172.21.15.12:0/473035372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f210c133b00 0x7f210c06bc60 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f20fc00c450 tx=0x7f20fc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:05.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.416+0000 7f2108ff9640 1 -- 172.21.15.12:0/473035372 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20fc017070 con 0x7f210c133b00 2024-09-11T23:05:05.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.416+0000 7f2108ff9640 1 -- 172.21.15.12:0/473035372 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20fc005c20 con 0x7f210c133b00 2024-09-11T23:05:05.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.416+0000 7f2111b91640 1 -- 172.21.15.12:0/473035372 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f210c09e480 con 0x7f210c133b00 2024-09-11T23:05:05.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.416+0000 7f2108ff9640 1 -- 172.21.15.12:0/473035372 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20fc007070 con 0x7f210c133b00 2024-09-11T23:05:05.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.416+0000 7f2111b91640 1 -- 172.21.15.12:0/473035372 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f210c09da30 con 0x7f210c133b00 2024-09-11T23:05:05.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.416+0000 7f2108ff9640 1 -- 172.21.15.12:0/473035372 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 44164+0+0 (secure 0 0 0) 0x7f20fc01a070 con 0x7f210c133b00 2024-09-11T23:05:05.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.416+0000 7f2108ff9640 1 --2- 172.21.15.12:0/473035372 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f20ec035ed0 0x7f20ec038390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:05.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.416+0000 7f2108ff9640 1 -- 172.21.15.12:0/473035372 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 3439+0+0 (secure 0 0 0) 0x7f20fc047b40 con 0x7f210c133b00 2024-09-11T23:05:05.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.416+0000 7f2103fff640 1 -- 172.21.15.12:0/473035372 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f20ec035ed0 msgr2=0x7f20ec038390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6824/718802078 2024-09-11T23:05:05.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.416+0000 7f2103fff640 1 --2- 172.21.15.12:0/473035372 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f20ec035ed0 0x7f20ec038390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:05:05.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.416+0000 7f2111b91640 1 -- 172.21.15.12:0/473035372 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f210c133ee0 con 0x7f210c133b00 2024-09-11T23:05:05.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.420+0000 7f2108ff9640 1 -- 172.21.15.12:0/473035372 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f20fc007210 con 0x7f210c133b00 2024-09-11T23:05:05.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.584+0000 7f2111b91640 1 -- 172.21.15.12:0/473035372 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_b_metadata", "pg_num_min": 64} v 0) -- 0x7f210c0a2100 con 0x7f210c133b00 2024-09-11T23:05:05.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.620+0000 7f2103fff640 1 -- 172.21.15.12:0/473035372 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f20ec035ed0 msgr2=0x7f20ec038390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6824/718802078 2024-09-11T23:05:05.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.620+0000 7f2103fff640 1 --2- 172.21.15.12:0/473035372 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f20ec035ed0 0x7f20ec038390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T23:05:05.797 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:05.796+0000 7fbbb2f9a180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T23:05:05.873 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:05.872+0000 7fbbb2f9a180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T23:05:05.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.924+0000 7f2108ff9640 1 -- 172.21.15.12:0/473035372 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_b_metadata", "pg_num_min": 64}]=0 pool 'cephfs_b_metadata' created v37) ==== 142+0+0 (secure 0 0 0) 0x7f20fc0124a0 con 0x7f210c133b00 2024-09-11T23:05:05.925 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_b_metadata' created 2024-09-11T23:05:05.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.928+0000 7f2111b91640 1 -- 172.21.15.12:0/473035372 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f20ec035ed0 msgr2=0x7f20ec038390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:05:05.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.928+0000 7f2111b91640 1 --2- 172.21.15.12:0/473035372 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f20ec035ed0 0x7f20ec038390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:05.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.928+0000 7f2111b91640 1 -- 172.21.15.12:0/473035372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f210c133b00 msgr2=0x7f210c06bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:05.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.928+0000 7f2111b91640 1 --2- 172.21.15.12:0/473035372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f210c133b00 0x7f210c06bc60 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f20fc00c450 tx=0x7f20fc00c910 comp rx=0 tx=0).stop 2024-09-11T23:05:05.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.928+0000 7f2111b91640 1 -- 172.21.15.12:0/473035372 shutdown_connections 2024-09-11T23:05:05.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.928+0000 7f2111b91640 1 --2- 172.21.15.12:0/473035372 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7f20ec035ed0 0x7f20ec038390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:05.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.928+0000 7f2111b91640 1 --2- 172.21.15.12:0/473035372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f210c133b00 0x7f210c06bc60 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:05.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.928+0000 7f2111b91640 1 -- 172.21.15.12:0/473035372 >> 172.21.15.12:0/473035372 conn(0x7f210c068000 msgr2=0x7f210c130a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:05.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.928+0000 7f2111b91640 1 -- 172.21.15.12:0/473035372 shutdown_connections 2024-09-11T23:05:05.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:05.928+0000 7f2111b91640 1 -- 172.21.15.12:0/473035372 wait complete. 2024-09-11T23:05:05.958 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_b_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T23:05:06.037 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:06.036+0000 7fbbb2f9a180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T23:05:06.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.080+0000 7fb044731640 1 Processor -- start 2024-09-11T23:05:06.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.080+0000 7fb044731640 1 -- start start 2024-09-11T23:05:06.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.080+0000 7fb044731640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb03c136dc0 0x7fb03c1371a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:06.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.080+0000 7fb044731640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb03c136bc0 con 0x7fb03c0a2f00 2024-09-11T23:05:06.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.080+0000 7fb044731640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fb03c0a0c60 con 0x7fb03c136dc0 2024-09-11T23:05:06.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.080+0000 7fb0424cd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb03c136dc0 0x7fb03c1371a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:06.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.080+0000 7fb0424cd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb03c136dc0 0x7fb03c1371a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59838/0 (socket says 172.21.15.12:59838) 2024-09-11T23:05:06.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.080+0000 7fb0424cd640 1 -- 172.21.15.12:0/4202696066 learned_addr learned my addr 172.21.15.12:0/4202696066 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:06.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.080+0000 7fb0424cd640 1 -- 172.21.15.12:0/4202696066 >> v1:172.21.15.12:6789/0 conn(0x7fb03c0a2f00 legacy=0x7fb03c0a48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:06.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.080+0000 7fb0424cd640 1 -- 172.21.15.12:0/4202696066 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb03c0a10b0 con 0x7fb03c136dc0 2024-09-11T23:05:06.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.084+0000 7fb0424cd640 1 --2- 172.21.15.12:0/4202696066 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb03c136dc0 0x7fb03c1371a0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fb0340097f0 tx=0x7fb03401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=316325e4830d9782 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:06.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.084+0000 7fb0414cb640 1 -- 172.21.15.12:0/4202696066 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0340b0070 con 0x7fb03c136dc0 2024-09-11T23:05:06.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.084+0000 7fb0414cb640 1 -- 172.21.15.12:0/4202696066 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0340ab530 con 0x7fb03c136dc0 2024-09-11T23:05:06.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.084+0000 7fb0414cb640 1 -- 172.21.15.12:0/4202696066 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0340ab830 con 0x7fb03c136dc0 2024-09-11T23:05:06.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.084+0000 7fb044731640 1 -- 172.21.15.12:0/4202696066 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb03c136dc0 msgr2=0x7fb03c1371a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:06.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.084+0000 7fb044731640 1 --2- 172.21.15.12:0/4202696066 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb03c136dc0 0x7fb03c1371a0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fb0340097f0 tx=0x7fb03401c450 comp rx=0 tx=0).stop 2024-09-11T23:05:06.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.084+0000 7fb044731640 1 -- 172.21.15.12:0/4202696066 shutdown_connections 2024-09-11T23:05:06.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.084+0000 7fb044731640 1 --2- 172.21.15.12:0/4202696066 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb03c136dc0 0x7fb03c1371a0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:06.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.084+0000 7fb044731640 1 -- 172.21.15.12:0/4202696066 >> 172.21.15.12:0/4202696066 conn(0x7fb03c0a94b0 msgr2=0x7fb03c0a59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:06.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.084+0000 7fb044731640 1 -- 172.21.15.12:0/4202696066 shutdown_connections 2024-09-11T23:05:06.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.084+0000 7fb044731640 1 -- 172.21.15.12:0/4202696066 wait complete. 2024-09-11T23:05:06.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.084+0000 7fb044731640 1 Processor -- start 2024-09-11T23:05:06.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.084+0000 7fb044731640 1 -- start start 2024-09-11T23:05:06.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.084+0000 7fb044731640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb03c0a2f00 0x7fb03c09e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:06.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.084+0000 7fb044731640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb03c0a6410 con 0x7fb03c0a2f00 2024-09-11T23:05:06.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.084+0000 7fb0424cd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb03c0a2f00 0x7fb03c09e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:06.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.084+0000 7fb0424cd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb03c0a2f00 0x7fb03c09e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59850/0 (socket says 172.21.15.12:59850) 2024-09-11T23:05:06.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.084+0000 7fb0424cd640 1 -- 172.21.15.12:0/2225739976 learned_addr learned my addr 172.21.15.12:0/2225739976 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:06.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.084+0000 7fb0424cd640 1 -- 172.21.15.12:0/2225739976 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb03c121cd0 con 0x7fb03c0a2f00 2024-09-11T23:05:06.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.088+0000 7fb0424cd640 1 --2- 172.21.15.12:0/2225739976 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb03c0a2f00 0x7fb03c09e1d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb03401a080 tx=0x7fb03401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:06.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.088+0000 7fb03affd640 1 -- 172.21.15.12:0/2225739976 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0340ba020 con 0x7fb03c0a2f00 2024-09-11T23:05:06.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.088+0000 7fb03affd640 1 -- 172.21.15.12:0/2225739976 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0340b6420 con 0x7fb03c0a2f00 2024-09-11T23:05:06.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.088+0000 7fb03affd640 1 -- 172.21.15.12:0/2225739976 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0340b0040 con 0x7fb03c0a2f00 2024-09-11T23:05:06.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.088+0000 7fb044731640 1 -- 172.21.15.12:0/2225739976 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb03c121580 con 0x7fb03c0a2f00 2024-09-11T23:05:06.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.088+0000 7fb044731640 1 -- 172.21.15.12:0/2225739976 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb03c120300 con 0x7fb03c0a2f00 2024-09-11T23:05:06.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.088+0000 7fb044731640 1 -- 172.21.15.12:0/2225739976 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb03c121eb0 con 0x7fb03c0a2f00 2024-09-11T23:05:06.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.088+0000 7fb03affd640 1 -- 172.21.15.12:0/2225739976 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 44164+0+0 (secure 0 0 0) 0x7fb0340bd020 con 0x7fb03c0a2f00 2024-09-11T23:05:06.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.088+0000 7fb03affd640 1 --2- 172.21.15.12:0/2225739976 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fb028035f20 0x7fb0280383e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:06.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.088+0000 7fb03affd640 1 -- 172.21.15.12:0/2225739976 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 3811+0+0 (secure 0 0 0) 0x7fb0340a4e00 con 0x7fb03c0a2f00 2024-09-11T23:05:06.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.088+0000 7fb041ccc640 1 -- 172.21.15.12:0/2225739976 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fb028035f20 msgr2=0x7fb0280383e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6824/718802078 2024-09-11T23:05:06.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.088+0000 7fb041ccc640 1 --2- 172.21.15.12:0/2225739976 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fb028035f20 0x7fb0280383e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:05:06.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.092+0000 7fb03affd640 1 -- 172.21.15.12:0/2225739976 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb0340c4030 con 0x7fb03c0a2f00 2024-09-11T23:05:06.115 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:06.112+0000 7fbbb2f9a180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T23:05:06.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.256+0000 7fb044731640 1 -- 172.21.15.12:0/2225739976 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_b_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fb03c121750 con 0x7fb03c0a2f00 2024-09-11T23:05:06.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.292+0000 7fb041ccc640 1 -- 172.21.15.12:0/2225739976 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fb028035f20 msgr2=0x7fb0280383e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6824/718802078 2024-09-11T23:05:06.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.292+0000 7fb041ccc640 1 --2- 172.21.15.12:0/2225739976 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fb028035f20 0x7fb0280383e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T23:05:06.418 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:06.416+0000 7fbbb2f9a180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T23:05:06.473 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:06.472+0000 7fbbb2f9a180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T23:05:06.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.496+0000 7fb03affd640 1 -- 172.21.15.12:0/2225739976 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_b_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_b_data' created v38) ==== 174+0+0 (secure 0 0 0) 0x7fb03c121cd0 con 0x7fb03c0a2f00 2024-09-11T23:05:06.499 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_b_data' created 2024-09-11T23:05:06.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.500+0000 7fb044731640 1 -- 172.21.15.12:0/2225739976 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fb028035f20 msgr2=0x7fb0280383e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:05:06.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.500+0000 7fb044731640 1 --2- 172.21.15.12:0/2225739976 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fb028035f20 0x7fb0280383e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:06.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.500+0000 7fb044731640 1 -- 172.21.15.12:0/2225739976 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb03c0a2f00 msgr2=0x7fb03c09e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:06.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.500+0000 7fb044731640 1 --2- 172.21.15.12:0/2225739976 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb03c0a2f00 0x7fb03c09e1d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb03401a080 tx=0x7fb03401ac90 comp rx=0 tx=0).stop 2024-09-11T23:05:06.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.500+0000 7fb044731640 1 -- 172.21.15.12:0/2225739976 shutdown_connections 2024-09-11T23:05:06.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.500+0000 7fb044731640 1 --2- 172.21.15.12:0/2225739976 >> [v2:172.21.15.12:6824/718802078,v1:172.21.15.12:6825/718802078] conn(0x7fb028035f20 0x7fb0280383e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:06.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.500+0000 7fb044731640 1 --2- 172.21.15.12:0/2225739976 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb03c0a2f00 0x7fb03c09e1d0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:06.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.500+0000 7fb044731640 1 -- 172.21.15.12:0/2225739976 >> 172.21.15.12:0/2225739976 conn(0x7fb03c0a94b0 msgr2=0x7fb03c0732c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:06.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.500+0000 7fb044731640 1 -- 172.21.15.12:0/2225739976 shutdown_connections 2024-09-11T23:05:06.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.500+0000 7fb044731640 1 -- 172.21.15.12:0/2225739976 wait complete. 2024-09-11T23:05:06.542 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs_b cephfs_b_metadata cephfs_b_data 2024-09-11T23:05:06.597 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:06.596+0000 7fbb3928f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:05:06.597 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:06.596+0000 7fbb3928f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:05:06.597 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:06.596+0000 7fbb3928f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:05:06.598 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:06.596+0000 7fbb3928f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:05:06.598 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:06.596+0000 7fbb3928f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:05:06.598 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:06.596+0000 7fbb3c295640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:05:06.598 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:06.596+0000 7fbb3c295640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:05:06.598 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:06.596+0000 7fbb3c295640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:05:06.598 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:06.596+0000 7fbb3c295640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:05:06.599 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:06.596+0000 7fbb3c295640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:05:06.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.656+0000 7fb24faea640 1 Processor -- start 2024-09-11T23:05:06.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.656+0000 7fb24faea640 1 -- start start 2024-09-11T23:05:06.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.660+0000 7fb24faea640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb248136da0 0x7fb248137180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:06.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.660+0000 7fb24faea640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2480a1e90 con 0x7fb24809ac20 2024-09-11T23:05:06.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.660+0000 7fb24faea640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fb2481376c0 con 0x7fb248136da0 2024-09-11T23:05:06.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.660+0000 7fb24d886640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb248136da0 0x7fb248137180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:06.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.660+0000 7fb24d085640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fb24809ac20 0x7fb2480a36a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:53552/0 (socket says 172.21.15.12:53552) 2024-09-11T23:05:06.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.660+0000 7fb24d085640 1 -- 172.21.15.12:0/1479021684 learned_addr learned my addr 172.21.15.12:0/1479021684 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:06.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.660+0000 7fb24d886640 1 -- 172.21.15.12:0/1479021684 >> v1:172.21.15.12:6789/0 conn(0x7fb24809ac20 legacy=0x7fb2480a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:06.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.660+0000 7fb24d886640 1 -- 172.21.15.12:0/1479021684 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2480a0650 con 0x7fb248136da0 2024-09-11T23:05:06.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.660+0000 7fb24c884640 1 -- 172.21.15.12:0/1479021684 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3837542009 0 0) 0x7fb2480a1e90 con 0x7fb24809ac20 2024-09-11T23:05:06.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.660+0000 7fb24d886640 1 --2- 172.21.15.12:0/1479021684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb248136da0 0x7fb248137180 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fb23c00bfa0 tx=0x7fb23c01eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f210cacd10a550b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:06.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.660+0000 7fb24c884640 1 -- 172.21.15.12:0/1479021684 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb23c00b200 con 0x7fb248136da0 2024-09-11T23:05:06.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.660+0000 7fb24c884640 1 -- 172.21.15.12:0/1479021684 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb23c00b3a0 con 0x7fb248136da0 2024-09-11T23:05:06.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.660+0000 7fb24c884640 1 -- 172.21.15.12:0/1479021684 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb23c0a7910 con 0x7fb248136da0 2024-09-11T23:05:06.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.660+0000 7fb24faea640 1 -- 172.21.15.12:0/1479021684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb248136da0 msgr2=0x7fb248137180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:06.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.660+0000 7fb24faea640 1 --2- 172.21.15.12:0/1479021684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb248136da0 0x7fb248137180 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fb23c00bfa0 tx=0x7fb23c01eb70 comp rx=0 tx=0).stop 2024-09-11T23:05:06.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.660+0000 7fb24faea640 1 -- 172.21.15.12:0/1479021684 shutdown_connections 2024-09-11T23:05:06.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.660+0000 7fb24faea640 1 --2- 172.21.15.12:0/1479021684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb248136da0 0x7fb248137180 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:06.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.660+0000 7fb24faea640 1 -- 172.21.15.12:0/1479021684 >> 172.21.15.12:0/1479021684 conn(0x7fb2480a82f0 msgr2=0x7fb2480a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:06.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.660+0000 7fb24faea640 1 -- 172.21.15.12:0/1479021684 shutdown_connections 2024-09-11T23:05:06.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.660+0000 7fb24faea640 1 -- 172.21.15.12:0/1479021684 wait complete. 2024-09-11T23:05:06.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.664+0000 7fb24faea640 1 Processor -- start 2024-09-11T23:05:06.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.664+0000 7fb24faea640 1 -- start start 2024-09-11T23:05:06.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.664+0000 7fb24faea640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb24809ac20 0x7fb2480729e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:06.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.664+0000 7fb24faea640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb24809f520 con 0x7fb24809ac20 2024-09-11T23:05:06.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.664+0000 7fb24d886640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb24809ac20 0x7fb2480729e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:06.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.664+0000 7fb24d886640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb24809ac20 0x7fb2480729e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59936/0 (socket says 172.21.15.12:59936) 2024-09-11T23:05:06.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.664+0000 7fb24d886640 1 -- 172.21.15.12:0/583713377 learned_addr learned my addr 172.21.15.12:0/583713377 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:06.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.664+0000 7fb24d886640 1 -- 172.21.15.12:0/583713377 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb248071d00 con 0x7fb24809ac20 2024-09-11T23:05:06.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.664+0000 7fb24d886640 1 --2- 172.21.15.12:0/583713377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb24809ac20 0x7fb2480729e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fb23c01b780 tx=0x7fb23c01b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:06.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.664+0000 7fb2467fc640 1 -- 172.21.15.12:0/583713377 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb23c009540 con 0x7fb24809ac20 2024-09-11T23:05:06.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.664+0000 7fb2467fc640 1 -- 172.21.15.12:0/583713377 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb23c0096e0 con 0x7fb24809ac20 2024-09-11T23:05:06.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.664+0000 7fb2467fc640 1 -- 172.21.15.12:0/583713377 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb23c009a00 con 0x7fb24809ac20 2024-09-11T23:05:06.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.664+0000 7fb24faea640 1 -- 172.21.15.12:0/583713377 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb248073260 con 0x7fb24809ac20 2024-09-11T23:05:06.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.664+0000 7fb24faea640 1 -- 172.21.15.12:0/583713377 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2480a7180 con 0x7fb24809ac20 2024-09-11T23:05:06.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.664+0000 7fb2467fc640 1 -- 172.21.15.12:0/583713377 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 43773+0+0 (secure 0 0 0) 0x7fb23c0c0020 con 0x7fb24809ac20 2024-09-11T23:05:06.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.664+0000 7fb24faea640 1 -- 172.21.15.12:0/583713377 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb248073600 con 0x7fb24809ac20 2024-09-11T23:05:06.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.664+0000 7fb2467fc640 1 -- 172.21.15.12:0/583713377 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4539+0+0 (secure 0 0 0) 0x7fb23c0be020 con 0x7fb24809ac20 2024-09-11T23:05:06.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.672+0000 7fb2467fc640 1 -- 172.21.15.12:0/583713377 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb23c0c7020 con 0x7fb24809ac20 2024-09-11T23:05:06.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:06.860+0000 7fb24faea640 1 -- 172.21.15.12:0/583713377 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs_b", "metadata": "cephfs_b_metadata", "data": "cephfs_b_data"} v 0) -- 0x7fb2480738b0 con 0x7fb24809ac20 2024-09-11T23:05:07.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.496+0000 7fb2467fc640 1 -- 172.21.15.12:0/583713377 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs_b", "metadata": "cephfs_b_metadata", "data": "cephfs_b_data"}]=0 new fs with metadata pool 8 and data pool 9 v27) ==== 178+0+0 (secure 0 0 0) 0x7fb23c018760 con 0x7fb24809ac20 2024-09-11T23:05:07.500 INFO:teuthology.orchestra.run.smithi012.stderr:new fs with metadata pool 8 and data pool 9 2024-09-11T23:05:07.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.504+0000 7fb24faea640 1 -- 172.21.15.12:0/583713377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb24809ac20 msgr2=0x7fb2480729e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:07.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.504+0000 7fb24faea640 1 --2- 172.21.15.12:0/583713377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb24809ac20 0x7fb2480729e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fb23c01b780 tx=0x7fb23c01b910 comp rx=0 tx=0).stop 2024-09-11T23:05:07.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.504+0000 7fb24faea640 1 -- 172.21.15.12:0/583713377 shutdown_connections 2024-09-11T23:05:07.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.504+0000 7fb24faea640 1 --2- 172.21.15.12:0/583713377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb24809ac20 0x7fb2480729e0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:07.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.504+0000 7fb24faea640 1 -- 172.21.15.12:0/583713377 >> 172.21.15.12:0/583713377 conn(0x7fb2480a82f0 msgr2=0x7fb24809b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:07.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.504+0000 7fb24faea640 1 -- 172.21.15.12:0/583713377 shutdown_connections 2024-09-11T23:05:07.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.504+0000 7fb24faea640 1 -- 172.21.15.12:0/583713377 wait complete. 2024-09-11T23:05:07.537 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:05:07.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.651+0000 7f1c86abb640 1 Processor -- start 2024-09-11T23:05:07.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.651+0000 7f1c86abb640 1 -- start start 2024-09-11T23:05:07.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.651+0000 7f1c86abb640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1c80137080 0x7f1c8013bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:07.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.651+0000 7f1c86abb640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c800a1ff0 con 0x7f1c80136ca0 2024-09-11T23:05:07.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.651+0000 7f1c86abb640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f1c8009b4a0 con 0x7f1c80137080 2024-09-11T23:05:07.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.655+0000 7f1c7ffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1c80137080 0x7f1c8013bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:07.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.655+0000 7f1c84857640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1c80136ca0 0x7f1c8009ad90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:53564/0 (socket says 172.21.15.12:53564) 2024-09-11T23:05:07.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.655+0000 7f1c84857640 1 -- 172.21.15.12:0/2501344480 learned_addr learned my addr 172.21.15.12:0/2501344480 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:07.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.655+0000 7f1c7ffff640 1 -- 172.21.15.12:0/2501344480 >> v1:172.21.15.12:6789/0 conn(0x7f1c80136ca0 legacy=0x7f1c8009ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:07.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.655+0000 7f1c7ffff640 1 -- 172.21.15.12:0/2501344480 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c800a0eb0 con 0x7f1c80137080 2024-09-11T23:05:07.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.655+0000 7f1c7ffff640 1 --2- 172.21.15.12:0/2501344480 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c80137080 0x7f1c8013bb70 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f1c70009d90 tx=0x7f1c7001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3789aafc804b5ec1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:07.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.655+0000 7f1c7f7fe640 1 -- 172.21.15.12:0/2501344480 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c700b2070 con 0x7f1c80137080 2024-09-11T23:05:07.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.655+0000 7f1c7f7fe640 1 -- 172.21.15.12:0/2501344480 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c700a56e0 con 0x7f1c80137080 2024-09-11T23:05:07.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.655+0000 7f1c7f7fe640 1 -- 172.21.15.12:0/2501344480 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c700a59e0 con 0x7f1c80137080 2024-09-11T23:05:07.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.655+0000 7f1c86abb640 1 -- 172.21.15.12:0/2501344480 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c80137080 msgr2=0x7f1c8013bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:07.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.655+0000 7f1c86abb640 1 --2- 172.21.15.12:0/2501344480 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c80137080 0x7f1c8013bb70 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f1c70009d90 tx=0x7f1c7001c970 comp rx=0 tx=0).stop 2024-09-11T23:05:07.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.655+0000 7f1c86abb640 1 -- 172.21.15.12:0/2501344480 shutdown_connections 2024-09-11T23:05:07.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.655+0000 7f1c86abb640 1 --2- 172.21.15.12:0/2501344480 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c80137080 0x7f1c8013bb70 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:07.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.655+0000 7f1c86abb640 1 -- 172.21.15.12:0/2501344480 >> 172.21.15.12:0/2501344480 conn(0x7f1c800a8450 msgr2=0x7f1c800a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:07.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.655+0000 7f1c86abb640 1 -- 172.21.15.12:0/2501344480 shutdown_connections 2024-09-11T23:05:07.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.655+0000 7f1c86abb640 1 -- 172.21.15.12:0/2501344480 wait complete. 2024-09-11T23:05:07.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.659+0000 7f1c86abb640 1 Processor -- start 2024-09-11T23:05:07.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.659+0000 7f1c86abb640 1 -- start start 2024-09-11T23:05:07.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.659+0000 7f1c86abb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c80136ca0 0x7f1c800728f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:07.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.659+0000 7f1c86abb640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1c8009f520 con 0x7f1c80136ca0 2024-09-11T23:05:07.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.659+0000 7f1c84857640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c80136ca0 0x7f1c800728f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:07.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.659+0000 7f1c84857640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c80136ca0 0x7f1c800728f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59940/0 (socket says 172.21.15.12:59940) 2024-09-11T23:05:07.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.659+0000 7f1c84857640 1 -- 172.21.15.12:0/1377573598 learned_addr learned my addr 172.21.15.12:0/1377573598 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:07.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.659+0000 7f1c84857640 1 -- 172.21.15.12:0/1377573598 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c80073480 con 0x7f1c80136ca0 2024-09-11T23:05:07.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.659+0000 7f1c84857640 1 --2- 172.21.15.12:0/1377573598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c80136ca0 0x7f1c800728f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f1c6800c480 tx=0x7f1c6800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:07.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.659+0000 7f1c7d7fa640 1 -- 172.21.15.12:0/1377573598 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c68017070 con 0x7f1c80136ca0 2024-09-11T23:05:07.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.659+0000 7f1c7d7fa640 1 -- 172.21.15.12:0/1377573598 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c68005c20 con 0x7f1c80136ca0 2024-09-11T23:05:07.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.659+0000 7f1c86abb640 1 -- 172.21.15.12:0/1377573598 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c80071eb0 con 0x7f1c80136ca0 2024-09-11T23:05:07.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.659+0000 7f1c7d7fa640 1 -- 172.21.15.12:0/1377573598 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c68007070 con 0x7f1c80136ca0 2024-09-11T23:05:07.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.659+0000 7f1c86abb640 1 -- 172.21.15.12:0/1377573598 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c801359c0 con 0x7f1c80136ca0 2024-09-11T23:05:07.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.659+0000 7f1c7d7fa640 1 -- 172.21.15.12:0/1377573598 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 43900+0+0 (secure 0 0 0) 0x7f1c6801a070 con 0x7f1c80136ca0 2024-09-11T23:05:07.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.659+0000 7f1c86abb640 1 -- 172.21.15.12:0/1377573598 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c80070370 con 0x7f1c80136ca0 2024-09-11T23:05:07.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.659+0000 7f1c7d7fa640 1 --2- 172.21.15.12:0/1377573598 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f1c60035c50 0x7f1c60038110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:07.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.659+0000 7f1c7d7fa640 1 -- 172.21.15.12:0/1377573598 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4643+0+0 (secure 0 0 0) 0x7f1c68047b30 con 0x7f1c80136ca0 2024-09-11T23:05:07.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.659+0000 7f1c7ffff640 1 --2- 172.21.15.12:0/1377573598 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f1c60035c50 0x7f1c60038110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:07.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.659+0000 7f1c7ffff640 1 --2- 172.21.15.12:0/1377573598 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f1c60035c50 0x7f1c60038110 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1c700af000 tx=0x7f1c700a7070 comp rx=0 tx=0).ready entity=mgr.4612 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:07.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.667+0000 7f1c7d7fa640 1 -- 172.21.15.12:0/1377573598 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1c68007210 con 0x7f1c80136ca0 2024-09-11T23:05:07.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.831+0000 7f1c86abb640 1 -- 172.21.15.12:0/1377573598 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1c8009ad90 con 0x7f1c80136ca0 2024-09-11T23:05:07.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.831+0000 7f1c7d7fa640 1 -- 172.21.15.12:0/1377573598 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+15075 (secure 0 0 0) 0x7f1c6801b450 con 0x7f1c80136ca0 2024-09-11T23:05:07.834 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:05:07.834 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":39,"fsid":"8be14356-3340-4500-91a2-4cbc6b511f65","created":"2024-09-11T23:03:10.620234+0000","modified":"2024-09-11T23:05:06.862874+0000","last_up_change":"2024-09-11T23:03:22.359028+0000","last_in_change":"2024-09-11T23:03:11.545817+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:03:23.587068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:04:43.298425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-11T23:04:44.624329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_b_metadata","create_time":"2024-09-11T23:05:05.624837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs_b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_b_data","create_time":"2024-09-11T23:05:06.296091+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs_b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"153b72a1-40b1-400d-93ea-333e733f9bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6817","nonce":3680911937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6819","nonce":3680911937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6823","nonce":3680911937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6821","nonce":3680911937}]},"public_addr":"172.21.15.12:6817/3680911937","cluster_addr":"172.21.15.12:6819/3680911937","heartbeat_back_addr":"172.21.15.12:6823/3680911937","heartbeat_front_addr":"172.21.15.12:6821/3680911937","state":["exists","up"]},{"osd":1,"uuid":"94669e49-ee4f-4acf-9e25-e94374dda8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6801","nonce":236825163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6803","nonce":236825163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6807","nonce":236825163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6805","nonce":236825163}]},"public_addr":"172.21.15.12:6801/236825163","cluster_addr":"172.21.15.12:6803/236825163","heartbeat_back_addr":"172.21.15.12:6807/236825163","heartbeat_front_addr":"172.21.15.12:6805/236825163","state":["exists","up"]},{"osd":2,"uuid":"826dae4d-8888-4ec5-8f00-425b3be93814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6809","nonce":3263521655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6811","nonce":3263521655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6815","nonce":3263521655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6813","nonce":3263521655}]},"public_addr":"172.21.15.12:6809/3263521655","cluster_addr":"172.21.15.12:6811/3263521655","heartbeat_back_addr":"172.21.15.12:6815/3263521655","heartbeat_front_addr":"172.21.15.12:6813/3263521655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:19.398518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.761524+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.904997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/2509166838":"2024-09-12T23:05:06.494857+0000","172.21.15.12:6825/718802078":"2024-09-12T23:05:06.494857+0000","172.21.15.12:6824/718802078":"2024-09-12T23:05:06.494857+0000","172.21.15.12:0/2490570290":"2024-09-12T23:05:06.494857+0000","172.21.15.12:0/2957476143":"2024-09-12T23:05:06.494857+0000","172.21.15.12:0/37905181":"2024-09-12T23:05:06.494857+0000","172.21.15.12:0/3294231065":"2024-09-12T23:05:06.494857+0000","172.21.15.12:0/2407367943":"2024-09-12T23:05:06.494857+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:05:07.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.831+0000 7f1c86abb640 1 -- 172.21.15.12:0/1377573598 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f1c60035c50 msgr2=0x7f1c60038110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:07.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.831+0000 7f1c86abb640 1 --2- 172.21.15.12:0/1377573598 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f1c60035c50 0x7f1c60038110 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1c700af000 tx=0x7f1c700a7070 comp rx=0 tx=0).stop 2024-09-11T23:05:07.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.831+0000 7f1c86abb640 1 -- 172.21.15.12:0/1377573598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c80136ca0 msgr2=0x7f1c800728f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:07.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.831+0000 7f1c86abb640 1 --2- 172.21.15.12:0/1377573598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c80136ca0 0x7f1c800728f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f1c6800c480 tx=0x7f1c6800c940 comp rx=0 tx=0).stop 2024-09-11T23:05:07.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.831+0000 7f1c86abb640 1 -- 172.21.15.12:0/1377573598 shutdown_connections 2024-09-11T23:05:07.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.831+0000 7f1c86abb640 1 --2- 172.21.15.12:0/1377573598 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f1c60035c50 0x7f1c60038110 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:07.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.831+0000 7f1c86abb640 1 --2- 172.21.15.12:0/1377573598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c80136ca0 0x7f1c800728f0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:07.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.831+0000 7f1c86abb640 1 -- 172.21.15.12:0/1377573598 >> 172.21.15.12:0/1377573598 conn(0x7f1c800a8450 msgr2=0x7f1c800a6d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:07.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.835+0000 7f1c86abb640 1 -- 172.21.15.12:0/1377573598 shutdown_connections 2024-09-11T23:05:07.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.835+0000 7f1c86abb640 1 -- 172.21.15.12:0/1377573598 wait complete. 2024-09-11T23:05:07.853 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:05:07.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.979+0000 7fdfeaf65640 1 Processor -- start 2024-09-11T23:05:07.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.979+0000 7fdfeaf65640 1 -- start start 2024-09-11T23:05:07.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.979+0000 7fdfeaf65640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdfe4137f60 0x7fdfe4138340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:07.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.979+0000 7fdfeaf65640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfe4070c20 con 0x7fdfe40a0c20 2024-09-11T23:05:07.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.979+0000 7fdfeaf65640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fdfe41378e0 con 0x7fdfe4137f60 2024-09-11T23:05:07.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.979+0000 7fdfe8d01640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdfe4137f60 0x7fdfe4138340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:07.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.979+0000 7fdfe3fff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fdfe40a0c20 0x7fdfe4073480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:53570/0 (socket says 172.21.15.12:53570) 2024-09-11T23:05:07.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.979+0000 7fdfe3fff640 1 -- 172.21.15.12:0/3052569810 learned_addr learned my addr 172.21.15.12:0/3052569810 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:07.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.979+0000 7fdfe8d01640 1 -- 172.21.15.12:0/3052569810 >> v1:172.21.15.12:6789/0 conn(0x7fdfe40a0c20 legacy=0x7fdfe4073480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:07.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.979+0000 7fdfe8d01640 1 -- 172.21.15.12:0/3052569810 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfe4067fa0 con 0x7fdfe4137f60 2024-09-11T23:05:07.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.979+0000 7fdfe8d01640 1 --2- 172.21.15.12:0/3052569810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdfe4137f60 0x7fdfe4138340 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4009740 tx=0x7fdfd401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b564294ab01ec2d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:07.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.979+0000 7fdfe37fe640 1 -- 172.21.15.12:0/3052569810 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfd40b0070 con 0x7fdfe4137f60 2024-09-11T23:05:07.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.983+0000 7fdfe37fe640 1 -- 172.21.15.12:0/3052569810 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfd40a4e50 con 0x7fdfe4137f60 2024-09-11T23:05:07.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.983+0000 7fdfe37fe640 1 -- 172.21.15.12:0/3052569810 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfd40ab680 con 0x7fdfe4137f60 2024-09-11T23:05:07.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.983+0000 7fdfeaf65640 1 -- 172.21.15.12:0/3052569810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdfe4137f60 msgr2=0x7fdfe4138340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:07.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.983+0000 7fdfeaf65640 1 --2- 172.21.15.12:0/3052569810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdfe4137f60 0x7fdfe4138340 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4009740 tx=0x7fdfd401c390 comp rx=0 tx=0).stop 2024-09-11T23:05:07.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.983+0000 7fdfeaf65640 1 -- 172.21.15.12:0/3052569810 shutdown_connections 2024-09-11T23:05:07.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.983+0000 7fdfeaf65640 1 --2- 172.21.15.12:0/3052569810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdfe4137f60 0x7fdfe4138340 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:07.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.983+0000 7fdfeaf65640 1 -- 172.21.15.12:0/3052569810 >> 172.21.15.12:0/3052569810 conn(0x7fdfe409aba0 msgr2=0x7fdfe409afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:07.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.983+0000 7fdfeaf65640 1 -- 172.21.15.12:0/3052569810 shutdown_connections 2024-09-11T23:05:07.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.983+0000 7fdfeaf65640 1 -- 172.21.15.12:0/3052569810 wait complete. 2024-09-11T23:05:07.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.983+0000 7fdfeaf65640 1 Processor -- start 2024-09-11T23:05:07.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.983+0000 7fdfeaf65640 1 -- start start 2024-09-11T23:05:07.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.983+0000 7fdfeaf65640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdfe40a0c20 0x7fdfe413c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:07.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.983+0000 7fdfeaf65640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe409bea0 con 0x7fdfe40a0c20 2024-09-11T23:05:07.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.983+0000 7fdfe8d01640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdfe40a0c20 0x7fdfe413c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:07.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.983+0000 7fdfe8d01640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdfe40a0c20 0x7fdfe413c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59968/0 (socket says 172.21.15.12:59968) 2024-09-11T23:05:07.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.983+0000 7fdfe8d01640 1 -- 172.21.15.12:0/1113779750 learned_addr learned my addr 172.21.15.12:0/1113779750 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:07.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.983+0000 7fdfe8d01640 1 -- 172.21.15.12:0/1113779750 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfe413b650 con 0x7fdfe40a0c20 2024-09-11T23:05:07.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.983+0000 7fdfe8d01640 1 --2- 172.21.15.12:0/1113779750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdfe40a0c20 0x7fdfe413c800 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4018fa0 tx=0x7fdfd401abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:07.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.983+0000 7fdfe17fa640 1 -- 172.21.15.12:0/1113779750 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfd40b0050 con 0x7fdfe40a0c20 2024-09-11T23:05:07.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.983+0000 7fdfe17fa640 1 -- 172.21.15.12:0/1113779750 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfd40b1040 con 0x7fdfe40a0c20 2024-09-11T23:05:07.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.983+0000 7fdfeaf65640 1 -- 172.21.15.12:0/1113779750 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfe413c450 con 0x7fdfe40a0c20 2024-09-11T23:05:07.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.983+0000 7fdfe17fa640 1 -- 172.21.15.12:0/1113779750 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfd40b5780 con 0x7fdfe40a0c20 2024-09-11T23:05:07.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.983+0000 7fdfeaf65640 1 -- 172.21.15.12:0/1113779750 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfe413aff0 con 0x7fdfe40a0c20 2024-09-11T23:05:07.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.983+0000 7fdfe17fa640 1 -- 172.21.15.12:0/1113779750 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 43900+0+0 (secure 0 0 0) 0x7fdfd40be030 con 0x7fdfe40a0c20 2024-09-11T23:05:07.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.983+0000 7fdfeaf65640 1 -- 172.21.15.12:0/1113779750 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfe4072de0 con 0x7fdfe40a0c20 2024-09-11T23:05:07.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.983+0000 7fdfe17fa640 1 --2- 172.21.15.12:0/1113779750 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7fdfd0035c50 0x7fdfd0038110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:07.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.983+0000 7fdfe17fa640 1 -- 172.21.15.12:0/1113779750 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4643+0+0 (secure 0 0 0) 0x7fdfd40bc070 con 0x7fdfe40a0c20 2024-09-11T23:05:07.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.987+0000 7fdfe3fff640 1 --2- 172.21.15.12:0/1113779750 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7fdfd0035c50 0x7fdfd0038110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:07.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.987+0000 7fdfe3fff640 1 --2- 172.21.15.12:0/1113779750 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7fdfd0035c50 0x7fdfd0038110 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdfd8001610 tx=0x7fdfd8007ad0 comp rx=0 tx=0).ready entity=mgr.4612 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:07.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:07.991+0000 7fdfe17fa640 1 -- 172.21.15.12:0/1113779750 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fdfd40c5060 con 0x7fdfe40a0c20 2024-09-11T23:05:08.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.151+0000 7fdfeaf65640 1 -- 172.21.15.12:0/1113779750 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdfe4075580 con 0x7fdfe40a0c20 2024-09-11T23:05:08.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.155+0000 7fdfe17fa640 1 -- 172.21.15.12:0/1113779750 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+15062 (secure 0 0 0) 0x7fdfd4016010 con 0x7fdfe40a0c20 2024-09-11T23:05:08.157 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:05:08.158 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":40,"fsid":"8be14356-3340-4500-91a2-4cbc6b511f65","created":"2024-09-11T23:03:10.620234+0000","modified":"2024-09-11T23:05:07.926161+0000","last_up_change":"2024-09-11T23:03:22.359028+0000","last_in_change":"2024-09-11T23:03:11.545817+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:03:23.587068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:04:43.298425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-11T23:04:44.624329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_b_metadata","create_time":"2024-09-11T23:05:05.624837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs_b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_b_data","create_time":"2024-09-11T23:05:06.296091+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs_b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"153b72a1-40b1-400d-93ea-333e733f9bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6817","nonce":3680911937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6819","nonce":3680911937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6823","nonce":3680911937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6821","nonce":3680911937}]},"public_addr":"172.21.15.12:6817/3680911937","cluster_addr":"172.21.15.12:6819/3680911937","heartbeat_back_addr":"172.21.15.12:6823/3680911937","heartbeat_front_addr":"172.21.15.12:6821/3680911937","state":["exists","up"]},{"osd":1,"uuid":"94669e49-ee4f-4acf-9e25-e94374dda8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6801","nonce":236825163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6803","nonce":236825163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6807","nonce":236825163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6805","nonce":236825163}]},"public_addr":"172.21.15.12:6801/236825163","cluster_addr":"172.21.15.12:6803/236825163","heartbeat_back_addr":"172.21.15.12:6807/236825163","heartbeat_front_addr":"172.21.15.12:6805/236825163","state":["exists","up"]},{"osd":2,"uuid":"826dae4d-8888-4ec5-8f00-425b3be93814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6809","nonce":3263521655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6811","nonce":3263521655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6815","nonce":3263521655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6813","nonce":3263521655}]},"public_addr":"172.21.15.12:6809/3263521655","cluster_addr":"172.21.15.12:6811/3263521655","heartbeat_back_addr":"172.21.15.12:6815/3263521655","heartbeat_front_addr":"172.21.15.12:6813/3263521655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:19.398518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.761524+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.904997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/2509166838":"2024-09-12T23:05:06.494857+0000","172.21.15.12:6825/718802078":"2024-09-12T23:05:06.494857+0000","172.21.15.12:6824/718802078":"2024-09-12T23:05:06.494857+0000","172.21.15.12:0/2490570290":"2024-09-12T23:05:06.494857+0000","172.21.15.12:0/2957476143":"2024-09-12T23:05:06.494857+0000","172.21.15.12:0/37905181":"2024-09-12T23:05:06.494857+0000","172.21.15.12:0/3294231065":"2024-09-12T23:05:06.494857+0000","172.21.15.12:0/2407367943":"2024-09-12T23:05:06.494857+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:05:08.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.155+0000 7fdfeaf65640 1 -- 172.21.15.12:0/1113779750 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7fdfd0035c50 msgr2=0x7fdfd0038110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:08.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.155+0000 7fdfeaf65640 1 --2- 172.21.15.12:0/1113779750 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7fdfd0035c50 0x7fdfd0038110 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdfd8001610 tx=0x7fdfd8007ad0 comp rx=0 tx=0).stop 2024-09-11T23:05:08.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.155+0000 7fdfeaf65640 1 -- 172.21.15.12:0/1113779750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdfe40a0c20 msgr2=0x7fdfe413c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:08.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.155+0000 7fdfeaf65640 1 --2- 172.21.15.12:0/1113779750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdfe40a0c20 0x7fdfe413c800 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4018fa0 tx=0x7fdfd401abd0 comp rx=0 tx=0).stop 2024-09-11T23:05:08.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.155+0000 7fdfeaf65640 1 -- 172.21.15.12:0/1113779750 shutdown_connections 2024-09-11T23:05:08.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.155+0000 7fdfeaf65640 1 --2- 172.21.15.12:0/1113779750 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7fdfd0035c50 0x7fdfd0038110 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:08.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.155+0000 7fdfeaf65640 1 --2- 172.21.15.12:0/1113779750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdfe40a0c20 0x7fdfe413c800 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:08.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.155+0000 7fdfeaf65640 1 -- 172.21.15.12:0/1113779750 >> 172.21.15.12:0/1113779750 conn(0x7fdfe409aba0 msgr2=0x7fdfe4131590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:08.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.155+0000 7fdfeaf65640 1 -- 172.21.15.12:0/1113779750 shutdown_connections 2024-09-11T23:05:08.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.155+0000 7fdfeaf65640 1 -- 172.21.15.12:0/1113779750 wait complete. 2024-09-11T23:05:08.177 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs_b standby_count_wanted 0 2024-09-11T23:05:08.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.303+0000 7fe1e2ae8640 1 Processor -- start 2024-09-11T23:05:08.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.303+0000 7fe1e2ae8640 1 -- start start 2024-09-11T23:05:08.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.303+0000 7fe1e2ae8640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe1dc139ff0 0x7fe1dc13a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:08.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.303+0000 7fe1e2ae8640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1dc09fe00 con 0x7fe1dc0a0780 2024-09-11T23:05:08.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.303+0000 7fe1e2ae8640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fe1dc139bc0 con 0x7fe1dc139ff0 2024-09-11T23:05:08.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.303+0000 7fe1e0884640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe1dc139ff0 0x7fe1dc13a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:08.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.303+0000 7fe1dbfff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe1dc0a0780 0x7fe1dc0a36a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:53580/0 (socket says 172.21.15.12:53580) 2024-09-11T23:05:08.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.303+0000 7fe1dbfff640 1 -- 172.21.15.12:0/3396489335 learned_addr learned my addr 172.21.15.12:0/3396489335 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:08.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.307+0000 7fe1e0884640 1 -- 172.21.15.12:0/3396489335 >> v1:172.21.15.12:6789/0 conn(0x7fe1dc0a0780 legacy=0x7fe1dc0a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:08.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.307+0000 7fe1e0884640 1 -- 172.21.15.12:0/3396489335 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1dc13a910 con 0x7fe1dc139ff0 2024-09-11T23:05:08.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.307+0000 7fe1e0884640 1 --2- 172.21.15.12:0/3396489335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1dc139ff0 0x7fe1dc13a3d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fe1c4009740 tx=0x7fe1c401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89306706ecb8b54a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:08.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.307+0000 7fe1db7fe640 1 -- 172.21.15.12:0/3396489335 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1c40b0070 con 0x7fe1dc139ff0 2024-09-11T23:05:08.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.307+0000 7fe1db7fe640 1 -- 172.21.15.12:0/3396489335 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1c40a4e50 con 0x7fe1dc139ff0 2024-09-11T23:05:08.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.307+0000 7fe1db7fe640 1 -- 172.21.15.12:0/3396489335 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1c40ab680 con 0x7fe1dc139ff0 2024-09-11T23:05:08.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.307+0000 7fe1e2ae8640 1 -- 172.21.15.12:0/3396489335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1dc139ff0 msgr2=0x7fe1dc13a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:08.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.307+0000 7fe1e2ae8640 1 --2- 172.21.15.12:0/3396489335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1dc139ff0 0x7fe1dc13a3d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fe1c4009740 tx=0x7fe1c401c390 comp rx=0 tx=0).stop 2024-09-11T23:05:08.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.307+0000 7fe1e2ae8640 1 -- 172.21.15.12:0/3396489335 shutdown_connections 2024-09-11T23:05:08.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.307+0000 7fe1e2ae8640 1 --2- 172.21.15.12:0/3396489335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1dc139ff0 0x7fe1dc13a3d0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:08.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.307+0000 7fe1e2ae8640 1 -- 172.21.15.12:0/3396489335 >> 172.21.15.12:0/3396489335 conn(0x7fe1dc0a82f0 msgr2=0x7fe1dc0a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:08.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.307+0000 7fe1e2ae8640 1 -- 172.21.15.12:0/3396489335 shutdown_connections 2024-09-11T23:05:08.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.307+0000 7fe1e2ae8640 1 -- 172.21.15.12:0/3396489335 wait complete. 2024-09-11T23:05:08.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.307+0000 7fe1e2ae8640 1 Processor -- start 2024-09-11T23:05:08.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.311+0000 7fe1e2ae8640 1 -- start start 2024-09-11T23:05:08.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.311+0000 7fe1e2ae8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1dc0a0780 0x7fe1dc13d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:08.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.311+0000 7fe1e2ae8640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe1dc0a0d10 con 0x7fe1dc0a0780 2024-09-11T23:05:08.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.311+0000 7fe1e0884640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1dc0a0780 0x7fe1dc13d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:08.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.311+0000 7fe1e0884640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1dc0a0780 0x7fe1dc13d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59988/0 (socket says 172.21.15.12:59988) 2024-09-11T23:05:08.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.311+0000 7fe1e0884640 1 -- 172.21.15.12:0/3956333358 learned_addr learned my addr 172.21.15.12:0/3956333358 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:08.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.311+0000 7fe1e0884640 1 -- 172.21.15.12:0/3956333358 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1dc11f1a0 con 0x7fe1dc0a0780 2024-09-11T23:05:08.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.311+0000 7fe1e0884640 1 --2- 172.21.15.12:0/3956333358 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1dc0a0780 0x7fe1dc13d060 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fe1c40ae040 tx=0x7fe1c401abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:08.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.311+0000 7fe1d97fa640 1 -- 172.21.15.12:0/3956333358 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1c40b0050 con 0x7fe1dc0a0780 2024-09-11T23:05:08.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.311+0000 7fe1d97fa640 1 -- 172.21.15.12:0/3956333358 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1c40b1040 con 0x7fe1dc0a0780 2024-09-11T23:05:08.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.311+0000 7fe1e2ae8640 1 -- 172.21.15.12:0/3956333358 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1dc11e620 con 0x7fe1dc0a0780 2024-09-11T23:05:08.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.311+0000 7fe1d97fa640 1 -- 172.21.15.12:0/3956333358 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1c40b7450 con 0x7fe1dc0a0780 2024-09-11T23:05:08.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.311+0000 7fe1e2ae8640 1 -- 172.21.15.12:0/3956333358 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1dc11ee90 con 0x7fe1dc0a0780 2024-09-11T23:05:08.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.311+0000 7fe1d97fa640 1 -- 172.21.15.12:0/3956333358 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 43900+0+0 (secure 0 0 0) 0x7fe1c40be030 con 0x7fe1dc0a0780 2024-09-11T23:05:08.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.311+0000 7fe1d97fa640 1 --2- 172.21.15.12:0/3956333358 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7fe1bc035c50 0x7fe1bc038110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:08.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.311+0000 7fe1e2ae8640 1 -- 172.21.15.12:0/3956333358 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1dc13a450 con 0x7fe1dc0a0780 2024-09-11T23:05:08.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.311+0000 7fe1d97fa640 1 -- 172.21.15.12:0/3956333358 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4643+0+0 (secure 0 0 0) 0x7fe1c40bc070 con 0x7fe1dc0a0780 2024-09-11T23:05:08.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.311+0000 7fe1dbfff640 1 --2- 172.21.15.12:0/3956333358 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7fe1bc035c50 0x7fe1bc038110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:08.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.311+0000 7fe1dbfff640 1 --2- 172.21.15.12:0/3956333358 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7fe1bc035c50 0x7fe1bc038110 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc001610 tx=0x7fe1cc007ad0 comp rx=0 tx=0).ready entity=mgr.4612 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:08.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.315+0000 7fe1d97fa640 1 -- 172.21.15.12:0/3956333358 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe1c40c5060 con 0x7fe1dc0a0780 2024-09-11T23:05:08.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:08.519+0000 7fe1e2ae8640 1 -- 172.21.15.12:0/3956333358 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs_b", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fe1dc09ee70 con 0x7fe1dc0a0780 2024-09-11T23:05:09.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.519+0000 7fe1d97fa640 1 -- 172.21.15.12:0/3956333358 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs_b", "var": "standby_count_wanted", "val": "0"}]=0 v29) ==== 120+0+0 (secure 0 0 0) 0x7fe1c4016010 con 0x7fe1dc0a0780 2024-09-11T23:05:09.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.523+0000 7fe1e2ae8640 1 -- 172.21.15.12:0/3956333358 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7fe1bc035c50 msgr2=0x7fe1bc038110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:09.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.523+0000 7fe1e2ae8640 1 --2- 172.21.15.12:0/3956333358 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7fe1bc035c50 0x7fe1bc038110 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc001610 tx=0x7fe1cc007ad0 comp rx=0 tx=0).stop 2024-09-11T23:05:09.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.523+0000 7fe1e2ae8640 1 -- 172.21.15.12:0/3956333358 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1dc0a0780 msgr2=0x7fe1dc13d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:09.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.523+0000 7fe1e2ae8640 1 --2- 172.21.15.12:0/3956333358 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1dc0a0780 0x7fe1dc13d060 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fe1c40ae040 tx=0x7fe1c401abd0 comp rx=0 tx=0).stop 2024-09-11T23:05:09.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.523+0000 7fe1e2ae8640 1 -- 172.21.15.12:0/3956333358 shutdown_connections 2024-09-11T23:05:09.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.523+0000 7fe1e2ae8640 1 --2- 172.21.15.12:0/3956333358 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7fe1bc035c50 0x7fe1bc038110 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:09.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.523+0000 7fe1e2ae8640 1 --2- 172.21.15.12:0/3956333358 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1dc0a0780 0x7fe1dc13d060 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:09.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.523+0000 7fe1e2ae8640 1 -- 172.21.15.12:0/3956333358 >> 172.21.15.12:0/3956333358 conn(0x7fe1dc0a82f0 msgr2=0x7fe1dc0a1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:09.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.523+0000 7fe1e2ae8640 1 -- 172.21.15.12:0/3956333358 shutdown_connections 2024-09-11T23:05:09.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.523+0000 7fe1e2ae8640 1 -- 172.21.15.12:0/3956333358 wait complete. 2024-09-11T23:05:09.549 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-11T23:05:09.549 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs_b allow_standby_replay false 2024-09-11T23:05:09.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.679+0000 7fcb6130c640 1 Processor -- start 2024-09-11T23:05:09.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.679+0000 7fcb6130c640 1 -- start start 2024-09-11T23:05:09.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.683+0000 7fcb6130c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcb5c13a200 0x7fcb5c13a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:09.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.683+0000 7fcb6130c640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb5c0a1c00 con 0x7fcb5c09fc40 2024-09-11T23:05:09.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.683+0000 7fcb6130c640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fcb5c0a0e40 con 0x7fcb5c13a200 2024-09-11T23:05:09.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.683+0000 7fcb5affd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcb5c13a200 0x7fcb5c13a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:09.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.683+0000 7fcb5a7fc640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fcb5c09fc40 0x7fcb5c09d9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:53582/0 (socket says 172.21.15.12:53582) 2024-09-11T23:05:09.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.683+0000 7fcb5affd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcb5c13a200 0x7fcb5c13a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60020/0 (socket says 172.21.15.12:60020) 2024-09-11T23:05:09.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.683+0000 7fcb5a7fc640 1 -- 172.21.15.12:0/3321729197 learned_addr learned my addr 172.21.15.12:0/3321729197 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:09.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.683+0000 7fcb5affd640 1 -- 172.21.15.12:0/3321729197 >> v1:172.21.15.12:6789/0 conn(0x7fcb5c09fc40 legacy=0x7fcb5c09d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:09.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.683+0000 7fcb59ffb640 1 -- 172.21.15.12:0/3321729197 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1908317083 0 0) 0x7fcb5c0a1c00 con 0x7fcb5c09fc40 2024-09-11T23:05:09.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.683+0000 7fcb5affd640 1 -- 172.21.15.12:0/3321729197 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb5c13ab20 con 0x7fcb5c13a200 2024-09-11T23:05:09.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.683+0000 7fcb5affd640 1 --2- 172.21.15.12:0/3321729197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb5c13a200 0x7fcb5c13a5e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c009740 tx=0x7fcb4c01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85accb6a900ca0f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:09.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.683+0000 7fcb59ffb640 1 -- 172.21.15.12:0/3321729197 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb4c0b0070 con 0x7fcb5c13a200 2024-09-11T23:05:09.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.683+0000 7fcb59ffb640 1 -- 172.21.15.12:0/3321729197 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb4c0ab530 con 0x7fcb5c13a200 2024-09-11T23:05:09.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.683+0000 7fcb59ffb640 1 -- 172.21.15.12:0/3321729197 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb4c0ab830 con 0x7fcb5c13a200 2024-09-11T23:05:09.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.683+0000 7fcb6130c640 1 -- 172.21.15.12:0/3321729197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb5c13a200 msgr2=0x7fcb5c13a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:09.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.683+0000 7fcb6130c640 1 --2- 172.21.15.12:0/3321729197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb5c13a200 0x7fcb5c13a5e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c009740 tx=0x7fcb4c01c390 comp rx=0 tx=0).stop 2024-09-11T23:05:09.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.683+0000 7fcb6130c640 1 -- 172.21.15.12:0/3321729197 shutdown_connections 2024-09-11T23:05:09.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.683+0000 7fcb6130c640 1 --2- 172.21.15.12:0/3321729197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb5c13a200 0x7fcb5c13a5e0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:09.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.683+0000 7fcb6130c640 1 -- 172.21.15.12:0/3321729197 >> 172.21.15.12:0/3321729197 conn(0x7fcb5c06da30 msgr2=0x7fcb5c06de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:09.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.683+0000 7fcb6130c640 1 -- 172.21.15.12:0/3321729197 shutdown_connections 2024-09-11T23:05:09.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.683+0000 7fcb6130c640 1 -- 172.21.15.12:0/3321729197 wait complete. 2024-09-11T23:05:09.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.687+0000 7fcb6130c640 1 Processor -- start 2024-09-11T23:05:09.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.687+0000 7fcb6130c640 1 -- start start 2024-09-11T23:05:09.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.687+0000 7fcb6130c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb5c0a4940 0x7fcb5c0a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:09.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.687+0000 7fcb6130c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcb5c0a17c0 con 0x7fcb5c0a4940 2024-09-11T23:05:09.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.687+0000 7fcb5affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb5c0a4940 0x7fcb5c0a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:09.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.687+0000 7fcb5affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb5c0a4940 0x7fcb5c0a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60026/0 (socket says 172.21.15.12:60026) 2024-09-11T23:05:09.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.687+0000 7fcb5affd640 1 -- 172.21.15.12:0/2360066116 learned_addr learned my addr 172.21.15.12:0/2360066116 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:09.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.687+0000 7fcb5affd640 1 -- 172.21.15.12:0/2360066116 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb5c0a8420 con 0x7fcb5c0a4940 2024-09-11T23:05:09.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.687+0000 7fcb5affd640 1 --2- 172.21.15.12:0/2360066116 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb5c0a4940 0x7fcb5c0a4d20 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c019fc0 tx=0x7fcb4c01abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:09.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.687+0000 7fcb537fe640 1 -- 172.21.15.12:0/2360066116 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb4c0b0050 con 0x7fcb5c0a4940 2024-09-11T23:05:09.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.687+0000 7fcb537fe640 1 -- 172.21.15.12:0/2360066116 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb4c0b1040 con 0x7fcb5c0a4940 2024-09-11T23:05:09.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.687+0000 7fcb6130c640 1 -- 172.21.15.12:0/2360066116 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb5c0a8110 con 0x7fcb5c0a4940 2024-09-11T23:05:09.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.687+0000 7fcb537fe640 1 -- 172.21.15.12:0/2360066116 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb4c0b5610 con 0x7fcb5c0a4940 2024-09-11T23:05:09.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.687+0000 7fcb6130c640 1 -- 172.21.15.12:0/2360066116 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb5c0ac3a0 con 0x7fcb5c0a4940 2024-09-11T23:05:09.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.687+0000 7fcb6130c640 1 -- 172.21.15.12:0/2360066116 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb5c13a5e0 con 0x7fcb5c0a4940 2024-09-11T23:05:09.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.687+0000 7fcb537fe640 1 -- 172.21.15.12:0/2360066116 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 19) ==== 44108+0+0 (secure 0 0 0) 0x7fcb4c0be030 con 0x7fcb5c0a4940 2024-09-11T23:05:09.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.687+0000 7fcb537fe640 1 --2- 172.21.15.12:0/2360066116 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7fcb3c035e90 0x7fcb3c038350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:09.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.687+0000 7fcb537fe640 1 -- 172.21.15.12:0/2360066116 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4643+0+0 (secure 0 0 0) 0x7fcb4c0bc070 con 0x7fcb5c0a4940 2024-09-11T23:05:09.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.687+0000 7fcb5a7fc640 1 --2- 172.21.15.12:0/2360066116 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7fcb3c035e90 0x7fcb3c038350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:09.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.687+0000 7fcb5a7fc640 1 --2- 172.21.15.12:0/2360066116 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7fcb3c035e90 0x7fcb3c038350 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcb44007fd0 tx=0x7fcb44007920 comp rx=0 tx=0).ready entity=mgr.4612 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:09.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.695+0000 7fcb537fe640 1 -- 172.21.15.12:0/2360066116 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fcb4c0c5060 con 0x7fcb5c0a4940 2024-09-11T23:05:09.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:09.891+0000 7fcb6130c640 1 -- 172.21.15.12:0/2360066116 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs_b", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fcb5c073580 con 0x7fcb5c0a4940 2024-09-11T23:05:10.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.519+0000 7fcb537fe640 1 -- 172.21.15.12:0/2360066116 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs_b", "var": "allow_standby_replay", "val": "false"}]=0 v30) ==== 124+0+0 (secure 0 0 0) 0x7fcb4c016010 con 0x7fcb5c0a4940 2024-09-11T23:05:10.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.523+0000 7fcb6130c640 1 -- 172.21.15.12:0/2360066116 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7fcb3c035e90 msgr2=0x7fcb3c038350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:10.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.523+0000 7fcb6130c640 1 --2- 172.21.15.12:0/2360066116 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7fcb3c035e90 0x7fcb3c038350 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcb44007fd0 tx=0x7fcb44007920 comp rx=0 tx=0).stop 2024-09-11T23:05:10.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.523+0000 7fcb6130c640 1 -- 172.21.15.12:0/2360066116 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb5c0a4940 msgr2=0x7fcb5c0a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:10.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.523+0000 7fcb6130c640 1 --2- 172.21.15.12:0/2360066116 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb5c0a4940 0x7fcb5c0a4d20 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c019fc0 tx=0x7fcb4c01abd0 comp rx=0 tx=0).stop 2024-09-11T23:05:10.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.523+0000 7fcb6130c640 1 -- 172.21.15.12:0/2360066116 shutdown_connections 2024-09-11T23:05:10.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.523+0000 7fcb6130c640 1 --2- 172.21.15.12:0/2360066116 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7fcb3c035e90 0x7fcb3c038350 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:10.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.523+0000 7fcb6130c640 1 --2- 172.21.15.12:0/2360066116 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb5c0a4940 0x7fcb5c0a4d20 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:10.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.523+0000 7fcb6130c640 1 -- 172.21.15.12:0/2360066116 >> 172.21.15.12:0/2360066116 conn(0x7fcb5c06da30 msgr2=0x7fcb5c137140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:10.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.523+0000 7fcb6130c640 1 -- 172.21.15.12:0/2360066116 shutdown_connections 2024-09-11T23:05:10.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.523+0000 7fcb6130c640 1 -- 172.21.15.12:0/2360066116 wait complete. 2024-09-11T23:05:10.546 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs_b' 2024-09-11T23:05:10.546 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:05:10.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.667+0000 7f178223d640 1 Processor -- start 2024-09-11T23:05:10.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.667+0000 7f178223d640 1 -- start start 2024-09-11T23:05:10.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.671+0000 7f178223d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f177c09f6e0 0x7f177c13cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:10.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.671+0000 7f178223d640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f177c09e930 con 0x7f177c137e60 2024-09-11T23:05:10.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.671+0000 7f178223d640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f177c1379e0 con 0x7f177c09f6e0 2024-09-11T23:05:10.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.671+0000 7f177affd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f177c09f6e0 0x7f177c13cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:10.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.671+0000 7f177b7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f177c137e60 0x7f177c138240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:53592/0 (socket says 172.21.15.12:53592) 2024-09-11T23:05:10.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.671+0000 7f177b7fe640 1 -- 172.21.15.12:0/1050805616 learned_addr learned my addr 172.21.15.12:0/1050805616 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:10.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.671+0000 7f177affd640 1 -- 172.21.15.12:0/1050805616 >> v1:172.21.15.12:6789/0 conn(0x7f177c137e60 legacy=0x7f177c138240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:10.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.671+0000 7f177affd640 1 -- 172.21.15.12:0/1050805616 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f177c09d910 con 0x7f177c09f6e0 2024-09-11T23:05:10.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.671+0000 7f177affd640 1 --2- 172.21.15.12:0/1050805616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f177c09f6e0 0x7f177c13cc60 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f1770009740 tx=0x7f177001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7d58e56cb952871 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:10.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.671+0000 7f177a7fc640 1 -- 172.21.15.12:0/1050805616 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17700ab570 con 0x7f177c09f6e0 2024-09-11T23:05:10.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.671+0000 7f177a7fc640 1 -- 172.21.15.12:0/1050805616 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17700b0070 con 0x7f177c09f6e0 2024-09-11T23:05:10.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.671+0000 7f177a7fc640 1 -- 172.21.15.12:0/1050805616 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17700ab860 con 0x7f177c09f6e0 2024-09-11T23:05:10.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.671+0000 7f178223d640 1 -- 172.21.15.12:0/1050805616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f177c09f6e0 msgr2=0x7f177c13cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:10.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.671+0000 7f178223d640 1 --2- 172.21.15.12:0/1050805616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f177c09f6e0 0x7f177c13cc60 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f1770009740 tx=0x7f177001c420 comp rx=0 tx=0).stop 2024-09-11T23:05:10.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.671+0000 7f178223d640 1 -- 172.21.15.12:0/1050805616 shutdown_connections 2024-09-11T23:05:10.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.671+0000 7f178223d640 1 --2- 172.21.15.12:0/1050805616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f177c09f6e0 0x7f177c13cc60 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:10.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.671+0000 7f178223d640 1 -- 172.21.15.12:0/1050805616 >> 172.21.15.12:0/1050805616 conn(0x7f177c0a8450 msgr2=0x7f177c0a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:10.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.671+0000 7f178223d640 1 -- 172.21.15.12:0/1050805616 shutdown_connections 2024-09-11T23:05:10.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.671+0000 7f178223d640 1 -- 172.21.15.12:0/1050805616 wait complete. 2024-09-11T23:05:10.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.675+0000 7f178223d640 1 Processor -- start 2024-09-11T23:05:10.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.675+0000 7f178223d640 1 -- start start 2024-09-11T23:05:10.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.675+0000 7f178223d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f177c09f6e0 0x7f177c1d1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:10.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.675+0000 7f178223d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f177c13fd50 con 0x7f177c09f6e0 2024-09-11T23:05:10.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.675+0000 7f177b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f177c09f6e0 0x7f177c1d1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:10.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.675+0000 7f177b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f177c09f6e0 0x7f177c1d1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60046/0 (socket says 172.21.15.12:60046) 2024-09-11T23:05:10.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.675+0000 7f177b7fe640 1 -- 172.21.15.12:0/470645040 learned_addr learned my addr 172.21.15.12:0/470645040 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:10.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.675+0000 7f177b7fe640 1 -- 172.21.15.12:0/470645040 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f177c071680 con 0x7f177c09f6e0 2024-09-11T23:05:10.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.675+0000 7f177b7fe640 1 --2- 172.21.15.12:0/470645040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f177c09f6e0 0x7f177c1d1f50 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f176c00c480 tx=0x7f176c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:10.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.675+0000 7f1763fff640 1 -- 172.21.15.12:0/470645040 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f176c017070 con 0x7f177c09f6e0 2024-09-11T23:05:10.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.675+0000 7f1763fff640 1 -- 172.21.15.12:0/470645040 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f176c005c20 con 0x7f177c09f6e0 2024-09-11T23:05:10.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.675+0000 7f1763fff640 1 -- 172.21.15.12:0/470645040 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f176c007070 con 0x7f177c09f6e0 2024-09-11T23:05:10.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.675+0000 7f178223d640 1 -- 172.21.15.12:0/470645040 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f177c070e10 con 0x7f177c09f6e0 2024-09-11T23:05:10.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.675+0000 7f178223d640 1 -- 172.21.15.12:0/470645040 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f177c070570 con 0x7f177c09f6e0 2024-09-11T23:05:10.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.675+0000 7f1763fff640 1 -- 172.21.15.12:0/470645040 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 19) ==== 44108+0+0 (secure 0 0 0) 0x7f176c01a070 con 0x7f177c09f6e0 2024-09-11T23:05:10.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.675+0000 7f178223d640 1 -- 172.21.15.12:0/470645040 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f177c071430 con 0x7f177c09f6e0 2024-09-11T23:05:10.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.675+0000 7f1763fff640 1 --2- 172.21.15.12:0/470645040 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f1768035e90 0x7f1768038350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:10.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.675+0000 7f1763fff640 1 -- 172.21.15.12:0/470645040 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4643+0+0 (secure 0 0 0) 0x7f176c047f50 con 0x7f177c09f6e0 2024-09-11T23:05:10.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.679+0000 7f177affd640 1 --2- 172.21.15.12:0/470645040 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f1768035e90 0x7f1768038350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:10.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.679+0000 7f177affd640 1 --2- 172.21.15.12:0/470645040 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f1768035e90 0x7f1768038350 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f17700af000 tx=0x7f17700a7000 comp rx=0 tx=0).ready entity=mgr.4612 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:10.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.683+0000 7f1763fff640 1 -- 172.21.15.12:0/470645040 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f176c007210 con 0x7f177c09f6e0 2024-09-11T23:05:10.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.879+0000 7f178223d640 1 -- 172.21.15.12:0/470645040 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f177c06bc60 con 0x7f177c09f6e0 2024-09-11T23:05:10.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.883+0000 7f1763fff640 1 -- 172.21.15.12:0/470645040 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+4890 (secure 0 0 0) 0x7f176c01b450 con 0x7f177c09f6e0 2024-09-11T23:05:10.885 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:05:10.885 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":30,"btime":"2024-09-11T23:05:10:521996+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:04:45.641763+0000","modified":"2024-09-11T23:04:48.653841+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4528},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4528":{"gid":4528,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6829/2765393463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":2765393463},{"type":"v1","addr":"172.21.15.12:6829","nonce":2765393463}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4528,"qdb_cluster":[4528]},"id":3},{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:05:06.863235+0000","modified":"2024-09-11T23:05:09.896567+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4527},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4527":{"gid":4527,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":8,"addr":"172.21.15.12:6827/1887547537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":1887547537},{"type":"v1","addr":"172.21.15.12:6827","nonce":1887547537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs_b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4527,"qdb_cluster":[4527]},"id":4}]} 2024-09-11T23:05:10.885 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 30 2024-09-11T23:05:10.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.883+0000 7f178223d640 1 -- 172.21.15.12:0/470645040 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f1768035e90 msgr2=0x7f1768038350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:10.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.883+0000 7f178223d640 1 --2- 172.21.15.12:0/470645040 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f1768035e90 0x7f1768038350 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f17700af000 tx=0x7f17700a7000 comp rx=0 tx=0).stop 2024-09-11T23:05:10.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.883+0000 7f178223d640 1 -- 172.21.15.12:0/470645040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f177c09f6e0 msgr2=0x7f177c1d1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:10.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.883+0000 7f178223d640 1 --2- 172.21.15.12:0/470645040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f177c09f6e0 0x7f177c1d1f50 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f176c00c480 tx=0x7f176c00c940 comp rx=0 tx=0).stop 2024-09-11T23:05:10.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.883+0000 7f178223d640 1 -- 172.21.15.12:0/470645040 shutdown_connections 2024-09-11T23:05:10.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.883+0000 7f178223d640 1 --2- 172.21.15.12:0/470645040 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f1768035e90 0x7f1768038350 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:10.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.883+0000 7f178223d640 1 --2- 172.21.15.12:0/470645040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f177c09f6e0 0x7f177c1d1f50 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:10.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.883+0000 7f178223d640 1 -- 172.21.15.12:0/470645040 >> 172.21.15.12:0/470645040 conn(0x7f177c0a8450 msgr2=0x7f177c0a7260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:10.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.883+0000 7f178223d640 1 -- 172.21.15.12:0/470645040 shutdown_connections 2024-09-11T23:05:10.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:10.883+0000 7f178223d640 1 -- 172.21.15.12:0/470645040 wait complete. 2024-09-11T23:05:10.903 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:05:11.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.019+0000 7f5a0df68640 1 Processor -- start 2024-09-11T23:05:11.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.023+0000 7f5a0df68640 1 -- start start 2024-09-11T23:05:11.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.023+0000 7f5a0df68640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5a080a4b80 0x7f5a080a7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:11.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.023+0000 7f5a0df68640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a080a82a0 con 0x7f5a0813a410 2024-09-11T23:05:11.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.023+0000 7f5a0df68640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f5a080a3cb0 con 0x7f5a080a4b80 2024-09-11T23:05:11.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.023+0000 7f5a06ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5a080a4b80 0x7f5a080a7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:11.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.023+0000 7f5a077fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f5a0813a410 0x7f5a080a6af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:53600/0 (socket says 172.21.15.12:53600) 2024-09-11T23:05:11.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.023+0000 7f5a077fe640 1 -- 172.21.15.12:0/3413605572 learned_addr learned my addr 172.21.15.12:0/3413605572 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:11.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.023+0000 7f5a06ffd640 1 -- 172.21.15.12:0/3413605572 >> v1:172.21.15.12:6789/0 conn(0x7f5a0813a410 legacy=0x7f5a080a6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:11.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.023+0000 7f5a067fc640 1 -- 172.21.15.12:0/3413605572 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2306840747 0 0) 0x7f5a080a82a0 con 0x7f5a0813a410 2024-09-11T23:05:11.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.023+0000 7f5a06ffd640 1 -- 172.21.15.12:0/3413605572 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a08139fe0 con 0x7f5a080a4b80 2024-09-11T23:05:11.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.023+0000 7f5a06ffd640 1 --2- 172.21.15.12:0/3413605572 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a080a4b80 0x7f5a080a7200 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f59f8009740 tx=0x7f59f801c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b3e1579e4f2f3e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:11.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.023+0000 7f5a067fc640 1 -- 172.21.15.12:0/3413605572 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59f80b0070 con 0x7f5a080a4b80 2024-09-11T23:05:11.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.023+0000 7f5a067fc640 1 -- 172.21.15.12:0/3413605572 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59f80ab530 con 0x7f5a080a4b80 2024-09-11T23:05:11.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.023+0000 7f5a067fc640 1 -- 172.21.15.12:0/3413605572 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59f80ab830 con 0x7f5a080a4b80 2024-09-11T23:05:11.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.027+0000 7f5a0df68640 1 -- 172.21.15.12:0/3413605572 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a080a4b80 msgr2=0x7f5a080a7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:11.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.027+0000 7f5a0df68640 1 --2- 172.21.15.12:0/3413605572 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a080a4b80 0x7f5a080a7200 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f59f8009740 tx=0x7f59f801c390 comp rx=0 tx=0).stop 2024-09-11T23:05:11.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.027+0000 7f5a0df68640 1 -- 172.21.15.12:0/3413605572 shutdown_connections 2024-09-11T23:05:11.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.027+0000 7f5a0df68640 1 --2- 172.21.15.12:0/3413605572 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a080a4b80 0x7f5a080a7200 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:11.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.027+0000 7f5a0df68640 1 -- 172.21.15.12:0/3413605572 >> 172.21.15.12:0/3413605572 conn(0x7f5a080ac2c0 msgr2=0x7f5a080ac6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:11.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.027+0000 7f5a0df68640 1 -- 172.21.15.12:0/3413605572 shutdown_connections 2024-09-11T23:05:11.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.027+0000 7f5a0df68640 1 -- 172.21.15.12:0/3413605572 wait complete. 2024-09-11T23:05:11.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.027+0000 7f5a0df68640 1 Processor -- start 2024-09-11T23:05:11.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.027+0000 7f5a0df68640 1 -- start start 2024-09-11T23:05:11.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.027+0000 7f5a0df68640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a080a4b80 0x7f5a081cecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:11.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.027+0000 7f5a0df68640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5a080a7740 con 0x7f5a080a4b80 2024-09-11T23:05:11.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.027+0000 7f5a077fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a080a4b80 0x7f5a081cecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:11.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.027+0000 7f5a077fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a080a4b80 0x7f5a081cecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60074/0 (socket says 172.21.15.12:60074) 2024-09-11T23:05:11.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.027+0000 7f5a077fe640 1 -- 172.21.15.12:0/1597171352 learned_addr learned my addr 172.21.15.12:0/1597171352 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:11.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.027+0000 7f5a077fe640 1 -- 172.21.15.12:0/1597171352 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a0809c7a0 con 0x7f5a080a4b80 2024-09-11T23:05:11.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.027+0000 7f5a077fe640 1 --2- 172.21.15.12:0/1597171352 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a080a4b80 0x7f5a081cecb0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f59f000c450 tx=0x7f59f000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:11.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.027+0000 7f59fffff640 1 -- 172.21.15.12:0/1597171352 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59f0005c20 con 0x7f5a080a4b80 2024-09-11T23:05:11.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.027+0000 7f59fffff640 1 -- 172.21.15.12:0/1597171352 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59f0005dc0 con 0x7f5a080a4b80 2024-09-11T23:05:11.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.027+0000 7f5a0df68640 1 -- 172.21.15.12:0/1597171352 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a0809a9d0 con 0x7f5a080a4b80 2024-09-11T23:05:11.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.027+0000 7f59fffff640 1 -- 172.21.15.12:0/1597171352 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59f00071a0 con 0x7f5a080a4b80 2024-09-11T23:05:11.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.027+0000 7f5a0df68640 1 -- 172.21.15.12:0/1597171352 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a081ce810 con 0x7f5a080a4b80 2024-09-11T23:05:11.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.031+0000 7f59fffff640 1 -- 172.21.15.12:0/1597171352 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 19) ==== 44108+0+0 (secure 0 0 0) 0x7f59f0007400 con 0x7f5a080a4b80 2024-09-11T23:05:11.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.031+0000 7f5a0df68640 1 -- 172.21.15.12:0/1597171352 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a080a6af0 con 0x7f5a080a4b80 2024-09-11T23:05:11.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.031+0000 7f59fffff640 1 --2- 172.21.15.12:0/1597171352 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f59e8035e40 0x7f59e8038300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:11.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.031+0000 7f59fffff640 1 -- 172.21.15.12:0/1597171352 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4643+0+0 (secure 0 0 0) 0x7f59f0048950 con 0x7f5a080a4b80 2024-09-11T23:05:11.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.031+0000 7f5a06ffd640 1 --2- 172.21.15.12:0/1597171352 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f59e8035e40 0x7f59e8038300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:11.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.031+0000 7f5a06ffd640 1 --2- 172.21.15.12:0/1597171352 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f59e8035e40 0x7f59e8038300 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f59f80ad000 tx=0x7f59f8008040 comp rx=0 tx=0).ready entity=mgr.4612 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:11.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.035+0000 7f59fffff640 1 -- 172.21.15.12:0/1597171352 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f59f00182b0 con 0x7f5a080a4b80 2024-09-11T23:05:11.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.199+0000 7f5a0df68640 1 -- 172.21.15.12:0/1597171352 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5a080a87e0 con 0x7f5a080a4b80 2024-09-11T23:05:11.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.199+0000 7f59fffff640 1 -- 172.21.15.12:0/1597171352 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+15062 (secure 0 0 0) 0x7f59f00076f0 con 0x7f5a080a4b80 2024-09-11T23:05:11.203 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:05:11.203 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":40,"fsid":"8be14356-3340-4500-91a2-4cbc6b511f65","created":"2024-09-11T23:03:10.620234+0000","modified":"2024-09-11T23:05:07.926161+0000","last_up_change":"2024-09-11T23:03:22.359028+0000","last_in_change":"2024-09-11T23:03:11.545817+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:03:23.587068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:04:43.298425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-11T23:04:44.624329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_b_metadata","create_time":"2024-09-11T23:05:05.624837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs_b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_b_data","create_time":"2024-09-11T23:05:06.296091+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs_b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"153b72a1-40b1-400d-93ea-333e733f9bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6817","nonce":3680911937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6819","nonce":3680911937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6823","nonce":3680911937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6821","nonce":3680911937}]},"public_addr":"172.21.15.12:6817/3680911937","cluster_addr":"172.21.15.12:6819/3680911937","heartbeat_back_addr":"172.21.15.12:6823/3680911937","heartbeat_front_addr":"172.21.15.12:6821/3680911937","state":["exists","up"]},{"osd":1,"uuid":"94669e49-ee4f-4acf-9e25-e94374dda8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6801","nonce":236825163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6803","nonce":236825163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6807","nonce":236825163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6805","nonce":236825163}]},"public_addr":"172.21.15.12:6801/236825163","cluster_addr":"172.21.15.12:6803/236825163","heartbeat_back_addr":"172.21.15.12:6807/236825163","heartbeat_front_addr":"172.21.15.12:6805/236825163","state":["exists","up"]},{"osd":2,"uuid":"826dae4d-8888-4ec5-8f00-425b3be93814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6809","nonce":3263521655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6811","nonce":3263521655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6815","nonce":3263521655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6813","nonce":3263521655}]},"public_addr":"172.21.15.12:6809/3263521655","cluster_addr":"172.21.15.12:6811/3263521655","heartbeat_back_addr":"172.21.15.12:6815/3263521655","heartbeat_front_addr":"172.21.15.12:6813/3263521655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:19.398518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.761524+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.904997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/2509166838":"2024-09-12T23:05:06.494857+0000","172.21.15.12:6825/718802078":"2024-09-12T23:05:06.494857+0000","172.21.15.12:6824/718802078":"2024-09-12T23:05:06.494857+0000","172.21.15.12:0/2490570290":"2024-09-12T23:05:06.494857+0000","172.21.15.12:0/2957476143":"2024-09-12T23:05:06.494857+0000","172.21.15.12:0/37905181":"2024-09-12T23:05:06.494857+0000","172.21.15.12:0/3294231065":"2024-09-12T23:05:06.494857+0000","172.21.15.12:0/2407367943":"2024-09-12T23:05:06.494857+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:05:11.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.203+0000 7f5a0df68640 1 -- 172.21.15.12:0/1597171352 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f59e8035e40 msgr2=0x7f59e8038300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:11.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.203+0000 7f5a0df68640 1 --2- 172.21.15.12:0/1597171352 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f59e8035e40 0x7f59e8038300 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f59f80ad000 tx=0x7f59f8008040 comp rx=0 tx=0).stop 2024-09-11T23:05:11.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.203+0000 7f5a0df68640 1 -- 172.21.15.12:0/1597171352 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a080a4b80 msgr2=0x7f5a081cecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:11.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.203+0000 7f5a0df68640 1 --2- 172.21.15.12:0/1597171352 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a080a4b80 0x7f5a081cecb0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f59f000c450 tx=0x7f59f000c910 comp rx=0 tx=0).stop 2024-09-11T23:05:11.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.203+0000 7f5a0df68640 1 -- 172.21.15.12:0/1597171352 shutdown_connections 2024-09-11T23:05:11.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.203+0000 7f5a0df68640 1 --2- 172.21.15.12:0/1597171352 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f59e8035e40 0x7f59e8038300 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:11.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.203+0000 7f5a0df68640 1 --2- 172.21.15.12:0/1597171352 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a080a4b80 0x7f5a081cecb0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:11.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.203+0000 7f5a0df68640 1 -- 172.21.15.12:0/1597171352 >> 172.21.15.12:0/1597171352 conn(0x7f5a080ac2c0 msgr2=0x7f5a0813f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:11.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.203+0000 7f5a0df68640 1 -- 172.21.15.12:0/1597171352 shutdown_connections 2024-09-11T23:05:11.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.203+0000 7f5a0df68640 1 -- 172.21.15.12:0/1597171352 wait complete. 2024-09-11T23:05:11.222 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T23:05:11.223 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:05:11.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.331+0000 7f37000e3640 1 Processor -- start 2024-09-11T23:05:11.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.331+0000 7f37000e3640 1 -- start start 2024-09-11T23:05:11.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.335+0000 7f37000e3640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f36f80a0380 0x7f36f809f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:11.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.335+0000 7f37000e3640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36f806ed80 con 0x7f36f80a0760 2024-09-11T23:05:11.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.335+0000 7f37000e3640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f36f806e890 con 0x7f36f80a0380 2024-09-11T23:05:11.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.335+0000 7f36fde7f640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f36f80a0380 0x7f36f809f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:11.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.335+0000 7f36fd67e640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f36f80a0760 0x7f36f8139b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:53602/0 (socket says 172.21.15.12:53602) 2024-09-11T23:05:11.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.335+0000 7f36fde7f640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f36f80a0380 0x7f36f809f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60084/0 (socket says 172.21.15.12:60084) 2024-09-11T23:05:11.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.335+0000 7f36fd67e640 1 -- 172.21.15.12:0/4148140251 learned_addr learned my addr 172.21.15.12:0/4148140251 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:11.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.335+0000 7f36fde7f640 1 -- 172.21.15.12:0/4148140251 >> v1:172.21.15.12:6789/0 conn(0x7f36f80a0760 legacy=0x7f36f8139b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:11.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.335+0000 7f36fde7f640 1 -- 172.21.15.12:0/4148140251 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36f806eac0 con 0x7f36f80a0380 2024-09-11T23:05:11.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.335+0000 7f36fde7f640 1 --2- 172.21.15.12:0/4148140251 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36f80a0380 0x7f36f809f3b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f36e8009740 tx=0x7f36e801c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d87e8666535cbbb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:11.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.335+0000 7f36fce7d640 1 -- 172.21.15.12:0/4148140251 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36e80b0070 con 0x7f36f80a0380 2024-09-11T23:05:11.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.335+0000 7f36fce7d640 1 -- 172.21.15.12:0/4148140251 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36e80ab530 con 0x7f36f80a0380 2024-09-11T23:05:11.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.335+0000 7f36fce7d640 1 -- 172.21.15.12:0/4148140251 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36e80ab830 con 0x7f36f80a0380 2024-09-11T23:05:11.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.335+0000 7f37000e3640 1 -- 172.21.15.12:0/4148140251 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36f80a0380 msgr2=0x7f36f809f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:11.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.335+0000 7f37000e3640 1 --2- 172.21.15.12:0/4148140251 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36f80a0380 0x7f36f809f3b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f36e8009740 tx=0x7f36e801c390 comp rx=0 tx=0).stop 2024-09-11T23:05:11.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.335+0000 7f37000e3640 1 -- 172.21.15.12:0/4148140251 shutdown_connections 2024-09-11T23:05:11.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.335+0000 7f37000e3640 1 --2- 172.21.15.12:0/4148140251 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36f80a0380 0x7f36f809f3b0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:11.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.335+0000 7f37000e3640 1 -- 172.21.15.12:0/4148140251 >> 172.21.15.12:0/4148140251 conn(0x7f36f80aa2c0 msgr2=0x7f36f80aa6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:11.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.335+0000 7f37000e3640 1 -- 172.21.15.12:0/4148140251 shutdown_connections 2024-09-11T23:05:11.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.335+0000 7f37000e3640 1 -- 172.21.15.12:0/4148140251 wait complete. 2024-09-11T23:05:11.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.339+0000 7f37000e3640 1 Processor -- start 2024-09-11T23:05:11.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.339+0000 7f37000e3640 1 -- start start 2024-09-11T23:05:11.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.339+0000 7f37000e3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36f80a0380 0x7f36f813c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:11.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.339+0000 7f37000e3640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f36f81420c0 con 0x7f36f80a0380 2024-09-11T23:05:11.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.339+0000 7f36fde7f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36f80a0380 0x7f36f813c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:11.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.339+0000 7f36fde7f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36f80a0380 0x7f36f813c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60100/0 (socket says 172.21.15.12:60100) 2024-09-11T23:05:11.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.339+0000 7f36fde7f640 1 -- 172.21.15.12:0/1288973455 learned_addr learned my addr 172.21.15.12:0/1288973455 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:11.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.339+0000 7f36fde7f640 1 -- 172.21.15.12:0/1288973455 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36f813dec0 con 0x7f36f80a0380 2024-09-11T23:05:11.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.339+0000 7f36fde7f640 1 --2- 172.21.15.12:0/1288973455 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36f80a0380 0x7f36f813c380 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f36e8019fc0 tx=0x7f36e801abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:11.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.339+0000 7f36ee7fc640 1 -- 172.21.15.12:0/1288973455 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36e80b0050 con 0x7f36f80a0380 2024-09-11T23:05:11.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.339+0000 7f36ee7fc640 1 -- 172.21.15.12:0/1288973455 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36e80b1040 con 0x7f36f80a0380 2024-09-11T23:05:11.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.339+0000 7f36ee7fc640 1 -- 172.21.15.12:0/1288973455 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36e80b5930 con 0x7f36f80a0380 2024-09-11T23:05:11.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.339+0000 7f37000e3640 1 -- 172.21.15.12:0/1288973455 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36f813e1a0 con 0x7f36f80a0380 2024-09-11T23:05:11.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.339+0000 7f37000e3640 1 -- 172.21.15.12:0/1288973455 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36f813f9f0 con 0x7f36f80a0380 2024-09-11T23:05:11.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.339+0000 7f36ee7fc640 1 -- 172.21.15.12:0/1288973455 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 19) ==== 44108+0+0 (secure 0 0 0) 0x7f36e80be030 con 0x7f36f80a0380 2024-09-11T23:05:11.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.339+0000 7f37000e3640 1 -- 172.21.15.12:0/1288973455 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36f809f3b0 con 0x7f36f80a0380 2024-09-11T23:05:11.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.339+0000 7f36ee7fc640 1 --2- 172.21.15.12:0/1288973455 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f36dc035e90 0x7f36dc038350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:11.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.339+0000 7f36ee7fc640 1 -- 172.21.15.12:0/1288973455 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4643+0+0 (secure 0 0 0) 0x7f36e80bc070 con 0x7f36f80a0380 2024-09-11T23:05:11.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.339+0000 7f36fd67e640 1 --2- 172.21.15.12:0/1288973455 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f36dc035e90 0x7f36dc038350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:11.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.339+0000 7f36fd67e640 1 --2- 172.21.15.12:0/1288973455 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f36dc035e90 0x7f36dc038350 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f36f4007fd0 tx=0x7f36f4007940 comp rx=0 tx=0).ready entity=mgr.4612 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:11.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.343+0000 7f36ee7fc640 1 -- 172.21.15.12:0/1288973455 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f36e80c5020 con 0x7f36f80a0380 2024-09-11T23:05:11.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.503+0000 7f37000e3640 1 -- 172.21.15.12:0/1288973455 --> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f36f81394b0 con 0x7f36dc035e90 2024-09-11T23:05:11.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.523+0000 7f36ee7fc640 1 -- 172.21.15.12:0/1288973455 <== mgr.4612 v2:172.21.15.12:6824/2340508205 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+482154 (secure 0 0 0) 0x7f36f40070d0 con 0x7f36dc035e90 2024-09-11T23:05:11.531 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:05:11.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.527+0000 7f36ee7fc640 1 -- 172.21.15.12:0/1288973455 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 20) ==== 44164+0+0 (secure 0 0 0) 0x7f36e80b77d0 con 0x7f36f80a0380 2024-09-11T23:05:11.536 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-11T23:05:11.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.531+0000 7f37000e3640 1 -- 172.21.15.12:0/1288973455 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f36dc035e90 msgr2=0x7f36dc038350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:11.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.531+0000 7f37000e3640 1 --2- 172.21.15.12:0/1288973455 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f36dc035e90 0x7f36dc038350 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f36f4007fd0 tx=0x7f36f4007940 comp rx=0 tx=0).stop 2024-09-11T23:05:11.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.531+0000 7f37000e3640 1 -- 172.21.15.12:0/1288973455 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36f80a0380 msgr2=0x7f36f813c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:11.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.531+0000 7f37000e3640 1 --2- 172.21.15.12:0/1288973455 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36f80a0380 0x7f36f813c380 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f36e8019fc0 tx=0x7f36e801abd0 comp rx=0 tx=0).stop 2024-09-11T23:05:11.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.531+0000 7f37000e3640 1 -- 172.21.15.12:0/1288973455 shutdown_connections 2024-09-11T23:05:11.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.531+0000 7f37000e3640 1 --2- 172.21.15.12:0/1288973455 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f36dc035e90 0x7f36dc038350 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:11.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.531+0000 7f37000e3640 1 --2- 172.21.15.12:0/1288973455 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36f80a0380 0x7f36f813c380 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:11.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.531+0000 7f37000e3640 1 -- 172.21.15.12:0/1288973455 >> 172.21.15.12:0/1288973455 conn(0x7f36f80aa2c0 msgr2=0x7f36f80732a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:11.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.531+0000 7f37000e3640 1 -- 172.21.15.12:0/1288973455 shutdown_connections 2024-09-11T23:05:11.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.531+0000 7f37000e3640 1 -- 172.21.15.12:0/1288973455 wait complete. 2024-09-11T23:05:11.549 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":7,"stamp":"2024-09-11T23:05:10.523545+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596850,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":298,"num_read_kb":503,"num_write":265,"num_write_kb":1921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":285,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91652,"kb_used_data":2232,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283023868,"statfs":{"total":289910292480,"available":289816440832,"internally_reserved":0,"allocated":2285568,"data_stored":1583335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.994512"},"pg_stats":[{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.000094+0000","last_change":"2024-09-11T23:05:06.988059+0000","last_active":"2024-09-11T23:05:07.000094+0000","last_peered":"2024-09-11T23:05:07.000094+0000","last_clean":"2024-09-11T23:05:07.000094+0000","last_became_active":"2024-09-11T23:05:06.987429+0000","last_became_peered":"2024-09-11T23:05:06.987429+0000","last_unstale":"2024-09-11T23:05:07.000094+0000","last_undegraded":"2024-09-11T23:05:07.000094+0000","last_fullsized":"2024-09-11T23:05:07.000094+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:02.837866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"35'4","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.979471+0000","last_change":"2024-09-11T23:04:45.300320+0000","last_active":"2024-09-11T23:05:06.979471+0000","last_peered":"2024-09-11T23:05:06.979471+0000","last_clean":"2024-09-11T23:05:06.979471+0000","last_became_active":"2024-09-11T23:04:45.300023+0000","last_became_peered":"2024-09-11T23:04:45.300023+0000","last_unstale":"2024-09-11T23:05:06.979471+0000","last_undegraded":"2024-09-11T23:05:06.979471+0000","last_fullsized":"2024-09-11T23:05:06.979471+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:21.535311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.958633+0000","last_change":"2024-09-11T23:04:46.303423+0000","last_active":"2024-09-11T23:05:06.958633+0000","last_peered":"2024-09-11T23:05:06.958633+0000","last_clean":"2024-09-11T23:05:06.958633+0000","last_became_active":"2024-09-11T23:04:46.302883+0000","last_became_peered":"2024-09-11T23:04:46.302883+0000","last_unstale":"2024-09-11T23:05:06.958633+0000","last_undegraded":"2024-09-11T23:05:06.958633+0000","last_fullsized":"2024-09-11T23:05:06.958633+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:26.438762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.958305+0000","last_change":"2024-09-11T23:05:06.533763+0000","last_active":"2024-09-11T23:05:06.958305+0000","last_peered":"2024-09-11T23:05:06.958305+0000","last_clean":"2024-09-11T23:05:06.958305+0000","last_became_active":"2024-09-11T23:05:06.530952+0000","last_became_peered":"2024-09-11T23:05:06.530952+0000","last_unstale":"2024-09-11T23:05:06.958305+0000","last_undegraded":"2024-09-11T23:05:06.958305+0000","last_fullsized":"2024-09-11T23:05:06.958305+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:45.046652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.007240+0000","last_change":"2024-09-11T23:05:06.993107+0000","last_active":"2024-09-11T23:05:07.007240+0000","last_peered":"2024-09-11T23:05:07.007240+0000","last_clean":"2024-09-11T23:05:07.007240+0000","last_became_active":"2024-09-11T23:05:06.987224+0000","last_became_peered":"2024-09-11T23:05:06.987224+0000","last_unstale":"2024-09-11T23:05:07.007240+0000","last_undegraded":"2024-09-11T23:05:07.007240+0000","last_fullsized":"2024-09-11T23:05:07.007240+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:25:44.800463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"35'1","reported_seq":21,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.957554+0000","last_change":"2024-09-11T23:04:45.295255+0000","last_active":"2024-09-11T23:05:06.957554+0000","last_peered":"2024-09-11T23:05:06.957554+0000","last_clean":"2024-09-11T23:05:06.957554+0000","last_became_active":"2024-09-11T23:04:45.293741+0000","last_became_peered":"2024-09-11T23:04:45.293741+0000","last_unstale":"2024-09-11T23:05:06.957554+0000","last_undegraded":"2024-09-11T23:05:06.957554+0000","last_fullsized":"2024-09-11T23:05:06.957554+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:47.401560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.951466+0000","last_change":"2024-09-11T23:04:46.318822+0000","last_active":"2024-09-11T23:05:06.951466+0000","last_peered":"2024-09-11T23:05:06.951466+0000","last_clean":"2024-09-11T23:05:06.951466+0000","last_became_active":"2024-09-11T23:04:46.310782+0000","last_became_peered":"2024-09-11T23:04:46.310782+0000","last_unstale":"2024-09-11T23:05:06.951466+0000","last_undegraded":"2024-09-11T23:05:06.951466+0000","last_fullsized":"2024-09-11T23:05:06.951466+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:24.029506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"39'8","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.527417+0000","last_change":"2024-09-11T23:05:06.534076+0000","last_active":"2024-09-11T23:05:07.527417+0000","last_peered":"2024-09-11T23:05:07.527417+0000","last_clean":"2024-09-11T23:05:07.527417+0000","last_became_active":"2024-09-11T23:05:06.533799+0000","last_became_peered":"2024-09-11T23:05:06.533799+0000","last_unstale":"2024-09-11T23:05:07.527417+0000","last_undegraded":"2024-09-11T23:05:07.527417+0000","last_fullsized":"2024-09-11T23:05:07.527417+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:55.506722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.999470+0000","last_change":"2024-09-11T23:05:06.987669+0000","last_active":"2024-09-11T23:05:06.999470+0000","last_peered":"2024-09-11T23:05:06.999470+0000","last_clean":"2024-09-11T23:05:06.999470+0000","last_became_active":"2024-09-11T23:05:06.975626+0000","last_became_peered":"2024-09-11T23:05:06.975626+0000","last_unstale":"2024-09-11T23:05:06.999470+0000","last_undegraded":"2024-09-11T23:05:06.999470+0000","last_fullsized":"2024-09-11T23:05:06.999470+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:35.878366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"35'2","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.948272+0000","last_change":"2024-09-11T23:04:45.291351+0000","last_active":"2024-09-11T23:05:06.948272+0000","last_peered":"2024-09-11T23:05:06.948272+0000","last_clean":"2024-09-11T23:05:06.948272+0000","last_became_active":"2024-09-11T23:04:45.290803+0000","last_became_peered":"2024-09-11T23:04:45.290803+0000","last_unstale":"2024-09-11T23:05:06.948272+0000","last_undegraded":"2024-09-11T23:05:06.948272+0000","last_fullsized":"2024-09-11T23:05:06.948272+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:21.574886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.964327+0000","last_change":"2024-09-11T23:04:46.321983+0000","last_active":"2024-09-11T23:05:06.964327+0000","last_peered":"2024-09-11T23:05:06.964327+0000","last_clean":"2024-09-11T23:05:06.964327+0000","last_became_active":"2024-09-11T23:04:46.318618+0000","last_became_peered":"2024-09-11T23:04:46.318618+0000","last_unstale":"2024-09-11T23:05:06.964327+0000","last_undegraded":"2024-09-11T23:05:06.964327+0000","last_fullsized":"2024-09-11T23:05:06.964327+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:31.865881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.948731+0000","last_change":"2024-09-11T23:05:06.531879+0000","last_active":"2024-09-11T23:05:06.948731+0000","last_peered":"2024-09-11T23:05:06.948731+0000","last_clean":"2024-09-11T23:05:06.948731+0000","last_became_active":"2024-09-11T23:05:06.531630+0000","last_became_peered":"2024-09-11T23:05:06.531630+0000","last_unstale":"2024-09-11T23:05:06.948731+0000","last_undegraded":"2024-09-11T23:05:06.948731+0000","last_fullsized":"2024-09-11T23:05:06.948731+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:45.046652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.012218+0000","last_change":"2024-09-11T23:05:07.004859+0000","last_active":"2024-09-11T23:05:07.012218+0000","last_peered":"2024-09-11T23:05:07.012218+0000","last_clean":"2024-09-11T23:05:07.012218+0000","last_became_active":"2024-09-11T23:05:07.004547+0000","last_became_peered":"2024-09-11T23:05:07.004547+0000","last_unstale":"2024-09-11T23:05:07.012218+0000","last_undegraded":"2024-09-11T23:05:07.012218+0000","last_fullsized":"2024-09-11T23:05:07.012218+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:37:20.217282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"35'2","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.970654+0000","last_change":"2024-09-11T23:04:45.298753+0000","last_active":"2024-09-11T23:05:06.970654+0000","last_peered":"2024-09-11T23:05:06.970654+0000","last_clean":"2024-09-11T23:05:06.970654+0000","last_became_active":"2024-09-11T23:04:45.293365+0000","last_became_peered":"2024-09-11T23:04:45.293365+0000","last_unstale":"2024-09-11T23:05:06.970654+0000","last_undegraded":"2024-09-11T23:05:06.970654+0000","last_fullsized":"2024-09-11T23:05:06.970654+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:30.192602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.948686+0000","last_change":"2024-09-11T23:04:46.319460+0000","last_active":"2024-09-11T23:05:06.948686+0000","last_peered":"2024-09-11T23:05:06.948686+0000","last_clean":"2024-09-11T23:05:06.948686+0000","last_became_active":"2024-09-11T23:04:46.318424+0000","last_became_peered":"2024-09-11T23:04:46.318424+0000","last_unstale":"2024-09-11T23:05:06.948686+0000","last_undegraded":"2024-09-11T23:05:06.948686+0000","last_fullsized":"2024-09-11T23:05:06.948686+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:11.312361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.959561+0000","last_change":"2024-09-11T23:05:06.535479+0000","last_active":"2024-09-11T23:05:06.959561+0000","last_peered":"2024-09-11T23:05:06.959561+0000","last_clean":"2024-09-11T23:05:06.959561+0000","last_became_active":"2024-09-11T23:05:06.534835+0000","last_became_peered":"2024-09-11T23:05:06.534835+0000","last_unstale":"2024-09-11T23:05:06.959561+0000","last_undegraded":"2024-09-11T23:05:06.959561+0000","last_fullsized":"2024-09-11T23:05:06.959561+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:25.350163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.001871+0000","last_change":"2024-09-11T23:05:06.992845+0000","last_active":"2024-09-11T23:05:07.001871+0000","last_peered":"2024-09-11T23:05:07.001871+0000","last_clean":"2024-09-11T23:05:07.001871+0000","last_became_active":"2024-09-11T23:05:06.988931+0000","last_became_peered":"2024-09-11T23:05:06.988931+0000","last_unstale":"2024-09-11T23:05:07.001871+0000","last_undegraded":"2024-09-11T23:05:07.001871+0000","last_fullsized":"2024-09-11T23:05:07.001871+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:50.163278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.948434+0000","last_change":"2024-09-11T23:04:46.295090+0000","last_active":"2024-09-11T23:05:06.948434+0000","last_peered":"2024-09-11T23:05:06.948434+0000","last_clean":"2024-09-11T23:05:06.948434+0000","last_became_active":"2024-09-11T23:04:46.294809+0000","last_became_peered":"2024-09-11T23:04:46.294809+0000","last_unstale":"2024-09-11T23:05:06.948434+0000","last_undegraded":"2024-09-11T23:05:06.948434+0000","last_fullsized":"2024-09-11T23:05:06.948434+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:55.065032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.932593+0000","last_change":"2024-09-11T23:04:45.282514+0000","last_active":"2024-09-11T23:05:06.932593+0000","last_peered":"2024-09-11T23:05:06.932593+0000","last_clean":"2024-09-11T23:05:06.932593+0000","last_became_active":"2024-09-11T23:04:45.282208+0000","last_became_peered":"2024-09-11T23:04:45.282208+0000","last_unstale":"2024-09-11T23:05:06.932593+0000","last_undegraded":"2024-09-11T23:05:06.932593+0000","last_fullsized":"2024-09-11T23:05:06.932593+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:42:03.884314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.965623+0000","last_change":"2024-09-11T23:05:06.535500+0000","last_active":"2024-09-11T23:05:06.965623+0000","last_peered":"2024-09-11T23:05:06.965623+0000","last_clean":"2024-09-11T23:05:06.965623+0000","last_became_active":"2024-09-11T23:05:06.535290+0000","last_became_peered":"2024-09-11T23:05:06.535290+0000","last_unstale":"2024-09-11T23:05:06.965623+0000","last_undegraded":"2024-09-11T23:05:06.965623+0000","last_fullsized":"2024-09-11T23:05:06.965623+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:00.899145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.000417+0000","last_change":"2024-09-11T23:05:06.992863+0000","last_active":"2024-09-11T23:05:07.000417+0000","last_peered":"2024-09-11T23:05:07.000417+0000","last_clean":"2024-09-11T23:05:07.000417+0000","last_became_active":"2024-09-11T23:05:06.979708+0000","last_became_peered":"2024-09-11T23:05:06.979708+0000","last_unstale":"2024-09-11T23:05:07.000417+0000","last_undegraded":"2024-09-11T23:05:07.000417+0000","last_fullsized":"2024-09-11T23:05:07.000417+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:23.035505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.959074+0000","last_change":"2024-09-11T23:04:46.326774+0000","last_active":"2024-09-11T23:05:06.959074+0000","last_peered":"2024-09-11T23:05:06.959074+0000","last_clean":"2024-09-11T23:05:06.959074+0000","last_became_active":"2024-09-11T23:04:46.326246+0000","last_became_peered":"2024-09-11T23:04:46.326246+0000","last_unstale":"2024-09-11T23:05:06.959074+0000","last_undegraded":"2024-09-11T23:05:06.959074+0000","last_fullsized":"2024-09-11T23:05:06.959074+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:09.138555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"35'2","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.949103+0000","last_change":"2024-09-11T23:04:45.294359+0000","last_active":"2024-09-11T23:05:06.949103+0000","last_peered":"2024-09-11T23:05:06.949103+0000","last_clean":"2024-09-11T23:05:06.949103+0000","last_became_active":"2024-09-11T23:04:45.293592+0000","last_became_peered":"2024-09-11T23:04:45.293592+0000","last_unstale":"2024-09-11T23:05:06.949103+0000","last_undegraded":"2024-09-11T23:05:06.949103+0000","last_fullsized":"2024-09-11T23:05:06.949103+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:11.282148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.955667+0000","last_change":"2024-09-11T23:05:06.542951+0000","last_active":"2024-09-11T23:05:06.955667+0000","last_peered":"2024-09-11T23:05:06.955667+0000","last_clean":"2024-09-11T23:05:06.955667+0000","last_became_active":"2024-09-11T23:05:06.533320+0000","last_became_peered":"2024-09-11T23:05:06.533320+0000","last_unstale":"2024-09-11T23:05:06.955667+0000","last_undegraded":"2024-09-11T23:05:06.955667+0000","last_fullsized":"2024-09-11T23:05:06.955667+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:00.899145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.007259+0000","last_change":"2024-09-11T23:05:06.994998+0000","last_active":"2024-09-11T23:05:07.007259+0000","last_peered":"2024-09-11T23:05:07.007259+0000","last_clean":"2024-09-11T23:05:07.007259+0000","last_became_active":"2024-09-11T23:05:06.989570+0000","last_became_peered":"2024-09-11T23:05:06.989570+0000","last_unstale":"2024-09-11T23:05:07.007259+0000","last_undegraded":"2024-09-11T23:05:07.007259+0000","last_fullsized":"2024-09-11T23:05:07.007259+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:39.752373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.956735+0000","last_change":"2024-09-11T23:04:46.297755+0000","last_active":"2024-09-11T23:05:06.956735+0000","last_peered":"2024-09-11T23:05:06.956735+0000","last_clean":"2024-09-11T23:05:06.956735+0000","last_became_active":"2024-09-11T23:04:46.293603+0000","last_became_peered":"2024-09-11T23:04:46.293603+0000","last_unstale":"2024-09-11T23:05:06.956735+0000","last_undegraded":"2024-09-11T23:05:06.956735+0000","last_fullsized":"2024-09-11T23:05:06.956735+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:31.865881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"36'1","reported_seq":21,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.957018+0000","last_change":"2024-09-11T23:04:45.287761+0000","last_active":"2024-09-11T23:05:06.957018+0000","last_peered":"2024-09-11T23:05:06.957018+0000","last_clean":"2024-09-11T23:05:06.957018+0000","last_became_active":"2024-09-11T23:04:45.286454+0000","last_became_peered":"2024-09-11T23:04:45.286454+0000","last_unstale":"2024-09-11T23:05:06.957018+0000","last_undegraded":"2024-09-11T23:05:06.957018+0000","last_fullsized":"2024-09-11T23:05:06.957018+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:01.543559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.971136+0000","last_change":"2024-09-11T23:05:06.544751+0000","last_active":"2024-09-11T23:05:06.971136+0000","last_peered":"2024-09-11T23:05:06.971136+0000","last_clean":"2024-09-11T23:05:06.971136+0000","last_became_active":"2024-09-11T23:05:06.544281+0000","last_became_peered":"2024-09-11T23:05:06.544281+0000","last_unstale":"2024-09-11T23:05:06.971136+0000","last_undegraded":"2024-09-11T23:05:06.971136+0000","last_fullsized":"2024-09-11T23:05:06.971136+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:59.482764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.004125+0000","last_change":"2024-09-11T23:05:06.994314+0000","last_active":"2024-09-11T23:05:07.004125+0000","last_peered":"2024-09-11T23:05:07.004125+0000","last_clean":"2024-09-11T23:05:07.004125+0000","last_became_active":"2024-09-11T23:05:06.993794+0000","last_became_peered":"2024-09-11T23:05:06.993794+0000","last_unstale":"2024-09-11T23:05:07.004125+0000","last_undegraded":"2024-09-11T23:05:07.004125+0000","last_fullsized":"2024-09-11T23:05:07.004125+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:37:20.217282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"35'1","reported_seq":21,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.934351+0000","last_change":"2024-09-11T23:04:45.296095+0000","last_active":"2024-09-11T23:05:06.934351+0000","last_peered":"2024-09-11T23:05:06.934351+0000","last_clean":"2024-09-11T23:05:06.934351+0000","last_became_active":"2024-09-11T23:04:45.295473+0000","last_became_peered":"2024-09-11T23:04:45.295473+0000","last_unstale":"2024-09-11T23:05:06.934351+0000","last_undegraded":"2024-09-11T23:05:06.934351+0000","last_fullsized":"2024-09-11T23:05:06.934351+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:30.858904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.959674+0000","last_change":"2024-09-11T23:04:46.326881+0000","last_active":"2024-09-11T23:05:06.959674+0000","last_peered":"2024-09-11T23:05:06.959674+0000","last_clean":"2024-09-11T23:05:06.959674+0000","last_became_active":"2024-09-11T23:04:46.326341+0000","last_became_peered":"2024-09-11T23:04:46.326341+0000","last_unstale":"2024-09-11T23:05:06.959674+0000","last_undegraded":"2024-09-11T23:05:06.959674+0000","last_fullsized":"2024-09-11T23:05:06.959674+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:33.670979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.15","version":"39'3","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.970920+0000","last_change":"2024-09-11T23:05:06.532300+0000","last_active":"2024-09-11T23:05:06.970920+0000","last_peered":"2024-09-11T23:05:06.970920+0000","last_clean":"2024-09-11T23:05:06.970920+0000","last_became_active":"2024-09-11T23:05:06.532025+0000","last_became_peered":"2024-09-11T23:05:06.532025+0000","last_unstale":"2024-09-11T23:05:06.970920+0000","last_undegraded":"2024-09-11T23:05:06.970920+0000","last_fullsized":"2024-09-11T23:05:06.970920+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:31.662183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.001195+0000","last_change":"2024-09-11T23:05:06.993725+0000","last_active":"2024-09-11T23:05:07.001195+0000","last_peered":"2024-09-11T23:05:07.001195+0000","last_clean":"2024-09-11T23:05:07.001195+0000","last_became_active":"2024-09-11T23:05:06.993191+0000","last_became_peered":"2024-09-11T23:05:06.993191+0000","last_unstale":"2024-09-11T23:05:07.001195+0000","last_undegraded":"2024-09-11T23:05:07.001195+0000","last_fullsized":"2024-09-11T23:05:07.001195+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:01.603630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.933186+0000","last_change":"2024-09-11T23:04:46.305208+0000","last_active":"2024-09-11T23:05:06.933186+0000","last_peered":"2024-09-11T23:05:06.933186+0000","last_clean":"2024-09-11T23:05:06.933186+0000","last_became_active":"2024-09-11T23:04:46.302083+0000","last_became_peered":"2024-09-11T23:04:46.302083+0000","last_unstale":"2024-09-11T23:05:06.933186+0000","last_undegraded":"2024-09-11T23:05:06.933186+0000","last_fullsized":"2024-09-11T23:05:06.933186+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:26.819867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.934712+0000","last_change":"2024-09-11T23:04:45.288188+0000","last_active":"2024-09-11T23:05:06.934712+0000","last_peered":"2024-09-11T23:05:06.934712+0000","last_clean":"2024-09-11T23:05:06.934712+0000","last_became_active":"2024-09-11T23:04:45.287709+0000","last_became_peered":"2024-09-11T23:04:45.287709+0000","last_unstale":"2024-09-11T23:05:06.934712+0000","last_undegraded":"2024-09-11T23:05:06.934712+0000","last_fullsized":"2024-09-11T23:05:06.934712+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:03.374706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.523587+0000","last_change":"2024-09-11T23:05:06.547698+0000","last_active":"2024-09-11T23:05:07.523587+0000","last_peered":"2024-09-11T23:05:07.523587+0000","last_clean":"2024-09-11T23:05:07.523587+0000","last_became_active":"2024-09-11T23:05:06.547434+0000","last_became_peered":"2024-09-11T23:05:06.547434+0000","last_unstale":"2024-09-11T23:05:07.523587+0000","last_undegraded":"2024-09-11T23:05:07.523587+0000","last_fullsized":"2024-09-11T23:05:07.523587+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:20.609018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.012325+0000","last_change":"2024-09-11T23:05:07.005381+0000","last_active":"2024-09-11T23:05:07.012325+0000","last_peered":"2024-09-11T23:05:07.012325+0000","last_clean":"2024-09-11T23:05:07.012325+0000","last_became_active":"2024-09-11T23:05:07.004605+0000","last_became_peered":"2024-09-11T23:05:07.004605+0000","last_unstale":"2024-09-11T23:05:07.012325+0000","last_undegraded":"2024-09-11T23:05:07.012325+0000","last_fullsized":"2024-09-11T23:05:07.012325+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:46.200998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.958490+0000","last_change":"2024-09-11T23:04:46.317503+0000","last_active":"2024-09-11T23:05:06.958490+0000","last_peered":"2024-09-11T23:05:06.958490+0000","last_clean":"2024-09-11T23:05:06.958490+0000","last_became_active":"2024-09-11T23:04:46.316769+0000","last_became_peered":"2024-09-11T23:04:46.316769+0000","last_unstale":"2024-09-11T23:05:06.958490+0000","last_undegraded":"2024-09-11T23:05:06.958490+0000","last_fullsized":"2024-09-11T23:05:06.958490+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:20.489333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.932893+0000","last_change":"2024-09-11T23:04:45.289256+0000","last_active":"2024-09-11T23:05:06.932893+0000","last_peered":"2024-09-11T23:05:06.932893+0000","last_clean":"2024-09-11T23:05:06.932893+0000","last_became_active":"2024-09-11T23:04:45.288748+0000","last_became_peered":"2024-09-11T23:04:45.288748+0000","last_unstale":"2024-09-11T23:05:06.932893+0000","last_undegraded":"2024-09-11T23:05:06.932893+0000","last_fullsized":"2024-09-11T23:05:06.932893+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:07.147196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.958079+0000","last_change":"2024-09-11T23:05:06.543128+0000","last_active":"2024-09-11T23:05:06.958079+0000","last_peered":"2024-09-11T23:05:06.958079+0000","last_clean":"2024-09-11T23:05:06.958079+0000","last_became_active":"2024-09-11T23:05:06.542436+0000","last_became_peered":"2024-09-11T23:05:06.542436+0000","last_unstale":"2024-09-11T23:05:06.958079+0000","last_undegraded":"2024-09-11T23:05:06.958079+0000","last_fullsized":"2024-09-11T23:05:06.958079+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:31.662183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.001653+0000","last_change":"2024-09-11T23:05:06.992912+0000","last_active":"2024-09-11T23:05:07.001653+0000","last_peered":"2024-09-11T23:05:07.001653+0000","last_clean":"2024-09-11T23:05:07.001653+0000","last_became_active":"2024-09-11T23:05:06.987318+0000","last_became_peered":"2024-09-11T23:05:06.987318+0000","last_unstale":"2024-09-11T23:05:07.001653+0000","last_undegraded":"2024-09-11T23:05:07.001653+0000","last_fullsized":"2024-09-11T23:05:07.001653+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:46.733768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.971114+0000","last_change":"2024-09-11T23:04:46.324555+0000","last_active":"2024-09-11T23:05:06.971114+0000","last_peered":"2024-09-11T23:05:06.971114+0000","last_clean":"2024-09-11T23:05:06.971114+0000","last_became_active":"2024-09-11T23:04:46.324272+0000","last_became_peered":"2024-09-11T23:04:46.324272+0000","last_unstale":"2024-09-11T23:05:06.971114+0000","last_undegraded":"2024-09-11T23:05:06.971114+0000","last_fullsized":"2024-09-11T23:05:06.971114+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:21.068619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.971104+0000","last_change":"2024-09-11T23:04:45.291185+0000","last_active":"2024-09-11T23:05:06.971104+0000","last_peered":"2024-09-11T23:05:06.971104+0000","last_clean":"2024-09-11T23:05:06.971104+0000","last_became_active":"2024-09-11T23:04:45.290872+0000","last_became_peered":"2024-09-11T23:04:45.290872+0000","last_unstale":"2024-09-11T23:05:06.971104+0000","last_undegraded":"2024-09-11T23:05:06.971104+0000","last_fullsized":"2024-09-11T23:05:06.971104+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:37.312674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.966552+0000","last_change":"2024-09-11T23:05:06.545869+0000","last_active":"2024-09-11T23:05:06.966552+0000","last_peered":"2024-09-11T23:05:06.966552+0000","last_clean":"2024-09-11T23:05:06.966552+0000","last_became_active":"2024-09-11T23:05:06.544738+0000","last_became_peered":"2024-09-11T23:05:06.544738+0000","last_unstale":"2024-09-11T23:05:06.966552+0000","last_undegraded":"2024-09-11T23:05:06.966552+0000","last_fullsized":"2024-09-11T23:05:06.966552+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:43.740594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.984871+0000","last_change":"2024-09-11T23:05:06.979874+0000","last_active":"2024-09-11T23:05:06.984871+0000","last_peered":"2024-09-11T23:05:06.984871+0000","last_clean":"2024-09-11T23:05:06.984871+0000","last_became_active":"2024-09-11T23:05:06.978278+0000","last_became_peered":"2024-09-11T23:05:06.978278+0000","last_unstale":"2024-09-11T23:05:06.984871+0000","last_undegraded":"2024-09-11T23:05:06.984871+0000","last_fullsized":"2024-09-11T23:05:06.984871+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:54.900728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.931456+0000","last_change":"2024-09-11T23:04:46.294410+0000","last_active":"2024-09-11T23:05:06.931456+0000","last_peered":"2024-09-11T23:05:06.931456+0000","last_clean":"2024-09-11T23:05:06.931456+0000","last_became_active":"2024-09-11T23:04:46.294110+0000","last_became_peered":"2024-09-11T23:04:46.294110+0000","last_unstale":"2024-09-11T23:05:06.931456+0000","last_undegraded":"2024-09-11T23:05:06.931456+0000","last_fullsized":"2024-09-11T23:05:06.931456+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:25.425271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.933133+0000","last_change":"2024-09-11T23:04:45.291550+0000","last_active":"2024-09-11T23:05:06.933133+0000","last_peered":"2024-09-11T23:05:06.933133+0000","last_clean":"2024-09-11T23:05:06.933133+0000","last_became_active":"2024-09-11T23:04:45.288657+0000","last_became_peered":"2024-09-11T23:04:45.288657+0000","last_unstale":"2024-09-11T23:05:06.933133+0000","last_undegraded":"2024-09-11T23:05:06.933133+0000","last_fullsized":"2024-09-11T23:05:06.933133+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:10.305384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.958470+0000","last_change":"2024-09-11T23:05:06.545740+0000","last_active":"2024-09-11T23:05:06.958470+0000","last_peered":"2024-09-11T23:05:06.958470+0000","last_clean":"2024-09-11T23:05:06.958470+0000","last_became_active":"2024-09-11T23:05:06.543205+0000","last_became_peered":"2024-09-11T23:05:06.543205+0000","last_unstale":"2024-09-11T23:05:06.958470+0000","last_undegraded":"2024-09-11T23:05:06.958470+0000","last_fullsized":"2024-09-11T23:05:06.958470+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:53.799981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.990635+0000","last_change":"2024-09-11T23:05:06.985345+0000","last_active":"2024-09-11T23:05:06.990635+0000","last_peered":"2024-09-11T23:05:06.990635+0000","last_clean":"2024-09-11T23:05:06.990635+0000","last_became_active":"2024-09-11T23:05:06.984425+0000","last_became_peered":"2024-09-11T23:05:06.984425+0000","last_unstale":"2024-09-11T23:05:06.990635+0000","last_undegraded":"2024-09-11T23:05:06.990635+0000","last_fullsized":"2024-09-11T23:05:06.990635+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:37.316173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.958646+0000","last_change":"2024-09-11T23:04:46.294456+0000","last_active":"2024-09-11T23:05:06.958646+0000","last_peered":"2024-09-11T23:05:06.958646+0000","last_clean":"2024-09-11T23:05:06.958646+0000","last_became_active":"2024-09-11T23:04:46.294179+0000","last_became_peered":"2024-09-11T23:04:46.294179+0000","last_unstale":"2024-09-11T23:05:06.958646+0000","last_undegraded":"2024-09-11T23:05:06.958646+0000","last_fullsized":"2024-09-11T23:05:06.958646+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:00.992500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.933684+0000","last_change":"2024-09-11T23:04:45.295884+0000","last_active":"2024-09-11T23:05:06.933684+0000","last_peered":"2024-09-11T23:05:06.933684+0000","last_clean":"2024-09-11T23:05:06.933684+0000","last_became_active":"2024-09-11T23:04:45.294402+0000","last_became_peered":"2024-09-11T23:04:45.294402+0000","last_unstale":"2024-09-11T23:05:06.933684+0000","last_undegraded":"2024-09-11T23:05:06.933684+0000","last_fullsized":"2024-09-11T23:05:06.933684+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:12.693171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"39'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.971000+0000","last_change":"2024-09-11T23:05:06.530183+0000","last_active":"2024-09-11T23:05:06.971000+0000","last_peered":"2024-09-11T23:05:06.971000+0000","last_clean":"2024-09-11T23:05:06.971000+0000","last_became_active":"2024-09-11T23:05:06.526572+0000","last_became_peered":"2024-09-11T23:05:06.526572+0000","last_unstale":"2024-09-11T23:05:06.971000+0000","last_undegraded":"2024-09-11T23:05:06.971000+0000","last_fullsized":"2024-09-11T23:05:06.971000+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:26.961176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.983500+0000","last_change":"2024-09-11T23:05:06.979252+0000","last_active":"2024-09-11T23:05:06.983500+0000","last_peered":"2024-09-11T23:05:06.983500+0000","last_clean":"2024-09-11T23:05:06.983500+0000","last_became_active":"2024-09-11T23:05:06.978549+0000","last_became_peered":"2024-09-11T23:05:06.978549+0000","last_unstale":"2024-09-11T23:05:06.983500+0000","last_undegraded":"2024-09-11T23:05:06.983500+0000","last_fullsized":"2024-09-11T23:05:06.983500+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:52.828195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.934803+0000","last_change":"2024-09-11T23:04:46.296765+0000","last_active":"2024-09-11T23:05:06.934803+0000","last_peered":"2024-09-11T23:05:06.934803+0000","last_clean":"2024-09-11T23:05:06.934803+0000","last_became_active":"2024-09-11T23:04:46.296396+0000","last_became_peered":"2024-09-11T23:04:46.296396+0000","last_unstale":"2024-09-11T23:05:06.934803+0000","last_undegraded":"2024-09-11T23:05:06.934803+0000","last_fullsized":"2024-09-11T23:05:06.934803+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:24.956388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.965568+0000","last_change":"2024-09-11T23:04:45.294541+0000","last_active":"2024-09-11T23:05:06.965568+0000","last_peered":"2024-09-11T23:05:06.965568+0000","last_clean":"2024-09-11T23:05:06.965568+0000","last_became_active":"2024-09-11T23:04:45.294242+0000","last_became_peered":"2024-09-11T23:04:45.294242+0000","last_unstale":"2024-09-11T23:05:06.965568+0000","last_undegraded":"2024-09-11T23:05:06.965568+0000","last_fullsized":"2024-09-11T23:05:06.965568+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:42.801527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.935548+0000","last_change":"2024-09-11T23:05:06.542274+0000","last_active":"2024-09-11T23:05:06.935548+0000","last_peered":"2024-09-11T23:05:06.935548+0000","last_clean":"2024-09-11T23:05:06.935548+0000","last_became_active":"2024-09-11T23:05:06.541365+0000","last_became_peered":"2024-09-11T23:05:06.541365+0000","last_unstale":"2024-09-11T23:05:06.935548+0000","last_undegraded":"2024-09-11T23:05:06.935548+0000","last_fullsized":"2024-09-11T23:05:06.935548+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:12:29.001425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.013410+0000","last_change":"2024-09-11T23:05:07.005411+0000","last_active":"2024-09-11T23:05:07.013410+0000","last_peered":"2024-09-11T23:05:07.013410+0000","last_clean":"2024-09-11T23:05:07.013410+0000","last_became_active":"2024-09-11T23:05:07.004149+0000","last_became_peered":"2024-09-11T23:05:07.004149+0000","last_unstale":"2024-09-11T23:05:07.013410+0000","last_undegraded":"2024-09-11T23:05:07.013410+0000","last_fullsized":"2024-09-11T23:05:07.013410+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:39.989662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.969497+0000","last_change":"2024-09-11T23:04:46.291068+0000","last_active":"2024-09-11T23:05:06.969497+0000","last_peered":"2024-09-11T23:05:06.969497+0000","last_clean":"2024-09-11T23:05:06.969497+0000","last_became_active":"2024-09-11T23:04:46.290401+0000","last_became_peered":"2024-09-11T23:04:46.290401+0000","last_unstale":"2024-09-11T23:05:06.969497+0000","last_undegraded":"2024-09-11T23:05:06.969497+0000","last_fullsized":"2024-09-11T23:05:06.969497+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:56.339465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.943937+0000","last_change":"2024-09-11T23:04:45.287742+0000","last_active":"2024-09-11T23:05:06.943937+0000","last_peered":"2024-09-11T23:05:06.943937+0000","last_clean":"2024-09-11T23:05:06.943937+0000","last_became_active":"2024-09-11T23:04:45.287427+0000","last_became_peered":"2024-09-11T23:04:45.287427+0000","last_unstale":"2024-09-11T23:05:06.943937+0000","last_undegraded":"2024-09-11T23:05:06.943937+0000","last_fullsized":"2024-09-11T23:05:06.943937+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:12:05.734167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.525482+0000","last_change":"2024-09-11T23:05:06.537058+0000","last_active":"2024-09-11T23:05:07.525482+0000","last_peered":"2024-09-11T23:05:07.525482+0000","last_clean":"2024-09-11T23:05:07.525482+0000","last_became_active":"2024-09-11T23:05:06.536750+0000","last_became_peered":"2024-09-11T23:05:06.536750+0000","last_unstale":"2024-09-11T23:05:07.525482+0000","last_undegraded":"2024-09-11T23:05:07.525482+0000","last_fullsized":"2024-09-11T23:05:07.525482+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:27.071695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.012719+0000","last_change":"2024-09-11T23:05:07.011369+0000","last_active":"2024-09-11T23:05:07.012719+0000","last_peered":"2024-09-11T23:05:07.012719+0000","last_clean":"2024-09-11T23:05:07.012719+0000","last_became_active":"2024-09-11T23:05:07.010581+0000","last_became_peered":"2024-09-11T23:05:07.010581+0000","last_unstale":"2024-09-11T23:05:07.012719+0000","last_undegraded":"2024-09-11T23:05:07.012719+0000","last_fullsized":"2024-09-11T23:05:07.012719+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:18.543786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.956244+0000","last_change":"2024-09-11T23:04:46.303925+0000","last_active":"2024-09-11T23:05:06.956244+0000","last_peered":"2024-09-11T23:05:06.956244+0000","last_clean":"2024-09-11T23:05:06.956244+0000","last_became_active":"2024-09-11T23:04:46.303641+0000","last_became_peered":"2024-09-11T23:04:46.303641+0000","last_unstale":"2024-09-11T23:05:06.956244+0000","last_undegraded":"2024-09-11T23:05:06.956244+0000","last_fullsized":"2024-09-11T23:05:06.956244+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:56.339465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.931105+0000","last_change":"2024-09-11T23:04:45.290849+0000","last_active":"2024-09-11T23:05:06.931105+0000","last_peered":"2024-09-11T23:05:06.931105+0000","last_clean":"2024-09-11T23:05:06.931105+0000","last_became_active":"2024-09-11T23:04:45.290218+0000","last_became_peered":"2024-09-11T23:04:45.290218+0000","last_unstale":"2024-09-11T23:05:06.931105+0000","last_undegraded":"2024-09-11T23:05:06.931105+0000","last_fullsized":"2024-09-11T23:05:06.931105+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:17.935064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.525715+0000","last_change":"2024-09-11T23:05:06.537396+0000","last_active":"2024-09-11T23:05:07.525715+0000","last_peered":"2024-09-11T23:05:07.525715+0000","last_clean":"2024-09-11T23:05:07.525715+0000","last_became_active":"2024-09-11T23:05:06.537129+0000","last_became_peered":"2024-09-11T23:05:06.537129+0000","last_unstale":"2024-09-11T23:05:07.525715+0000","last_undegraded":"2024-09-11T23:05:07.525715+0000","last_fullsized":"2024-09-11T23:05:07.525715+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:49.356921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.013078+0000","last_change":"2024-09-11T23:05:07.011688+0000","last_active":"2024-09-11T23:05:07.013078+0000","last_peered":"2024-09-11T23:05:07.013078+0000","last_clean":"2024-09-11T23:05:07.013078+0000","last_became_active":"2024-09-11T23:05:07.010921+0000","last_became_peered":"2024-09-11T23:05:07.010921+0000","last_unstale":"2024-09-11T23:05:07.013078+0000","last_undegraded":"2024-09-11T23:05:07.013078+0000","last_fullsized":"2024-09-11T23:05:07.013078+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:58.912419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.933371+0000","last_change":"2024-09-11T23:04:46.313005+0000","last_active":"2024-09-11T23:05:06.933371+0000","last_peered":"2024-09-11T23:05:06.933371+0000","last_clean":"2024-09-11T23:05:06.933371+0000","last_became_active":"2024-09-11T23:04:46.309136+0000","last_became_peered":"2024-09-11T23:04:46.309136+0000","last_unstale":"2024-09-11T23:05:06.933371+0000","last_undegraded":"2024-09-11T23:05:06.933371+0000","last_fullsized":"2024-09-11T23:05:06.933371+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:38.815486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.958242+0000","last_change":"2024-09-11T23:04:45.297149+0000","last_active":"2024-09-11T23:05:06.958242+0000","last_peered":"2024-09-11T23:05:06.958242+0000","last_clean":"2024-09-11T23:05:06.958242+0000","last_became_active":"2024-09-11T23:04:45.296339+0000","last_became_peered":"2024-09-11T23:04:45.296339+0000","last_unstale":"2024-09-11T23:05:06.958242+0000","last_undegraded":"2024-09-11T23:05:06.958242+0000","last_fullsized":"2024-09-11T23:05:06.958242+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:39.026235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.937661+0000","last_change":"2024-09-11T23:05:06.540829+0000","last_active":"2024-09-11T23:05:06.937661+0000","last_peered":"2024-09-11T23:05:06.937661+0000","last_clean":"2024-09-11T23:05:06.937661+0000","last_became_active":"2024-09-11T23:05:06.540572+0000","last_became_peered":"2024-09-11T23:05:06.540572+0000","last_unstale":"2024-09-11T23:05:06.937661+0000","last_undegraded":"2024-09-11T23:05:06.937661+0000","last_fullsized":"2024-09-11T23:05:06.937661+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:45.724589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.994547+0000","last_change":"2024-09-11T23:05:06.985346+0000","last_active":"2024-09-11T23:05:06.994547+0000","last_peered":"2024-09-11T23:05:06.994547+0000","last_clean":"2024-09-11T23:05:06.994547+0000","last_became_active":"2024-09-11T23:05:06.983948+0000","last_became_peered":"2024-09-11T23:05:06.983948+0000","last_unstale":"2024-09-11T23:05:06.994547+0000","last_undegraded":"2024-09-11T23:05:06.994547+0000","last_fullsized":"2024-09-11T23:05:06.994547+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:35.878366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.937138+0000","last_change":"2024-09-11T23:04:46.299931+0000","last_active":"2024-09-11T23:05:06.937138+0000","last_peered":"2024-09-11T23:05:06.937138+0000","last_clean":"2024-09-11T23:05:06.937138+0000","last_became_active":"2024-09-11T23:04:46.299104+0000","last_became_peered":"2024-09-11T23:04:46.299104+0000","last_unstale":"2024-09-11T23:05:06.937138+0000","last_undegraded":"2024-09-11T23:05:06.937138+0000","last_fullsized":"2024-09-11T23:05:06.937138+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:26.287271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"35'2","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.936845+0000","last_change":"2024-09-11T23:04:45.293809+0000","last_active":"2024-09-11T23:05:06.936845+0000","last_peered":"2024-09-11T23:05:06.936845+0000","last_clean":"2024-09-11T23:05:06.936845+0000","last_became_active":"2024-09-11T23:04:45.293303+0000","last_became_peered":"2024-09-11T23:04:45.293303+0000","last_unstale":"2024-09-11T23:05:06.936845+0000","last_undegraded":"2024-09-11T23:05:06.936845+0000","last_fullsized":"2024-09-11T23:05:06.936845+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:34.183985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'119","reported_seq":269,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.969777+0000","last_change":"2024-09-11T23:03:26.382905+0000","last_active":"2024-09-11T23:05:06.969777+0000","last_peered":"2024-09-11T23:05:06.969777+0000","last_clean":"2024-09-11T23:05:06.969777+0000","last_became_active":"2024-09-11T23:03:26.380590+0000","last_became_peered":"2024-09-11T23:03:26.380590+0000","last_unstale":"2024-09-11T23:05:06.969777+0000","last_undegraded":"2024-09-11T23:05:06.969777+0000","last_fullsized":"2024-09-11T23:05:06.969777+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:24.361793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:24.361793+0000","last_clean_scrub_stamp":"2024-09-11T23:03:24.361793+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:46.577063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":298,"num_read_kb":503,"num_write":177,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.950119+0000","last_change":"2024-09-11T23:05:06.540976+0000","last_active":"2024-09-11T23:05:06.950119+0000","last_peered":"2024-09-11T23:05:06.950119+0000","last_clean":"2024-09-11T23:05:06.950119+0000","last_became_active":"2024-09-11T23:05:06.540701+0000","last_became_peered":"2024-09-11T23:05:06.540701+0000","last_unstale":"2024-09-11T23:05:06.950119+0000","last_undegraded":"2024-09-11T23:05:06.950119+0000","last_fullsized":"2024-09-11T23:05:06.950119+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:06.064375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.012492+0000","last_change":"2024-09-11T23:05:07.006622+0000","last_active":"2024-09-11T23:05:07.012492+0000","last_peered":"2024-09-11T23:05:07.012492+0000","last_clean":"2024-09-11T23:05:07.012492+0000","last_became_active":"2024-09-11T23:05:07.006098+0000","last_became_peered":"2024-09-11T23:05:07.006098+0000","last_unstale":"2024-09-11T23:05:07.012492+0000","last_undegraded":"2024-09-11T23:05:07.012492+0000","last_fullsized":"2024-09-11T23:05:07.012492+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:31.610531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.944188+0000","last_change":"2024-09-11T23:04:46.294044+0000","last_active":"2024-09-11T23:05:06.944188+0000","last_peered":"2024-09-11T23:05:06.944188+0000","last_clean":"2024-09-11T23:05:06.944188+0000","last_became_active":"2024-09-11T23:04:46.293776+0000","last_became_peered":"2024-09-11T23:04:46.293776+0000","last_unstale":"2024-09-11T23:05:06.944188+0000","last_undegraded":"2024-09-11T23:05:06.944188+0000","last_fullsized":"2024-09-11T23:05:06.944188+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:33.670979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.931392+0000","last_change":"2024-09-11T23:04:45.281525+0000","last_active":"2024-09-11T23:05:06.931392+0000","last_peered":"2024-09-11T23:05:06.931392+0000","last_clean":"2024-09-11T23:05:06.931392+0000","last_became_active":"2024-09-11T23:04:45.281038+0000","last_became_peered":"2024-09-11T23:04:45.281038+0000","last_unstale":"2024-09-11T23:05:06.931392+0000","last_undegraded":"2024-09-11T23:05:06.931392+0000","last_fullsized":"2024-09-11T23:05:06.931392+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:54.058055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.964030+0000","last_change":"2024-09-11T23:05:06.532665+0000","last_active":"2024-09-11T23:05:06.964030+0000","last_peered":"2024-09-11T23:05:06.964030+0000","last_clean":"2024-09-11T23:05:06.964030+0000","last_became_active":"2024-09-11T23:05:06.532430+0000","last_became_peered":"2024-09-11T23:05:06.532430+0000","last_unstale":"2024-09-11T23:05:06.964030+0000","last_undegraded":"2024-09-11T23:05:06.964030+0000","last_fullsized":"2024-09-11T23:05:06.964030+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:55.550409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.999112+0000","last_change":"2024-09-11T23:05:06.987916+0000","last_active":"2024-09-11T23:05:06.999112+0000","last_peered":"2024-09-11T23:05:06.999112+0000","last_clean":"2024-09-11T23:05:06.999112+0000","last_became_active":"2024-09-11T23:05:06.986319+0000","last_became_peered":"2024-09-11T23:05:06.986319+0000","last_unstale":"2024-09-11T23:05:06.999112+0000","last_undegraded":"2024-09-11T23:05:06.999112+0000","last_fullsized":"2024-09-11T23:05:06.999112+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:33.171589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.948467+0000","last_change":"2024-09-11T23:04:46.304850+0000","last_active":"2024-09-11T23:05:06.948467+0000","last_peered":"2024-09-11T23:05:06.948467+0000","last_clean":"2024-09-11T23:05:06.948467+0000","last_became_active":"2024-09-11T23:04:46.304479+0000","last_became_peered":"2024-09-11T23:04:46.304479+0000","last_unstale":"2024-09-11T23:05:06.948467+0000","last_undegraded":"2024-09-11T23:05:06.948467+0000","last_fullsized":"2024-09-11T23:05:06.948467+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:09.138555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.970884+0000","last_change":"2024-09-11T23:04:45.298317+0000","last_active":"2024-09-11T23:05:06.970884+0000","last_peered":"2024-09-11T23:05:06.970884+0000","last_clean":"2024-09-11T23:05:06.970884+0000","last_became_active":"2024-09-11T23:04:45.293939+0000","last_became_peered":"2024-09-11T23:04:45.293939+0000","last_unstale":"2024-09-11T23:05:06.970884+0000","last_undegraded":"2024-09-11T23:05:06.970884+0000","last_fullsized":"2024-09-11T23:05:06.970884+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:30.293738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.972361+0000","last_change":"2024-09-11T23:05:06.535273+0000","last_active":"2024-09-11T23:05:06.972361+0000","last_peered":"2024-09-11T23:05:06.972361+0000","last_clean":"2024-09-11T23:05:06.972361+0000","last_became_active":"2024-09-11T23:05:06.534537+0000","last_became_peered":"2024-09-11T23:05:06.534537+0000","last_unstale":"2024-09-11T23:05:06.972361+0000","last_undegraded":"2024-09-11T23:05:06.972361+0000","last_fullsized":"2024-09-11T23:05:06.972361+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:43.740594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.004112+0000","last_change":"2024-09-11T23:05:07.000044+0000","last_active":"2024-09-11T23:05:07.004112+0000","last_peered":"2024-09-11T23:05:07.004112+0000","last_clean":"2024-09-11T23:05:07.004112+0000","last_became_active":"2024-09-11T23:05:06.999538+0000","last_became_peered":"2024-09-11T23:05:06.999538+0000","last_unstale":"2024-09-11T23:05:07.004112+0000","last_undegraded":"2024-09-11T23:05:07.004112+0000","last_fullsized":"2024-09-11T23:05:07.004112+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:27.609111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.963033+0000","last_change":"2024-09-11T23:04:46.322461+0000","last_active":"2024-09-11T23:05:06.963033+0000","last_peered":"2024-09-11T23:05:06.963033+0000","last_clean":"2024-09-11T23:05:06.963033+0000","last_became_active":"2024-09-11T23:04:46.321529+0000","last_became_peered":"2024-09-11T23:04:46.321529+0000","last_unstale":"2024-09-11T23:05:06.963033+0000","last_undegraded":"2024-09-11T23:05:06.963033+0000","last_fullsized":"2024-09-11T23:05:06.963033+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:11.312361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"35'1","reported_seq":21,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.966224+0000","last_change":"2024-09-11T23:04:45.298340+0000","last_active":"2024-09-11T23:05:06.966224+0000","last_peered":"2024-09-11T23:05:06.966224+0000","last_clean":"2024-09-11T23:05:06.966224+0000","last_became_active":"2024-09-11T23:04:45.293597+0000","last_became_peered":"2024-09-11T23:04:45.293597+0000","last_unstale":"2024-09-11T23:05:06.966224+0000","last_undegraded":"2024-09-11T23:05:06.966224+0000","last_fullsized":"2024-09-11T23:05:06.966224+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:11.217943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.948115+0000","last_change":"2024-09-11T23:05:06.542874+0000","last_active":"2024-09-11T23:05:06.948115+0000","last_peered":"2024-09-11T23:05:06.948115+0000","last_clean":"2024-09-11T23:05:06.948115+0000","last_became_active":"2024-09-11T23:05:06.542601+0000","last_became_peered":"2024-09-11T23:05:06.542601+0000","last_unstale":"2024-09-11T23:05:06.948115+0000","last_undegraded":"2024-09-11T23:05:06.948115+0000","last_fullsized":"2024-09-11T23:05:06.948115+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:37.995281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.007088+0000","last_change":"2024-09-11T23:05:06.991756+0000","last_active":"2024-09-11T23:05:07.007088+0000","last_peered":"2024-09-11T23:05:07.007088+0000","last_clean":"2024-09-11T23:05:07.007088+0000","last_became_active":"2024-09-11T23:05:06.988767+0000","last_became_peered":"2024-09-11T23:05:06.988767+0000","last_unstale":"2024-09-11T23:05:07.007088+0000","last_undegraded":"2024-09-11T23:05:07.007088+0000","last_fullsized":"2024-09-11T23:05:07.007088+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:12:19.167910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.951190+0000","last_change":"2024-09-11T23:04:46.300634+0000","last_active":"2024-09-11T23:05:06.951190+0000","last_peered":"2024-09-11T23:05:06.951190+0000","last_clean":"2024-09-11T23:05:06.951190+0000","last_became_active":"2024-09-11T23:04:46.300237+0000","last_became_peered":"2024-09-11T23:04:46.300237+0000","last_unstale":"2024-09-11T23:05:06.951190+0000","last_undegraded":"2024-09-11T23:05:06.951190+0000","last_fullsized":"2024-09-11T23:05:06.951190+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:37.667809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"35'2","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.957290+0000","last_change":"2024-09-11T23:04:45.287996+0000","last_active":"2024-09-11T23:05:06.957290+0000","last_peered":"2024-09-11T23:05:06.957290+0000","last_clean":"2024-09-11T23:05:06.957290+0000","last_became_active":"2024-09-11T23:04:45.286798+0000","last_became_peered":"2024-09-11T23:04:45.286798+0000","last_unstale":"2024-09-11T23:05:06.957290+0000","last_undegraded":"2024-09-11T23:05:06.957290+0000","last_fullsized":"2024-09-11T23:05:06.957290+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:21.516047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.970756+0000","last_change":"2024-09-11T23:05:06.544544+0000","last_active":"2024-09-11T23:05:06.970756+0000","last_peered":"2024-09-11T23:05:06.970756+0000","last_clean":"2024-09-11T23:05:06.970756+0000","last_became_active":"2024-09-11T23:05:06.544173+0000","last_became_peered":"2024-09-11T23:05:06.544173+0000","last_unstale":"2024-09-11T23:05:06.970756+0000","last_undegraded":"2024-09-11T23:05:06.970756+0000","last_fullsized":"2024-09-11T23:05:06.970756+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:36.738841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.004285+0000","last_change":"2024-09-11T23:05:07.000082+0000","last_active":"2024-09-11T23:05:07.004285+0000","last_peered":"2024-09-11T23:05:07.004285+0000","last_clean":"2024-09-11T23:05:07.004285+0000","last_became_active":"2024-09-11T23:05:06.993421+0000","last_became_peered":"2024-09-11T23:05:06.993421+0000","last_unstale":"2024-09-11T23:05:07.004285+0000","last_undegraded":"2024-09-11T23:05:07.004285+0000","last_fullsized":"2024-09-11T23:05:07.004285+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:31.610531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.957642+0000","last_change":"2024-09-11T23:04:46.317542+0000","last_active":"2024-09-11T23:05:06.957642+0000","last_peered":"2024-09-11T23:05:06.957642+0000","last_clean":"2024-09-11T23:05:06.957642+0000","last_became_active":"2024-09-11T23:04:46.316806+0000","last_became_peered":"2024-09-11T23:04:46.316806+0000","last_unstale":"2024-09-11T23:05:06.957642+0000","last_undegraded":"2024-09-11T23:05:06.957642+0000","last_fullsized":"2024-09-11T23:05:06.957642+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:04.381683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"35'1","reported_seq":21,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.978406+0000","last_change":"2024-09-11T23:04:45.283727+0000","last_active":"2024-09-11T23:05:06.978406+0000","last_peered":"2024-09-11T23:05:06.978406+0000","last_clean":"2024-09-11T23:05:06.978406+0000","last_became_active":"2024-09-11T23:04:45.283180+0000","last_became_peered":"2024-09-11T23:04:45.283180+0000","last_unstale":"2024-09-11T23:05:06.978406+0000","last_undegraded":"2024-09-11T23:05:06.978406+0000","last_fullsized":"2024-09-11T23:05:06.978406+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:53.245910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.949366+0000","last_change":"2024-09-11T23:05:06.545931+0000","last_active":"2024-09-11T23:05:06.949366+0000","last_peered":"2024-09-11T23:05:06.949366+0000","last_clean":"2024-09-11T23:05:06.949366+0000","last_became_active":"2024-09-11T23:05:06.544152+0000","last_became_peered":"2024-09-11T23:05:06.544152+0000","last_unstale":"2024-09-11T23:05:06.949366+0000","last_undegraded":"2024-09-11T23:05:06.949366+0000","last_fullsized":"2024-09-11T23:05:06.949366+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:25.350163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.005834+0000","last_change":"2024-09-11T23:05:07.002791+0000","last_active":"2024-09-11T23:05:07.005834+0000","last_peered":"2024-09-11T23:05:07.005834+0000","last_clean":"2024-09-11T23:05:07.005834+0000","last_became_active":"2024-09-11T23:05:07.002520+0000","last_became_peered":"2024-09-11T23:05:07.002520+0000","last_unstale":"2024-09-11T23:05:07.005834+0000","last_undegraded":"2024-09-11T23:05:07.005834+0000","last_fullsized":"2024-09-11T23:05:07.005834+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:47.531881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.963725+0000","last_change":"2024-09-11T23:05:06.542928+0000","last_active":"2024-09-11T23:05:06.963725+0000","last_peered":"2024-09-11T23:05:06.963725+0000","last_clean":"2024-09-11T23:05:06.963725+0000","last_became_active":"2024-09-11T23:05:06.542672+0000","last_became_peered":"2024-09-11T23:05:06.542672+0000","last_unstale":"2024-09-11T23:05:06.963725+0000","last_undegraded":"2024-09-11T23:05:06.963725+0000","last_fullsized":"2024-09-11T23:05:06.963725+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:26.961176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.956493+0000","last_change":"2024-09-11T23:04:46.326062+0000","last_active":"2024-09-11T23:05:06.956493+0000","last_peered":"2024-09-11T23:05:06.956493+0000","last_clean":"2024-09-11T23:05:06.956493+0000","last_became_active":"2024-09-11T23:04:46.325734+0000","last_became_peered":"2024-09-11T23:04:46.325734+0000","last_unstale":"2024-09-11T23:05:06.956493+0000","last_undegraded":"2024-09-11T23:05:06.956493+0000","last_fullsized":"2024-09-11T23:05:06.956493+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:55.065032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"35'8","reported_seq":28,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.931123+0000","last_change":"2024-09-11T23:04:45.291040+0000","last_active":"2024-09-11T23:05:06.931123+0000","last_peered":"2024-09-11T23:05:06.931123+0000","last_clean":"2024-09-11T23:05:06.931123+0000","last_became_active":"2024-09-11T23:04:45.290561+0000","last_became_peered":"2024-09-11T23:04:45.290561+0000","last_unstale":"2024-09-11T23:05:06.931123+0000","last_undegraded":"2024-09-11T23:05:06.931123+0000","last_fullsized":"2024-09-11T23:05:06.931123+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:32.664002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.984945+0000","last_change":"2024-09-11T23:05:06.980444+0000","last_active":"2024-09-11T23:05:06.984945+0000","last_peered":"2024-09-11T23:05:06.984945+0000","last_clean":"2024-09-11T23:05:06.984945+0000","last_became_active":"2024-09-11T23:05:06.979198+0000","last_became_peered":"2024-09-11T23:05:06.979198+0000","last_unstale":"2024-09-11T23:05:06.984945+0000","last_undegraded":"2024-09-11T23:05:06.984945+0000","last_fullsized":"2024-09-11T23:05:06.984945+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:50.014916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"39'4","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.527056+0000","last_change":"2024-09-11T23:05:06.545802+0000","last_active":"2024-09-11T23:05:07.527056+0000","last_peered":"2024-09-11T23:05:07.527056+0000","last_clean":"2024-09-11T23:05:07.527056+0000","last_became_active":"2024-09-11T23:05:06.545451+0000","last_became_peered":"2024-09-11T23:05:06.545451+0000","last_unstale":"2024-09-11T23:05:07.527056+0000","last_undegraded":"2024-09-11T23:05:07.527056+0000","last_fullsized":"2024-09-11T23:05:07.527056+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:01.405747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.969594+0000","last_change":"2024-09-11T23:04:46.291296+0000","last_active":"2024-09-11T23:05:06.969594+0000","last_peered":"2024-09-11T23:05:06.969594+0000","last_clean":"2024-09-11T23:05:06.969594+0000","last_became_active":"2024-09-11T23:04:46.290797+0000","last_became_peered":"2024-09-11T23:04:46.290797+0000","last_unstale":"2024-09-11T23:05:06.969594+0000","last_undegraded":"2024-09-11T23:05:06.969594+0000","last_fullsized":"2024-09-11T23:05:06.969594+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:18.942042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.955961+0000","last_change":"2024-09-11T23:04:45.296296+0000","last_active":"2024-09-11T23:05:06.955961+0000","last_peered":"2024-09-11T23:05:06.955961+0000","last_clean":"2024-09-11T23:05:06.955961+0000","last_became_active":"2024-09-11T23:04:45.296002+0000","last_became_peered":"2024-09-11T23:04:45.296002+0000","last_unstale":"2024-09-11T23:05:06.955961+0000","last_undegraded":"2024-09-11T23:05:06.955961+0000","last_fullsized":"2024-09-11T23:05:06.955961+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:32.556160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.999061+0000","last_change":"2024-09-11T23:05:06.989844+0000","last_active":"2024-09-11T23:05:06.999061+0000","last_peered":"2024-09-11T23:05:06.999061+0000","last_clean":"2024-09-11T23:05:06.999061+0000","last_became_active":"2024-09-11T23:05:06.987995+0000","last_became_peered":"2024-09-11T23:05:06.987995+0000","last_unstale":"2024-09-11T23:05:06.999061+0000","last_undegraded":"2024-09-11T23:05:06.999061+0000","last_fullsized":"2024-09-11T23:05:06.999061+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:06.602353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.935106+0000","last_change":"2024-09-11T23:04:46.298699+0000","last_active":"2024-09-11T23:05:06.935106+0000","last_peered":"2024-09-11T23:05:06.935106+0000","last_clean":"2024-09-11T23:05:06.935106+0000","last_became_active":"2024-09-11T23:04:46.296442+0000","last_became_peered":"2024-09-11T23:04:46.296442+0000","last_unstale":"2024-09-11T23:05:06.935106+0000","last_undegraded":"2024-09-11T23:05:06.935106+0000","last_fullsized":"2024-09-11T23:05:06.935106+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:45.578284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.932855+0000","last_change":"2024-09-11T23:04:45.293202+0000","last_active":"2024-09-11T23:05:06.932855+0000","last_peered":"2024-09-11T23:05:06.932855+0000","last_clean":"2024-09-11T23:05:06.932855+0000","last_became_active":"2024-09-11T23:04:45.292892+0000","last_became_peered":"2024-09-11T23:04:45.292892+0000","last_unstale":"2024-09-11T23:05:06.932855+0000","last_undegraded":"2024-09-11T23:05:06.932855+0000","last_fullsized":"2024-09-11T23:05:06.932855+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:21.096831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"39'2","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.970369+0000","last_change":"2024-09-11T23:05:06.533300+0000","last_active":"2024-09-11T23:05:06.970369+0000","last_peered":"2024-09-11T23:05:06.970369+0000","last_clean":"2024-09-11T23:05:06.970369+0000","last_became_active":"2024-09-11T23:05:06.533053+0000","last_became_peered":"2024-09-11T23:05:06.533053+0000","last_unstale":"2024-09-11T23:05:06.970369+0000","last_undegraded":"2024-09-11T23:05:06.970369+0000","last_fullsized":"2024-09-11T23:05:06.970369+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:53.799981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.009143+0000","last_change":"2024-09-11T23:05:07.004152+0000","last_active":"2024-09-11T23:05:07.009143+0000","last_peered":"2024-09-11T23:05:07.009143+0000","last_clean":"2024-09-11T23:05:07.009143+0000","last_became_active":"2024-09-11T23:05:07.002577+0000","last_became_peered":"2024-09-11T23:05:07.002577+0000","last_unstale":"2024-09-11T23:05:07.009143+0000","last_undegraded":"2024-09-11T23:05:07.009143+0000","last_fullsized":"2024-09-11T23:05:07.009143+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:28.021989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.965829+0000","last_change":"2024-09-11T23:04:46.303775+0000","last_active":"2024-09-11T23:05:06.965829+0000","last_peered":"2024-09-11T23:05:06.965829+0000","last_clean":"2024-09-11T23:05:06.965829+0000","last_became_active":"2024-09-11T23:04:46.303500+0000","last_became_peered":"2024-09-11T23:04:46.303500+0000","last_unstale":"2024-09-11T23:05:06.965829+0000","last_undegraded":"2024-09-11T23:05:06.965829+0000","last_fullsized":"2024-09-11T23:05:06.965829+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:22.103808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"35'2","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.963452+0000","last_change":"2024-09-11T23:04:45.285357+0000","last_active":"2024-09-11T23:05:06.963452+0000","last_peered":"2024-09-11T23:05:06.963452+0000","last_clean":"2024-09-11T23:05:06.963452+0000","last_became_active":"2024-09-11T23:04:45.281608+0000","last_became_peered":"2024-09-11T23:04:45.281608+0000","last_unstale":"2024-09-11T23:05:06.963452+0000","last_undegraded":"2024-09-11T23:05:06.963452+0000","last_fullsized":"2024-09-11T23:05:06.963452+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:54.908265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.526998+0000","last_change":"2024-09-11T23:05:06.548603+0000","last_active":"2024-09-11T23:05:07.526998+0000","last_peered":"2024-09-11T23:05:07.526998+0000","last_clean":"2024-09-11T23:05:07.526998+0000","last_became_active":"2024-09-11T23:05:06.548351+0000","last_became_peered":"2024-09-11T23:05:06.548351+0000","last_unstale":"2024-09-11T23:05:07.526998+0000","last_undegraded":"2024-09-11T23:05:07.526998+0000","last_fullsized":"2024-09-11T23:05:07.526998+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:08.320000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.978214+0000","last_change":"2024-09-11T23:05:06.973603+0000","last_active":"2024-09-11T23:05:06.978214+0000","last_peered":"2024-09-11T23:05:06.978214+0000","last_clean":"2024-09-11T23:05:06.978214+0000","last_became_active":"2024-09-11T23:05:06.972904+0000","last_became_peered":"2024-09-11T23:05:06.972904+0000","last_unstale":"2024-09-11T23:05:06.978214+0000","last_undegraded":"2024-09-11T23:05:06.978214+0000","last_fullsized":"2024-09-11T23:05:06.978214+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:59.059167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.971052+0000","last_change":"2024-09-11T23:04:46.304086+0000","last_active":"2024-09-11T23:05:06.971052+0000","last_peered":"2024-09-11T23:05:06.971052+0000","last_clean":"2024-09-11T23:05:06.971052+0000","last_became_active":"2024-09-11T23:04:46.303805+0000","last_became_peered":"2024-09-11T23:04:46.303805+0000","last_unstale":"2024-09-11T23:05:06.971052+0000","last_undegraded":"2024-09-11T23:05:06.971052+0000","last_fullsized":"2024-09-11T23:05:06.971052+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:06.111336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"38'12","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.959618+0000","last_change":"2024-09-11T23:04:45.297552+0000","last_active":"2024-09-11T23:05:06.959618+0000","last_peered":"2024-09-11T23:05:06.959618+0000","last_clean":"2024-09-11T23:05:06.959618+0000","last_became_active":"2024-09-11T23:04:45.297265+0000","last_became_peered":"2024-09-11T23:04:45.297265+0000","last_unstale":"2024-09-11T23:05:06.959618+0000","last_undegraded":"2024-09-11T23:05:06.959618+0000","last_fullsized":"2024-09-11T23:05:06.959618+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:05.305481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4248,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1a","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.525408+0000","last_change":"2024-09-11T23:05:06.542315+0000","last_active":"2024-09-11T23:05:07.525408+0000","last_peered":"2024-09-11T23:05:07.525408+0000","last_clean":"2024-09-11T23:05:07.525408+0000","last_became_active":"2024-09-11T23:05:06.542044+0000","last_became_peered":"2024-09-11T23:05:06.542044+0000","last_unstale":"2024-09-11T23:05:07.525408+0000","last_undegraded":"2024-09-11T23:05:07.525408+0000","last_fullsized":"2024-09-11T23:05:07.525408+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:48.292538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.015424+0000","last_change":"2024-09-11T23:05:07.014436+0000","last_active":"2024-09-11T23:05:07.015424+0000","last_peered":"2024-09-11T23:05:07.015424+0000","last_clean":"2024-09-11T23:05:07.015424+0000","last_became_active":"2024-09-11T23:05:07.013761+0000","last_became_peered":"2024-09-11T23:05:07.013761+0000","last_unstale":"2024-09-11T23:05:07.015424+0000","last_undegraded":"2024-09-11T23:05:07.015424+0000","last_fullsized":"2024-09-11T23:05:07.015424+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:26.834726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.970463+0000","last_change":"2024-09-11T23:04:46.301279+0000","last_active":"2024-09-11T23:05:06.970463+0000","last_peered":"2024-09-11T23:05:06.970463+0000","last_clean":"2024-09-11T23:05:06.970463+0000","last_became_active":"2024-09-11T23:04:46.301000+0000","last_became_peered":"2024-09-11T23:04:46.301000+0000","last_unstale":"2024-09-11T23:05:06.970463+0000","last_undegraded":"2024-09-11T23:05:06.970463+0000","last_fullsized":"2024-09-11T23:05:06.970463+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:42:04.891291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.15","version":"35'3","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.971347+0000","last_change":"2024-09-11T23:04:45.297825+0000","last_active":"2024-09-11T23:05:06.971347+0000","last_peered":"2024-09-11T23:05:06.971347+0000","last_clean":"2024-09-11T23:05:06.971347+0000","last_became_active":"2024-09-11T23:04:45.296383+0000","last_became_peered":"2024-09-11T23:04:45.296383+0000","last_unstale":"2024-09-11T23:05:06.971347+0000","last_undegraded":"2024-09-11T23:05:06.971347+0000","last_fullsized":"2024-09-11T23:05:06.971347+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:42.801527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1b","version":"39'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.971832+0000","last_change":"2024-09-11T23:05:06.534644+0000","last_active":"2024-09-11T23:05:06.971832+0000","last_peered":"2024-09-11T23:05:06.971832+0000","last_clean":"2024-09-11T23:05:06.971832+0000","last_became_active":"2024-09-11T23:05:06.534430+0000","last_became_peered":"2024-09-11T23:05:06.534430+0000","last_unstale":"2024-09-11T23:05:06.971832+0000","last_undegraded":"2024-09-11T23:05:06.971832+0000","last_fullsized":"2024-09-11T23:05:06.971832+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:55.550409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.990674+0000","last_change":"2024-09-11T23:05:06.985438+0000","last_active":"2024-09-11T23:05:06.990674+0000","last_peered":"2024-09-11T23:05:06.990674+0000","last_clean":"2024-09-11T23:05:06.990674+0000","last_became_active":"2024-09-11T23:05:06.983562+0000","last_became_peered":"2024-09-11T23:05:06.983562+0000","last_unstale":"2024-09-11T23:05:06.990674+0000","last_undegraded":"2024-09-11T23:05:06.990674+0000","last_fullsized":"2024-09-11T23:05:06.990674+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:07.530868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.957299+0000","last_change":"2024-09-11T23:04:46.318066+0000","last_active":"2024-09-11T23:05:06.957299+0000","last_peered":"2024-09-11T23:05:06.957299+0000","last_clean":"2024-09-11T23:05:06.957299+0000","last_became_active":"2024-09-11T23:04:46.317529+0000","last_became_peered":"2024-09-11T23:04:46.317529+0000","last_unstale":"2024-09-11T23:05:06.957299+0000","last_undegraded":"2024-09-11T23:05:06.957299+0000","last_fullsized":"2024-09-11T23:05:06.957299+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:08.154174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.936842+0000","last_change":"2024-09-11T23:04:45.282485+0000","last_active":"2024-09-11T23:05:06.936842+0000","last_peered":"2024-09-11T23:05:06.936842+0000","last_clean":"2024-09-11T23:05:06.936842+0000","last_became_active":"2024-09-11T23:04:45.282192+0000","last_became_peered":"2024-09-11T23:04:45.282192+0000","last_unstale":"2024-09-11T23:05:06.936842+0000","last_undegraded":"2024-09-11T23:05:06.936842+0000","last_fullsized":"2024-09-11T23:05:06.936842+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:08.131578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.932262+0000","last_change":"2024-09-11T23:05:06.537522+0000","last_active":"2024-09-11T23:05:06.932262+0000","last_peered":"2024-09-11T23:05:06.932262+0000","last_clean":"2024-09-11T23:05:06.932262+0000","last_became_active":"2024-09-11T23:05:06.537257+0000","last_became_peered":"2024-09-11T23:05:06.537257+0000","last_unstale":"2024-09-11T23:05:06.932262+0000","last_undegraded":"2024-09-11T23:05:06.932262+0000","last_fullsized":"2024-09-11T23:05:06.932262+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:40.902960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.997009+0000","last_change":"2024-09-11T23:05:06.990762+0000","last_active":"2024-09-11T23:05:06.997009+0000","last_peered":"2024-09-11T23:05:06.997009+0000","last_clean":"2024-09-11T23:05:06.997009+0000","last_became_active":"2024-09-11T23:05:06.990053+0000","last_became_peered":"2024-09-11T23:05:06.990053+0000","last_unstale":"2024-09-11T23:05:06.997009+0000","last_undegraded":"2024-09-11T23:05:06.997009+0000","last_fullsized":"2024-09-11T23:05:06.997009+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:23.035505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.957814+0000","last_change":"2024-09-11T23:04:46.302523+0000","last_active":"2024-09-11T23:05:06.957814+0000","last_peered":"2024-09-11T23:05:06.957814+0000","last_clean":"2024-09-11T23:05:06.957814+0000","last_became_active":"2024-09-11T23:04:46.302177+0000","last_became_peered":"2024-09-11T23:04:46.302177+0000","last_unstale":"2024-09-11T23:05:06.957814+0000","last_undegraded":"2024-09-11T23:05:06.957814+0000","last_fullsized":"2024-09-11T23:05:06.957814+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:04.381683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.956481+0000","last_change":"2024-09-11T23:04:45.294857+0000","last_active":"2024-09-11T23:05:06.956481+0000","last_peered":"2024-09-11T23:05:06.956481+0000","last_clean":"2024-09-11T23:05:06.956481+0000","last_became_active":"2024-09-11T23:04:45.292853+0000","last_became_peered":"2024-09-11T23:04:45.292853+0000","last_unstale":"2024-09-11T23:05:06.956481+0000","last_undegraded":"2024-09-11T23:05:06.956481+0000","last_fullsized":"2024-09-11T23:05:06.956481+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:24.272501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.944714+0000","last_change":"2024-09-11T23:05:06.544366+0000","last_active":"2024-09-11T23:05:06.944714+0000","last_peered":"2024-09-11T23:05:06.944714+0000","last_clean":"2024-09-11T23:05:06.944714+0000","last_became_active":"2024-09-11T23:05:06.543171+0000","last_became_peered":"2024-09-11T23:05:06.543171+0000","last_unstale":"2024-09-11T23:05:06.944714+0000","last_undegraded":"2024-09-11T23:05:06.944714+0000","last_fullsized":"2024-09-11T23:05:06.944714+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:29:36.929493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.996760+0000","last_change":"2024-09-11T23:05:06.970253+0000","last_active":"2024-09-11T23:05:06.996760+0000","last_peered":"2024-09-11T23:05:06.996760+0000","last_clean":"2024-09-11T23:05:06.996760+0000","last_became_active":"2024-09-11T23:05:06.969570+0000","last_became_peered":"2024-09-11T23:05:06.969570+0000","last_unstale":"2024-09-11T23:05:06.996760+0000","last_undegraded":"2024-09-11T23:05:06.996760+0000","last_fullsized":"2024-09-11T23:05:06.996760+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:07.530868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"35'1","reported_seq":21,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.937524+0000","last_change":"2024-09-11T23:04:45.281392+0000","last_active":"2024-09-11T23:05:06.937524+0000","last_peered":"2024-09-11T23:05:06.937524+0000","last_clean":"2024-09-11T23:05:06.937524+0000","last_became_active":"2024-09-11T23:04:45.281085+0000","last_became_peered":"2024-09-11T23:04:45.281085+0000","last_unstale":"2024-09-11T23:05:06.937524+0000","last_undegraded":"2024-09-11T23:05:06.937524+0000","last_fullsized":"2024-09-11T23:05:06.937524+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:55.332488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.935098+0000","last_change":"2024-09-11T23:04:46.300077+0000","last_active":"2024-09-11T23:05:06.935098+0000","last_peered":"2024-09-11T23:05:06.935098+0000","last_clean":"2024-09-11T23:05:06.935098+0000","last_became_active":"2024-09-11T23:04:46.299088+0000","last_became_peered":"2024-09-11T23:04:46.299088+0000","last_unstale":"2024-09-11T23:05:06.935098+0000","last_undegraded":"2024-09-11T23:05:06.935098+0000","last_fullsized":"2024-09-11T23:05:06.935098+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:40.359020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"39'5","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.525737+0000","last_change":"2024-09-11T23:05:06.541882+0000","last_active":"2024-09-11T23:05:07.525737+0000","last_peered":"2024-09-11T23:05:07.525737+0000","last_clean":"2024-09-11T23:05:07.525737+0000","last_became_active":"2024-09-11T23:05:06.540892+0000","last_became_peered":"2024-09-11T23:05:06.540892+0000","last_unstale":"2024-09-11T23:05:07.525737+0000","last_undegraded":"2024-09-11T23:05:07.525737+0000","last_fullsized":"2024-09-11T23:05:07.525737+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:47.205829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.994532+0000","last_change":"2024-09-11T23:05:06.985065+0000","last_active":"2024-09-11T23:05:06.994532+0000","last_peered":"2024-09-11T23:05:06.994532+0000","last_clean":"2024-09-11T23:05:06.994532+0000","last_became_active":"2024-09-11T23:05:06.983978+0000","last_became_peered":"2024-09-11T23:05:06.983978+0000","last_unstale":"2024-09-11T23:05:06.994532+0000","last_undegraded":"2024-09-11T23:05:06.994532+0000","last_fullsized":"2024-09-11T23:05:06.994532+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:25.724245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.958908+0000","last_change":"2024-09-11T23:04:46.316259+0000","last_active":"2024-09-11T23:05:06.958908+0000","last_peered":"2024-09-11T23:05:06.958908+0000","last_clean":"2024-09-11T23:05:06.958908+0000","last_became_active":"2024-09-11T23:04:46.303687+0000","last_became_peered":"2024-09-11T23:04:46.303687+0000","last_unstale":"2024-09-11T23:05:06.958908+0000","last_undegraded":"2024-09-11T23:05:06.958908+0000","last_fullsized":"2024-09-11T23:05:06.958908+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:57.879933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.005344+0000","last_change":"2024-09-11T23:05:07.000817+0000","last_active":"2024-09-11T23:05:07.005344+0000","last_peered":"2024-09-11T23:05:07.005344+0000","last_clean":"2024-09-11T23:05:07.005344+0000","last_became_active":"2024-09-11T23:05:07.000325+0000","last_became_peered":"2024-09-11T23:05:07.000325+0000","last_unstale":"2024-09-11T23:05:07.005344+0000","last_undegraded":"2024-09-11T23:05:07.005344+0000","last_fullsized":"2024-09-11T23:05:07.005344+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:35.620797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.948784+0000","last_change":"2024-09-11T23:04:46.318259+0000","last_active":"2024-09-11T23:05:06.948784+0000","last_peered":"2024-09-11T23:05:06.948784+0000","last_clean":"2024-09-11T23:05:06.948784+0000","last_became_active":"2024-09-11T23:04:46.317792+0000","last_became_peered":"2024-09-11T23:04:46.317792+0000","last_unstale":"2024-09-11T23:05:06.948784+0000","last_undegraded":"2024-09-11T23:05:06.948784+0000","last_fullsized":"2024-09-11T23:05:06.948784+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:57.781311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.004084+0000","last_change":"2024-09-11T23:05:06.994502+0000","last_active":"2024-09-11T23:05:07.004084+0000","last_peered":"2024-09-11T23:05:07.004084+0000","last_clean":"2024-09-11T23:05:07.004084+0000","last_became_active":"2024-09-11T23:05:06.993852+0000","last_became_peered":"2024-09-11T23:05:06.993852+0000","last_unstale":"2024-09-11T23:05:07.004084+0000","last_undegraded":"2024-09-11T23:05:07.004084+0000","last_fullsized":"2024-09-11T23:05:07.004084+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:46.200998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.971624+0000","last_change":"2024-09-11T23:04:46.324495+0000","last_active":"2024-09-11T23:05:06.971624+0000","last_peered":"2024-09-11T23:05:06.971624+0000","last_clean":"2024-09-11T23:05:06.971624+0000","last_became_active":"2024-09-11T23:04:46.324164+0000","last_became_peered":"2024-09-11T23:04:46.324164+0000","last_unstale":"2024-09-11T23:05:06.971624+0000","last_undegraded":"2024-09-11T23:05:06.971624+0000","last_fullsized":"2024-09-11T23:05:06.971624+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:18.942042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.993417+0000","last_change":"2024-09-11T23:05:06.986061+0000","last_active":"2024-09-11T23:05:06.993417+0000","last_peered":"2024-09-11T23:05:06.993417+0000","last_clean":"2024-09-11T23:05:06.993417+0000","last_became_active":"2024-09-11T23:05:06.985376+0000","last_became_peered":"2024-09-11T23:05:06.985376+0000","last_unstale":"2024-09-11T23:05:06.993417+0000","last_undegraded":"2024-09-11T23:05:06.993417+0000","last_fullsized":"2024-09-11T23:05:06.993417+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:02.837866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.935392+0000","last_change":"2024-09-11T23:04:46.309119+0000","last_active":"2024-09-11T23:05:06.935392+0000","last_peered":"2024-09-11T23:05:06.935392+0000","last_clean":"2024-09-11T23:05:06.935392+0000","last_became_active":"2024-09-11T23:04:46.305535+0000","last_became_peered":"2024-09-11T23:04:46.305535+0000","last_unstale":"2024-09-11T23:05:06.935392+0000","last_undegraded":"2024-09-11T23:05:06.935392+0000","last_fullsized":"2024-09-11T23:05:06.935392+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:01.790895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.005683+0000","last_change":"2024-09-11T23:05:07.001690+0000","last_active":"2024-09-11T23:05:07.005683+0000","last_peered":"2024-09-11T23:05:07.005683+0000","last_clean":"2024-09-11T23:05:07.005683+0000","last_became_active":"2024-09-11T23:05:07.001191+0000","last_became_peered":"2024-09-11T23:05:07.001191+0000","last_unstale":"2024-09-11T23:05:07.005683+0000","last_undegraded":"2024-09-11T23:05:07.005683+0000","last_fullsized":"2024-09-11T23:05:07.005683+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:48.064477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.964551+0000","last_change":"2024-09-11T23:04:46.322235+0000","last_active":"2024-09-11T23:05:06.964551+0000","last_peered":"2024-09-11T23:05:06.964551+0000","last_clean":"2024-09-11T23:05:06.964551+0000","last_became_active":"2024-09-11T23:04:46.318694+0000","last_became_peered":"2024-09-11T23:04:46.318694+0000","last_unstale":"2024-09-11T23:05:06.964551+0000","last_undegraded":"2024-09-11T23:05:06.964551+0000","last_fullsized":"2024-09-11T23:05:06.964551+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:08.154174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.981507+0000","last_change":"2024-09-11T23:05:06.974158+0000","last_active":"2024-09-11T23:05:06.981507+0000","last_peered":"2024-09-11T23:05:06.981507+0000","last_clean":"2024-09-11T23:05:06.981507+0000","last_became_active":"2024-09-11T23:05:06.973514+0000","last_became_peered":"2024-09-11T23:05:06.973514+0000","last_unstale":"2024-09-11T23:05:06.981507+0000","last_undegraded":"2024-09-11T23:05:06.981507+0000","last_fullsized":"2024-09-11T23:05:06.981507+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:45.557228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.935459+0000","last_change":"2024-09-11T23:04:46.312949+0000","last_active":"2024-09-11T23:05:06.935459+0000","last_peered":"2024-09-11T23:05:06.935459+0000","last_clean":"2024-09-11T23:05:06.935459+0000","last_became_active":"2024-09-11T23:04:46.302019+0000","last_became_peered":"2024-09-11T23:04:46.302019+0000","last_unstale":"2024-09-11T23:05:06.935459+0000","last_undegraded":"2024-09-11T23:05:06.935459+0000","last_fullsized":"2024-09-11T23:05:06.935459+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:36:58.972672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.995936+0000","last_change":"2024-09-11T23:05:06.975494+0000","last_active":"2024-09-11T23:05:06.995936+0000","last_peered":"2024-09-11T23:05:06.995936+0000","last_clean":"2024-09-11T23:05:06.995936+0000","last_became_active":"2024-09-11T23:05:06.974850+0000","last_became_peered":"2024-09-11T23:05:06.974850+0000","last_unstale":"2024-09-11T23:05:06.995936+0000","last_undegraded":"2024-09-11T23:05:06.995936+0000","last_fullsized":"2024-09-11T23:05:06.995936+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:25.724245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.959096+0000","last_change":"2024-09-11T23:04:46.322057+0000","last_active":"2024-09-11T23:05:06.959096+0000","last_peered":"2024-09-11T23:05:06.959096+0000","last_clean":"2024-09-11T23:05:06.959096+0000","last_became_active":"2024-09-11T23:04:46.321757+0000","last_became_peered":"2024-09-11T23:04:46.321757+0000","last_unstale":"2024-09-11T23:05:06.959096+0000","last_undegraded":"2024-09-11T23:05:06.959096+0000","last_fullsized":"2024-09-11T23:05:06.959096+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:35.190963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.974800+0000","last_change":"2024-09-11T23:05:06.966480+0000","last_active":"2024-09-11T23:05:06.974800+0000","last_peered":"2024-09-11T23:05:06.974800+0000","last_clean":"2024-09-11T23:05:06.974800+0000","last_became_active":"2024-09-11T23:05:06.965716+0000","last_became_peered":"2024-09-11T23:05:06.965716+0000","last_unstale":"2024-09-11T23:05:06.974800+0000","last_undegraded":"2024-09-11T23:05:06.974800+0000","last_fullsized":"2024-09-11T23:05:06.974800+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:46.669881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.951694+0000","last_change":"2024-09-11T23:04:46.310580+0000","last_active":"2024-09-11T23:05:06.951694+0000","last_peered":"2024-09-11T23:05:06.951694+0000","last_clean":"2024-09-11T23:05:06.951694+0000","last_became_active":"2024-09-11T23:04:46.303113+0000","last_became_peered":"2024-09-11T23:04:46.303113+0000","last_unstale":"2024-09-11T23:05:06.951694+0000","last_undegraded":"2024-09-11T23:05:06.951694+0000","last_fullsized":"2024-09-11T23:05:06.951694+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:57.299176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.982960+0000","last_change":"2024-09-11T23:05:06.974756+0000","last_active":"2024-09-11T23:05:06.982960+0000","last_peered":"2024-09-11T23:05:06.982960+0000","last_clean":"2024-09-11T23:05:06.982960+0000","last_became_active":"2024-09-11T23:05:06.973533+0000","last_became_peered":"2024-09-11T23:05:06.973533+0000","last_unstale":"2024-09-11T23:05:06.982960+0000","last_undegraded":"2024-09-11T23:05:06.982960+0000","last_fullsized":"2024-09-11T23:05:06.982960+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:33.464461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.959323+0000","last_change":"2024-09-11T23:04:46.317887+0000","last_active":"2024-09-11T23:05:06.959323+0000","last_peered":"2024-09-11T23:05:06.959323+0000","last_clean":"2024-09-11T23:05:06.959323+0000","last_became_active":"2024-09-11T23:04:46.302562+0000","last_became_peered":"2024-09-11T23:04:46.302562+0000","last_unstale":"2024-09-11T23:05:06.959323+0000","last_undegraded":"2024-09-11T23:05:06.959323+0000","last_fullsized":"2024-09-11T23:05:06.959323+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:57.781311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.013116+0000","last_change":"2024-09-11T23:05:07.011737+0000","last_active":"2024-09-11T23:05:07.013116+0000","last_peered":"2024-09-11T23:05:07.013116+0000","last_clean":"2024-09-11T23:05:07.013116+0000","last_became_active":"2024-09-11T23:05:07.011235+0000","last_became_peered":"2024-09-11T23:05:07.011235+0000","last_unstale":"2024-09-11T23:05:07.013116+0000","last_undegraded":"2024-09-11T23:05:07.013116+0000","last_fullsized":"2024-09-11T23:05:07.013116+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:24.403140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.950864+0000","last_change":"2024-09-11T23:04:46.309407+0000","last_active":"2024-09-11T23:05:06.950864+0000","last_peered":"2024-09-11T23:05:06.950864+0000","last_clean":"2024-09-11T23:05:06.950864+0000","last_became_active":"2024-09-11T23:04:46.305205+0000","last_became_peered":"2024-09-11T23:04:46.305205+0000","last_unstale":"2024-09-11T23:05:06.950864+0000","last_undegraded":"2024-09-11T23:05:06.950864+0000","last_fullsized":"2024-09-11T23:05:06.950864+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:16.071563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.990389+0000","last_change":"2024-09-11T23:05:06.984212+0000","last_active":"2024-09-11T23:05:06.990389+0000","last_peered":"2024-09-11T23:05:06.990389+0000","last_clean":"2024-09-11T23:05:06.990389+0000","last_became_active":"2024-09-11T23:05:06.983612+0000","last_became_peered":"2024-09-11T23:05:06.983612+0000","last_unstale":"2024-09-11T23:05:06.990389+0000","last_undegraded":"2024-09-11T23:05:06.990389+0000","last_fullsized":"2024-09-11T23:05:06.990389+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:46.669881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.937823+0000","last_change":"2024-09-11T23:04:46.305516+0000","last_active":"2024-09-11T23:05:06.937823+0000","last_peered":"2024-09-11T23:05:06.937823+0000","last_clean":"2024-09-11T23:05:06.937823+0000","last_became_active":"2024-09-11T23:04:46.305081+0000","last_became_peered":"2024-09-11T23:04:46.305081+0000","last_unstale":"2024-09-11T23:05:06.937823+0000","last_undegraded":"2024-09-11T23:05:06.937823+0000","last_fullsized":"2024-09-11T23:05:06.937823+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:14.633756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.999081+0000","last_change":"2024-09-11T23:05:06.989600+0000","last_active":"2024-09-11T23:05:06.999081+0000","last_peered":"2024-09-11T23:05:06.999081+0000","last_clean":"2024-09-11T23:05:06.999081+0000","last_became_active":"2024-09-11T23:05:06.988144+0000","last_became_peered":"2024-09-11T23:05:06.988144+0000","last_unstale":"2024-09-11T23:05:06.999081+0000","last_undegraded":"2024-09-11T23:05:06.999081+0000","last_fullsized":"2024-09-11T23:05:06.999081+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:10:40.766794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.963730+0000","last_change":"2024-09-11T23:04:46.325121+0000","last_active":"2024-09-11T23:05:06.963730+0000","last_peered":"2024-09-11T23:05:06.963730+0000","last_clean":"2024-09-11T23:05:06.963730+0000","last_became_active":"2024-09-11T23:04:46.324845+0000","last_became_peered":"2024-09-11T23:04:46.324845+0000","last_unstale":"2024-09-11T23:05:06.963730+0000","last_undegraded":"2024-09-11T23:05:06.963730+0000","last_fullsized":"2024-09-11T23:05:06.963730+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:40:40.557329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.004249+0000","last_change":"2024-09-11T23:05:07.001370+0000","last_active":"2024-09-11T23:05:07.004249+0000","last_peered":"2024-09-11T23:05:07.004249+0000","last_clean":"2024-09-11T23:05:07.004249+0000","last_became_active":"2024-09-11T23:05:07.000922+0000","last_became_peered":"2024-09-11T23:05:07.000922+0000","last_unstale":"2024-09-11T23:05:07.004249+0000","last_undegraded":"2024-09-11T23:05:07.004249+0000","last_fullsized":"2024-09-11T23:05:07.004249+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:25.786033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.964932+0000","last_change":"2024-09-11T23:04:46.325750+0000","last_active":"2024-09-11T23:05:06.964932+0000","last_peered":"2024-09-11T23:05:06.964932+0000","last_clean":"2024-09-11T23:05:06.964932+0000","last_became_active":"2024-09-11T23:04:46.325162+0000","last_became_peered":"2024-09-11T23:04:46.325162+0000","last_unstale":"2024-09-11T23:05:06.964932+0000","last_undegraded":"2024-09-11T23:05:06.964932+0000","last_fullsized":"2024-09-11T23:05:06.964932+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:42:04.891291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.012363+0000","last_change":"2024-09-11T23:05:07.005638+0000","last_active":"2024-09-11T23:05:07.012363+0000","last_peered":"2024-09-11T23:05:07.012363+0000","last_clean":"2024-09-11T23:05:07.012363+0000","last_became_active":"2024-09-11T23:05:07.004870+0000","last_became_peered":"2024-09-11T23:05:07.004870+0000","last_unstale":"2024-09-11T23:05:07.012363+0000","last_undegraded":"2024-09-11T23:05:07.012363+0000","last_fullsized":"2024-09-11T23:05:07.012363+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:27.609111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.934898+0000","last_change":"2024-09-11T23:04:46.302357+0000","last_active":"2024-09-11T23:05:06.934898+0000","last_peered":"2024-09-11T23:05:06.934898+0000","last_clean":"2024-09-11T23:05:06.934898+0000","last_became_active":"2024-09-11T23:04:46.300136+0000","last_became_peered":"2024-09-11T23:04:46.300136+0000","last_unstale":"2024-09-11T23:05:06.934898+0000","last_undegraded":"2024-09-11T23:05:06.934898+0000","last_fullsized":"2024-09-11T23:05:06.934898+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:05.590116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.982171+0000","last_change":"2024-09-11T23:05:06.975382+0000","last_active":"2024-09-11T23:05:06.982171+0000","last_peered":"2024-09-11T23:05:06.982171+0000","last_clean":"2024-09-11T23:05:06.982171+0000","last_became_active":"2024-09-11T23:05:06.973466+0000","last_became_peered":"2024-09-11T23:05:06.973466+0000","last_unstale":"2024-09-11T23:05:06.982171+0000","last_undegraded":"2024-09-11T23:05:06.982171+0000","last_fullsized":"2024-09-11T23:05:06.982171+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:46.458163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.962776+0000","last_change":"2024-09-11T23:04:46.316600+0000","last_active":"2024-09-11T23:05:06.962776+0000","last_peered":"2024-09-11T23:05:06.962776+0000","last_clean":"2024-09-11T23:05:06.962776+0000","last_became_active":"2024-09-11T23:04:46.316342+0000","last_became_peered":"2024-09-11T23:04:46.316342+0000","last_unstale":"2024-09-11T23:05:06.962776+0000","last_undegraded":"2024-09-11T23:05:06.962776+0000","last_fullsized":"2024-09-11T23:05:06.962776+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:35.190963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.012173+0000","last_change":"2024-09-11T23:05:07.004521+0000","last_active":"2024-09-11T23:05:07.012173+0000","last_peered":"2024-09-11T23:05:07.012173+0000","last_clean":"2024-09-11T23:05:07.012173+0000","last_became_active":"2024-09-11T23:05:07.004022+0000","last_became_peered":"2024-09-11T23:05:07.004022+0000","last_unstale":"2024-09-11T23:05:07.012173+0000","last_undegraded":"2024-09-11T23:05:07.012173+0000","last_fullsized":"2024-09-11T23:05:07.012173+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:06.822894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.980050+0000","last_change":"2024-09-11T23:04:46.326089+0000","last_active":"2024-09-11T23:05:06.980050+0000","last_peered":"2024-09-11T23:05:06.980050+0000","last_clean":"2024-09-11T23:05:06.980050+0000","last_became_active":"2024-09-11T23:04:46.325794+0000","last_became_peered":"2024-09-11T23:04:46.325794+0000","last_unstale":"2024-09-11T23:05:06.980050+0000","last_undegraded":"2024-09-11T23:05:06.980050+0000","last_fullsized":"2024-09-11T23:05:06.980050+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:33.658422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.013444+0000","last_change":"2024-09-11T23:05:07.010825+0000","last_active":"2024-09-11T23:05:07.013444+0000","last_peered":"2024-09-11T23:05:07.013444+0000","last_clean":"2024-09-11T23:05:07.013444+0000","last_became_active":"2024-09-11T23:05:07.010365+0000","last_became_peered":"2024-09-11T23:05:07.010365+0000","last_unstale":"2024-09-11T23:05:07.013444+0000","last_undegraded":"2024-09-11T23:05:07.013444+0000","last_fullsized":"2024-09-11T23:05:07.013444+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:45.274116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.931715+0000","last_change":"2024-09-11T23:04:46.292375+0000","last_active":"2024-09-11T23:05:06.931715+0000","last_peered":"2024-09-11T23:05:06.931715+0000","last_clean":"2024-09-11T23:05:06.931715+0000","last_became_active":"2024-09-11T23:04:46.292063+0000","last_became_peered":"2024-09-11T23:04:46.292063+0000","last_unstale":"2024-09-11T23:05:06.931715+0000","last_undegraded":"2024-09-11T23:05:06.931715+0000","last_fullsized":"2024-09-11T23:05:06.931715+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:34.883131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.012526+0000","last_change":"2024-09-11T23:05:07.006768+0000","last_active":"2024-09-11T23:05:07.012526+0000","last_peered":"2024-09-11T23:05:07.012526+0000","last_clean":"2024-09-11T23:05:07.012526+0000","last_became_active":"2024-09-11T23:05:07.006298+0000","last_became_peered":"2024-09-11T23:05:07.006298+0000","last_unstale":"2024-09-11T23:05:07.012526+0000","last_undegraded":"2024-09-11T23:05:07.012526+0000","last_fullsized":"2024-09-11T23:05:07.012526+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:25.786033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.957799+0000","last_change":"2024-09-11T23:04:46.294302+0000","last_active":"2024-09-11T23:05:06.957799+0000","last_peered":"2024-09-11T23:05:06.957799+0000","last_clean":"2024-09-11T23:05:06.957799+0000","last_became_active":"2024-09-11T23:04:46.294005+0000","last_became_peered":"2024-09-11T23:04:46.294005+0000","last_unstale":"2024-09-11T23:05:06.957799+0000","last_undegraded":"2024-09-11T23:05:06.957799+0000","last_fullsized":"2024-09-11T23:05:06.957799+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:46.062475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.998976+0000","last_change":"2024-09-11T23:05:06.988301+0000","last_active":"2024-09-11T23:05:06.998976+0000","last_peered":"2024-09-11T23:05:06.998976+0000","last_clean":"2024-09-11T23:05:06.998976+0000","last_became_active":"2024-09-11T23:05:06.986888+0000","last_became_peered":"2024-09-11T23:05:06.986888+0000","last_unstale":"2024-09-11T23:05:06.998976+0000","last_undegraded":"2024-09-11T23:05:06.998976+0000","last_fullsized":"2024-09-11T23:05:06.998976+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:43.518194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.937949+0000","last_change":"2024-09-11T23:04:46.302655+0000","last_active":"2024-09-11T23:05:06.937949+0000","last_peered":"2024-09-11T23:05:06.937949+0000","last_clean":"2024-09-11T23:05:06.937949+0000","last_became_active":"2024-09-11T23:04:46.302072+0000","last_became_peered":"2024-09-11T23:04:46.302072+0000","last_unstale":"2024-09-11T23:05:06.937949+0000","last_undegraded":"2024-09-11T23:05:06.937949+0000","last_fullsized":"2024-09-11T23:05:06.937949+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:04.479635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.012530+0000","last_change":"2024-09-11T23:05:07.006957+0000","last_active":"2024-09-11T23:05:07.012530+0000","last_peered":"2024-09-11T23:05:07.012530+0000","last_clean":"2024-09-11T23:05:07.012530+0000","last_became_active":"2024-09-11T23:05:07.006345+0000","last_became_peered":"2024-09-11T23:05:07.006345+0000","last_unstale":"2024-09-11T23:05:07.012530+0000","last_undegraded":"2024-09-11T23:05:07.012530+0000","last_fullsized":"2024-09-11T23:05:07.012530+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:47.531881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.963963+0000","last_change":"2024-09-11T23:04:46.316413+0000","last_active":"2024-09-11T23:05:06.963963+0000","last_peered":"2024-09-11T23:05:06.963963+0000","last_clean":"2024-09-11T23:05:06.963963+0000","last_became_active":"2024-09-11T23:04:46.316020+0000","last_became_peered":"2024-09-11T23:04:46.316020+0000","last_unstale":"2024-09-11T23:05:06.963963+0000","last_undegraded":"2024-09-11T23:05:06.963963+0000","last_fullsized":"2024-09-11T23:05:06.963963+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:26.438762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.000673+0000","last_change":"2024-09-11T23:05:06.992541+0000","last_active":"2024-09-11T23:05:07.000673+0000","last_peered":"2024-09-11T23:05:07.000673+0000","last_clean":"2024-09-11T23:05:07.000673+0000","last_became_active":"2024-09-11T23:05:06.991924+0000","last_became_peered":"2024-09-11T23:05:06.991924+0000","last_unstale":"2024-09-11T23:05:07.000673+0000","last_undegraded":"2024-09-11T23:05:07.000673+0000","last_fullsized":"2024-09-11T23:05:07.000673+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:00.902097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.965164+0000","last_change":"2024-09-11T23:04:46.325110+0000","last_active":"2024-09-11T23:05:06.965164+0000","last_peered":"2024-09-11T23:05:06.965164+0000","last_clean":"2024-09-11T23:05:06.965164+0000","last_became_active":"2024-09-11T23:04:46.324558+0000","last_became_peered":"2024-09-11T23:04:46.324558+0000","last_unstale":"2024-09-11T23:05:06.965164+0000","last_undegraded":"2024-09-11T23:05:06.965164+0000","last_fullsized":"2024-09-11T23:05:06.965164+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:22.103808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.012006+0000","last_change":"2024-09-11T23:05:07.003943+0000","last_active":"2024-09-11T23:05:07.012006+0000","last_peered":"2024-09-11T23:05:07.012006+0000","last_clean":"2024-09-11T23:05:07.012006+0000","last_became_active":"2024-09-11T23:05:07.003633+0000","last_became_peered":"2024-09-11T23:05:07.003633+0000","last_unstale":"2024-09-11T23:05:07.012006+0000","last_undegraded":"2024-09-11T23:05:07.012006+0000","last_fullsized":"2024-09-11T23:05:07.012006+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:01.603630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.935556+0000","last_change":"2024-09-11T23:04:46.315762+0000","last_active":"2024-09-11T23:05:06.935556+0000","last_peered":"2024-09-11T23:05:06.935556+0000","last_clean":"2024-09-11T23:05:06.935556+0000","last_became_active":"2024-09-11T23:04:46.313293+0000","last_became_peered":"2024-09-11T23:04:46.313293+0000","last_unstale":"2024-09-11T23:05:06.935556+0000","last_undegraded":"2024-09-11T23:05:06.935556+0000","last_fullsized":"2024-09-11T23:05:06.935556+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:06.364501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.012620+0000","last_change":"2024-09-11T23:05:07.010648+0000","last_active":"2024-09-11T23:05:07.012620+0000","last_peered":"2024-09-11T23:05:07.012620+0000","last_clean":"2024-09-11T23:05:07.012620+0000","last_became_active":"2024-09-11T23:05:07.005655+0000","last_became_peered":"2024-09-11T23:05:07.005655+0000","last_unstale":"2024-09-11T23:05:07.012620+0000","last_undegraded":"2024-09-11T23:05:07.012620+0000","last_fullsized":"2024-09-11T23:05:07.012620+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:26.834726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.937960+0000","last_change":"2024-09-11T23:04:46.300732+0000","last_active":"2024-09-11T23:05:06.937960+0000","last_peered":"2024-09-11T23:05:06.937960+0000","last_clean":"2024-09-11T23:05:06.937960+0000","last_became_active":"2024-09-11T23:04:46.300435+0000","last_became_peered":"2024-09-11T23:04:46.300435+0000","last_unstale":"2024-09-11T23:05:06.937960+0000","last_undegraded":"2024-09-11T23:05:06.937960+0000","last_fullsized":"2024-09-11T23:05:06.937960+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:18.745052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.007219+0000","last_change":"2024-09-11T23:05:06.992013+0000","last_active":"2024-09-11T23:05:07.007219+0000","last_peered":"2024-09-11T23:05:07.007219+0000","last_clean":"2024-09-11T23:05:07.007219+0000","last_became_active":"2024-09-11T23:05:06.986216+0000","last_became_peered":"2024-09-11T23:05:06.986216+0000","last_unstale":"2024-09-11T23:05:07.007219+0000","last_undegraded":"2024-09-11T23:05:07.007219+0000","last_fullsized":"2024-09-11T23:05:07.007219+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:09.815131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.952088+0000","last_change":"2024-09-11T23:04:46.315753+0000","last_active":"2024-09-11T23:05:06.952088+0000","last_peered":"2024-09-11T23:05:06.952088+0000","last_clean":"2024-09-11T23:05:06.952088+0000","last_became_active":"2024-09-11T23:04:46.310113+0000","last_became_peered":"2024-09-11T23:04:46.310113+0000","last_unstale":"2024-09-11T23:05:06.952088+0000","last_undegraded":"2024-09-11T23:05:06.952088+0000","last_fullsized":"2024-09-11T23:05:06.952088+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:04.541423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.003815+0000","last_change":"2024-09-11T23:05:06.989388+0000","last_active":"2024-09-11T23:05:07.003815+0000","last_peered":"2024-09-11T23:05:07.003815+0000","last_clean":"2024-09-11T23:05:07.003815+0000","last_became_active":"2024-09-11T23:05:06.988315+0000","last_became_peered":"2024-09-11T23:05:06.988315+0000","last_unstale":"2024-09-11T23:05:07.003815+0000","last_undegraded":"2024-09-11T23:05:07.003815+0000","last_fullsized":"2024-09-11T23:05:07.003815+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:06.822894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.932392+0000","last_change":"2024-09-11T23:04:46.319132+0000","last_active":"2024-09-11T23:05:06.932392+0000","last_peered":"2024-09-11T23:05:06.932392+0000","last_clean":"2024-09-11T23:05:06.932392+0000","last_became_active":"2024-09-11T23:04:46.318804+0000","last_became_peered":"2024-09-11T23:04:46.318804+0000","last_unstale":"2024-09-11T23:05:06.932392+0000","last_undegraded":"2024-09-11T23:05:06.932392+0000","last_fullsized":"2024-09-11T23:05:06.932392+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:06.293898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.003861+0000","last_change":"2024-09-11T23:05:06.993066+0000","last_active":"2024-09-11T23:05:07.003861+0000","last_peered":"2024-09-11T23:05:07.003861+0000","last_clean":"2024-09-11T23:05:07.003861+0000","last_became_active":"2024-09-11T23:05:06.988870+0000","last_became_peered":"2024-09-11T23:05:06.988870+0000","last_unstale":"2024-09-11T23:05:07.003861+0000","last_undegraded":"2024-09-11T23:05:07.003861+0000","last_fullsized":"2024-09-11T23:05:07.003861+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:35.620797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.950402+0000","last_change":"2024-09-11T23:04:46.309627+0000","last_active":"2024-09-11T23:05:06.950402+0000","last_peered":"2024-09-11T23:05:06.950402+0000","last_clean":"2024-09-11T23:05:06.950402+0000","last_became_active":"2024-09-11T23:04:46.305521+0000","last_became_peered":"2024-09-11T23:04:46.305521+0000","last_unstale":"2024-09-11T23:05:06.950402+0000","last_undegraded":"2024-09-11T23:05:06.950402+0000","last_fullsized":"2024-09-11T23:05:06.950402+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:23.073316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.000455+0000","last_change":"2024-09-11T23:05:06.993261+0000","last_active":"2024-09-11T23:05:07.000455+0000","last_peered":"2024-09-11T23:05:07.000455+0000","last_clean":"2024-09-11T23:05:07.000455+0000","last_became_active":"2024-09-11T23:05:06.988788+0000","last_became_peered":"2024-09-11T23:05:06.988788+0000","last_unstale":"2024-09-11T23:05:07.000455+0000","last_undegraded":"2024-09-11T23:05:07.000455+0000","last_fullsized":"2024-09-11T23:05:07.000455+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:48.064477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.938108+0000","last_change":"2024-09-11T23:04:46.303213+0000","last_active":"2024-09-11T23:05:06.938108+0000","last_peered":"2024-09-11T23:05:06.938108+0000","last_clean":"2024-09-11T23:05:06.938108+0000","last_became_active":"2024-09-11T23:04:46.302373+0000","last_became_peered":"2024-09-11T23:04:46.302373+0000","last_unstale":"2024-09-11T23:05:06.938108+0000","last_undegraded":"2024-09-11T23:05:06.938108+0000","last_fullsized":"2024-09-11T23:05:06.938108+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:46.286258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.003742+0000","last_change":"2024-09-11T23:05:06.996492+0000","last_active":"2024-09-11T23:05:07.003742+0000","last_peered":"2024-09-11T23:05:07.003742+0000","last_clean":"2024-09-11T23:05:07.003742+0000","last_became_active":"2024-09-11T23:05:06.996085+0000","last_became_peered":"2024-09-11T23:05:06.996085+0000","last_unstale":"2024-09-11T23:05:07.003742+0000","last_undegraded":"2024-09-11T23:05:07.003742+0000","last_fullsized":"2024-09-11T23:05:07.003742+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:39.989662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.952074+0000","last_change":"2024-09-11T23:04:46.305232+0000","last_active":"2024-09-11T23:05:06.952074+0000","last_peered":"2024-09-11T23:05:06.952074+0000","last_clean":"2024-09-11T23:05:06.952074+0000","last_became_active":"2024-09-11T23:04:46.300680+0000","last_became_peered":"2024-09-11T23:04:46.300680+0000","last_unstale":"2024-09-11T23:05:06.952074+0000","last_undegraded":"2024-09-11T23:05:06.952074+0000","last_fullsized":"2024-09-11T23:05:06.952074+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:41.593257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.990815+0000","last_change":"2024-09-11T23:05:06.985392+0000","last_active":"2024-09-11T23:05:06.990815+0000","last_peered":"2024-09-11T23:05:06.990815+0000","last_clean":"2024-09-11T23:05:06.990815+0000","last_became_active":"2024-09-11T23:05:06.984496+0000","last_became_peered":"2024-09-11T23:05:06.984496+0000","last_unstale":"2024-09-11T23:05:06.990815+0000","last_undegraded":"2024-09-11T23:05:06.990815+0000","last_fullsized":"2024-09-11T23:05:06.990815+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:00.060096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.934061+0000","last_change":"2024-09-11T23:04:46.302736+0000","last_active":"2024-09-11T23:05:06.934061+0000","last_peered":"2024-09-11T23:05:06.934061+0000","last_clean":"2024-09-11T23:05:06.934061+0000","last_became_active":"2024-09-11T23:04:46.302383+0000","last_became_peered":"2024-09-11T23:04:46.302383+0000","last_unstale":"2024-09-11T23:05:06.934061+0000","last_undegraded":"2024-09-11T23:05:06.934061+0000","last_fullsized":"2024-09-11T23:05:06.934061+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:14.376187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.999143+0000","last_change":"2024-09-11T23:05:06.987075+0000","last_active":"2024-09-11T23:05:06.999143+0000","last_peered":"2024-09-11T23:05:06.999143+0000","last_clean":"2024-09-11T23:05:06.999143+0000","last_became_active":"2024-09-11T23:05:06.986305+0000","last_became_peered":"2024-09-11T23:05:06.986305+0000","last_unstale":"2024-09-11T23:05:06.999143+0000","last_undegraded":"2024-09-11T23:05:06.999143+0000","last_fullsized":"2024-09-11T23:05:06.999143+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:29:29.938449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.956015+0000","last_change":"2024-09-11T23:04:46.297471+0000","last_active":"2024-09-11T23:05:06.956015+0000","last_peered":"2024-09-11T23:05:06.956015+0000","last_clean":"2024-09-11T23:05:06.956015+0000","last_became_active":"2024-09-11T23:04:46.297150+0000","last_became_peered":"2024-09-11T23:04:46.297150+0000","last_unstale":"2024-09-11T23:05:06.956015+0000","last_undegraded":"2024-09-11T23:05:06.956015+0000","last_fullsized":"2024-09-11T23:05:06.956015+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:13.700148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.982485+0000","last_change":"2024-09-11T23:05:06.978012+0000","last_active":"2024-09-11T23:05:06.982485+0000","last_peered":"2024-09-11T23:05:06.982485+0000","last_clean":"2024-09-11T23:05:06.982485+0000","last_became_active":"2024-09-11T23:05:06.977418+0000","last_became_peered":"2024-09-11T23:05:06.977418+0000","last_unstale":"2024-09-11T23:05:06.982485+0000","last_undegraded":"2024-09-11T23:05:06.982485+0000","last_fullsized":"2024-09-11T23:05:06.982485+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:05:29.209984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.964874+0000","last_change":"2024-09-11T23:04:46.327199+0000","last_active":"2024-09-11T23:05:06.964874+0000","last_peered":"2024-09-11T23:05:06.964874+0000","last_clean":"2024-09-11T23:05:06.964874+0000","last_became_active":"2024-09-11T23:04:46.326311+0000","last_became_peered":"2024-09-11T23:04:46.326311+0000","last_unstale":"2024-09-11T23:05:06.964874+0000","last_undegraded":"2024-09-11T23:05:06.964874+0000","last_fullsized":"2024-09-11T23:05:06.964874+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:13.700148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.984900+0000","last_change":"2024-09-11T23:05:06.980358+0000","last_active":"2024-09-11T23:05:06.984900+0000","last_peered":"2024-09-11T23:05:06.984900+0000","last_clean":"2024-09-11T23:05:06.984900+0000","last_became_active":"2024-09-11T23:05:06.976675+0000","last_became_peered":"2024-09-11T23:05:06.976675+0000","last_unstale":"2024-09-11T23:05:06.984900+0000","last_undegraded":"2024-09-11T23:05:06.984900+0000","last_fullsized":"2024-09-11T23:05:06.984900+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:02.495582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.952329+0000","last_change":"2024-09-11T23:04:46.318408+0000","last_active":"2024-09-11T23:05:06.952329+0000","last_peered":"2024-09-11T23:05:06.952329+0000","last_clean":"2024-09-11T23:05:06.952329+0000","last_became_active":"2024-09-11T23:04:46.310368+0000","last_became_peered":"2024-09-11T23:04:46.310368+0000","last_unstale":"2024-09-11T23:05:06.952329+0000","last_undegraded":"2024-09-11T23:05:06.952329+0000","last_fullsized":"2024-09-11T23:05:06.952329+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:10.365921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1436,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":64,"acting":64,"num_store_stats":3},{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":5046,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":10092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":298,"num_read_kb":503,"num_write":177,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738391,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":368640,"data_stored":133656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738391,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":958464,"data_stored":725641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738391,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":958464,"data_stored":724038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:05:11.558 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:05:11.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.711+0000 7feaa8e83640 1 Processor -- start 2024-09-11T23:05:11.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.711+0000 7feaa8e83640 1 -- start start 2024-09-11T23:05:11.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.711+0000 7feaa8e83640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7feaa4070420 0x7feaa4070840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:11.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.711+0000 7feaa8e83640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feaa40732a0 con 0x7feaa4070040 2024-09-11T23:05:11.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.711+0000 7feaa8e83640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7feaa4072c70 con 0x7feaa4070420 2024-09-11T23:05:11.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.711+0000 7feaa1d9b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7feaa4070420 0x7feaa4070840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:11.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.711+0000 7feaa259c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7feaa4070040 0x7feaa4073b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:53606/0 (socket says 172.21.15.12:53606) 2024-09-11T23:05:11.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.711+0000 7feaa259c640 1 -- 172.21.15.12:0/1347869702 learned_addr learned my addr 172.21.15.12:0/1347869702 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:11.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.711+0000 7feaa1d9b640 1 -- 172.21.15.12:0/1347869702 >> v1:172.21.15.12:6789/0 conn(0x7feaa4070040 legacy=0x7feaa4073b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:11.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.711+0000 7feaa159a640 1 -- 172.21.15.12:0/1347869702 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3773495151 0 0) 0x7fea94001120 con 0x7feaa4070040 2024-09-11T23:05:11.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.711+0000 7feaa1d9b640 1 -- 172.21.15.12:0/1347869702 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaa4071ee0 con 0x7feaa4070420 2024-09-11T23:05:11.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.711+0000 7feaa1d9b640 1 --2- 172.21.15.12:0/1347869702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feaa4070420 0x7feaa4070840 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fea98009740 tx=0x7fea9801c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=311efc498e0f3f6e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:11.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.711+0000 7feaa159a640 1 -- 172.21.15.12:0/1347869702 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea980b1070 con 0x7feaa4070420 2024-09-11T23:05:11.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.711+0000 7feaa159a640 1 -- 172.21.15.12:0/1347869702 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea980ac520 con 0x7feaa4070420 2024-09-11T23:05:11.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.711+0000 7feaa159a640 1 -- 172.21.15.12:0/1347869702 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea980ac820 con 0x7feaa4070420 2024-09-11T23:05:11.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.715+0000 7feaa8e83640 1 -- 172.21.15.12:0/1347869702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feaa4070420 msgr2=0x7feaa4070840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:11.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.715+0000 7feaa8e83640 1 --2- 172.21.15.12:0/1347869702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feaa4070420 0x7feaa4070840 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fea98009740 tx=0x7fea9801c390 comp rx=0 tx=0).stop 2024-09-11T23:05:11.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.715+0000 7feaa8e83640 1 -- 172.21.15.12:0/1347869702 shutdown_connections 2024-09-11T23:05:11.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.715+0000 7feaa8e83640 1 --2- 172.21.15.12:0/1347869702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feaa4070420 0x7feaa4070840 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:11.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.715+0000 7feaa8e83640 1 -- 172.21.15.12:0/1347869702 >> 172.21.15.12:0/1347869702 conn(0x7feaa409aba0 msgr2=0x7feaa409cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:11.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.715+0000 7feaa8e83640 1 -- 172.21.15.12:0/1347869702 shutdown_connections 2024-09-11T23:05:11.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.715+0000 7feaa8e83640 1 -- 172.21.15.12:0/1347869702 wait complete. 2024-09-11T23:05:11.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.715+0000 7feaa8e83640 1 Processor -- start 2024-09-11T23:05:11.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.715+0000 7feaa8e83640 1 -- start start 2024-09-11T23:05:11.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.715+0000 7feaa8e83640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feaa4070040 0x7feaa40a3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:11.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.715+0000 7feaa8e83640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7feaa4067de0 con 0x7feaa4070040 2024-09-11T23:05:11.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.715+0000 7feaa259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feaa4070040 0x7feaa40a3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:11.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.715+0000 7feaa259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feaa4070040 0x7feaa40a3de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60122/0 (socket says 172.21.15.12:60122) 2024-09-11T23:05:11.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.715+0000 7feaa259c640 1 -- 172.21.15.12:0/4129614257 learned_addr learned my addr 172.21.15.12:0/4129614257 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:11.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.715+0000 7feaa259c640 1 -- 172.21.15.12:0/4129614257 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaa40a7770 con 0x7feaa4070040 2024-09-11T23:05:11.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.715+0000 7feaa259c640 1 --2- 172.21.15.12:0/4129614257 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feaa4070040 0x7feaa40a3de0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fea9400c700 tx=0x7fea9400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:11.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.715+0000 7fea92ffd640 1 -- 172.21.15.12:0/4129614257 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea94018070 con 0x7feaa4070040 2024-09-11T23:05:11.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.715+0000 7fea92ffd640 1 -- 172.21.15.12:0/4129614257 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea940070d0 con 0x7feaa4070040 2024-09-11T23:05:11.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.715+0000 7feaa8e83640 1 -- 172.21.15.12:0/4129614257 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaa40a5c30 con 0x7feaa4070040 2024-09-11T23:05:11.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.715+0000 7fea92ffd640 1 -- 172.21.15.12:0/4129614257 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea940073f0 con 0x7feaa4070040 2024-09-11T23:05:11.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.715+0000 7feaa8e83640 1 -- 172.21.15.12:0/4129614257 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaa40a64f0 con 0x7feaa4070040 2024-09-11T23:05:11.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.715+0000 7fea92ffd640 1 -- 172.21.15.12:0/4129614257 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 20) ==== 44164+0+0 (secure 0 0 0) 0x7fea9401b070 con 0x7feaa4070040 2024-09-11T23:05:11.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.715+0000 7feaa8e83640 1 -- 172.21.15.12:0/4129614257 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaa4070840 con 0x7feaa4070040 2024-09-11T23:05:11.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.715+0000 7fea92ffd640 1 --2- 172.21.15.12:0/4129614257 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7fea84035f20 0x7fea840383e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:11.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.715+0000 7fea92ffd640 1 -- 172.21.15.12:0/4129614257 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4643+0+0 (secure 0 0 0) 0x7fea94048080 con 0x7feaa4070040 2024-09-11T23:05:11.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.715+0000 7feaa1d9b640 1 --2- 172.21.15.12:0/4129614257 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7fea84035f20 0x7fea840383e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:11.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.719+0000 7feaa1d9b640 1 --2- 172.21.15.12:0/4129614257 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7fea84035f20 0x7fea840383e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fea980ae000 tx=0x7fea98008040 comp rx=0 tx=0).ready entity=mgr.4612 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:11.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.723+0000 7fea92ffd640 1 -- 172.21.15.12:0/4129614257 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7feaa40732a0 con 0x7feaa4070040 2024-09-11T23:05:11.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.875+0000 7feaa8e83640 1 -- 172.21.15.12:0/4129614257 --> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7feaa40a7990 con 0x7fea84035f20 2024-09-11T23:05:11.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.895+0000 7fea92ffd640 1 -- 172.21.15.12:0/4129614257 <== mgr.4612 v2:172.21.15.12:6824/2340508205 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+482154 (secure 0 0 0) 0x7feaa40a7990 con 0x7fea84035f20 2024-09-11T23:05:11.899 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:05:11.906 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-11T23:05:11.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.903+0000 7feaa8e83640 1 -- 172.21.15.12:0/4129614257 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7fea84035f20 msgr2=0x7fea840383e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:11.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.903+0000 7feaa8e83640 1 --2- 172.21.15.12:0/4129614257 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7fea84035f20 0x7fea840383e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fea980ae000 tx=0x7fea98008040 comp rx=0 tx=0).stop 2024-09-11T23:05:11.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.903+0000 7feaa8e83640 1 -- 172.21.15.12:0/4129614257 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feaa4070040 msgr2=0x7feaa40a3de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:11.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.903+0000 7feaa8e83640 1 --2- 172.21.15.12:0/4129614257 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feaa4070040 0x7feaa40a3de0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fea9400c700 tx=0x7fea9400cbc0 comp rx=0 tx=0).stop 2024-09-11T23:05:11.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.903+0000 7feaa8e83640 1 -- 172.21.15.12:0/4129614257 shutdown_connections 2024-09-11T23:05:11.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.903+0000 7feaa8e83640 1 --2- 172.21.15.12:0/4129614257 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7fea84035f20 0x7fea840383e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:11.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.903+0000 7feaa8e83640 1 --2- 172.21.15.12:0/4129614257 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feaa4070040 0x7feaa40a3de0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:11.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.903+0000 7feaa8e83640 1 -- 172.21.15.12:0/4129614257 >> 172.21.15.12:0/4129614257 conn(0x7feaa409aba0 msgr2=0x7feaa4139830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:11.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.903+0000 7feaa8e83640 1 -- 172.21.15.12:0/4129614257 shutdown_connections 2024-09-11T23:05:11.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:11.903+0000 7feaa8e83640 1 -- 172.21.15.12:0/4129614257 wait complete. 2024-09-11T23:05:11.921 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":7,"stamp":"2024-09-11T23:05:10.523545+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596850,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":298,"num_read_kb":503,"num_write":265,"num_write_kb":1921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":285,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91652,"kb_used_data":2232,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283023868,"statfs":{"total":289910292480,"available":289816440832,"internally_reserved":0,"allocated":2285568,"data_stored":1583335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.994512"},"pg_stats":[{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.000094+0000","last_change":"2024-09-11T23:05:06.988059+0000","last_active":"2024-09-11T23:05:07.000094+0000","last_peered":"2024-09-11T23:05:07.000094+0000","last_clean":"2024-09-11T23:05:07.000094+0000","last_became_active":"2024-09-11T23:05:06.987429+0000","last_became_peered":"2024-09-11T23:05:06.987429+0000","last_unstale":"2024-09-11T23:05:07.000094+0000","last_undegraded":"2024-09-11T23:05:07.000094+0000","last_fullsized":"2024-09-11T23:05:07.000094+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:02.837866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"35'4","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.979471+0000","last_change":"2024-09-11T23:04:45.300320+0000","last_active":"2024-09-11T23:05:06.979471+0000","last_peered":"2024-09-11T23:05:06.979471+0000","last_clean":"2024-09-11T23:05:06.979471+0000","last_became_active":"2024-09-11T23:04:45.300023+0000","last_became_peered":"2024-09-11T23:04:45.300023+0000","last_unstale":"2024-09-11T23:05:06.979471+0000","last_undegraded":"2024-09-11T23:05:06.979471+0000","last_fullsized":"2024-09-11T23:05:06.979471+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:21.535311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.958633+0000","last_change":"2024-09-11T23:04:46.303423+0000","last_active":"2024-09-11T23:05:06.958633+0000","last_peered":"2024-09-11T23:05:06.958633+0000","last_clean":"2024-09-11T23:05:06.958633+0000","last_became_active":"2024-09-11T23:04:46.302883+0000","last_became_peered":"2024-09-11T23:04:46.302883+0000","last_unstale":"2024-09-11T23:05:06.958633+0000","last_undegraded":"2024-09-11T23:05:06.958633+0000","last_fullsized":"2024-09-11T23:05:06.958633+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:26.438762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.958305+0000","last_change":"2024-09-11T23:05:06.533763+0000","last_active":"2024-09-11T23:05:06.958305+0000","last_peered":"2024-09-11T23:05:06.958305+0000","last_clean":"2024-09-11T23:05:06.958305+0000","last_became_active":"2024-09-11T23:05:06.530952+0000","last_became_peered":"2024-09-11T23:05:06.530952+0000","last_unstale":"2024-09-11T23:05:06.958305+0000","last_undegraded":"2024-09-11T23:05:06.958305+0000","last_fullsized":"2024-09-11T23:05:06.958305+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:45.046652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.007240+0000","last_change":"2024-09-11T23:05:06.993107+0000","last_active":"2024-09-11T23:05:07.007240+0000","last_peered":"2024-09-11T23:05:07.007240+0000","last_clean":"2024-09-11T23:05:07.007240+0000","last_became_active":"2024-09-11T23:05:06.987224+0000","last_became_peered":"2024-09-11T23:05:06.987224+0000","last_unstale":"2024-09-11T23:05:07.007240+0000","last_undegraded":"2024-09-11T23:05:07.007240+0000","last_fullsized":"2024-09-11T23:05:07.007240+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:25:44.800463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"35'1","reported_seq":21,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.957554+0000","last_change":"2024-09-11T23:04:45.295255+0000","last_active":"2024-09-11T23:05:06.957554+0000","last_peered":"2024-09-11T23:05:06.957554+0000","last_clean":"2024-09-11T23:05:06.957554+0000","last_became_active":"2024-09-11T23:04:45.293741+0000","last_became_peered":"2024-09-11T23:04:45.293741+0000","last_unstale":"2024-09-11T23:05:06.957554+0000","last_undegraded":"2024-09-11T23:05:06.957554+0000","last_fullsized":"2024-09-11T23:05:06.957554+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:47.401560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.951466+0000","last_change":"2024-09-11T23:04:46.318822+0000","last_active":"2024-09-11T23:05:06.951466+0000","last_peered":"2024-09-11T23:05:06.951466+0000","last_clean":"2024-09-11T23:05:06.951466+0000","last_became_active":"2024-09-11T23:04:46.310782+0000","last_became_peered":"2024-09-11T23:04:46.310782+0000","last_unstale":"2024-09-11T23:05:06.951466+0000","last_undegraded":"2024-09-11T23:05:06.951466+0000","last_fullsized":"2024-09-11T23:05:06.951466+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:24.029506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"39'8","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.527417+0000","last_change":"2024-09-11T23:05:06.534076+0000","last_active":"2024-09-11T23:05:07.527417+0000","last_peered":"2024-09-11T23:05:07.527417+0000","last_clean":"2024-09-11T23:05:07.527417+0000","last_became_active":"2024-09-11T23:05:06.533799+0000","last_became_peered":"2024-09-11T23:05:06.533799+0000","last_unstale":"2024-09-11T23:05:07.527417+0000","last_undegraded":"2024-09-11T23:05:07.527417+0000","last_fullsized":"2024-09-11T23:05:07.527417+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:55.506722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.999470+0000","last_change":"2024-09-11T23:05:06.987669+0000","last_active":"2024-09-11T23:05:06.999470+0000","last_peered":"2024-09-11T23:05:06.999470+0000","last_clean":"2024-09-11T23:05:06.999470+0000","last_became_active":"2024-09-11T23:05:06.975626+0000","last_became_peered":"2024-09-11T23:05:06.975626+0000","last_unstale":"2024-09-11T23:05:06.999470+0000","last_undegraded":"2024-09-11T23:05:06.999470+0000","last_fullsized":"2024-09-11T23:05:06.999470+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:35.878366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"35'2","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.948272+0000","last_change":"2024-09-11T23:04:45.291351+0000","last_active":"2024-09-11T23:05:06.948272+0000","last_peered":"2024-09-11T23:05:06.948272+0000","last_clean":"2024-09-11T23:05:06.948272+0000","last_became_active":"2024-09-11T23:04:45.290803+0000","last_became_peered":"2024-09-11T23:04:45.290803+0000","last_unstale":"2024-09-11T23:05:06.948272+0000","last_undegraded":"2024-09-11T23:05:06.948272+0000","last_fullsized":"2024-09-11T23:05:06.948272+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:21.574886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.964327+0000","last_change":"2024-09-11T23:04:46.321983+0000","last_active":"2024-09-11T23:05:06.964327+0000","last_peered":"2024-09-11T23:05:06.964327+0000","last_clean":"2024-09-11T23:05:06.964327+0000","last_became_active":"2024-09-11T23:04:46.318618+0000","last_became_peered":"2024-09-11T23:04:46.318618+0000","last_unstale":"2024-09-11T23:05:06.964327+0000","last_undegraded":"2024-09-11T23:05:06.964327+0000","last_fullsized":"2024-09-11T23:05:06.964327+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:31.865881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.948731+0000","last_change":"2024-09-11T23:05:06.531879+0000","last_active":"2024-09-11T23:05:06.948731+0000","last_peered":"2024-09-11T23:05:06.948731+0000","last_clean":"2024-09-11T23:05:06.948731+0000","last_became_active":"2024-09-11T23:05:06.531630+0000","last_became_peered":"2024-09-11T23:05:06.531630+0000","last_unstale":"2024-09-11T23:05:06.948731+0000","last_undegraded":"2024-09-11T23:05:06.948731+0000","last_fullsized":"2024-09-11T23:05:06.948731+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:45.046652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.012218+0000","last_change":"2024-09-11T23:05:07.004859+0000","last_active":"2024-09-11T23:05:07.012218+0000","last_peered":"2024-09-11T23:05:07.012218+0000","last_clean":"2024-09-11T23:05:07.012218+0000","last_became_active":"2024-09-11T23:05:07.004547+0000","last_became_peered":"2024-09-11T23:05:07.004547+0000","last_unstale":"2024-09-11T23:05:07.012218+0000","last_undegraded":"2024-09-11T23:05:07.012218+0000","last_fullsized":"2024-09-11T23:05:07.012218+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:37:20.217282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"35'2","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.970654+0000","last_change":"2024-09-11T23:04:45.298753+0000","last_active":"2024-09-11T23:05:06.970654+0000","last_peered":"2024-09-11T23:05:06.970654+0000","last_clean":"2024-09-11T23:05:06.970654+0000","last_became_active":"2024-09-11T23:04:45.293365+0000","last_became_peered":"2024-09-11T23:04:45.293365+0000","last_unstale":"2024-09-11T23:05:06.970654+0000","last_undegraded":"2024-09-11T23:05:06.970654+0000","last_fullsized":"2024-09-11T23:05:06.970654+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:30.192602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.948686+0000","last_change":"2024-09-11T23:04:46.319460+0000","last_active":"2024-09-11T23:05:06.948686+0000","last_peered":"2024-09-11T23:05:06.948686+0000","last_clean":"2024-09-11T23:05:06.948686+0000","last_became_active":"2024-09-11T23:04:46.318424+0000","last_became_peered":"2024-09-11T23:04:46.318424+0000","last_unstale":"2024-09-11T23:05:06.948686+0000","last_undegraded":"2024-09-11T23:05:06.948686+0000","last_fullsized":"2024-09-11T23:05:06.948686+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:11.312361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.959561+0000","last_change":"2024-09-11T23:05:06.535479+0000","last_active":"2024-09-11T23:05:06.959561+0000","last_peered":"2024-09-11T23:05:06.959561+0000","last_clean":"2024-09-11T23:05:06.959561+0000","last_became_active":"2024-09-11T23:05:06.534835+0000","last_became_peered":"2024-09-11T23:05:06.534835+0000","last_unstale":"2024-09-11T23:05:06.959561+0000","last_undegraded":"2024-09-11T23:05:06.959561+0000","last_fullsized":"2024-09-11T23:05:06.959561+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:25.350163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.001871+0000","last_change":"2024-09-11T23:05:06.992845+0000","last_active":"2024-09-11T23:05:07.001871+0000","last_peered":"2024-09-11T23:05:07.001871+0000","last_clean":"2024-09-11T23:05:07.001871+0000","last_became_active":"2024-09-11T23:05:06.988931+0000","last_became_peered":"2024-09-11T23:05:06.988931+0000","last_unstale":"2024-09-11T23:05:07.001871+0000","last_undegraded":"2024-09-11T23:05:07.001871+0000","last_fullsized":"2024-09-11T23:05:07.001871+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:50.163278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.948434+0000","last_change":"2024-09-11T23:04:46.295090+0000","last_active":"2024-09-11T23:05:06.948434+0000","last_peered":"2024-09-11T23:05:06.948434+0000","last_clean":"2024-09-11T23:05:06.948434+0000","last_became_active":"2024-09-11T23:04:46.294809+0000","last_became_peered":"2024-09-11T23:04:46.294809+0000","last_unstale":"2024-09-11T23:05:06.948434+0000","last_undegraded":"2024-09-11T23:05:06.948434+0000","last_fullsized":"2024-09-11T23:05:06.948434+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:55.065032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.932593+0000","last_change":"2024-09-11T23:04:45.282514+0000","last_active":"2024-09-11T23:05:06.932593+0000","last_peered":"2024-09-11T23:05:06.932593+0000","last_clean":"2024-09-11T23:05:06.932593+0000","last_became_active":"2024-09-11T23:04:45.282208+0000","last_became_peered":"2024-09-11T23:04:45.282208+0000","last_unstale":"2024-09-11T23:05:06.932593+0000","last_undegraded":"2024-09-11T23:05:06.932593+0000","last_fullsized":"2024-09-11T23:05:06.932593+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:42:03.884314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.965623+0000","last_change":"2024-09-11T23:05:06.535500+0000","last_active":"2024-09-11T23:05:06.965623+0000","last_peered":"2024-09-11T23:05:06.965623+0000","last_clean":"2024-09-11T23:05:06.965623+0000","last_became_active":"2024-09-11T23:05:06.535290+0000","last_became_peered":"2024-09-11T23:05:06.535290+0000","last_unstale":"2024-09-11T23:05:06.965623+0000","last_undegraded":"2024-09-11T23:05:06.965623+0000","last_fullsized":"2024-09-11T23:05:06.965623+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:00.899145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.000417+0000","last_change":"2024-09-11T23:05:06.992863+0000","last_active":"2024-09-11T23:05:07.000417+0000","last_peered":"2024-09-11T23:05:07.000417+0000","last_clean":"2024-09-11T23:05:07.000417+0000","last_became_active":"2024-09-11T23:05:06.979708+0000","last_became_peered":"2024-09-11T23:05:06.979708+0000","last_unstale":"2024-09-11T23:05:07.000417+0000","last_undegraded":"2024-09-11T23:05:07.000417+0000","last_fullsized":"2024-09-11T23:05:07.000417+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:23.035505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.959074+0000","last_change":"2024-09-11T23:04:46.326774+0000","last_active":"2024-09-11T23:05:06.959074+0000","last_peered":"2024-09-11T23:05:06.959074+0000","last_clean":"2024-09-11T23:05:06.959074+0000","last_became_active":"2024-09-11T23:04:46.326246+0000","last_became_peered":"2024-09-11T23:04:46.326246+0000","last_unstale":"2024-09-11T23:05:06.959074+0000","last_undegraded":"2024-09-11T23:05:06.959074+0000","last_fullsized":"2024-09-11T23:05:06.959074+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:09.138555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"35'2","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.949103+0000","last_change":"2024-09-11T23:04:45.294359+0000","last_active":"2024-09-11T23:05:06.949103+0000","last_peered":"2024-09-11T23:05:06.949103+0000","last_clean":"2024-09-11T23:05:06.949103+0000","last_became_active":"2024-09-11T23:04:45.293592+0000","last_became_peered":"2024-09-11T23:04:45.293592+0000","last_unstale":"2024-09-11T23:05:06.949103+0000","last_undegraded":"2024-09-11T23:05:06.949103+0000","last_fullsized":"2024-09-11T23:05:06.949103+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:11.282148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.955667+0000","last_change":"2024-09-11T23:05:06.542951+0000","last_active":"2024-09-11T23:05:06.955667+0000","last_peered":"2024-09-11T23:05:06.955667+0000","last_clean":"2024-09-11T23:05:06.955667+0000","last_became_active":"2024-09-11T23:05:06.533320+0000","last_became_peered":"2024-09-11T23:05:06.533320+0000","last_unstale":"2024-09-11T23:05:06.955667+0000","last_undegraded":"2024-09-11T23:05:06.955667+0000","last_fullsized":"2024-09-11T23:05:06.955667+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:00.899145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.007259+0000","last_change":"2024-09-11T23:05:06.994998+0000","last_active":"2024-09-11T23:05:07.007259+0000","last_peered":"2024-09-11T23:05:07.007259+0000","last_clean":"2024-09-11T23:05:07.007259+0000","last_became_active":"2024-09-11T23:05:06.989570+0000","last_became_peered":"2024-09-11T23:05:06.989570+0000","last_unstale":"2024-09-11T23:05:07.007259+0000","last_undegraded":"2024-09-11T23:05:07.007259+0000","last_fullsized":"2024-09-11T23:05:07.007259+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:39.752373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.956735+0000","last_change":"2024-09-11T23:04:46.297755+0000","last_active":"2024-09-11T23:05:06.956735+0000","last_peered":"2024-09-11T23:05:06.956735+0000","last_clean":"2024-09-11T23:05:06.956735+0000","last_became_active":"2024-09-11T23:04:46.293603+0000","last_became_peered":"2024-09-11T23:04:46.293603+0000","last_unstale":"2024-09-11T23:05:06.956735+0000","last_undegraded":"2024-09-11T23:05:06.956735+0000","last_fullsized":"2024-09-11T23:05:06.956735+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:31.865881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"36'1","reported_seq":21,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.957018+0000","last_change":"2024-09-11T23:04:45.287761+0000","last_active":"2024-09-11T23:05:06.957018+0000","last_peered":"2024-09-11T23:05:06.957018+0000","last_clean":"2024-09-11T23:05:06.957018+0000","last_became_active":"2024-09-11T23:04:45.286454+0000","last_became_peered":"2024-09-11T23:04:45.286454+0000","last_unstale":"2024-09-11T23:05:06.957018+0000","last_undegraded":"2024-09-11T23:05:06.957018+0000","last_fullsized":"2024-09-11T23:05:06.957018+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:01.543559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.971136+0000","last_change":"2024-09-11T23:05:06.544751+0000","last_active":"2024-09-11T23:05:06.971136+0000","last_peered":"2024-09-11T23:05:06.971136+0000","last_clean":"2024-09-11T23:05:06.971136+0000","last_became_active":"2024-09-11T23:05:06.544281+0000","last_became_peered":"2024-09-11T23:05:06.544281+0000","last_unstale":"2024-09-11T23:05:06.971136+0000","last_undegraded":"2024-09-11T23:05:06.971136+0000","last_fullsized":"2024-09-11T23:05:06.971136+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:59.482764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.004125+0000","last_change":"2024-09-11T23:05:06.994314+0000","last_active":"2024-09-11T23:05:07.004125+0000","last_peered":"2024-09-11T23:05:07.004125+0000","last_clean":"2024-09-11T23:05:07.004125+0000","last_became_active":"2024-09-11T23:05:06.993794+0000","last_became_peered":"2024-09-11T23:05:06.993794+0000","last_unstale":"2024-09-11T23:05:07.004125+0000","last_undegraded":"2024-09-11T23:05:07.004125+0000","last_fullsized":"2024-09-11T23:05:07.004125+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:37:20.217282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"35'1","reported_seq":21,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.934351+0000","last_change":"2024-09-11T23:04:45.296095+0000","last_active":"2024-09-11T23:05:06.934351+0000","last_peered":"2024-09-11T23:05:06.934351+0000","last_clean":"2024-09-11T23:05:06.934351+0000","last_became_active":"2024-09-11T23:04:45.295473+0000","last_became_peered":"2024-09-11T23:04:45.295473+0000","last_unstale":"2024-09-11T23:05:06.934351+0000","last_undegraded":"2024-09-11T23:05:06.934351+0000","last_fullsized":"2024-09-11T23:05:06.934351+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:30.858904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.959674+0000","last_change":"2024-09-11T23:04:46.326881+0000","last_active":"2024-09-11T23:05:06.959674+0000","last_peered":"2024-09-11T23:05:06.959674+0000","last_clean":"2024-09-11T23:05:06.959674+0000","last_became_active":"2024-09-11T23:04:46.326341+0000","last_became_peered":"2024-09-11T23:04:46.326341+0000","last_unstale":"2024-09-11T23:05:06.959674+0000","last_undegraded":"2024-09-11T23:05:06.959674+0000","last_fullsized":"2024-09-11T23:05:06.959674+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:33.670979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.15","version":"39'3","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.970920+0000","last_change":"2024-09-11T23:05:06.532300+0000","last_active":"2024-09-11T23:05:06.970920+0000","last_peered":"2024-09-11T23:05:06.970920+0000","last_clean":"2024-09-11T23:05:06.970920+0000","last_became_active":"2024-09-11T23:05:06.532025+0000","last_became_peered":"2024-09-11T23:05:06.532025+0000","last_unstale":"2024-09-11T23:05:06.970920+0000","last_undegraded":"2024-09-11T23:05:06.970920+0000","last_fullsized":"2024-09-11T23:05:06.970920+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:31.662183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.001195+0000","last_change":"2024-09-11T23:05:06.993725+0000","last_active":"2024-09-11T23:05:07.001195+0000","last_peered":"2024-09-11T23:05:07.001195+0000","last_clean":"2024-09-11T23:05:07.001195+0000","last_became_active":"2024-09-11T23:05:06.993191+0000","last_became_peered":"2024-09-11T23:05:06.993191+0000","last_unstale":"2024-09-11T23:05:07.001195+0000","last_undegraded":"2024-09-11T23:05:07.001195+0000","last_fullsized":"2024-09-11T23:05:07.001195+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:01.603630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.933186+0000","last_change":"2024-09-11T23:04:46.305208+0000","last_active":"2024-09-11T23:05:06.933186+0000","last_peered":"2024-09-11T23:05:06.933186+0000","last_clean":"2024-09-11T23:05:06.933186+0000","last_became_active":"2024-09-11T23:04:46.302083+0000","last_became_peered":"2024-09-11T23:04:46.302083+0000","last_unstale":"2024-09-11T23:05:06.933186+0000","last_undegraded":"2024-09-11T23:05:06.933186+0000","last_fullsized":"2024-09-11T23:05:06.933186+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:26.819867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.934712+0000","last_change":"2024-09-11T23:04:45.288188+0000","last_active":"2024-09-11T23:05:06.934712+0000","last_peered":"2024-09-11T23:05:06.934712+0000","last_clean":"2024-09-11T23:05:06.934712+0000","last_became_active":"2024-09-11T23:04:45.287709+0000","last_became_peered":"2024-09-11T23:04:45.287709+0000","last_unstale":"2024-09-11T23:05:06.934712+0000","last_undegraded":"2024-09-11T23:05:06.934712+0000","last_fullsized":"2024-09-11T23:05:06.934712+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:03.374706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.523587+0000","last_change":"2024-09-11T23:05:06.547698+0000","last_active":"2024-09-11T23:05:07.523587+0000","last_peered":"2024-09-11T23:05:07.523587+0000","last_clean":"2024-09-11T23:05:07.523587+0000","last_became_active":"2024-09-11T23:05:06.547434+0000","last_became_peered":"2024-09-11T23:05:06.547434+0000","last_unstale":"2024-09-11T23:05:07.523587+0000","last_undegraded":"2024-09-11T23:05:07.523587+0000","last_fullsized":"2024-09-11T23:05:07.523587+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:20.609018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.012325+0000","last_change":"2024-09-11T23:05:07.005381+0000","last_active":"2024-09-11T23:05:07.012325+0000","last_peered":"2024-09-11T23:05:07.012325+0000","last_clean":"2024-09-11T23:05:07.012325+0000","last_became_active":"2024-09-11T23:05:07.004605+0000","last_became_peered":"2024-09-11T23:05:07.004605+0000","last_unstale":"2024-09-11T23:05:07.012325+0000","last_undegraded":"2024-09-11T23:05:07.012325+0000","last_fullsized":"2024-09-11T23:05:07.012325+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:46.200998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.958490+0000","last_change":"2024-09-11T23:04:46.317503+0000","last_active":"2024-09-11T23:05:06.958490+0000","last_peered":"2024-09-11T23:05:06.958490+0000","last_clean":"2024-09-11T23:05:06.958490+0000","last_became_active":"2024-09-11T23:04:46.316769+0000","last_became_peered":"2024-09-11T23:04:46.316769+0000","last_unstale":"2024-09-11T23:05:06.958490+0000","last_undegraded":"2024-09-11T23:05:06.958490+0000","last_fullsized":"2024-09-11T23:05:06.958490+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:20.489333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.932893+0000","last_change":"2024-09-11T23:04:45.289256+0000","last_active":"2024-09-11T23:05:06.932893+0000","last_peered":"2024-09-11T23:05:06.932893+0000","last_clean":"2024-09-11T23:05:06.932893+0000","last_became_active":"2024-09-11T23:04:45.288748+0000","last_became_peered":"2024-09-11T23:04:45.288748+0000","last_unstale":"2024-09-11T23:05:06.932893+0000","last_undegraded":"2024-09-11T23:05:06.932893+0000","last_fullsized":"2024-09-11T23:05:06.932893+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:07.147196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.958079+0000","last_change":"2024-09-11T23:05:06.543128+0000","last_active":"2024-09-11T23:05:06.958079+0000","last_peered":"2024-09-11T23:05:06.958079+0000","last_clean":"2024-09-11T23:05:06.958079+0000","last_became_active":"2024-09-11T23:05:06.542436+0000","last_became_peered":"2024-09-11T23:05:06.542436+0000","last_unstale":"2024-09-11T23:05:06.958079+0000","last_undegraded":"2024-09-11T23:05:06.958079+0000","last_fullsized":"2024-09-11T23:05:06.958079+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:31.662183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.001653+0000","last_change":"2024-09-11T23:05:06.992912+0000","last_active":"2024-09-11T23:05:07.001653+0000","last_peered":"2024-09-11T23:05:07.001653+0000","last_clean":"2024-09-11T23:05:07.001653+0000","last_became_active":"2024-09-11T23:05:06.987318+0000","last_became_peered":"2024-09-11T23:05:06.987318+0000","last_unstale":"2024-09-11T23:05:07.001653+0000","last_undegraded":"2024-09-11T23:05:07.001653+0000","last_fullsized":"2024-09-11T23:05:07.001653+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:46.733768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.971114+0000","last_change":"2024-09-11T23:04:46.324555+0000","last_active":"2024-09-11T23:05:06.971114+0000","last_peered":"2024-09-11T23:05:06.971114+0000","last_clean":"2024-09-11T23:05:06.971114+0000","last_became_active":"2024-09-11T23:04:46.324272+0000","last_became_peered":"2024-09-11T23:04:46.324272+0000","last_unstale":"2024-09-11T23:05:06.971114+0000","last_undegraded":"2024-09-11T23:05:06.971114+0000","last_fullsized":"2024-09-11T23:05:06.971114+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:21.068619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.971104+0000","last_change":"2024-09-11T23:04:45.291185+0000","last_active":"2024-09-11T23:05:06.971104+0000","last_peered":"2024-09-11T23:05:06.971104+0000","last_clean":"2024-09-11T23:05:06.971104+0000","last_became_active":"2024-09-11T23:04:45.290872+0000","last_became_peered":"2024-09-11T23:04:45.290872+0000","last_unstale":"2024-09-11T23:05:06.971104+0000","last_undegraded":"2024-09-11T23:05:06.971104+0000","last_fullsized":"2024-09-11T23:05:06.971104+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:37.312674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.966552+0000","last_change":"2024-09-11T23:05:06.545869+0000","last_active":"2024-09-11T23:05:06.966552+0000","last_peered":"2024-09-11T23:05:06.966552+0000","last_clean":"2024-09-11T23:05:06.966552+0000","last_became_active":"2024-09-11T23:05:06.544738+0000","last_became_peered":"2024-09-11T23:05:06.544738+0000","last_unstale":"2024-09-11T23:05:06.966552+0000","last_undegraded":"2024-09-11T23:05:06.966552+0000","last_fullsized":"2024-09-11T23:05:06.966552+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:43.740594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.984871+0000","last_change":"2024-09-11T23:05:06.979874+0000","last_active":"2024-09-11T23:05:06.984871+0000","last_peered":"2024-09-11T23:05:06.984871+0000","last_clean":"2024-09-11T23:05:06.984871+0000","last_became_active":"2024-09-11T23:05:06.978278+0000","last_became_peered":"2024-09-11T23:05:06.978278+0000","last_unstale":"2024-09-11T23:05:06.984871+0000","last_undegraded":"2024-09-11T23:05:06.984871+0000","last_fullsized":"2024-09-11T23:05:06.984871+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:54.900728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.931456+0000","last_change":"2024-09-11T23:04:46.294410+0000","last_active":"2024-09-11T23:05:06.931456+0000","last_peered":"2024-09-11T23:05:06.931456+0000","last_clean":"2024-09-11T23:05:06.931456+0000","last_became_active":"2024-09-11T23:04:46.294110+0000","last_became_peered":"2024-09-11T23:04:46.294110+0000","last_unstale":"2024-09-11T23:05:06.931456+0000","last_undegraded":"2024-09-11T23:05:06.931456+0000","last_fullsized":"2024-09-11T23:05:06.931456+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:25.425271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.933133+0000","last_change":"2024-09-11T23:04:45.291550+0000","last_active":"2024-09-11T23:05:06.933133+0000","last_peered":"2024-09-11T23:05:06.933133+0000","last_clean":"2024-09-11T23:05:06.933133+0000","last_became_active":"2024-09-11T23:04:45.288657+0000","last_became_peered":"2024-09-11T23:04:45.288657+0000","last_unstale":"2024-09-11T23:05:06.933133+0000","last_undegraded":"2024-09-11T23:05:06.933133+0000","last_fullsized":"2024-09-11T23:05:06.933133+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:10.305384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.958470+0000","last_change":"2024-09-11T23:05:06.545740+0000","last_active":"2024-09-11T23:05:06.958470+0000","last_peered":"2024-09-11T23:05:06.958470+0000","last_clean":"2024-09-11T23:05:06.958470+0000","last_became_active":"2024-09-11T23:05:06.543205+0000","last_became_peered":"2024-09-11T23:05:06.543205+0000","last_unstale":"2024-09-11T23:05:06.958470+0000","last_undegraded":"2024-09-11T23:05:06.958470+0000","last_fullsized":"2024-09-11T23:05:06.958470+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:53.799981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.990635+0000","last_change":"2024-09-11T23:05:06.985345+0000","last_active":"2024-09-11T23:05:06.990635+0000","last_peered":"2024-09-11T23:05:06.990635+0000","last_clean":"2024-09-11T23:05:06.990635+0000","last_became_active":"2024-09-11T23:05:06.984425+0000","last_became_peered":"2024-09-11T23:05:06.984425+0000","last_unstale":"2024-09-11T23:05:06.990635+0000","last_undegraded":"2024-09-11T23:05:06.990635+0000","last_fullsized":"2024-09-11T23:05:06.990635+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:37.316173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.958646+0000","last_change":"2024-09-11T23:04:46.294456+0000","last_active":"2024-09-11T23:05:06.958646+0000","last_peered":"2024-09-11T23:05:06.958646+0000","last_clean":"2024-09-11T23:05:06.958646+0000","last_became_active":"2024-09-11T23:04:46.294179+0000","last_became_peered":"2024-09-11T23:04:46.294179+0000","last_unstale":"2024-09-11T23:05:06.958646+0000","last_undegraded":"2024-09-11T23:05:06.958646+0000","last_fullsized":"2024-09-11T23:05:06.958646+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:00.992500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.933684+0000","last_change":"2024-09-11T23:04:45.295884+0000","last_active":"2024-09-11T23:05:06.933684+0000","last_peered":"2024-09-11T23:05:06.933684+0000","last_clean":"2024-09-11T23:05:06.933684+0000","last_became_active":"2024-09-11T23:04:45.294402+0000","last_became_peered":"2024-09-11T23:04:45.294402+0000","last_unstale":"2024-09-11T23:05:06.933684+0000","last_undegraded":"2024-09-11T23:05:06.933684+0000","last_fullsized":"2024-09-11T23:05:06.933684+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:12.693171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"39'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.971000+0000","last_change":"2024-09-11T23:05:06.530183+0000","last_active":"2024-09-11T23:05:06.971000+0000","last_peered":"2024-09-11T23:05:06.971000+0000","last_clean":"2024-09-11T23:05:06.971000+0000","last_became_active":"2024-09-11T23:05:06.526572+0000","last_became_peered":"2024-09-11T23:05:06.526572+0000","last_unstale":"2024-09-11T23:05:06.971000+0000","last_undegraded":"2024-09-11T23:05:06.971000+0000","last_fullsized":"2024-09-11T23:05:06.971000+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:26.961176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.983500+0000","last_change":"2024-09-11T23:05:06.979252+0000","last_active":"2024-09-11T23:05:06.983500+0000","last_peered":"2024-09-11T23:05:06.983500+0000","last_clean":"2024-09-11T23:05:06.983500+0000","last_became_active":"2024-09-11T23:05:06.978549+0000","last_became_peered":"2024-09-11T23:05:06.978549+0000","last_unstale":"2024-09-11T23:05:06.983500+0000","last_undegraded":"2024-09-11T23:05:06.983500+0000","last_fullsized":"2024-09-11T23:05:06.983500+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:52.828195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.934803+0000","last_change":"2024-09-11T23:04:46.296765+0000","last_active":"2024-09-11T23:05:06.934803+0000","last_peered":"2024-09-11T23:05:06.934803+0000","last_clean":"2024-09-11T23:05:06.934803+0000","last_became_active":"2024-09-11T23:04:46.296396+0000","last_became_peered":"2024-09-11T23:04:46.296396+0000","last_unstale":"2024-09-11T23:05:06.934803+0000","last_undegraded":"2024-09-11T23:05:06.934803+0000","last_fullsized":"2024-09-11T23:05:06.934803+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:24.956388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.965568+0000","last_change":"2024-09-11T23:04:45.294541+0000","last_active":"2024-09-11T23:05:06.965568+0000","last_peered":"2024-09-11T23:05:06.965568+0000","last_clean":"2024-09-11T23:05:06.965568+0000","last_became_active":"2024-09-11T23:04:45.294242+0000","last_became_peered":"2024-09-11T23:04:45.294242+0000","last_unstale":"2024-09-11T23:05:06.965568+0000","last_undegraded":"2024-09-11T23:05:06.965568+0000","last_fullsized":"2024-09-11T23:05:06.965568+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:42.801527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.935548+0000","last_change":"2024-09-11T23:05:06.542274+0000","last_active":"2024-09-11T23:05:06.935548+0000","last_peered":"2024-09-11T23:05:06.935548+0000","last_clean":"2024-09-11T23:05:06.935548+0000","last_became_active":"2024-09-11T23:05:06.541365+0000","last_became_peered":"2024-09-11T23:05:06.541365+0000","last_unstale":"2024-09-11T23:05:06.935548+0000","last_undegraded":"2024-09-11T23:05:06.935548+0000","last_fullsized":"2024-09-11T23:05:06.935548+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:12:29.001425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.013410+0000","last_change":"2024-09-11T23:05:07.005411+0000","last_active":"2024-09-11T23:05:07.013410+0000","last_peered":"2024-09-11T23:05:07.013410+0000","last_clean":"2024-09-11T23:05:07.013410+0000","last_became_active":"2024-09-11T23:05:07.004149+0000","last_became_peered":"2024-09-11T23:05:07.004149+0000","last_unstale":"2024-09-11T23:05:07.013410+0000","last_undegraded":"2024-09-11T23:05:07.013410+0000","last_fullsized":"2024-09-11T23:05:07.013410+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:39.989662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.969497+0000","last_change":"2024-09-11T23:04:46.291068+0000","last_active":"2024-09-11T23:05:06.969497+0000","last_peered":"2024-09-11T23:05:06.969497+0000","last_clean":"2024-09-11T23:05:06.969497+0000","last_became_active":"2024-09-11T23:04:46.290401+0000","last_became_peered":"2024-09-11T23:04:46.290401+0000","last_unstale":"2024-09-11T23:05:06.969497+0000","last_undegraded":"2024-09-11T23:05:06.969497+0000","last_fullsized":"2024-09-11T23:05:06.969497+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:56.339465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.943937+0000","last_change":"2024-09-11T23:04:45.287742+0000","last_active":"2024-09-11T23:05:06.943937+0000","last_peered":"2024-09-11T23:05:06.943937+0000","last_clean":"2024-09-11T23:05:06.943937+0000","last_became_active":"2024-09-11T23:04:45.287427+0000","last_became_peered":"2024-09-11T23:04:45.287427+0000","last_unstale":"2024-09-11T23:05:06.943937+0000","last_undegraded":"2024-09-11T23:05:06.943937+0000","last_fullsized":"2024-09-11T23:05:06.943937+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:12:05.734167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.525482+0000","last_change":"2024-09-11T23:05:06.537058+0000","last_active":"2024-09-11T23:05:07.525482+0000","last_peered":"2024-09-11T23:05:07.525482+0000","last_clean":"2024-09-11T23:05:07.525482+0000","last_became_active":"2024-09-11T23:05:06.536750+0000","last_became_peered":"2024-09-11T23:05:06.536750+0000","last_unstale":"2024-09-11T23:05:07.525482+0000","last_undegraded":"2024-09-11T23:05:07.525482+0000","last_fullsized":"2024-09-11T23:05:07.525482+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:27.071695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.012719+0000","last_change":"2024-09-11T23:05:07.011369+0000","last_active":"2024-09-11T23:05:07.012719+0000","last_peered":"2024-09-11T23:05:07.012719+0000","last_clean":"2024-09-11T23:05:07.012719+0000","last_became_active":"2024-09-11T23:05:07.010581+0000","last_became_peered":"2024-09-11T23:05:07.010581+0000","last_unstale":"2024-09-11T23:05:07.012719+0000","last_undegraded":"2024-09-11T23:05:07.012719+0000","last_fullsized":"2024-09-11T23:05:07.012719+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:18.543786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.956244+0000","last_change":"2024-09-11T23:04:46.303925+0000","last_active":"2024-09-11T23:05:06.956244+0000","last_peered":"2024-09-11T23:05:06.956244+0000","last_clean":"2024-09-11T23:05:06.956244+0000","last_became_active":"2024-09-11T23:04:46.303641+0000","last_became_peered":"2024-09-11T23:04:46.303641+0000","last_unstale":"2024-09-11T23:05:06.956244+0000","last_undegraded":"2024-09-11T23:05:06.956244+0000","last_fullsized":"2024-09-11T23:05:06.956244+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:56.339465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.931105+0000","last_change":"2024-09-11T23:04:45.290849+0000","last_active":"2024-09-11T23:05:06.931105+0000","last_peered":"2024-09-11T23:05:06.931105+0000","last_clean":"2024-09-11T23:05:06.931105+0000","last_became_active":"2024-09-11T23:04:45.290218+0000","last_became_peered":"2024-09-11T23:04:45.290218+0000","last_unstale":"2024-09-11T23:05:06.931105+0000","last_undegraded":"2024-09-11T23:05:06.931105+0000","last_fullsized":"2024-09-11T23:05:06.931105+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:17.935064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.525715+0000","last_change":"2024-09-11T23:05:06.537396+0000","last_active":"2024-09-11T23:05:07.525715+0000","last_peered":"2024-09-11T23:05:07.525715+0000","last_clean":"2024-09-11T23:05:07.525715+0000","last_became_active":"2024-09-11T23:05:06.537129+0000","last_became_peered":"2024-09-11T23:05:06.537129+0000","last_unstale":"2024-09-11T23:05:07.525715+0000","last_undegraded":"2024-09-11T23:05:07.525715+0000","last_fullsized":"2024-09-11T23:05:07.525715+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:49.356921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.013078+0000","last_change":"2024-09-11T23:05:07.011688+0000","last_active":"2024-09-11T23:05:07.013078+0000","last_peered":"2024-09-11T23:05:07.013078+0000","last_clean":"2024-09-11T23:05:07.013078+0000","last_became_active":"2024-09-11T23:05:07.010921+0000","last_became_peered":"2024-09-11T23:05:07.010921+0000","last_unstale":"2024-09-11T23:05:07.013078+0000","last_undegraded":"2024-09-11T23:05:07.013078+0000","last_fullsized":"2024-09-11T23:05:07.013078+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:58.912419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.933371+0000","last_change":"2024-09-11T23:04:46.313005+0000","last_active":"2024-09-11T23:05:06.933371+0000","last_peered":"2024-09-11T23:05:06.933371+0000","last_clean":"2024-09-11T23:05:06.933371+0000","last_became_active":"2024-09-11T23:04:46.309136+0000","last_became_peered":"2024-09-11T23:04:46.309136+0000","last_unstale":"2024-09-11T23:05:06.933371+0000","last_undegraded":"2024-09-11T23:05:06.933371+0000","last_fullsized":"2024-09-11T23:05:06.933371+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:38.815486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.958242+0000","last_change":"2024-09-11T23:04:45.297149+0000","last_active":"2024-09-11T23:05:06.958242+0000","last_peered":"2024-09-11T23:05:06.958242+0000","last_clean":"2024-09-11T23:05:06.958242+0000","last_became_active":"2024-09-11T23:04:45.296339+0000","last_became_peered":"2024-09-11T23:04:45.296339+0000","last_unstale":"2024-09-11T23:05:06.958242+0000","last_undegraded":"2024-09-11T23:05:06.958242+0000","last_fullsized":"2024-09-11T23:05:06.958242+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:39.026235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.937661+0000","last_change":"2024-09-11T23:05:06.540829+0000","last_active":"2024-09-11T23:05:06.937661+0000","last_peered":"2024-09-11T23:05:06.937661+0000","last_clean":"2024-09-11T23:05:06.937661+0000","last_became_active":"2024-09-11T23:05:06.540572+0000","last_became_peered":"2024-09-11T23:05:06.540572+0000","last_unstale":"2024-09-11T23:05:06.937661+0000","last_undegraded":"2024-09-11T23:05:06.937661+0000","last_fullsized":"2024-09-11T23:05:06.937661+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:45.724589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.994547+0000","last_change":"2024-09-11T23:05:06.985346+0000","last_active":"2024-09-11T23:05:06.994547+0000","last_peered":"2024-09-11T23:05:06.994547+0000","last_clean":"2024-09-11T23:05:06.994547+0000","last_became_active":"2024-09-11T23:05:06.983948+0000","last_became_peered":"2024-09-11T23:05:06.983948+0000","last_unstale":"2024-09-11T23:05:06.994547+0000","last_undegraded":"2024-09-11T23:05:06.994547+0000","last_fullsized":"2024-09-11T23:05:06.994547+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:35.878366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.937138+0000","last_change":"2024-09-11T23:04:46.299931+0000","last_active":"2024-09-11T23:05:06.937138+0000","last_peered":"2024-09-11T23:05:06.937138+0000","last_clean":"2024-09-11T23:05:06.937138+0000","last_became_active":"2024-09-11T23:04:46.299104+0000","last_became_peered":"2024-09-11T23:04:46.299104+0000","last_unstale":"2024-09-11T23:05:06.937138+0000","last_undegraded":"2024-09-11T23:05:06.937138+0000","last_fullsized":"2024-09-11T23:05:06.937138+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:26.287271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"35'2","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.936845+0000","last_change":"2024-09-11T23:04:45.293809+0000","last_active":"2024-09-11T23:05:06.936845+0000","last_peered":"2024-09-11T23:05:06.936845+0000","last_clean":"2024-09-11T23:05:06.936845+0000","last_became_active":"2024-09-11T23:04:45.293303+0000","last_became_peered":"2024-09-11T23:04:45.293303+0000","last_unstale":"2024-09-11T23:05:06.936845+0000","last_undegraded":"2024-09-11T23:05:06.936845+0000","last_fullsized":"2024-09-11T23:05:06.936845+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:34.183985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'119","reported_seq":269,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.969777+0000","last_change":"2024-09-11T23:03:26.382905+0000","last_active":"2024-09-11T23:05:06.969777+0000","last_peered":"2024-09-11T23:05:06.969777+0000","last_clean":"2024-09-11T23:05:06.969777+0000","last_became_active":"2024-09-11T23:03:26.380590+0000","last_became_peered":"2024-09-11T23:03:26.380590+0000","last_unstale":"2024-09-11T23:05:06.969777+0000","last_undegraded":"2024-09-11T23:05:06.969777+0000","last_fullsized":"2024-09-11T23:05:06.969777+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:24.361793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:24.361793+0000","last_clean_scrub_stamp":"2024-09-11T23:03:24.361793+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:46.577063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":298,"num_read_kb":503,"num_write":177,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.950119+0000","last_change":"2024-09-11T23:05:06.540976+0000","last_active":"2024-09-11T23:05:06.950119+0000","last_peered":"2024-09-11T23:05:06.950119+0000","last_clean":"2024-09-11T23:05:06.950119+0000","last_became_active":"2024-09-11T23:05:06.540701+0000","last_became_peered":"2024-09-11T23:05:06.540701+0000","last_unstale":"2024-09-11T23:05:06.950119+0000","last_undegraded":"2024-09-11T23:05:06.950119+0000","last_fullsized":"2024-09-11T23:05:06.950119+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:06.064375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.012492+0000","last_change":"2024-09-11T23:05:07.006622+0000","last_active":"2024-09-11T23:05:07.012492+0000","last_peered":"2024-09-11T23:05:07.012492+0000","last_clean":"2024-09-11T23:05:07.012492+0000","last_became_active":"2024-09-11T23:05:07.006098+0000","last_became_peered":"2024-09-11T23:05:07.006098+0000","last_unstale":"2024-09-11T23:05:07.012492+0000","last_undegraded":"2024-09-11T23:05:07.012492+0000","last_fullsized":"2024-09-11T23:05:07.012492+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:31.610531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.944188+0000","last_change":"2024-09-11T23:04:46.294044+0000","last_active":"2024-09-11T23:05:06.944188+0000","last_peered":"2024-09-11T23:05:06.944188+0000","last_clean":"2024-09-11T23:05:06.944188+0000","last_became_active":"2024-09-11T23:04:46.293776+0000","last_became_peered":"2024-09-11T23:04:46.293776+0000","last_unstale":"2024-09-11T23:05:06.944188+0000","last_undegraded":"2024-09-11T23:05:06.944188+0000","last_fullsized":"2024-09-11T23:05:06.944188+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:33.670979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.931392+0000","last_change":"2024-09-11T23:04:45.281525+0000","last_active":"2024-09-11T23:05:06.931392+0000","last_peered":"2024-09-11T23:05:06.931392+0000","last_clean":"2024-09-11T23:05:06.931392+0000","last_became_active":"2024-09-11T23:04:45.281038+0000","last_became_peered":"2024-09-11T23:04:45.281038+0000","last_unstale":"2024-09-11T23:05:06.931392+0000","last_undegraded":"2024-09-11T23:05:06.931392+0000","last_fullsized":"2024-09-11T23:05:06.931392+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:54.058055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.964030+0000","last_change":"2024-09-11T23:05:06.532665+0000","last_active":"2024-09-11T23:05:06.964030+0000","last_peered":"2024-09-11T23:05:06.964030+0000","last_clean":"2024-09-11T23:05:06.964030+0000","last_became_active":"2024-09-11T23:05:06.532430+0000","last_became_peered":"2024-09-11T23:05:06.532430+0000","last_unstale":"2024-09-11T23:05:06.964030+0000","last_undegraded":"2024-09-11T23:05:06.964030+0000","last_fullsized":"2024-09-11T23:05:06.964030+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:55.550409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.999112+0000","last_change":"2024-09-11T23:05:06.987916+0000","last_active":"2024-09-11T23:05:06.999112+0000","last_peered":"2024-09-11T23:05:06.999112+0000","last_clean":"2024-09-11T23:05:06.999112+0000","last_became_active":"2024-09-11T23:05:06.986319+0000","last_became_peered":"2024-09-11T23:05:06.986319+0000","last_unstale":"2024-09-11T23:05:06.999112+0000","last_undegraded":"2024-09-11T23:05:06.999112+0000","last_fullsized":"2024-09-11T23:05:06.999112+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:33.171589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.948467+0000","last_change":"2024-09-11T23:04:46.304850+0000","last_active":"2024-09-11T23:05:06.948467+0000","last_peered":"2024-09-11T23:05:06.948467+0000","last_clean":"2024-09-11T23:05:06.948467+0000","last_became_active":"2024-09-11T23:04:46.304479+0000","last_became_peered":"2024-09-11T23:04:46.304479+0000","last_unstale":"2024-09-11T23:05:06.948467+0000","last_undegraded":"2024-09-11T23:05:06.948467+0000","last_fullsized":"2024-09-11T23:05:06.948467+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:09.138555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.970884+0000","last_change":"2024-09-11T23:04:45.298317+0000","last_active":"2024-09-11T23:05:06.970884+0000","last_peered":"2024-09-11T23:05:06.970884+0000","last_clean":"2024-09-11T23:05:06.970884+0000","last_became_active":"2024-09-11T23:04:45.293939+0000","last_became_peered":"2024-09-11T23:04:45.293939+0000","last_unstale":"2024-09-11T23:05:06.970884+0000","last_undegraded":"2024-09-11T23:05:06.970884+0000","last_fullsized":"2024-09-11T23:05:06.970884+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:30.293738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.972361+0000","last_change":"2024-09-11T23:05:06.535273+0000","last_active":"2024-09-11T23:05:06.972361+0000","last_peered":"2024-09-11T23:05:06.972361+0000","last_clean":"2024-09-11T23:05:06.972361+0000","last_became_active":"2024-09-11T23:05:06.534537+0000","last_became_peered":"2024-09-11T23:05:06.534537+0000","last_unstale":"2024-09-11T23:05:06.972361+0000","last_undegraded":"2024-09-11T23:05:06.972361+0000","last_fullsized":"2024-09-11T23:05:06.972361+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:43.740594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.004112+0000","last_change":"2024-09-11T23:05:07.000044+0000","last_active":"2024-09-11T23:05:07.004112+0000","last_peered":"2024-09-11T23:05:07.004112+0000","last_clean":"2024-09-11T23:05:07.004112+0000","last_became_active":"2024-09-11T23:05:06.999538+0000","last_became_peered":"2024-09-11T23:05:06.999538+0000","last_unstale":"2024-09-11T23:05:07.004112+0000","last_undegraded":"2024-09-11T23:05:07.004112+0000","last_fullsized":"2024-09-11T23:05:07.004112+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:27.609111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.963033+0000","last_change":"2024-09-11T23:04:46.322461+0000","last_active":"2024-09-11T23:05:06.963033+0000","last_peered":"2024-09-11T23:05:06.963033+0000","last_clean":"2024-09-11T23:05:06.963033+0000","last_became_active":"2024-09-11T23:04:46.321529+0000","last_became_peered":"2024-09-11T23:04:46.321529+0000","last_unstale":"2024-09-11T23:05:06.963033+0000","last_undegraded":"2024-09-11T23:05:06.963033+0000","last_fullsized":"2024-09-11T23:05:06.963033+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:11.312361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"35'1","reported_seq":21,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.966224+0000","last_change":"2024-09-11T23:04:45.298340+0000","last_active":"2024-09-11T23:05:06.966224+0000","last_peered":"2024-09-11T23:05:06.966224+0000","last_clean":"2024-09-11T23:05:06.966224+0000","last_became_active":"2024-09-11T23:04:45.293597+0000","last_became_peered":"2024-09-11T23:04:45.293597+0000","last_unstale":"2024-09-11T23:05:06.966224+0000","last_undegraded":"2024-09-11T23:05:06.966224+0000","last_fullsized":"2024-09-11T23:05:06.966224+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:11.217943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.948115+0000","last_change":"2024-09-11T23:05:06.542874+0000","last_active":"2024-09-11T23:05:06.948115+0000","last_peered":"2024-09-11T23:05:06.948115+0000","last_clean":"2024-09-11T23:05:06.948115+0000","last_became_active":"2024-09-11T23:05:06.542601+0000","last_became_peered":"2024-09-11T23:05:06.542601+0000","last_unstale":"2024-09-11T23:05:06.948115+0000","last_undegraded":"2024-09-11T23:05:06.948115+0000","last_fullsized":"2024-09-11T23:05:06.948115+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:37.995281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.007088+0000","last_change":"2024-09-11T23:05:06.991756+0000","last_active":"2024-09-11T23:05:07.007088+0000","last_peered":"2024-09-11T23:05:07.007088+0000","last_clean":"2024-09-11T23:05:07.007088+0000","last_became_active":"2024-09-11T23:05:06.988767+0000","last_became_peered":"2024-09-11T23:05:06.988767+0000","last_unstale":"2024-09-11T23:05:07.007088+0000","last_undegraded":"2024-09-11T23:05:07.007088+0000","last_fullsized":"2024-09-11T23:05:07.007088+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:12:19.167910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.951190+0000","last_change":"2024-09-11T23:04:46.300634+0000","last_active":"2024-09-11T23:05:06.951190+0000","last_peered":"2024-09-11T23:05:06.951190+0000","last_clean":"2024-09-11T23:05:06.951190+0000","last_became_active":"2024-09-11T23:04:46.300237+0000","last_became_peered":"2024-09-11T23:04:46.300237+0000","last_unstale":"2024-09-11T23:05:06.951190+0000","last_undegraded":"2024-09-11T23:05:06.951190+0000","last_fullsized":"2024-09-11T23:05:06.951190+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:37.667809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"35'2","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.957290+0000","last_change":"2024-09-11T23:04:45.287996+0000","last_active":"2024-09-11T23:05:06.957290+0000","last_peered":"2024-09-11T23:05:06.957290+0000","last_clean":"2024-09-11T23:05:06.957290+0000","last_became_active":"2024-09-11T23:04:45.286798+0000","last_became_peered":"2024-09-11T23:04:45.286798+0000","last_unstale":"2024-09-11T23:05:06.957290+0000","last_undegraded":"2024-09-11T23:05:06.957290+0000","last_fullsized":"2024-09-11T23:05:06.957290+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:21.516047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.970756+0000","last_change":"2024-09-11T23:05:06.544544+0000","last_active":"2024-09-11T23:05:06.970756+0000","last_peered":"2024-09-11T23:05:06.970756+0000","last_clean":"2024-09-11T23:05:06.970756+0000","last_became_active":"2024-09-11T23:05:06.544173+0000","last_became_peered":"2024-09-11T23:05:06.544173+0000","last_unstale":"2024-09-11T23:05:06.970756+0000","last_undegraded":"2024-09-11T23:05:06.970756+0000","last_fullsized":"2024-09-11T23:05:06.970756+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:36.738841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.004285+0000","last_change":"2024-09-11T23:05:07.000082+0000","last_active":"2024-09-11T23:05:07.004285+0000","last_peered":"2024-09-11T23:05:07.004285+0000","last_clean":"2024-09-11T23:05:07.004285+0000","last_became_active":"2024-09-11T23:05:06.993421+0000","last_became_peered":"2024-09-11T23:05:06.993421+0000","last_unstale":"2024-09-11T23:05:07.004285+0000","last_undegraded":"2024-09-11T23:05:07.004285+0000","last_fullsized":"2024-09-11T23:05:07.004285+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:31.610531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.957642+0000","last_change":"2024-09-11T23:04:46.317542+0000","last_active":"2024-09-11T23:05:06.957642+0000","last_peered":"2024-09-11T23:05:06.957642+0000","last_clean":"2024-09-11T23:05:06.957642+0000","last_became_active":"2024-09-11T23:04:46.316806+0000","last_became_peered":"2024-09-11T23:04:46.316806+0000","last_unstale":"2024-09-11T23:05:06.957642+0000","last_undegraded":"2024-09-11T23:05:06.957642+0000","last_fullsized":"2024-09-11T23:05:06.957642+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:04.381683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"35'1","reported_seq":21,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.978406+0000","last_change":"2024-09-11T23:04:45.283727+0000","last_active":"2024-09-11T23:05:06.978406+0000","last_peered":"2024-09-11T23:05:06.978406+0000","last_clean":"2024-09-11T23:05:06.978406+0000","last_became_active":"2024-09-11T23:04:45.283180+0000","last_became_peered":"2024-09-11T23:04:45.283180+0000","last_unstale":"2024-09-11T23:05:06.978406+0000","last_undegraded":"2024-09-11T23:05:06.978406+0000","last_fullsized":"2024-09-11T23:05:06.978406+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:53.245910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.949366+0000","last_change":"2024-09-11T23:05:06.545931+0000","last_active":"2024-09-11T23:05:06.949366+0000","last_peered":"2024-09-11T23:05:06.949366+0000","last_clean":"2024-09-11T23:05:06.949366+0000","last_became_active":"2024-09-11T23:05:06.544152+0000","last_became_peered":"2024-09-11T23:05:06.544152+0000","last_unstale":"2024-09-11T23:05:06.949366+0000","last_undegraded":"2024-09-11T23:05:06.949366+0000","last_fullsized":"2024-09-11T23:05:06.949366+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:25.350163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.005834+0000","last_change":"2024-09-11T23:05:07.002791+0000","last_active":"2024-09-11T23:05:07.005834+0000","last_peered":"2024-09-11T23:05:07.005834+0000","last_clean":"2024-09-11T23:05:07.005834+0000","last_became_active":"2024-09-11T23:05:07.002520+0000","last_became_peered":"2024-09-11T23:05:07.002520+0000","last_unstale":"2024-09-11T23:05:07.005834+0000","last_undegraded":"2024-09-11T23:05:07.005834+0000","last_fullsized":"2024-09-11T23:05:07.005834+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:47.531881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.963725+0000","last_change":"2024-09-11T23:05:06.542928+0000","last_active":"2024-09-11T23:05:06.963725+0000","last_peered":"2024-09-11T23:05:06.963725+0000","last_clean":"2024-09-11T23:05:06.963725+0000","last_became_active":"2024-09-11T23:05:06.542672+0000","last_became_peered":"2024-09-11T23:05:06.542672+0000","last_unstale":"2024-09-11T23:05:06.963725+0000","last_undegraded":"2024-09-11T23:05:06.963725+0000","last_fullsized":"2024-09-11T23:05:06.963725+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:26.961176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.956493+0000","last_change":"2024-09-11T23:04:46.326062+0000","last_active":"2024-09-11T23:05:06.956493+0000","last_peered":"2024-09-11T23:05:06.956493+0000","last_clean":"2024-09-11T23:05:06.956493+0000","last_became_active":"2024-09-11T23:04:46.325734+0000","last_became_peered":"2024-09-11T23:04:46.325734+0000","last_unstale":"2024-09-11T23:05:06.956493+0000","last_undegraded":"2024-09-11T23:05:06.956493+0000","last_fullsized":"2024-09-11T23:05:06.956493+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:55.065032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"35'8","reported_seq":28,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.931123+0000","last_change":"2024-09-11T23:04:45.291040+0000","last_active":"2024-09-11T23:05:06.931123+0000","last_peered":"2024-09-11T23:05:06.931123+0000","last_clean":"2024-09-11T23:05:06.931123+0000","last_became_active":"2024-09-11T23:04:45.290561+0000","last_became_peered":"2024-09-11T23:04:45.290561+0000","last_unstale":"2024-09-11T23:05:06.931123+0000","last_undegraded":"2024-09-11T23:05:06.931123+0000","last_fullsized":"2024-09-11T23:05:06.931123+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:32.664002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.984945+0000","last_change":"2024-09-11T23:05:06.980444+0000","last_active":"2024-09-11T23:05:06.984945+0000","last_peered":"2024-09-11T23:05:06.984945+0000","last_clean":"2024-09-11T23:05:06.984945+0000","last_became_active":"2024-09-11T23:05:06.979198+0000","last_became_peered":"2024-09-11T23:05:06.979198+0000","last_unstale":"2024-09-11T23:05:06.984945+0000","last_undegraded":"2024-09-11T23:05:06.984945+0000","last_fullsized":"2024-09-11T23:05:06.984945+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:50.014916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"39'4","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.527056+0000","last_change":"2024-09-11T23:05:06.545802+0000","last_active":"2024-09-11T23:05:07.527056+0000","last_peered":"2024-09-11T23:05:07.527056+0000","last_clean":"2024-09-11T23:05:07.527056+0000","last_became_active":"2024-09-11T23:05:06.545451+0000","last_became_peered":"2024-09-11T23:05:06.545451+0000","last_unstale":"2024-09-11T23:05:07.527056+0000","last_undegraded":"2024-09-11T23:05:07.527056+0000","last_fullsized":"2024-09-11T23:05:07.527056+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:01.405747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.969594+0000","last_change":"2024-09-11T23:04:46.291296+0000","last_active":"2024-09-11T23:05:06.969594+0000","last_peered":"2024-09-11T23:05:06.969594+0000","last_clean":"2024-09-11T23:05:06.969594+0000","last_became_active":"2024-09-11T23:04:46.290797+0000","last_became_peered":"2024-09-11T23:04:46.290797+0000","last_unstale":"2024-09-11T23:05:06.969594+0000","last_undegraded":"2024-09-11T23:05:06.969594+0000","last_fullsized":"2024-09-11T23:05:06.969594+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:18.942042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.955961+0000","last_change":"2024-09-11T23:04:45.296296+0000","last_active":"2024-09-11T23:05:06.955961+0000","last_peered":"2024-09-11T23:05:06.955961+0000","last_clean":"2024-09-11T23:05:06.955961+0000","last_became_active":"2024-09-11T23:04:45.296002+0000","last_became_peered":"2024-09-11T23:04:45.296002+0000","last_unstale":"2024-09-11T23:05:06.955961+0000","last_undegraded":"2024-09-11T23:05:06.955961+0000","last_fullsized":"2024-09-11T23:05:06.955961+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:32.556160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.999061+0000","last_change":"2024-09-11T23:05:06.989844+0000","last_active":"2024-09-11T23:05:06.999061+0000","last_peered":"2024-09-11T23:05:06.999061+0000","last_clean":"2024-09-11T23:05:06.999061+0000","last_became_active":"2024-09-11T23:05:06.987995+0000","last_became_peered":"2024-09-11T23:05:06.987995+0000","last_unstale":"2024-09-11T23:05:06.999061+0000","last_undegraded":"2024-09-11T23:05:06.999061+0000","last_fullsized":"2024-09-11T23:05:06.999061+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:06.602353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.935106+0000","last_change":"2024-09-11T23:04:46.298699+0000","last_active":"2024-09-11T23:05:06.935106+0000","last_peered":"2024-09-11T23:05:06.935106+0000","last_clean":"2024-09-11T23:05:06.935106+0000","last_became_active":"2024-09-11T23:04:46.296442+0000","last_became_peered":"2024-09-11T23:04:46.296442+0000","last_unstale":"2024-09-11T23:05:06.935106+0000","last_undegraded":"2024-09-11T23:05:06.935106+0000","last_fullsized":"2024-09-11T23:05:06.935106+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:45.578284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.932855+0000","last_change":"2024-09-11T23:04:45.293202+0000","last_active":"2024-09-11T23:05:06.932855+0000","last_peered":"2024-09-11T23:05:06.932855+0000","last_clean":"2024-09-11T23:05:06.932855+0000","last_became_active":"2024-09-11T23:04:45.292892+0000","last_became_peered":"2024-09-11T23:04:45.292892+0000","last_unstale":"2024-09-11T23:05:06.932855+0000","last_undegraded":"2024-09-11T23:05:06.932855+0000","last_fullsized":"2024-09-11T23:05:06.932855+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:21.096831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"39'2","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.970369+0000","last_change":"2024-09-11T23:05:06.533300+0000","last_active":"2024-09-11T23:05:06.970369+0000","last_peered":"2024-09-11T23:05:06.970369+0000","last_clean":"2024-09-11T23:05:06.970369+0000","last_became_active":"2024-09-11T23:05:06.533053+0000","last_became_peered":"2024-09-11T23:05:06.533053+0000","last_unstale":"2024-09-11T23:05:06.970369+0000","last_undegraded":"2024-09-11T23:05:06.970369+0000","last_fullsized":"2024-09-11T23:05:06.970369+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:53.799981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.009143+0000","last_change":"2024-09-11T23:05:07.004152+0000","last_active":"2024-09-11T23:05:07.009143+0000","last_peered":"2024-09-11T23:05:07.009143+0000","last_clean":"2024-09-11T23:05:07.009143+0000","last_became_active":"2024-09-11T23:05:07.002577+0000","last_became_peered":"2024-09-11T23:05:07.002577+0000","last_unstale":"2024-09-11T23:05:07.009143+0000","last_undegraded":"2024-09-11T23:05:07.009143+0000","last_fullsized":"2024-09-11T23:05:07.009143+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:28.021989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.965829+0000","last_change":"2024-09-11T23:04:46.303775+0000","last_active":"2024-09-11T23:05:06.965829+0000","last_peered":"2024-09-11T23:05:06.965829+0000","last_clean":"2024-09-11T23:05:06.965829+0000","last_became_active":"2024-09-11T23:04:46.303500+0000","last_became_peered":"2024-09-11T23:04:46.303500+0000","last_unstale":"2024-09-11T23:05:06.965829+0000","last_undegraded":"2024-09-11T23:05:06.965829+0000","last_fullsized":"2024-09-11T23:05:06.965829+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:22.103808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"35'2","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.963452+0000","last_change":"2024-09-11T23:04:45.285357+0000","last_active":"2024-09-11T23:05:06.963452+0000","last_peered":"2024-09-11T23:05:06.963452+0000","last_clean":"2024-09-11T23:05:06.963452+0000","last_became_active":"2024-09-11T23:04:45.281608+0000","last_became_peered":"2024-09-11T23:04:45.281608+0000","last_unstale":"2024-09-11T23:05:06.963452+0000","last_undegraded":"2024-09-11T23:05:06.963452+0000","last_fullsized":"2024-09-11T23:05:06.963452+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:54.908265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.526998+0000","last_change":"2024-09-11T23:05:06.548603+0000","last_active":"2024-09-11T23:05:07.526998+0000","last_peered":"2024-09-11T23:05:07.526998+0000","last_clean":"2024-09-11T23:05:07.526998+0000","last_became_active":"2024-09-11T23:05:06.548351+0000","last_became_peered":"2024-09-11T23:05:06.548351+0000","last_unstale":"2024-09-11T23:05:07.526998+0000","last_undegraded":"2024-09-11T23:05:07.526998+0000","last_fullsized":"2024-09-11T23:05:07.526998+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:08.320000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.978214+0000","last_change":"2024-09-11T23:05:06.973603+0000","last_active":"2024-09-11T23:05:06.978214+0000","last_peered":"2024-09-11T23:05:06.978214+0000","last_clean":"2024-09-11T23:05:06.978214+0000","last_became_active":"2024-09-11T23:05:06.972904+0000","last_became_peered":"2024-09-11T23:05:06.972904+0000","last_unstale":"2024-09-11T23:05:06.978214+0000","last_undegraded":"2024-09-11T23:05:06.978214+0000","last_fullsized":"2024-09-11T23:05:06.978214+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:59.059167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.971052+0000","last_change":"2024-09-11T23:04:46.304086+0000","last_active":"2024-09-11T23:05:06.971052+0000","last_peered":"2024-09-11T23:05:06.971052+0000","last_clean":"2024-09-11T23:05:06.971052+0000","last_became_active":"2024-09-11T23:04:46.303805+0000","last_became_peered":"2024-09-11T23:04:46.303805+0000","last_unstale":"2024-09-11T23:05:06.971052+0000","last_undegraded":"2024-09-11T23:05:06.971052+0000","last_fullsized":"2024-09-11T23:05:06.971052+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:06.111336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"38'12","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.959618+0000","last_change":"2024-09-11T23:04:45.297552+0000","last_active":"2024-09-11T23:05:06.959618+0000","last_peered":"2024-09-11T23:05:06.959618+0000","last_clean":"2024-09-11T23:05:06.959618+0000","last_became_active":"2024-09-11T23:04:45.297265+0000","last_became_peered":"2024-09-11T23:04:45.297265+0000","last_unstale":"2024-09-11T23:05:06.959618+0000","last_undegraded":"2024-09-11T23:05:06.959618+0000","last_fullsized":"2024-09-11T23:05:06.959618+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:05.305481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4248,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1a","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.525408+0000","last_change":"2024-09-11T23:05:06.542315+0000","last_active":"2024-09-11T23:05:07.525408+0000","last_peered":"2024-09-11T23:05:07.525408+0000","last_clean":"2024-09-11T23:05:07.525408+0000","last_became_active":"2024-09-11T23:05:06.542044+0000","last_became_peered":"2024-09-11T23:05:06.542044+0000","last_unstale":"2024-09-11T23:05:07.525408+0000","last_undegraded":"2024-09-11T23:05:07.525408+0000","last_fullsized":"2024-09-11T23:05:07.525408+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:48.292538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.015424+0000","last_change":"2024-09-11T23:05:07.014436+0000","last_active":"2024-09-11T23:05:07.015424+0000","last_peered":"2024-09-11T23:05:07.015424+0000","last_clean":"2024-09-11T23:05:07.015424+0000","last_became_active":"2024-09-11T23:05:07.013761+0000","last_became_peered":"2024-09-11T23:05:07.013761+0000","last_unstale":"2024-09-11T23:05:07.015424+0000","last_undegraded":"2024-09-11T23:05:07.015424+0000","last_fullsized":"2024-09-11T23:05:07.015424+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:26.834726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.970463+0000","last_change":"2024-09-11T23:04:46.301279+0000","last_active":"2024-09-11T23:05:06.970463+0000","last_peered":"2024-09-11T23:05:06.970463+0000","last_clean":"2024-09-11T23:05:06.970463+0000","last_became_active":"2024-09-11T23:04:46.301000+0000","last_became_peered":"2024-09-11T23:04:46.301000+0000","last_unstale":"2024-09-11T23:05:06.970463+0000","last_undegraded":"2024-09-11T23:05:06.970463+0000","last_fullsized":"2024-09-11T23:05:06.970463+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:42:04.891291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.15","version":"35'3","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.971347+0000","last_change":"2024-09-11T23:04:45.297825+0000","last_active":"2024-09-11T23:05:06.971347+0000","last_peered":"2024-09-11T23:05:06.971347+0000","last_clean":"2024-09-11T23:05:06.971347+0000","last_became_active":"2024-09-11T23:04:45.296383+0000","last_became_peered":"2024-09-11T23:04:45.296383+0000","last_unstale":"2024-09-11T23:05:06.971347+0000","last_undegraded":"2024-09-11T23:05:06.971347+0000","last_fullsized":"2024-09-11T23:05:06.971347+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:42.801527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1b","version":"39'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.971832+0000","last_change":"2024-09-11T23:05:06.534644+0000","last_active":"2024-09-11T23:05:06.971832+0000","last_peered":"2024-09-11T23:05:06.971832+0000","last_clean":"2024-09-11T23:05:06.971832+0000","last_became_active":"2024-09-11T23:05:06.534430+0000","last_became_peered":"2024-09-11T23:05:06.534430+0000","last_unstale":"2024-09-11T23:05:06.971832+0000","last_undegraded":"2024-09-11T23:05:06.971832+0000","last_fullsized":"2024-09-11T23:05:06.971832+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:55.550409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.990674+0000","last_change":"2024-09-11T23:05:06.985438+0000","last_active":"2024-09-11T23:05:06.990674+0000","last_peered":"2024-09-11T23:05:06.990674+0000","last_clean":"2024-09-11T23:05:06.990674+0000","last_became_active":"2024-09-11T23:05:06.983562+0000","last_became_peered":"2024-09-11T23:05:06.983562+0000","last_unstale":"2024-09-11T23:05:06.990674+0000","last_undegraded":"2024-09-11T23:05:06.990674+0000","last_fullsized":"2024-09-11T23:05:06.990674+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:07.530868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.957299+0000","last_change":"2024-09-11T23:04:46.318066+0000","last_active":"2024-09-11T23:05:06.957299+0000","last_peered":"2024-09-11T23:05:06.957299+0000","last_clean":"2024-09-11T23:05:06.957299+0000","last_became_active":"2024-09-11T23:04:46.317529+0000","last_became_peered":"2024-09-11T23:04:46.317529+0000","last_unstale":"2024-09-11T23:05:06.957299+0000","last_undegraded":"2024-09-11T23:05:06.957299+0000","last_fullsized":"2024-09-11T23:05:06.957299+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:08.154174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.936842+0000","last_change":"2024-09-11T23:04:45.282485+0000","last_active":"2024-09-11T23:05:06.936842+0000","last_peered":"2024-09-11T23:05:06.936842+0000","last_clean":"2024-09-11T23:05:06.936842+0000","last_became_active":"2024-09-11T23:04:45.282192+0000","last_became_peered":"2024-09-11T23:04:45.282192+0000","last_unstale":"2024-09-11T23:05:06.936842+0000","last_undegraded":"2024-09-11T23:05:06.936842+0000","last_fullsized":"2024-09-11T23:05:06.936842+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:08.131578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.932262+0000","last_change":"2024-09-11T23:05:06.537522+0000","last_active":"2024-09-11T23:05:06.932262+0000","last_peered":"2024-09-11T23:05:06.932262+0000","last_clean":"2024-09-11T23:05:06.932262+0000","last_became_active":"2024-09-11T23:05:06.537257+0000","last_became_peered":"2024-09-11T23:05:06.537257+0000","last_unstale":"2024-09-11T23:05:06.932262+0000","last_undegraded":"2024-09-11T23:05:06.932262+0000","last_fullsized":"2024-09-11T23:05:06.932262+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:40.902960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.997009+0000","last_change":"2024-09-11T23:05:06.990762+0000","last_active":"2024-09-11T23:05:06.997009+0000","last_peered":"2024-09-11T23:05:06.997009+0000","last_clean":"2024-09-11T23:05:06.997009+0000","last_became_active":"2024-09-11T23:05:06.990053+0000","last_became_peered":"2024-09-11T23:05:06.990053+0000","last_unstale":"2024-09-11T23:05:06.997009+0000","last_undegraded":"2024-09-11T23:05:06.997009+0000","last_fullsized":"2024-09-11T23:05:06.997009+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:23.035505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.957814+0000","last_change":"2024-09-11T23:04:46.302523+0000","last_active":"2024-09-11T23:05:06.957814+0000","last_peered":"2024-09-11T23:05:06.957814+0000","last_clean":"2024-09-11T23:05:06.957814+0000","last_became_active":"2024-09-11T23:04:46.302177+0000","last_became_peered":"2024-09-11T23:04:46.302177+0000","last_unstale":"2024-09-11T23:05:06.957814+0000","last_undegraded":"2024-09-11T23:05:06.957814+0000","last_fullsized":"2024-09-11T23:05:06.957814+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:04.381683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.956481+0000","last_change":"2024-09-11T23:04:45.294857+0000","last_active":"2024-09-11T23:05:06.956481+0000","last_peered":"2024-09-11T23:05:06.956481+0000","last_clean":"2024-09-11T23:05:06.956481+0000","last_became_active":"2024-09-11T23:04:45.292853+0000","last_became_peered":"2024-09-11T23:04:45.292853+0000","last_unstale":"2024-09-11T23:05:06.956481+0000","last_undegraded":"2024-09-11T23:05:06.956481+0000","last_fullsized":"2024-09-11T23:05:06.956481+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:24.272501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.944714+0000","last_change":"2024-09-11T23:05:06.544366+0000","last_active":"2024-09-11T23:05:06.944714+0000","last_peered":"2024-09-11T23:05:06.944714+0000","last_clean":"2024-09-11T23:05:06.944714+0000","last_became_active":"2024-09-11T23:05:06.543171+0000","last_became_peered":"2024-09-11T23:05:06.543171+0000","last_unstale":"2024-09-11T23:05:06.944714+0000","last_undegraded":"2024-09-11T23:05:06.944714+0000","last_fullsized":"2024-09-11T23:05:06.944714+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:29:36.929493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.996760+0000","last_change":"2024-09-11T23:05:06.970253+0000","last_active":"2024-09-11T23:05:06.996760+0000","last_peered":"2024-09-11T23:05:06.996760+0000","last_clean":"2024-09-11T23:05:06.996760+0000","last_became_active":"2024-09-11T23:05:06.969570+0000","last_became_peered":"2024-09-11T23:05:06.969570+0000","last_unstale":"2024-09-11T23:05:06.996760+0000","last_undegraded":"2024-09-11T23:05:06.996760+0000","last_fullsized":"2024-09-11T23:05:06.996760+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:07.530868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"35'1","reported_seq":21,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.937524+0000","last_change":"2024-09-11T23:04:45.281392+0000","last_active":"2024-09-11T23:05:06.937524+0000","last_peered":"2024-09-11T23:05:06.937524+0000","last_clean":"2024-09-11T23:05:06.937524+0000","last_became_active":"2024-09-11T23:04:45.281085+0000","last_became_peered":"2024-09-11T23:04:45.281085+0000","last_unstale":"2024-09-11T23:05:06.937524+0000","last_undegraded":"2024-09-11T23:05:06.937524+0000","last_fullsized":"2024-09-11T23:05:06.937524+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:44.243353+0000","last_clean_scrub_stamp":"2024-09-11T23:04:44.243353+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:55.332488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.935098+0000","last_change":"2024-09-11T23:04:46.300077+0000","last_active":"2024-09-11T23:05:06.935098+0000","last_peered":"2024-09-11T23:05:06.935098+0000","last_clean":"2024-09-11T23:05:06.935098+0000","last_became_active":"2024-09-11T23:04:46.299088+0000","last_became_peered":"2024-09-11T23:04:46.299088+0000","last_unstale":"2024-09-11T23:05:06.935098+0000","last_undegraded":"2024-09-11T23:05:06.935098+0000","last_fullsized":"2024-09-11T23:05:06.935098+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:40.359020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"39'5","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.525737+0000","last_change":"2024-09-11T23:05:06.541882+0000","last_active":"2024-09-11T23:05:07.525737+0000","last_peered":"2024-09-11T23:05:07.525737+0000","last_clean":"2024-09-11T23:05:07.525737+0000","last_became_active":"2024-09-11T23:05:06.540892+0000","last_became_peered":"2024-09-11T23:05:06.540892+0000","last_unstale":"2024-09-11T23:05:07.525737+0000","last_undegraded":"2024-09-11T23:05:07.525737+0000","last_fullsized":"2024-09-11T23:05:07.525737+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:05.917608+0000","last_clean_scrub_stamp":"2024-09-11T23:05:05.917608+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:47.205829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.994532+0000","last_change":"2024-09-11T23:05:06.985065+0000","last_active":"2024-09-11T23:05:06.994532+0000","last_peered":"2024-09-11T23:05:06.994532+0000","last_clean":"2024-09-11T23:05:06.994532+0000","last_became_active":"2024-09-11T23:05:06.983978+0000","last_became_peered":"2024-09-11T23:05:06.983978+0000","last_unstale":"2024-09-11T23:05:06.994532+0000","last_undegraded":"2024-09-11T23:05:06.994532+0000","last_fullsized":"2024-09-11T23:05:06.994532+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:25.724245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.958908+0000","last_change":"2024-09-11T23:04:46.316259+0000","last_active":"2024-09-11T23:05:06.958908+0000","last_peered":"2024-09-11T23:05:06.958908+0000","last_clean":"2024-09-11T23:05:06.958908+0000","last_became_active":"2024-09-11T23:04:46.303687+0000","last_became_peered":"2024-09-11T23:04:46.303687+0000","last_unstale":"2024-09-11T23:05:06.958908+0000","last_undegraded":"2024-09-11T23:05:06.958908+0000","last_fullsized":"2024-09-11T23:05:06.958908+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:57.879933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.005344+0000","last_change":"2024-09-11T23:05:07.000817+0000","last_active":"2024-09-11T23:05:07.005344+0000","last_peered":"2024-09-11T23:05:07.005344+0000","last_clean":"2024-09-11T23:05:07.005344+0000","last_became_active":"2024-09-11T23:05:07.000325+0000","last_became_peered":"2024-09-11T23:05:07.000325+0000","last_unstale":"2024-09-11T23:05:07.005344+0000","last_undegraded":"2024-09-11T23:05:07.005344+0000","last_fullsized":"2024-09-11T23:05:07.005344+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:35.620797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.948784+0000","last_change":"2024-09-11T23:04:46.318259+0000","last_active":"2024-09-11T23:05:06.948784+0000","last_peered":"2024-09-11T23:05:06.948784+0000","last_clean":"2024-09-11T23:05:06.948784+0000","last_became_active":"2024-09-11T23:04:46.317792+0000","last_became_peered":"2024-09-11T23:04:46.317792+0000","last_unstale":"2024-09-11T23:05:06.948784+0000","last_undegraded":"2024-09-11T23:05:06.948784+0000","last_fullsized":"2024-09-11T23:05:06.948784+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:57.781311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.004084+0000","last_change":"2024-09-11T23:05:06.994502+0000","last_active":"2024-09-11T23:05:07.004084+0000","last_peered":"2024-09-11T23:05:07.004084+0000","last_clean":"2024-09-11T23:05:07.004084+0000","last_became_active":"2024-09-11T23:05:06.993852+0000","last_became_peered":"2024-09-11T23:05:06.993852+0000","last_unstale":"2024-09-11T23:05:07.004084+0000","last_undegraded":"2024-09-11T23:05:07.004084+0000","last_fullsized":"2024-09-11T23:05:07.004084+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:46.200998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.971624+0000","last_change":"2024-09-11T23:04:46.324495+0000","last_active":"2024-09-11T23:05:06.971624+0000","last_peered":"2024-09-11T23:05:06.971624+0000","last_clean":"2024-09-11T23:05:06.971624+0000","last_became_active":"2024-09-11T23:04:46.324164+0000","last_became_peered":"2024-09-11T23:04:46.324164+0000","last_unstale":"2024-09-11T23:05:06.971624+0000","last_undegraded":"2024-09-11T23:05:06.971624+0000","last_fullsized":"2024-09-11T23:05:06.971624+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:18.942042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.993417+0000","last_change":"2024-09-11T23:05:06.986061+0000","last_active":"2024-09-11T23:05:06.993417+0000","last_peered":"2024-09-11T23:05:06.993417+0000","last_clean":"2024-09-11T23:05:06.993417+0000","last_became_active":"2024-09-11T23:05:06.985376+0000","last_became_peered":"2024-09-11T23:05:06.985376+0000","last_unstale":"2024-09-11T23:05:06.993417+0000","last_undegraded":"2024-09-11T23:05:06.993417+0000","last_fullsized":"2024-09-11T23:05:06.993417+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:02.837866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.935392+0000","last_change":"2024-09-11T23:04:46.309119+0000","last_active":"2024-09-11T23:05:06.935392+0000","last_peered":"2024-09-11T23:05:06.935392+0000","last_clean":"2024-09-11T23:05:06.935392+0000","last_became_active":"2024-09-11T23:04:46.305535+0000","last_became_peered":"2024-09-11T23:04:46.305535+0000","last_unstale":"2024-09-11T23:05:06.935392+0000","last_undegraded":"2024-09-11T23:05:06.935392+0000","last_fullsized":"2024-09-11T23:05:06.935392+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:01.790895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.005683+0000","last_change":"2024-09-11T23:05:07.001690+0000","last_active":"2024-09-11T23:05:07.005683+0000","last_peered":"2024-09-11T23:05:07.005683+0000","last_clean":"2024-09-11T23:05:07.005683+0000","last_became_active":"2024-09-11T23:05:07.001191+0000","last_became_peered":"2024-09-11T23:05:07.001191+0000","last_unstale":"2024-09-11T23:05:07.005683+0000","last_undegraded":"2024-09-11T23:05:07.005683+0000","last_fullsized":"2024-09-11T23:05:07.005683+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:48.064477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.964551+0000","last_change":"2024-09-11T23:04:46.322235+0000","last_active":"2024-09-11T23:05:06.964551+0000","last_peered":"2024-09-11T23:05:06.964551+0000","last_clean":"2024-09-11T23:05:06.964551+0000","last_became_active":"2024-09-11T23:04:46.318694+0000","last_became_peered":"2024-09-11T23:04:46.318694+0000","last_unstale":"2024-09-11T23:05:06.964551+0000","last_undegraded":"2024-09-11T23:05:06.964551+0000","last_fullsized":"2024-09-11T23:05:06.964551+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:08.154174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.981507+0000","last_change":"2024-09-11T23:05:06.974158+0000","last_active":"2024-09-11T23:05:06.981507+0000","last_peered":"2024-09-11T23:05:06.981507+0000","last_clean":"2024-09-11T23:05:06.981507+0000","last_became_active":"2024-09-11T23:05:06.973514+0000","last_became_peered":"2024-09-11T23:05:06.973514+0000","last_unstale":"2024-09-11T23:05:06.981507+0000","last_undegraded":"2024-09-11T23:05:06.981507+0000","last_fullsized":"2024-09-11T23:05:06.981507+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:45.557228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.935459+0000","last_change":"2024-09-11T23:04:46.312949+0000","last_active":"2024-09-11T23:05:06.935459+0000","last_peered":"2024-09-11T23:05:06.935459+0000","last_clean":"2024-09-11T23:05:06.935459+0000","last_became_active":"2024-09-11T23:04:46.302019+0000","last_became_peered":"2024-09-11T23:04:46.302019+0000","last_unstale":"2024-09-11T23:05:06.935459+0000","last_undegraded":"2024-09-11T23:05:06.935459+0000","last_fullsized":"2024-09-11T23:05:06.935459+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:36:58.972672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.995936+0000","last_change":"2024-09-11T23:05:06.975494+0000","last_active":"2024-09-11T23:05:06.995936+0000","last_peered":"2024-09-11T23:05:06.995936+0000","last_clean":"2024-09-11T23:05:06.995936+0000","last_became_active":"2024-09-11T23:05:06.974850+0000","last_became_peered":"2024-09-11T23:05:06.974850+0000","last_unstale":"2024-09-11T23:05:06.995936+0000","last_undegraded":"2024-09-11T23:05:06.995936+0000","last_fullsized":"2024-09-11T23:05:06.995936+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:25.724245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.959096+0000","last_change":"2024-09-11T23:04:46.322057+0000","last_active":"2024-09-11T23:05:06.959096+0000","last_peered":"2024-09-11T23:05:06.959096+0000","last_clean":"2024-09-11T23:05:06.959096+0000","last_became_active":"2024-09-11T23:04:46.321757+0000","last_became_peered":"2024-09-11T23:04:46.321757+0000","last_unstale":"2024-09-11T23:05:06.959096+0000","last_undegraded":"2024-09-11T23:05:06.959096+0000","last_fullsized":"2024-09-11T23:05:06.959096+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:35.190963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.974800+0000","last_change":"2024-09-11T23:05:06.966480+0000","last_active":"2024-09-11T23:05:06.974800+0000","last_peered":"2024-09-11T23:05:06.974800+0000","last_clean":"2024-09-11T23:05:06.974800+0000","last_became_active":"2024-09-11T23:05:06.965716+0000","last_became_peered":"2024-09-11T23:05:06.965716+0000","last_unstale":"2024-09-11T23:05:06.974800+0000","last_undegraded":"2024-09-11T23:05:06.974800+0000","last_fullsized":"2024-09-11T23:05:06.974800+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:46.669881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.951694+0000","last_change":"2024-09-11T23:04:46.310580+0000","last_active":"2024-09-11T23:05:06.951694+0000","last_peered":"2024-09-11T23:05:06.951694+0000","last_clean":"2024-09-11T23:05:06.951694+0000","last_became_active":"2024-09-11T23:04:46.303113+0000","last_became_peered":"2024-09-11T23:04:46.303113+0000","last_unstale":"2024-09-11T23:05:06.951694+0000","last_undegraded":"2024-09-11T23:05:06.951694+0000","last_fullsized":"2024-09-11T23:05:06.951694+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:57.299176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.982960+0000","last_change":"2024-09-11T23:05:06.974756+0000","last_active":"2024-09-11T23:05:06.982960+0000","last_peered":"2024-09-11T23:05:06.982960+0000","last_clean":"2024-09-11T23:05:06.982960+0000","last_became_active":"2024-09-11T23:05:06.973533+0000","last_became_peered":"2024-09-11T23:05:06.973533+0000","last_unstale":"2024-09-11T23:05:06.982960+0000","last_undegraded":"2024-09-11T23:05:06.982960+0000","last_fullsized":"2024-09-11T23:05:06.982960+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:33.464461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.959323+0000","last_change":"2024-09-11T23:04:46.317887+0000","last_active":"2024-09-11T23:05:06.959323+0000","last_peered":"2024-09-11T23:05:06.959323+0000","last_clean":"2024-09-11T23:05:06.959323+0000","last_became_active":"2024-09-11T23:04:46.302562+0000","last_became_peered":"2024-09-11T23:04:46.302562+0000","last_unstale":"2024-09-11T23:05:06.959323+0000","last_undegraded":"2024-09-11T23:05:06.959323+0000","last_fullsized":"2024-09-11T23:05:06.959323+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:57.781311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.013116+0000","last_change":"2024-09-11T23:05:07.011737+0000","last_active":"2024-09-11T23:05:07.013116+0000","last_peered":"2024-09-11T23:05:07.013116+0000","last_clean":"2024-09-11T23:05:07.013116+0000","last_became_active":"2024-09-11T23:05:07.011235+0000","last_became_peered":"2024-09-11T23:05:07.011235+0000","last_unstale":"2024-09-11T23:05:07.013116+0000","last_undegraded":"2024-09-11T23:05:07.013116+0000","last_fullsized":"2024-09-11T23:05:07.013116+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:24.403140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.950864+0000","last_change":"2024-09-11T23:04:46.309407+0000","last_active":"2024-09-11T23:05:06.950864+0000","last_peered":"2024-09-11T23:05:06.950864+0000","last_clean":"2024-09-11T23:05:06.950864+0000","last_became_active":"2024-09-11T23:04:46.305205+0000","last_became_peered":"2024-09-11T23:04:46.305205+0000","last_unstale":"2024-09-11T23:05:06.950864+0000","last_undegraded":"2024-09-11T23:05:06.950864+0000","last_fullsized":"2024-09-11T23:05:06.950864+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:16.071563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.990389+0000","last_change":"2024-09-11T23:05:06.984212+0000","last_active":"2024-09-11T23:05:06.990389+0000","last_peered":"2024-09-11T23:05:06.990389+0000","last_clean":"2024-09-11T23:05:06.990389+0000","last_became_active":"2024-09-11T23:05:06.983612+0000","last_became_peered":"2024-09-11T23:05:06.983612+0000","last_unstale":"2024-09-11T23:05:06.990389+0000","last_undegraded":"2024-09-11T23:05:06.990389+0000","last_fullsized":"2024-09-11T23:05:06.990389+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:46.669881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.937823+0000","last_change":"2024-09-11T23:04:46.305516+0000","last_active":"2024-09-11T23:05:06.937823+0000","last_peered":"2024-09-11T23:05:06.937823+0000","last_clean":"2024-09-11T23:05:06.937823+0000","last_became_active":"2024-09-11T23:04:46.305081+0000","last_became_peered":"2024-09-11T23:04:46.305081+0000","last_unstale":"2024-09-11T23:05:06.937823+0000","last_undegraded":"2024-09-11T23:05:06.937823+0000","last_fullsized":"2024-09-11T23:05:06.937823+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:14.633756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.999081+0000","last_change":"2024-09-11T23:05:06.989600+0000","last_active":"2024-09-11T23:05:06.999081+0000","last_peered":"2024-09-11T23:05:06.999081+0000","last_clean":"2024-09-11T23:05:06.999081+0000","last_became_active":"2024-09-11T23:05:06.988144+0000","last_became_peered":"2024-09-11T23:05:06.988144+0000","last_unstale":"2024-09-11T23:05:06.999081+0000","last_undegraded":"2024-09-11T23:05:06.999081+0000","last_fullsized":"2024-09-11T23:05:06.999081+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:10:40.766794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.963730+0000","last_change":"2024-09-11T23:04:46.325121+0000","last_active":"2024-09-11T23:05:06.963730+0000","last_peered":"2024-09-11T23:05:06.963730+0000","last_clean":"2024-09-11T23:05:06.963730+0000","last_became_active":"2024-09-11T23:04:46.324845+0000","last_became_peered":"2024-09-11T23:04:46.324845+0000","last_unstale":"2024-09-11T23:05:06.963730+0000","last_undegraded":"2024-09-11T23:05:06.963730+0000","last_fullsized":"2024-09-11T23:05:06.963730+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:40:40.557329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.004249+0000","last_change":"2024-09-11T23:05:07.001370+0000","last_active":"2024-09-11T23:05:07.004249+0000","last_peered":"2024-09-11T23:05:07.004249+0000","last_clean":"2024-09-11T23:05:07.004249+0000","last_became_active":"2024-09-11T23:05:07.000922+0000","last_became_peered":"2024-09-11T23:05:07.000922+0000","last_unstale":"2024-09-11T23:05:07.004249+0000","last_undegraded":"2024-09-11T23:05:07.004249+0000","last_fullsized":"2024-09-11T23:05:07.004249+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:25.786033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.964932+0000","last_change":"2024-09-11T23:04:46.325750+0000","last_active":"2024-09-11T23:05:06.964932+0000","last_peered":"2024-09-11T23:05:06.964932+0000","last_clean":"2024-09-11T23:05:06.964932+0000","last_became_active":"2024-09-11T23:04:46.325162+0000","last_became_peered":"2024-09-11T23:04:46.325162+0000","last_unstale":"2024-09-11T23:05:06.964932+0000","last_undegraded":"2024-09-11T23:05:06.964932+0000","last_fullsized":"2024-09-11T23:05:06.964932+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:42:04.891291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.012363+0000","last_change":"2024-09-11T23:05:07.005638+0000","last_active":"2024-09-11T23:05:07.012363+0000","last_peered":"2024-09-11T23:05:07.012363+0000","last_clean":"2024-09-11T23:05:07.012363+0000","last_became_active":"2024-09-11T23:05:07.004870+0000","last_became_peered":"2024-09-11T23:05:07.004870+0000","last_unstale":"2024-09-11T23:05:07.012363+0000","last_undegraded":"2024-09-11T23:05:07.012363+0000","last_fullsized":"2024-09-11T23:05:07.012363+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:27.609111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.934898+0000","last_change":"2024-09-11T23:04:46.302357+0000","last_active":"2024-09-11T23:05:06.934898+0000","last_peered":"2024-09-11T23:05:06.934898+0000","last_clean":"2024-09-11T23:05:06.934898+0000","last_became_active":"2024-09-11T23:04:46.300136+0000","last_became_peered":"2024-09-11T23:04:46.300136+0000","last_unstale":"2024-09-11T23:05:06.934898+0000","last_undegraded":"2024-09-11T23:05:06.934898+0000","last_fullsized":"2024-09-11T23:05:06.934898+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:05.590116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.982171+0000","last_change":"2024-09-11T23:05:06.975382+0000","last_active":"2024-09-11T23:05:06.982171+0000","last_peered":"2024-09-11T23:05:06.982171+0000","last_clean":"2024-09-11T23:05:06.982171+0000","last_became_active":"2024-09-11T23:05:06.973466+0000","last_became_peered":"2024-09-11T23:05:06.973466+0000","last_unstale":"2024-09-11T23:05:06.982171+0000","last_undegraded":"2024-09-11T23:05:06.982171+0000","last_fullsized":"2024-09-11T23:05:06.982171+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:46.458163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.962776+0000","last_change":"2024-09-11T23:04:46.316600+0000","last_active":"2024-09-11T23:05:06.962776+0000","last_peered":"2024-09-11T23:05:06.962776+0000","last_clean":"2024-09-11T23:05:06.962776+0000","last_became_active":"2024-09-11T23:04:46.316342+0000","last_became_peered":"2024-09-11T23:04:46.316342+0000","last_unstale":"2024-09-11T23:05:06.962776+0000","last_undegraded":"2024-09-11T23:05:06.962776+0000","last_fullsized":"2024-09-11T23:05:06.962776+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:35.190963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.012173+0000","last_change":"2024-09-11T23:05:07.004521+0000","last_active":"2024-09-11T23:05:07.012173+0000","last_peered":"2024-09-11T23:05:07.012173+0000","last_clean":"2024-09-11T23:05:07.012173+0000","last_became_active":"2024-09-11T23:05:07.004022+0000","last_became_peered":"2024-09-11T23:05:07.004022+0000","last_unstale":"2024-09-11T23:05:07.012173+0000","last_undegraded":"2024-09-11T23:05:07.012173+0000","last_fullsized":"2024-09-11T23:05:07.012173+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:06.822894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.980050+0000","last_change":"2024-09-11T23:04:46.326089+0000","last_active":"2024-09-11T23:05:06.980050+0000","last_peered":"2024-09-11T23:05:06.980050+0000","last_clean":"2024-09-11T23:05:06.980050+0000","last_became_active":"2024-09-11T23:04:46.325794+0000","last_became_peered":"2024-09-11T23:04:46.325794+0000","last_unstale":"2024-09-11T23:05:06.980050+0000","last_undegraded":"2024-09-11T23:05:06.980050+0000","last_fullsized":"2024-09-11T23:05:06.980050+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:33.658422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.013444+0000","last_change":"2024-09-11T23:05:07.010825+0000","last_active":"2024-09-11T23:05:07.013444+0000","last_peered":"2024-09-11T23:05:07.013444+0000","last_clean":"2024-09-11T23:05:07.013444+0000","last_became_active":"2024-09-11T23:05:07.010365+0000","last_became_peered":"2024-09-11T23:05:07.010365+0000","last_unstale":"2024-09-11T23:05:07.013444+0000","last_undegraded":"2024-09-11T23:05:07.013444+0000","last_fullsized":"2024-09-11T23:05:07.013444+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:45.274116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.931715+0000","last_change":"2024-09-11T23:04:46.292375+0000","last_active":"2024-09-11T23:05:06.931715+0000","last_peered":"2024-09-11T23:05:06.931715+0000","last_clean":"2024-09-11T23:05:06.931715+0000","last_became_active":"2024-09-11T23:04:46.292063+0000","last_became_peered":"2024-09-11T23:04:46.292063+0000","last_unstale":"2024-09-11T23:05:06.931715+0000","last_undegraded":"2024-09-11T23:05:06.931715+0000","last_fullsized":"2024-09-11T23:05:06.931715+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:34.883131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.012526+0000","last_change":"2024-09-11T23:05:07.006768+0000","last_active":"2024-09-11T23:05:07.012526+0000","last_peered":"2024-09-11T23:05:07.012526+0000","last_clean":"2024-09-11T23:05:07.012526+0000","last_became_active":"2024-09-11T23:05:07.006298+0000","last_became_peered":"2024-09-11T23:05:07.006298+0000","last_unstale":"2024-09-11T23:05:07.012526+0000","last_undegraded":"2024-09-11T23:05:07.012526+0000","last_fullsized":"2024-09-11T23:05:07.012526+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:25.786033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.957799+0000","last_change":"2024-09-11T23:04:46.294302+0000","last_active":"2024-09-11T23:05:06.957799+0000","last_peered":"2024-09-11T23:05:06.957799+0000","last_clean":"2024-09-11T23:05:06.957799+0000","last_became_active":"2024-09-11T23:04:46.294005+0000","last_became_peered":"2024-09-11T23:04:46.294005+0000","last_unstale":"2024-09-11T23:05:06.957799+0000","last_undegraded":"2024-09-11T23:05:06.957799+0000","last_fullsized":"2024-09-11T23:05:06.957799+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:46.062475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.998976+0000","last_change":"2024-09-11T23:05:06.988301+0000","last_active":"2024-09-11T23:05:06.998976+0000","last_peered":"2024-09-11T23:05:06.998976+0000","last_clean":"2024-09-11T23:05:06.998976+0000","last_became_active":"2024-09-11T23:05:06.986888+0000","last_became_peered":"2024-09-11T23:05:06.986888+0000","last_unstale":"2024-09-11T23:05:06.998976+0000","last_undegraded":"2024-09-11T23:05:06.998976+0000","last_fullsized":"2024-09-11T23:05:06.998976+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:43.518194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.937949+0000","last_change":"2024-09-11T23:04:46.302655+0000","last_active":"2024-09-11T23:05:06.937949+0000","last_peered":"2024-09-11T23:05:06.937949+0000","last_clean":"2024-09-11T23:05:06.937949+0000","last_became_active":"2024-09-11T23:04:46.302072+0000","last_became_peered":"2024-09-11T23:04:46.302072+0000","last_unstale":"2024-09-11T23:05:06.937949+0000","last_undegraded":"2024-09-11T23:05:06.937949+0000","last_fullsized":"2024-09-11T23:05:06.937949+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:04.479635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.012530+0000","last_change":"2024-09-11T23:05:07.006957+0000","last_active":"2024-09-11T23:05:07.012530+0000","last_peered":"2024-09-11T23:05:07.012530+0000","last_clean":"2024-09-11T23:05:07.012530+0000","last_became_active":"2024-09-11T23:05:07.006345+0000","last_became_peered":"2024-09-11T23:05:07.006345+0000","last_unstale":"2024-09-11T23:05:07.012530+0000","last_undegraded":"2024-09-11T23:05:07.012530+0000","last_fullsized":"2024-09-11T23:05:07.012530+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:47.531881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.963963+0000","last_change":"2024-09-11T23:04:46.316413+0000","last_active":"2024-09-11T23:05:06.963963+0000","last_peered":"2024-09-11T23:05:06.963963+0000","last_clean":"2024-09-11T23:05:06.963963+0000","last_became_active":"2024-09-11T23:04:46.316020+0000","last_became_peered":"2024-09-11T23:04:46.316020+0000","last_unstale":"2024-09-11T23:05:06.963963+0000","last_undegraded":"2024-09-11T23:05:06.963963+0000","last_fullsized":"2024-09-11T23:05:06.963963+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:26.438762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.000673+0000","last_change":"2024-09-11T23:05:06.992541+0000","last_active":"2024-09-11T23:05:07.000673+0000","last_peered":"2024-09-11T23:05:07.000673+0000","last_clean":"2024-09-11T23:05:07.000673+0000","last_became_active":"2024-09-11T23:05:06.991924+0000","last_became_peered":"2024-09-11T23:05:06.991924+0000","last_unstale":"2024-09-11T23:05:07.000673+0000","last_undegraded":"2024-09-11T23:05:07.000673+0000","last_fullsized":"2024-09-11T23:05:07.000673+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:00.902097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.965164+0000","last_change":"2024-09-11T23:04:46.325110+0000","last_active":"2024-09-11T23:05:06.965164+0000","last_peered":"2024-09-11T23:05:06.965164+0000","last_clean":"2024-09-11T23:05:06.965164+0000","last_became_active":"2024-09-11T23:04:46.324558+0000","last_became_peered":"2024-09-11T23:04:46.324558+0000","last_unstale":"2024-09-11T23:05:06.965164+0000","last_undegraded":"2024-09-11T23:05:06.965164+0000","last_fullsized":"2024-09-11T23:05:06.965164+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:22.103808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.012006+0000","last_change":"2024-09-11T23:05:07.003943+0000","last_active":"2024-09-11T23:05:07.012006+0000","last_peered":"2024-09-11T23:05:07.012006+0000","last_clean":"2024-09-11T23:05:07.012006+0000","last_became_active":"2024-09-11T23:05:07.003633+0000","last_became_peered":"2024-09-11T23:05:07.003633+0000","last_unstale":"2024-09-11T23:05:07.012006+0000","last_undegraded":"2024-09-11T23:05:07.012006+0000","last_fullsized":"2024-09-11T23:05:07.012006+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:01.603630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.935556+0000","last_change":"2024-09-11T23:04:46.315762+0000","last_active":"2024-09-11T23:05:06.935556+0000","last_peered":"2024-09-11T23:05:06.935556+0000","last_clean":"2024-09-11T23:05:06.935556+0000","last_became_active":"2024-09-11T23:04:46.313293+0000","last_became_peered":"2024-09-11T23:04:46.313293+0000","last_unstale":"2024-09-11T23:05:06.935556+0000","last_undegraded":"2024-09-11T23:05:06.935556+0000","last_fullsized":"2024-09-11T23:05:06.935556+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:06.364501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.012620+0000","last_change":"2024-09-11T23:05:07.010648+0000","last_active":"2024-09-11T23:05:07.012620+0000","last_peered":"2024-09-11T23:05:07.012620+0000","last_clean":"2024-09-11T23:05:07.012620+0000","last_became_active":"2024-09-11T23:05:07.005655+0000","last_became_peered":"2024-09-11T23:05:07.005655+0000","last_unstale":"2024-09-11T23:05:07.012620+0000","last_undegraded":"2024-09-11T23:05:07.012620+0000","last_fullsized":"2024-09-11T23:05:07.012620+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:26.834726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.937960+0000","last_change":"2024-09-11T23:04:46.300732+0000","last_active":"2024-09-11T23:05:06.937960+0000","last_peered":"2024-09-11T23:05:06.937960+0000","last_clean":"2024-09-11T23:05:06.937960+0000","last_became_active":"2024-09-11T23:04:46.300435+0000","last_became_peered":"2024-09-11T23:04:46.300435+0000","last_unstale":"2024-09-11T23:05:06.937960+0000","last_undegraded":"2024-09-11T23:05:06.937960+0000","last_fullsized":"2024-09-11T23:05:06.937960+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:18.745052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.007219+0000","last_change":"2024-09-11T23:05:06.992013+0000","last_active":"2024-09-11T23:05:07.007219+0000","last_peered":"2024-09-11T23:05:07.007219+0000","last_clean":"2024-09-11T23:05:07.007219+0000","last_became_active":"2024-09-11T23:05:06.986216+0000","last_became_peered":"2024-09-11T23:05:06.986216+0000","last_unstale":"2024-09-11T23:05:07.007219+0000","last_undegraded":"2024-09-11T23:05:07.007219+0000","last_fullsized":"2024-09-11T23:05:07.007219+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:09.815131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.952088+0000","last_change":"2024-09-11T23:04:46.315753+0000","last_active":"2024-09-11T23:05:06.952088+0000","last_peered":"2024-09-11T23:05:06.952088+0000","last_clean":"2024-09-11T23:05:06.952088+0000","last_became_active":"2024-09-11T23:04:46.310113+0000","last_became_peered":"2024-09-11T23:04:46.310113+0000","last_unstale":"2024-09-11T23:05:06.952088+0000","last_undegraded":"2024-09-11T23:05:06.952088+0000","last_fullsized":"2024-09-11T23:05:06.952088+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:04.541423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.003815+0000","last_change":"2024-09-11T23:05:06.989388+0000","last_active":"2024-09-11T23:05:07.003815+0000","last_peered":"2024-09-11T23:05:07.003815+0000","last_clean":"2024-09-11T23:05:07.003815+0000","last_became_active":"2024-09-11T23:05:06.988315+0000","last_became_peered":"2024-09-11T23:05:06.988315+0000","last_unstale":"2024-09-11T23:05:07.003815+0000","last_undegraded":"2024-09-11T23:05:07.003815+0000","last_fullsized":"2024-09-11T23:05:07.003815+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:06.822894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.932392+0000","last_change":"2024-09-11T23:04:46.319132+0000","last_active":"2024-09-11T23:05:06.932392+0000","last_peered":"2024-09-11T23:05:06.932392+0000","last_clean":"2024-09-11T23:05:06.932392+0000","last_became_active":"2024-09-11T23:04:46.318804+0000","last_became_peered":"2024-09-11T23:04:46.318804+0000","last_unstale":"2024-09-11T23:05:06.932392+0000","last_undegraded":"2024-09-11T23:05:06.932392+0000","last_fullsized":"2024-09-11T23:05:06.932392+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:06.293898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.003861+0000","last_change":"2024-09-11T23:05:06.993066+0000","last_active":"2024-09-11T23:05:07.003861+0000","last_peered":"2024-09-11T23:05:07.003861+0000","last_clean":"2024-09-11T23:05:07.003861+0000","last_became_active":"2024-09-11T23:05:06.988870+0000","last_became_peered":"2024-09-11T23:05:06.988870+0000","last_unstale":"2024-09-11T23:05:07.003861+0000","last_undegraded":"2024-09-11T23:05:07.003861+0000","last_fullsized":"2024-09-11T23:05:07.003861+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:35.620797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.950402+0000","last_change":"2024-09-11T23:04:46.309627+0000","last_active":"2024-09-11T23:05:06.950402+0000","last_peered":"2024-09-11T23:05:06.950402+0000","last_clean":"2024-09-11T23:05:06.950402+0000","last_became_active":"2024-09-11T23:04:46.305521+0000","last_became_peered":"2024-09-11T23:04:46.305521+0000","last_unstale":"2024-09-11T23:05:06.950402+0000","last_undegraded":"2024-09-11T23:05:06.950402+0000","last_fullsized":"2024-09-11T23:05:06.950402+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:23.073316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.000455+0000","last_change":"2024-09-11T23:05:06.993261+0000","last_active":"2024-09-11T23:05:07.000455+0000","last_peered":"2024-09-11T23:05:07.000455+0000","last_clean":"2024-09-11T23:05:07.000455+0000","last_became_active":"2024-09-11T23:05:06.988788+0000","last_became_peered":"2024-09-11T23:05:06.988788+0000","last_unstale":"2024-09-11T23:05:07.000455+0000","last_undegraded":"2024-09-11T23:05:07.000455+0000","last_fullsized":"2024-09-11T23:05:07.000455+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:48.064477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.938108+0000","last_change":"2024-09-11T23:04:46.303213+0000","last_active":"2024-09-11T23:05:06.938108+0000","last_peered":"2024-09-11T23:05:06.938108+0000","last_clean":"2024-09-11T23:05:06.938108+0000","last_became_active":"2024-09-11T23:04:46.302373+0000","last_became_peered":"2024-09-11T23:04:46.302373+0000","last_unstale":"2024-09-11T23:05:06.938108+0000","last_undegraded":"2024-09-11T23:05:06.938108+0000","last_fullsized":"2024-09-11T23:05:06.938108+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:46.286258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:07.003742+0000","last_change":"2024-09-11T23:05:06.996492+0000","last_active":"2024-09-11T23:05:07.003742+0000","last_peered":"2024-09-11T23:05:07.003742+0000","last_clean":"2024-09-11T23:05:07.003742+0000","last_became_active":"2024-09-11T23:05:06.996085+0000","last_became_peered":"2024-09-11T23:05:06.996085+0000","last_unstale":"2024-09-11T23:05:07.003742+0000","last_undegraded":"2024-09-11T23:05:07.003742+0000","last_fullsized":"2024-09-11T23:05:07.003742+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:39.989662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.952074+0000","last_change":"2024-09-11T23:04:46.305232+0000","last_active":"2024-09-11T23:05:06.952074+0000","last_peered":"2024-09-11T23:05:06.952074+0000","last_clean":"2024-09-11T23:05:06.952074+0000","last_became_active":"2024-09-11T23:04:46.300680+0000","last_became_peered":"2024-09-11T23:04:46.300680+0000","last_unstale":"2024-09-11T23:05:06.952074+0000","last_undegraded":"2024-09-11T23:05:06.952074+0000","last_fullsized":"2024-09-11T23:05:06.952074+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:41.593257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.990815+0000","last_change":"2024-09-11T23:05:06.985392+0000","last_active":"2024-09-11T23:05:06.990815+0000","last_peered":"2024-09-11T23:05:06.990815+0000","last_clean":"2024-09-11T23:05:06.990815+0000","last_became_active":"2024-09-11T23:05:06.984496+0000","last_became_peered":"2024-09-11T23:05:06.984496+0000","last_unstale":"2024-09-11T23:05:06.990815+0000","last_undegraded":"2024-09-11T23:05:06.990815+0000","last_fullsized":"2024-09-11T23:05:06.990815+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:00.060096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.934061+0000","last_change":"2024-09-11T23:04:46.302736+0000","last_active":"2024-09-11T23:05:06.934061+0000","last_peered":"2024-09-11T23:05:06.934061+0000","last_clean":"2024-09-11T23:05:06.934061+0000","last_became_active":"2024-09-11T23:04:46.302383+0000","last_became_peered":"2024-09-11T23:04:46.302383+0000","last_unstale":"2024-09-11T23:05:06.934061+0000","last_undegraded":"2024-09-11T23:05:06.934061+0000","last_fullsized":"2024-09-11T23:05:06.934061+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:14.376187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.999143+0000","last_change":"2024-09-11T23:05:06.987075+0000","last_active":"2024-09-11T23:05:06.999143+0000","last_peered":"2024-09-11T23:05:06.999143+0000","last_clean":"2024-09-11T23:05:06.999143+0000","last_became_active":"2024-09-11T23:05:06.986305+0000","last_became_peered":"2024-09-11T23:05:06.986305+0000","last_unstale":"2024-09-11T23:05:06.999143+0000","last_undegraded":"2024-09-11T23:05:06.999143+0000","last_fullsized":"2024-09-11T23:05:06.999143+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:29:29.938449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.956015+0000","last_change":"2024-09-11T23:04:46.297471+0000","last_active":"2024-09-11T23:05:06.956015+0000","last_peered":"2024-09-11T23:05:06.956015+0000","last_clean":"2024-09-11T23:05:06.956015+0000","last_became_active":"2024-09-11T23:04:46.297150+0000","last_became_peered":"2024-09-11T23:04:46.297150+0000","last_unstale":"2024-09-11T23:05:06.956015+0000","last_undegraded":"2024-09-11T23:05:06.956015+0000","last_fullsized":"2024-09-11T23:05:06.956015+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:13.700148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.982485+0000","last_change":"2024-09-11T23:05:06.978012+0000","last_active":"2024-09-11T23:05:06.982485+0000","last_peered":"2024-09-11T23:05:06.982485+0000","last_clean":"2024-09-11T23:05:06.982485+0000","last_became_active":"2024-09-11T23:05:06.977418+0000","last_became_peered":"2024-09-11T23:05:06.977418+0000","last_unstale":"2024-09-11T23:05:06.982485+0000","last_undegraded":"2024-09-11T23:05:06.982485+0000","last_fullsized":"2024-09-11T23:05:06.982485+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:05:29.209984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.964874+0000","last_change":"2024-09-11T23:04:46.327199+0000","last_active":"2024-09-11T23:05:06.964874+0000","last_peered":"2024-09-11T23:05:06.964874+0000","last_clean":"2024-09-11T23:05:06.964874+0000","last_became_active":"2024-09-11T23:04:46.326311+0000","last_became_peered":"2024-09-11T23:04:46.326311+0000","last_unstale":"2024-09-11T23:05:06.964874+0000","last_undegraded":"2024-09-11T23:05:06.964874+0000","last_fullsized":"2024-09-11T23:05:06.964874+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:13.700148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.984900+0000","last_change":"2024-09-11T23:05:06.980358+0000","last_active":"2024-09-11T23:05:06.984900+0000","last_peered":"2024-09-11T23:05:06.984900+0000","last_clean":"2024-09-11T23:05:06.984900+0000","last_became_active":"2024-09-11T23:05:06.976675+0000","last_became_peered":"2024-09-11T23:05:06.976675+0000","last_unstale":"2024-09-11T23:05:06.984900+0000","last_undegraded":"2024-09-11T23:05:06.984900+0000","last_fullsized":"2024-09-11T23:05:06.984900+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:06.494940+0000","last_clean_scrub_stamp":"2024-09-11T23:05:06.494940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:02.495582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-11T23:05:06.952329+0000","last_change":"2024-09-11T23:04:46.318408+0000","last_active":"2024-09-11T23:05:06.952329+0000","last_peered":"2024-09-11T23:05:06.952329+0000","last_clean":"2024-09-11T23:05:06.952329+0000","last_became_active":"2024-09-11T23:04:46.310368+0000","last_became_peered":"2024-09-11T23:04:46.310368+0000","last_unstale":"2024-09-11T23:05:06.952329+0000","last_undegraded":"2024-09-11T23:05:06.952329+0000","last_fullsized":"2024-09-11T23:05:06.952329+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:04:45.250330+0000","last_clean_scrub_stamp":"2024-09-11T23:04:45.250330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:10.365921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1436,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":64,"acting":64,"num_store_stats":3},{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":5046,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":10092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":298,"num_read_kb":503,"num_write":177,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738391,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":368640,"data_stored":133656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738391,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":958464,"data_stored":725641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738391,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":958464,"data_stored":724038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:05:11.932 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T23:05:11.933 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T23:05:12.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.083+0000 7f42f4316640 1 Processor -- start 2024-09-11T23:05:12.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.083+0000 7f42f4316640 1 -- start start 2024-09-11T23:05:12.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.083+0000 7f42f4316640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f42ec0a4b80 0x7f42ec0a7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:12.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.083+0000 7f42f4316640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42ec0a82a0 con 0x7f42ec13a410 2024-09-11T23:05:12.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.083+0000 7f42f4316640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f42ec0a3cb0 con 0x7f42ec0a4b80 2024-09-11T23:05:12.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.083+0000 7f42f18b1640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f42ec0a4b80 0x7f42ec0a7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:12.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.083+0000 7f42f20b2640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f42ec13a410 0x7f42ec0a6af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:53608/0 (socket says 172.21.15.12:53608) 2024-09-11T23:05:12.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.083+0000 7f42f20b2640 1 -- 172.21.15.12:0/744116651 learned_addr learned my addr 172.21.15.12:0/744116651 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:12.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.083+0000 7f42f18b1640 1 -- 172.21.15.12:0/744116651 >> v1:172.21.15.12:6789/0 conn(0x7f42ec13a410 legacy=0x7f42ec0a6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:12.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.083+0000 7f42f18b1640 1 -- 172.21.15.12:0/744116651 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42ec139fe0 con 0x7f42ec0a4b80 2024-09-11T23:05:12.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.083+0000 7f42f18b1640 1 --2- 172.21.15.12:0/744116651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42ec0a4b80 0x7f42ec0a7200 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f42dc009740 tx=0x7f42dc01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f98b585af081ed69 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:12.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.083+0000 7f42f10b0640 1 -- 172.21.15.12:0/744116651 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42dc0b0070 con 0x7f42ec0a4b80 2024-09-11T23:05:12.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.083+0000 7f42f10b0640 1 -- 172.21.15.12:0/744116651 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42dc0ab530 con 0x7f42ec0a4b80 2024-09-11T23:05:12.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.083+0000 7f42f10b0640 1 -- 172.21.15.12:0/744116651 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42dc0ab830 con 0x7f42ec0a4b80 2024-09-11T23:05:12.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.087+0000 7f42f4316640 1 -- 172.21.15.12:0/744116651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42ec0a4b80 msgr2=0x7f42ec0a7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:12.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.087+0000 7f42f4316640 1 --2- 172.21.15.12:0/744116651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42ec0a4b80 0x7f42ec0a7200 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f42dc009740 tx=0x7f42dc01c390 comp rx=0 tx=0).stop 2024-09-11T23:05:12.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.087+0000 7f42f4316640 1 -- 172.21.15.12:0/744116651 shutdown_connections 2024-09-11T23:05:12.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.087+0000 7f42f4316640 1 --2- 172.21.15.12:0/744116651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42ec0a4b80 0x7f42ec0a7200 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:12.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.087+0000 7f42f4316640 1 -- 172.21.15.12:0/744116651 >> 172.21.15.12:0/744116651 conn(0x7f42ec0ac2c0 msgr2=0x7f42ec0ac6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:12.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.087+0000 7f42f4316640 1 -- 172.21.15.12:0/744116651 shutdown_connections 2024-09-11T23:05:12.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.087+0000 7f42f4316640 1 -- 172.21.15.12:0/744116651 wait complete. 2024-09-11T23:05:12.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.087+0000 7f42f4316640 1 Processor -- start 2024-09-11T23:05:12.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.087+0000 7f42f4316640 1 -- start start 2024-09-11T23:05:12.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.087+0000 7f42f4316640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42ec0a4b80 0x7f42ec0a0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:12.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.087+0000 7f42f4316640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f42ec0a7740 con 0x7f42ec0a4b80 2024-09-11T23:05:12.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.087+0000 7f42f20b2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42ec0a4b80 0x7f42ec0a0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:12.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.087+0000 7f42f20b2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42ec0a4b80 0x7f42ec0a0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60142/0 (socket says 172.21.15.12:60142) 2024-09-11T23:05:12.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.087+0000 7f42f20b2640 1 -- 172.21.15.12:0/62483615 learned_addr learned my addr 172.21.15.12:0/62483615 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:12.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.087+0000 7f42f20b2640 1 -- 172.21.15.12:0/62483615 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42ec0a1710 con 0x7f42ec0a4b80 2024-09-11T23:05:12.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.087+0000 7f42f20b2640 1 --2- 172.21.15.12:0/62483615 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42ec0a4b80 0x7f42ec0a0fd0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f42e800c480 tx=0x7f42e800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:12.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.087+0000 7f42e2ffd640 1 -- 172.21.15.12:0/62483615 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42e8017070 con 0x7f42ec0a4b80 2024-09-11T23:05:12.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.087+0000 7f42e2ffd640 1 -- 172.21.15.12:0/62483615 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42e8005c20 con 0x7f42ec0a4b80 2024-09-11T23:05:12.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.087+0000 7f42f4316640 1 -- 172.21.15.12:0/62483615 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42ec0a1a30 con 0x7f42ec0a4b80 2024-09-11T23:05:12.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.087+0000 7f42e2ffd640 1 -- 172.21.15.12:0/62483615 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42e8007070 con 0x7f42ec0a4b80 2024-09-11T23:05:12.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.087+0000 7f42f4316640 1 -- 172.21.15.12:0/62483615 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42ec09f590 con 0x7f42ec0a4b80 2024-09-11T23:05:12.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.087+0000 7f42f4316640 1 -- 172.21.15.12:0/62483615 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42ec0a1510 con 0x7f42ec0a4b80 2024-09-11T23:05:12.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.087+0000 7f42e2ffd640 1 -- 172.21.15.12:0/62483615 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 20) ==== 44164+0+0 (secure 0 0 0) 0x7f42e801a070 con 0x7f42ec0a4b80 2024-09-11T23:05:12.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.087+0000 7f42e2ffd640 1 --2- 172.21.15.12:0/62483615 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f42d0035f20 0x7f42d00383e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:12.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.087+0000 7f42e2ffd640 1 -- 172.21.15.12:0/62483615 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4643+0+0 (secure 0 0 0) 0x7f42e8047ff0 con 0x7f42ec0a4b80 2024-09-11T23:05:12.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.087+0000 7f42f18b1640 1 --2- 172.21.15.12:0/62483615 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f42d0035f20 0x7f42d00383e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:12.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.091+0000 7f42f18b1640 1 --2- 172.21.15.12:0/62483615 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f42d0035f20 0x7f42d00383e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f42dc0ad000 tx=0x7f42dc008040 comp rx=0 tx=0).ready entity=mgr.4612 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:12.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.095+0000 7f42e2ffd640 1 -- 172.21.15.12:0/62483615 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f42e8007210 con 0x7f42ec0a4b80 2024-09-11T23:05:12.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.295+0000 7f42f4316640 1 -- 172.21.15.12:0/62483615 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f42ec09ecb0 con 0x7f42ec0a4b80 2024-09-11T23:05:12.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.295+0000 7f42e2ffd640 1 -- 172.21.15.12:0/62483615 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v30) ==== 53+0+152 (secure 0 0 0) 0x7f42e8046970 con 0x7f42ec0a4b80 2024-09-11T23:05:12.299 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T23:05:12.299 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs_b, metadata pool: cephfs_b_metadata, data pools: [cephfs_b_data ] 2024-09-11T23:05:12.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.299+0000 7f42f4316640 1 -- 172.21.15.12:0/62483615 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f42d0035f20 msgr2=0x7f42d00383e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:12.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.299+0000 7f42f4316640 1 --2- 172.21.15.12:0/62483615 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f42d0035f20 0x7f42d00383e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f42dc0ad000 tx=0x7f42dc008040 comp rx=0 tx=0).stop 2024-09-11T23:05:12.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.299+0000 7f42f4316640 1 -- 172.21.15.12:0/62483615 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42ec0a4b80 msgr2=0x7f42ec0a0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:12.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.299+0000 7f42f4316640 1 --2- 172.21.15.12:0/62483615 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42ec0a4b80 0x7f42ec0a0fd0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f42e800c480 tx=0x7f42e800c940 comp rx=0 tx=0).stop 2024-09-11T23:05:12.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.299+0000 7f42f4316640 1 -- 172.21.15.12:0/62483615 shutdown_connections 2024-09-11T23:05:12.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.299+0000 7f42f4316640 1 --2- 172.21.15.12:0/62483615 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f42d0035f20 0x7f42d00383e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:12.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.299+0000 7f42f4316640 1 --2- 172.21.15.12:0/62483615 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42ec0a4b80 0x7f42ec0a0fd0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:12.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.299+0000 7f42f4316640 1 -- 172.21.15.12:0/62483615 >> 172.21.15.12:0/62483615 conn(0x7f42ec0ac2c0 msgr2=0x7f42ec0aa560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:12.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.299+0000 7f42f4316640 1 -- 172.21.15.12:0/62483615 shutdown_connections 2024-09-11T23:05:12.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12.299+0000 7f42f4316640 1 -- 172.21.15.12:0/62483615 wait complete. 2024-09-11T23:05:12.318 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs_b; just confirmed its presence on cluster 2024-09-11T23:05:12.318 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:05:12.318 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi012.front.sepia.ceph.com 2024-09-11T23:05:12.318 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-11T23:05:12.318 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-11T23:05:12.318 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs_b 2024-09-11T23:05:12.318 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T23:05:12.318 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:05:12.318 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:05:12.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:05:12.319 DEBUG:teuthology.orchestra.run.smithi012:> ip addr 2024-09-11T23:05:12.325 INFO:teuthology.orchestra.run.smithi012.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:05:12.325 INFO:teuthology.orchestra.run.smithi012.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:05:12.325 INFO:teuthology.orchestra.run.smithi012.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:05:12.325 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:05:12.325 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 ::1/128 scope host 2024-09-11T23:05:12.325 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:05:12.326 INFO:teuthology.orchestra.run.smithi012.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:05:12.326 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a4 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:05:12.326 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f0 2024-09-11T23:05:12.326 INFO:teuthology.orchestra.run.smithi012.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:05:12.326 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a5 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:05:12.326 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f1 2024-09-11T23:05:12.326 INFO:teuthology.orchestra.run.smithi012.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:05:12.326 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:ea brd ff:ff:ff:ff:ff:ff 2024-09-11T23:05:12.326 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f0 2024-09-11T23:05:12.326 INFO:teuthology.orchestra.run.smithi012.stdout: inet 172.21.15.12/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-11T23:05:12.326 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft 42429sec preferred_lft 42429sec 2024-09-11T23:05:12.326 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::ae1f:6bff:fef8:25ea/64 scope link 2024-09-11T23:05:12.326 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:05:12.327 INFO:teuthology.orchestra.run.smithi012.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:05:12.327 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:eb brd ff:ff:ff:ff:ff:ff 2024-09-11T23:05:12.327 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f1 2024-09-11T23:05:12.327 INFO:teuthology.orchestra.run.smithi012.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-11T23:05:12.327 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 02:42:d6:75:63:83 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:05:12.327 INFO:teuthology.orchestra.run.smithi012.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-11T23:05:12.327 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:05:12.327 INFO:teuthology.orchestra.run.smithi012.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:05:12.327 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-11T23:05:12.327 INFO:teuthology.orchestra.run.smithi012.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T23:05:12.327 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:05:12.327 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-11T23:05:12.327 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:05:12.327 INFO:teuthology.orchestra.run.smithi012.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:05:12.328 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:05:12.328 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-11T23:05:12.328 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:05:12.328 INFO:teuthology.orchestra.run.smithi012.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:05:12.328 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:05:12.328 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-11T23:05:12.328 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:05:12.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:05:12.328 DEBUG:teuthology.orchestra.run.smithi012:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:05:12.379 INFO:teuthology.orchestra.run.smithi012.stdout:1 2024-09-11T23:05:12.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:05:12.380 DEBUG:teuthology.orchestra.run.smithi012:> route 2024-09-11T23:05:12.430 INFO:teuthology.orchestra.run.smithi012.stdout:Kernel IP routing table 2024-09-11T23:05:12.431 INFO:teuthology.orchestra.run.smithi012.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:05:12.431 INFO:teuthology.orchestra.run.smithi012.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-11T23:05:12.431 INFO:teuthology.orchestra.run.smithi012.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-11T23:05:12.431 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-11T23:05:12.431 INFO:teuthology.orchestra.run.smithi012.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:05:12.431 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:05:12.431 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-09-11T23:05:12.431 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-11T23:05:12.431 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-11T23:05:12.431 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-11T23:05:12.432 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-09-11T23:05:12.518 INFO:tasks.ceph.mds.a.smithi012.stderr:2024-09-11T23:05:12.515+0000 7f276699d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T23:05:12.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:05:12.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:05:12.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:05:12.555 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2024-09-11T23:05:12.561 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 1) 2024-09-11T23:05:12.561 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T23:05:12.561 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:05:12.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:05:12.562 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set brx.1 up 2024-09-11T23:05:12.616 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-11T23:05:12.616 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:05:12.616 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-11T23:05:12.665 INFO:teuthology.orchestra.run.smithi012.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:05:12.665 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:05:12.665 DEBUG:teuthology.orchestra.run.smithi012:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-11T23:05:12.717 DEBUG:teuthology.orchestra.run.smithi012:> sudo modprobe fuse 2024-09-11T23:05:12.775 DEBUG:teuthology.orchestra.run.smithi012:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:05:12.823 INFO:teuthology.orchestra.run.smithi012.stdout:/sys 2024-09-11T23:05:12.823 INFO:teuthology.orchestra.run.smithi012.stdout:/proc 2024-09-11T23:05:12.823 INFO:teuthology.orchestra.run.smithi012.stdout:/dev 2024-09-11T23:05:12.823 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/pts 2024-09-11T23:05:12.824 INFO:teuthology.orchestra.run.smithi012.stdout:/run 2024-09-11T23:05:12.824 INFO:teuthology.orchestra.run.smithi012.stdout:/ 2024-09-11T23:05:12.824 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/security 2024-09-11T23:05:12.824 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/shm 2024-09-11T23:05:12.824 INFO:teuthology.orchestra.run.smithi012.stdout:/run/lock 2024-09-11T23:05:12.824 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup 2024-09-11T23:05:12.824 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/pstore 2024-09-11T23:05:12.824 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/bpf 2024-09-11T23:05:12.824 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:05:12.824 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/hugepages 2024-09-11T23:05:12.824 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/mqueue 2024-09-11T23:05:12.824 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/debug 2024-09-11T23:05:12.825 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/tracing 2024-09-11T23:05:12.825 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/fs/nfsd 2024-09-11T23:05:12.825 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/fuse/connections 2024-09-11T23:05:12.825 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/config 2024-09-11T23:05:12.825 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:05:12.825 INFO:teuthology.orchestra.run.smithi012.stdout:/run/rpc_pipefs 2024-09-11T23:05:12.825 INFO:teuthology.orchestra.run.smithi012.stdout:/run/user/1000 2024-09-11T23:05:12.825 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph 2024-09-11T23:05:12.825 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:05:12.825 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:05:12.825 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:05:12.826 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns 2024-09-11T23:05:12.826 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:05:12.826 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:05:12.826 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:05:12.826 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:05:12.826 INFO:teuthology.orchestra.run.smithi012.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-11T23:05:12.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:05:12.827 DEBUG:teuthology.orchestra.run.smithi012:> ls /sys/fs/fuse/connections 2024-09-11T23:05:12.873 INFO:teuthology.orchestra.run.smithi012.stdout:45 2024-09-11T23:05:12.873 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [45] 2024-09-11T23:05:12.873 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1 --client_fs=cephfs_b) 2024-09-11T23:05:12.918 DEBUG:teuthology.orchestra.run.smithi012:> sudo modprobe fuse 2024-09-11T23:05:12.934 DEBUG:teuthology.orchestra.run.smithi012:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:05:12.982 INFO:teuthology.orchestra.run.smithi012.stdout:/sys 2024-09-11T23:05:12.982 INFO:teuthology.orchestra.run.smithi012.stdout:/proc 2024-09-11T23:05:12.982 INFO:teuthology.orchestra.run.smithi012.stdout:/dev 2024-09-11T23:05:12.983 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/pts 2024-09-11T23:05:12.983 INFO:teuthology.orchestra.run.smithi012.stdout:/run 2024-09-11T23:05:12.983 INFO:teuthology.orchestra.run.smithi012.stdout:/ 2024-09-11T23:05:12.983 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/security 2024-09-11T23:05:12.983 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/shm 2024-09-11T23:05:12.983 INFO:teuthology.orchestra.run.smithi012.stdout:/run/lock 2024-09-11T23:05:12.983 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup 2024-09-11T23:05:12.983 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/pstore 2024-09-11T23:05:12.983 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/bpf 2024-09-11T23:05:12.983 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:05:12.983 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/hugepages 2024-09-11T23:05:12.983 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/mqueue 2024-09-11T23:05:12.983 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/debug 2024-09-11T23:05:12.984 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/tracing 2024-09-11T23:05:12.984 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/fs/nfsd 2024-09-11T23:05:12.984 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/fuse/connections 2024-09-11T23:05:12.984 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/config 2024-09-11T23:05:12.984 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:05:12.984 INFO:teuthology.orchestra.run.smithi012.stdout:/run/rpc_pipefs 2024-09-11T23:05:12.984 INFO:teuthology.orchestra.run.smithi012.stdout:/run/user/1000 2024-09-11T23:05:12.984 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph 2024-09-11T23:05:12.984 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:05:12.984 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:05:12.984 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:05:12.984 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns 2024-09-11T23:05:12.984 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:05:12.985 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:05:12.985 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:05:12.985 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:05:12.985 INFO:teuthology.orchestra.run.smithi012.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-11T23:05:12.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:05:12.985 DEBUG:teuthology.orchestra.run.smithi012:> ls /sys/fs/fuse/connections 2024-09-11T23:05:13.000 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi012.stderr:2024-09-11T23:05:12.999+0000 7f6fcbfbf580 -1 init, newargv = 0x562ae4ce1580 newargc=15 2024-09-11T23:05:13.000 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi012.stderr:ceph-fuse[37588]: starting ceph client 2024-09-11T23:05:13.005 INFO:teuthology.orchestra.run.smithi012.stdout:45 2024-09-11T23:05:13.006 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi012.stderr:ceph-fuse[37588]: starting fuse 2024-09-11T23:05:14.106 DEBUG:teuthology.orchestra.run.smithi012:> sudo modprobe fuse 2024-09-11T23:05:14.122 DEBUG:teuthology.orchestra.run.smithi012:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:05:14.171 INFO:teuthology.orchestra.run.smithi012.stdout:/sys 2024-09-11T23:05:14.171 INFO:teuthology.orchestra.run.smithi012.stdout:/proc 2024-09-11T23:05:14.171 INFO:teuthology.orchestra.run.smithi012.stdout:/dev 2024-09-11T23:05:14.171 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/pts 2024-09-11T23:05:14.172 INFO:teuthology.orchestra.run.smithi012.stdout:/run 2024-09-11T23:05:14.172 INFO:teuthology.orchestra.run.smithi012.stdout:/ 2024-09-11T23:05:14.172 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/security 2024-09-11T23:05:14.172 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/shm 2024-09-11T23:05:14.172 INFO:teuthology.orchestra.run.smithi012.stdout:/run/lock 2024-09-11T23:05:14.172 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup 2024-09-11T23:05:14.172 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/pstore 2024-09-11T23:05:14.172 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/bpf 2024-09-11T23:05:14.172 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:05:14.172 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/hugepages 2024-09-11T23:05:14.172 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/mqueue 2024-09-11T23:05:14.172 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/debug 2024-09-11T23:05:14.173 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/tracing 2024-09-11T23:05:14.173 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/fs/nfsd 2024-09-11T23:05:14.173 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/fuse/connections 2024-09-11T23:05:14.173 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/config 2024-09-11T23:05:14.173 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:05:14.173 INFO:teuthology.orchestra.run.smithi012.stdout:/run/rpc_pipefs 2024-09-11T23:05:14.173 INFO:teuthology.orchestra.run.smithi012.stdout:/run/user/1000 2024-09-11T23:05:14.173 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph 2024-09-11T23:05:14.173 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:05:14.173 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:05:14.173 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:05:14.173 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns 2024-09-11T23:05:14.173 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:05:14.174 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:05:14.174 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:05:14.174 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:05:14.174 INFO:teuthology.orchestra.run.smithi012.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-11T23:05:14.174 INFO:teuthology.orchestra.run.smithi012.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-11T23:05:14.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:05:14.175 DEBUG:teuthology.orchestra.run.smithi012:> ls /sys/fs/fuse/connections 2024-09-11T23:05:14.221 INFO:teuthology.orchestra.run.smithi012.stdout:45 2024-09-11T23:05:14.221 INFO:teuthology.orchestra.run.smithi012.stdout:46 2024-09-11T23:05:14.221 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45, 46] 2024-09-11T23:05:14.221 DEBUG:teuthology.orchestra.run.smithi012:> sudo stdin-killer -- python3 -c ' 2024-09-11T23:05:14.221 DEBUG:teuthology.orchestra.run.smithi012:> import glob 2024-09-11T23:05:14.221 DEBUG:teuthology.orchestra.run.smithi012:> import re 2024-09-11T23:05:14.221 DEBUG:teuthology.orchestra.run.smithi012:> import os 2024-09-11T23:05:14.222 DEBUG:teuthology.orchestra.run.smithi012:> import subprocess 2024-09-11T23:05:14.222 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:05:14.222 DEBUG:teuthology.orchestra.run.smithi012:> def _find_admin_socket(client_name): 2024-09-11T23:05:14.222 DEBUG:teuthology.orchestra.run.smithi012:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-11T23:05:14.222 DEBUG:teuthology.orchestra.run.smithi012:> files = glob.glob(asok_path) 2024-09-11T23:05:14.222 DEBUG:teuthology.orchestra.run.smithi012:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-11T23:05:14.222 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:05:14.222 DEBUG:teuthology.orchestra.run.smithi012:> # Given a non-glob path, it better be there 2024-09-11T23:05:14.222 DEBUG:teuthology.orchestra.run.smithi012:> if "*" not in asok_path: 2024-09-11T23:05:14.222 DEBUG:teuthology.orchestra.run.smithi012:> assert(len(files) == 1) 2024-09-11T23:05:14.222 DEBUG:teuthology.orchestra.run.smithi012:> return files[0] 2024-09-11T23:05:14.222 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:05:14.222 DEBUG:teuthology.orchestra.run.smithi012:> for f in files: 2024-09-11T23:05:14.222 DEBUG:teuthology.orchestra.run.smithi012:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T23:05:14.222 DEBUG:teuthology.orchestra.run.smithi012:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T23:05:14.223 DEBUG:teuthology.orchestra.run.smithi012:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T23:05:14.223 DEBUG:teuthology.orchestra.run.smithi012:> contents = proc_f.read() 2024-09-11T23:05:14.223 DEBUG:teuthology.orchestra.run.smithi012:> if mountpoint in contents: 2024-09-11T23:05:14.223 DEBUG:teuthology.orchestra.run.smithi012:> return f 2024-09-11T23:05:14.223 DEBUG:teuthology.orchestra.run.smithi012:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T23:05:14.223 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:05:14.223 DEBUG:teuthology.orchestra.run.smithi012:> print(_find_admin_socket("client.1")) 2024-09-11T23:05:14.223 DEBUG:teuthology.orchestra.run.smithi012:> ' 2024-09-11T23:05:14.348 INFO:teuthology.orchestra.run.smithi012.stdout:/var/run/ceph/ceph-client.1.37588.asok 2024-09-11T23:05:14.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:05:14.361 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.37588.asok 2024-09-11T23:05:14.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:05:14.361 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.37588.asok status 2024-09-11T23:05:14.523 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T23:05:14.523 INFO:teuthology.orchestra.run.smithi012.stdout: "metadata": { 2024-09-11T23:05:14.523 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-11T23:05:14.523 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T23:05:14.524 INFO:teuthology.orchestra.run.smithi012.stdout: "entity_id": "1", 2024-09-11T23:05:14.524 INFO:teuthology.orchestra.run.smithi012.stdout: "hostname": "smithi012", 2024-09-11T23:05:14.524 INFO:teuthology.orchestra.run.smithi012.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-11T23:05:14.524 INFO:teuthology.orchestra.run.smithi012.stdout: "pid": "37588", 2024-09-11T23:05:14.524 INFO:teuthology.orchestra.run.smithi012.stdout: "root": "/" 2024-09-11T23:05:14.524 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:05:14.524 INFO:teuthology.orchestra.run.smithi012.stdout: "dentry_count": 0, 2024-09-11T23:05:14.525 INFO:teuthology.orchestra.run.smithi012.stdout: "dentry_pinned_count": 0, 2024-09-11T23:05:14.525 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4675, 2024-09-11T23:05:14.525 INFO:teuthology.orchestra.run.smithi012.stdout: "inst": { 2024-09-11T23:05:14.525 INFO:teuthology.orchestra.run.smithi012.stdout: "name": { 2024-09-11T23:05:14.525 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "client", 2024-09-11T23:05:14.525 INFO:teuthology.orchestra.run.smithi012.stdout: "num": 4675 2024-09-11T23:05:14.525 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:05:14.525 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": { 2024-09-11T23:05:14.525 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T23:05:14.525 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "192.168.0.2:0", 2024-09-11T23:05:14.525 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2758010723 2024-09-11T23:05:14.525 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:05:14.525 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:05:14.525 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": { 2024-09-11T23:05:14.526 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T23:05:14.526 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "192.168.0.2:0", 2024-09-11T23:05:14.526 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2758010723 2024-09-11T23:05:14.526 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:05:14.526 INFO:teuthology.orchestra.run.smithi012.stdout: "inst_str": "client.4675 192.168.0.2:0/2758010723", 2024-09-11T23:05:14.526 INFO:teuthology.orchestra.run.smithi012.stdout: "addr_str": "192.168.0.2:0/2758010723", 2024-09-11T23:05:14.526 INFO:teuthology.orchestra.run.smithi012.stdout: "inode_count": 1, 2024-09-11T23:05:14.526 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_epoch": 30, 2024-09-11T23:05:14.527 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_epoch": 40, 2024-09-11T23:05:14.527 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_epoch_barrier": 0, 2024-09-11T23:05:14.527 INFO:teuthology.orchestra.run.smithi012.stdout: "blocklisted": false, 2024-09-11T23:05:14.527 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs_b" 2024-09-11T23:05:14.527 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T23:05:14.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:05:14.539 DEBUG:teuthology.orchestra.run.smithi012:> stat --file-system '--printf=%T 2024-09-11T23:05:14.539 DEBUG:teuthology.orchestra.run.smithi012:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-11T23:05:14.546 INFO:teuthology.orchestra.run.smithi012.stdout:fuseblk 2024-09-11T23:05:14.546 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-11T23:05:14.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:05:14.547 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-11T23:05:14.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:05:14.601 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec cephfs-top --id=admin --dumpfs=cephfs_b) 2024-09-11T23:05:14.725 INFO:teuthology.orchestra.run.smithi012.stdout:{"cephfs_b": {}} 2024-09-11T23:05:14.734 DEBUG:teuthology.orchestra.run.smithi012:> sudo stdin-killer -- python3 -c ' 2024-09-11T23:05:14.735 DEBUG:teuthology.orchestra.run.smithi012:> import glob 2024-09-11T23:05:14.735 DEBUG:teuthology.orchestra.run.smithi012:> import re 2024-09-11T23:05:14.735 DEBUG:teuthology.orchestra.run.smithi012:> import os 2024-09-11T23:05:14.735 DEBUG:teuthology.orchestra.run.smithi012:> import subprocess 2024-09-11T23:05:14.736 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:05:14.736 DEBUG:teuthology.orchestra.run.smithi012:> def _find_admin_socket(client_name): 2024-09-11T23:05:14.736 DEBUG:teuthology.orchestra.run.smithi012:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-11T23:05:14.736 DEBUG:teuthology.orchestra.run.smithi012:> files = glob.glob(asok_path) 2024-09-11T23:05:14.736 DEBUG:teuthology.orchestra.run.smithi012:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-11T23:05:14.736 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:05:14.737 DEBUG:teuthology.orchestra.run.smithi012:> # Given a non-glob path, it better be there 2024-09-11T23:05:14.737 DEBUG:teuthology.orchestra.run.smithi012:> if "*" not in asok_path: 2024-09-11T23:05:14.737 DEBUG:teuthology.orchestra.run.smithi012:> assert(len(files) == 1) 2024-09-11T23:05:14.737 DEBUG:teuthology.orchestra.run.smithi012:> return files[0] 2024-09-11T23:05:14.737 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:05:14.737 DEBUG:teuthology.orchestra.run.smithi012:> for f in files: 2024-09-11T23:05:14.738 DEBUG:teuthology.orchestra.run.smithi012:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T23:05:14.738 DEBUG:teuthology.orchestra.run.smithi012:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T23:05:14.738 DEBUG:teuthology.orchestra.run.smithi012:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T23:05:14.738 DEBUG:teuthology.orchestra.run.smithi012:> contents = proc_f.read() 2024-09-11T23:05:14.739 DEBUG:teuthology.orchestra.run.smithi012:> if mountpoint in contents: 2024-09-11T23:05:14.739 DEBUG:teuthology.orchestra.run.smithi012:> return f 2024-09-11T23:05:14.739 DEBUG:teuthology.orchestra.run.smithi012:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T23:05:14.739 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:05:14.739 DEBUG:teuthology.orchestra.run.smithi012:> print(_find_admin_socket("client.1")) 2024-09-11T23:05:14.740 DEBUG:teuthology.orchestra.run.smithi012:> ' 2024-09-11T23:05:14.810 INFO:teuthology.orchestra.run.smithi012.stdout:/var/run/ceph/ceph-client.1.37588.asok 2024-09-11T23:05:14.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:05:14.821 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.37588.asok 2024-09-11T23:05:14.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:05:14.822 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.37588.asok mds_sessions 2024-09-11T23:05:14.983 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T23:05:14.983 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4675, 2024-09-11T23:05:14.983 INFO:teuthology.orchestra.run.smithi012.stdout: "inst": { 2024-09-11T23:05:14.983 INFO:teuthology.orchestra.run.smithi012.stdout: "name": { 2024-09-11T23:05:14.983 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "client", 2024-09-11T23:05:14.983 INFO:teuthology.orchestra.run.smithi012.stdout: "num": 4675 2024-09-11T23:05:14.984 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:05:14.984 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": { 2024-09-11T23:05:14.984 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T23:05:14.984 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "192.168.0.2:0", 2024-09-11T23:05:14.984 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2758010723 2024-09-11T23:05:14.984 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:05:14.984 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:05:14.984 INFO:teuthology.orchestra.run.smithi012.stdout: "inst_str": "client.4675 v1:192.168.0.2:0/2758010723", 2024-09-11T23:05:14.984 INFO:teuthology.orchestra.run.smithi012.stdout: "addr_str": "v1:192.168.0.2:0/2758010723", 2024-09-11T23:05:14.984 INFO:teuthology.orchestra.run.smithi012.stdout: "sessions": [ 2024-09-11T23:05:14.985 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:05:14.985 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": 0, 2024-09-11T23:05:14.985 INFO:teuthology.orchestra.run.smithi012.stdout: "addrs": { 2024-09-11T23:05:14.985 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T23:05:14.985 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:05:14.985 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T23:05:14.985 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6826", 2024-09-11T23:05:14.985 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1887547537 2024-09-11T23:05:14.985 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:05:14.985 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:05:14.985 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T23:05:14.985 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6827", 2024-09-11T23:05:14.986 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1887547537 2024-09-11T23:05:14.986 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:05:14.986 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T23:05:14.986 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:05:14.986 INFO:teuthology.orchestra.run.smithi012.stdout: "seq": 0, 2024-09-11T23:05:14.986 INFO:teuthology.orchestra.run.smithi012.stdout: "cap_gen": 0, 2024-09-11T23:05:14.986 INFO:teuthology.orchestra.run.smithi012.stdout: "cap_ttl": "2024-09-11T23:06:14.003667+0000", 2024-09-11T23:05:14.986 INFO:teuthology.orchestra.run.smithi012.stdout: "last_cap_renew_request": "2024-09-11T23:05:14.003667+0000", 2024-09-11T23:05:14.986 INFO:teuthology.orchestra.run.smithi012.stdout: "cap_renew_seq": 2, 2024-09-11T23:05:14.986 INFO:teuthology.orchestra.run.smithi012.stdout: "num_caps": 1, 2024-09-11T23:05:14.986 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "open" 2024-09-11T23:05:14.986 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:05:14.986 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-11T23:05:14.987 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 30 2024-09-11T23:05:14.987 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T23:05:16.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:05:16.000 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec cephfs-top --id=admin --dumpfs=cephfs_b) 2024-09-11T23:05:16.090 INFO:teuthology.orchestra.run.smithi012.stdout:{"cephfs_b": {}} 2024-09-11T23:05:16.099 DEBUG:teuthology.orchestra.run.smithi012:> sudo stdin-killer -- python3 -c ' 2024-09-11T23:05:16.100 DEBUG:teuthology.orchestra.run.smithi012:> import glob 2024-09-11T23:05:16.100 DEBUG:teuthology.orchestra.run.smithi012:> import re 2024-09-11T23:05:16.100 DEBUG:teuthology.orchestra.run.smithi012:> import os 2024-09-11T23:05:16.100 DEBUG:teuthology.orchestra.run.smithi012:> import subprocess 2024-09-11T23:05:16.101 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:05:16.101 DEBUG:teuthology.orchestra.run.smithi012:> def _find_admin_socket(client_name): 2024-09-11T23:05:16.101 DEBUG:teuthology.orchestra.run.smithi012:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-11T23:05:16.101 DEBUG:teuthology.orchestra.run.smithi012:> files = glob.glob(asok_path) 2024-09-11T23:05:16.101 DEBUG:teuthology.orchestra.run.smithi012:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-11T23:05:16.102 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:05:16.102 DEBUG:teuthology.orchestra.run.smithi012:> # Given a non-glob path, it better be there 2024-09-11T23:05:16.102 DEBUG:teuthology.orchestra.run.smithi012:> if "*" not in asok_path: 2024-09-11T23:05:16.102 DEBUG:teuthology.orchestra.run.smithi012:> assert(len(files) == 1) 2024-09-11T23:05:16.102 DEBUG:teuthology.orchestra.run.smithi012:> return files[0] 2024-09-11T23:05:16.102 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:05:16.102 DEBUG:teuthology.orchestra.run.smithi012:> for f in files: 2024-09-11T23:05:16.102 DEBUG:teuthology.orchestra.run.smithi012:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T23:05:16.102 DEBUG:teuthology.orchestra.run.smithi012:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T23:05:16.102 DEBUG:teuthology.orchestra.run.smithi012:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T23:05:16.102 DEBUG:teuthology.orchestra.run.smithi012:> contents = proc_f.read() 2024-09-11T23:05:16.102 DEBUG:teuthology.orchestra.run.smithi012:> if mountpoint in contents: 2024-09-11T23:05:16.103 DEBUG:teuthology.orchestra.run.smithi012:> return f 2024-09-11T23:05:16.103 DEBUG:teuthology.orchestra.run.smithi012:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T23:05:16.103 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:05:16.103 DEBUG:teuthology.orchestra.run.smithi012:> print(_find_admin_socket("client.1")) 2024-09-11T23:05:16.103 DEBUG:teuthology.orchestra.run.smithi012:> ' 2024-09-11T23:05:16.175 INFO:teuthology.orchestra.run.smithi012.stdout:/var/run/ceph/ceph-client.1.37588.asok 2024-09-11T23:05:16.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:05:16.187 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.37588.asok 2024-09-11T23:05:16.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:05:16.187 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.37588.asok mds_sessions 2024-09-11T23:05:16.337 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T23:05:16.337 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4675, 2024-09-11T23:05:16.337 INFO:teuthology.orchestra.run.smithi012.stdout: "inst": { 2024-09-11T23:05:16.337 INFO:teuthology.orchestra.run.smithi012.stdout: "name": { 2024-09-11T23:05:16.337 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "client", 2024-09-11T23:05:16.337 INFO:teuthology.orchestra.run.smithi012.stdout: "num": 4675 2024-09-11T23:05:16.337 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:05:16.337 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": { 2024-09-11T23:05:16.337 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T23:05:16.338 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "192.168.0.2:0", 2024-09-11T23:05:16.338 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2758010723 2024-09-11T23:05:16.338 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:05:16.338 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:05:16.338 INFO:teuthology.orchestra.run.smithi012.stdout: "inst_str": "client.4675 v1:192.168.0.2:0/2758010723", 2024-09-11T23:05:16.338 INFO:teuthology.orchestra.run.smithi012.stdout: "addr_str": "v1:192.168.0.2:0/2758010723", 2024-09-11T23:05:16.338 INFO:teuthology.orchestra.run.smithi012.stdout: "sessions": [ 2024-09-11T23:05:16.338 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:05:16.338 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": 0, 2024-09-11T23:05:16.338 INFO:teuthology.orchestra.run.smithi012.stdout: "addrs": { 2024-09-11T23:05:16.339 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T23:05:16.339 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:05:16.339 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T23:05:16.339 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6826", 2024-09-11T23:05:16.339 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1887547537 2024-09-11T23:05:16.339 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:05:16.339 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:05:16.339 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T23:05:16.339 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6827", 2024-09-11T23:05:16.339 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1887547537 2024-09-11T23:05:16.339 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:05:16.340 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T23:05:16.340 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:05:16.340 INFO:teuthology.orchestra.run.smithi012.stdout: "seq": 0, 2024-09-11T23:05:16.340 INFO:teuthology.orchestra.run.smithi012.stdout: "cap_gen": 0, 2024-09-11T23:05:16.340 INFO:teuthology.orchestra.run.smithi012.stdout: "cap_ttl": "2024-09-11T23:06:14.003667+0000", 2024-09-11T23:05:16.340 INFO:teuthology.orchestra.run.smithi012.stdout: "last_cap_renew_request": "2024-09-11T23:05:14.003667+0000", 2024-09-11T23:05:16.340 INFO:teuthology.orchestra.run.smithi012.stdout: "cap_renew_seq": 2, 2024-09-11T23:05:16.340 INFO:teuthology.orchestra.run.smithi012.stdout: "num_caps": 1, 2024-09-11T23:05:16.340 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "open" 2024-09-11T23:05:16.340 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:05:16.340 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-11T23:05:16.340 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 30 2024-09-11T23:05:16.340 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T23:05:17.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:05:17.353 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec cephfs-top --id=admin --dumpfs=cephfs_b) 2024-09-11T23:05:17.445 INFO:teuthology.orchestra.run.smithi012.stdout:{"cephfs_b": {}} 2024-09-11T23:05:17.454 DEBUG:teuthology.orchestra.run.smithi012:> sudo stdin-killer -- python3 -c ' 2024-09-11T23:05:17.454 DEBUG:teuthology.orchestra.run.smithi012:> import glob 2024-09-11T23:05:17.454 DEBUG:teuthology.orchestra.run.smithi012:> import re 2024-09-11T23:05:17.454 DEBUG:teuthology.orchestra.run.smithi012:> import os 2024-09-11T23:05:17.454 DEBUG:teuthology.orchestra.run.smithi012:> import subprocess 2024-09-11T23:05:17.454 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:05:17.454 DEBUG:teuthology.orchestra.run.smithi012:> def _find_admin_socket(client_name): 2024-09-11T23:05:17.454 DEBUG:teuthology.orchestra.run.smithi012:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-11T23:05:17.455 DEBUG:teuthology.orchestra.run.smithi012:> files = glob.glob(asok_path) 2024-09-11T23:05:17.455 DEBUG:teuthology.orchestra.run.smithi012:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-11T23:05:17.455 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:05:17.455 DEBUG:teuthology.orchestra.run.smithi012:> # Given a non-glob path, it better be there 2024-09-11T23:05:17.455 DEBUG:teuthology.orchestra.run.smithi012:> if "*" not in asok_path: 2024-09-11T23:05:17.455 DEBUG:teuthology.orchestra.run.smithi012:> assert(len(files) == 1) 2024-09-11T23:05:17.455 DEBUG:teuthology.orchestra.run.smithi012:> return files[0] 2024-09-11T23:05:17.455 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:05:17.455 DEBUG:teuthology.orchestra.run.smithi012:> for f in files: 2024-09-11T23:05:17.455 DEBUG:teuthology.orchestra.run.smithi012:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T23:05:17.455 DEBUG:teuthology.orchestra.run.smithi012:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T23:05:17.455 DEBUG:teuthology.orchestra.run.smithi012:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T23:05:17.455 DEBUG:teuthology.orchestra.run.smithi012:> contents = proc_f.read() 2024-09-11T23:05:17.455 DEBUG:teuthology.orchestra.run.smithi012:> if mountpoint in contents: 2024-09-11T23:05:17.456 DEBUG:teuthology.orchestra.run.smithi012:> return f 2024-09-11T23:05:17.456 DEBUG:teuthology.orchestra.run.smithi012:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T23:05:17.456 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:05:17.456 DEBUG:teuthology.orchestra.run.smithi012:> print(_find_admin_socket("client.1")) 2024-09-11T23:05:17.456 DEBUG:teuthology.orchestra.run.smithi012:> ' 2024-09-11T23:05:17.526 INFO:teuthology.orchestra.run.smithi012.stdout:/var/run/ceph/ceph-client.1.37588.asok 2024-09-11T23:05:17.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:05:17.538 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.37588.asok 2024-09-11T23:05:17.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:05:17.538 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.37588.asok mds_sessions 2024-09-11T23:05:17.693 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T23:05:17.694 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4675, 2024-09-11T23:05:17.694 INFO:teuthology.orchestra.run.smithi012.stdout: "inst": { 2024-09-11T23:05:17.694 INFO:teuthology.orchestra.run.smithi012.stdout: "name": { 2024-09-11T23:05:17.694 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "client", 2024-09-11T23:05:17.694 INFO:teuthology.orchestra.run.smithi012.stdout: "num": 4675 2024-09-11T23:05:17.694 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:05:17.694 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": { 2024-09-11T23:05:17.694 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T23:05:17.694 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "192.168.0.2:0", 2024-09-11T23:05:17.694 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2758010723 2024-09-11T23:05:17.694 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:05:17.694 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:05:17.694 INFO:teuthology.orchestra.run.smithi012.stdout: "inst_str": "client.4675 v1:192.168.0.2:0/2758010723", 2024-09-11T23:05:17.695 INFO:teuthology.orchestra.run.smithi012.stdout: "addr_str": "v1:192.168.0.2:0/2758010723", 2024-09-11T23:05:17.695 INFO:teuthology.orchestra.run.smithi012.stdout: "sessions": [ 2024-09-11T23:05:17.695 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:05:17.695 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": 0, 2024-09-11T23:05:17.695 INFO:teuthology.orchestra.run.smithi012.stdout: "addrs": { 2024-09-11T23:05:17.695 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T23:05:17.695 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:05:17.695 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T23:05:17.695 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6826", 2024-09-11T23:05:17.695 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1887547537 2024-09-11T23:05:17.695 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:05:17.695 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:05:17.695 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T23:05:17.695 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6827", 2024-09-11T23:05:17.696 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1887547537 2024-09-11T23:05:17.696 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:05:17.696 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T23:05:17.696 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:05:17.696 INFO:teuthology.orchestra.run.smithi012.stdout: "seq": 0, 2024-09-11T23:05:17.696 INFO:teuthology.orchestra.run.smithi012.stdout: "cap_gen": 0, 2024-09-11T23:05:17.696 INFO:teuthology.orchestra.run.smithi012.stdout: "cap_ttl": "2024-09-11T23:06:14.003667+0000", 2024-09-11T23:05:17.696 INFO:teuthology.orchestra.run.smithi012.stdout: "last_cap_renew_request": "2024-09-11T23:05:14.003667+0000", 2024-09-11T23:05:17.696 INFO:teuthology.orchestra.run.smithi012.stdout: "cap_renew_seq": 2, 2024-09-11T23:05:17.696 INFO:teuthology.orchestra.run.smithi012.stdout: "num_caps": 1, 2024-09-11T23:05:17.696 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "open" 2024-09-11T23:05:17.697 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:05:17.697 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-11T23:05:17.697 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 30 2024-09-11T23:05:17.697 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T23:05:18.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:05:18.708 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec cephfs-top --id=admin --dumpfs=cephfs_b) 2024-09-11T23:05:18.800 INFO:teuthology.orchestra.run.smithi012.stdout:{"cephfs_b": {}} 2024-09-11T23:05:18.809 DEBUG:teuthology.orchestra.run.smithi012:> sudo stdin-killer -- python3 -c ' 2024-09-11T23:05:18.809 DEBUG:teuthology.orchestra.run.smithi012:> import glob 2024-09-11T23:05:18.809 DEBUG:teuthology.orchestra.run.smithi012:> import re 2024-09-11T23:05:18.809 DEBUG:teuthology.orchestra.run.smithi012:> import os 2024-09-11T23:05:18.809 DEBUG:teuthology.orchestra.run.smithi012:> import subprocess 2024-09-11T23:05:18.809 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:05:18.809 DEBUG:teuthology.orchestra.run.smithi012:> def _find_admin_socket(client_name): 2024-09-11T23:05:18.809 DEBUG:teuthology.orchestra.run.smithi012:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-11T23:05:18.809 DEBUG:teuthology.orchestra.run.smithi012:> files = glob.glob(asok_path) 2024-09-11T23:05:18.809 DEBUG:teuthology.orchestra.run.smithi012:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-11T23:05:18.810 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:05:18.810 DEBUG:teuthology.orchestra.run.smithi012:> # Given a non-glob path, it better be there 2024-09-11T23:05:18.810 DEBUG:teuthology.orchestra.run.smithi012:> if "*" not in asok_path: 2024-09-11T23:05:18.810 DEBUG:teuthology.orchestra.run.smithi012:> assert(len(files) == 1) 2024-09-11T23:05:18.810 DEBUG:teuthology.orchestra.run.smithi012:> return files[0] 2024-09-11T23:05:18.810 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:05:18.810 DEBUG:teuthology.orchestra.run.smithi012:> for f in files: 2024-09-11T23:05:18.810 DEBUG:teuthology.orchestra.run.smithi012:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T23:05:18.810 DEBUG:teuthology.orchestra.run.smithi012:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T23:05:18.810 DEBUG:teuthology.orchestra.run.smithi012:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T23:05:18.810 DEBUG:teuthology.orchestra.run.smithi012:> contents = proc_f.read() 2024-09-11T23:05:18.810 DEBUG:teuthology.orchestra.run.smithi012:> if mountpoint in contents: 2024-09-11T23:05:18.810 DEBUG:teuthology.orchestra.run.smithi012:> return f 2024-09-11T23:05:18.810 DEBUG:teuthology.orchestra.run.smithi012:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T23:05:18.810 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:05:18.811 DEBUG:teuthology.orchestra.run.smithi012:> print(_find_admin_socket("client.1")) 2024-09-11T23:05:18.811 DEBUG:teuthology.orchestra.run.smithi012:> ' 2024-09-11T23:05:18.883 INFO:teuthology.orchestra.run.smithi012.stdout:/var/run/ceph/ceph-client.1.37588.asok 2024-09-11T23:05:18.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:05:18.895 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.37588.asok 2024-09-11T23:05:18.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:05:18.895 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.37588.asok mds_sessions 2024-09-11T23:05:19.049 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T23:05:19.049 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4675, 2024-09-11T23:05:19.049 INFO:teuthology.orchestra.run.smithi012.stdout: "inst": { 2024-09-11T23:05:19.049 INFO:teuthology.orchestra.run.smithi012.stdout: "name": { 2024-09-11T23:05:19.049 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "client", 2024-09-11T23:05:19.049 INFO:teuthology.orchestra.run.smithi012.stdout: "num": 4675 2024-09-11T23:05:19.049 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:05:19.049 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": { 2024-09-11T23:05:19.050 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T23:05:19.050 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "192.168.0.2:0", 2024-09-11T23:05:19.050 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2758010723 2024-09-11T23:05:19.050 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:05:19.050 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:05:19.050 INFO:teuthology.orchestra.run.smithi012.stdout: "inst_str": "client.4675 v1:192.168.0.2:0/2758010723", 2024-09-11T23:05:19.050 INFO:teuthology.orchestra.run.smithi012.stdout: "addr_str": "v1:192.168.0.2:0/2758010723", 2024-09-11T23:05:19.050 INFO:teuthology.orchestra.run.smithi012.stdout: "sessions": [ 2024-09-11T23:05:19.050 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:05:19.050 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": 0, 2024-09-11T23:05:19.050 INFO:teuthology.orchestra.run.smithi012.stdout: "addrs": { 2024-09-11T23:05:19.051 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T23:05:19.051 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:05:19.051 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T23:05:19.051 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6826", 2024-09-11T23:05:19.051 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1887547537 2024-09-11T23:05:19.051 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:05:19.051 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:05:19.051 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T23:05:19.051 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6827", 2024-09-11T23:05:19.051 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1887547537 2024-09-11T23:05:19.051 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:05:19.051 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T23:05:19.052 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:05:19.052 INFO:teuthology.orchestra.run.smithi012.stdout: "seq": 0, 2024-09-11T23:05:19.052 INFO:teuthology.orchestra.run.smithi012.stdout: "cap_gen": 0, 2024-09-11T23:05:19.052 INFO:teuthology.orchestra.run.smithi012.stdout: "cap_ttl": "2024-09-11T23:06:14.003667+0000", 2024-09-11T23:05:19.052 INFO:teuthology.orchestra.run.smithi012.stdout: "last_cap_renew_request": "2024-09-11T23:05:14.003667+0000", 2024-09-11T23:05:19.052 INFO:teuthology.orchestra.run.smithi012.stdout: "cap_renew_seq": 2, 2024-09-11T23:05:19.052 INFO:teuthology.orchestra.run.smithi012.stdout: "num_caps": 1, 2024-09-11T23:05:19.052 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "open" 2024-09-11T23:05:19.052 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:05:19.052 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-11T23:05:19.052 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 30 2024-09-11T23:05:19.052 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T23:05:20.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:05:20.064 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec cephfs-top --id=admin --dumpfs=cephfs_b) 2024-09-11T23:05:20.152 INFO:teuthology.orchestra.run.smithi012.stdout:{"cephfs_b": {"4675": {"mount_root": "/", "chit": 66.67, "dlease": 0.0, "ofiles": "0", "oicaps": "1", "oinodes": "0", "rtio": 0.0, "raio": 0.0, "rsp": 0.0, "wtio": 0.0, "waio": 0.0, "wsp": 0.0, "rlatavg": 0.0, "rlatsd": 0.0, "wlatavg": 0.0, "wlatsd": 0.0, "mlatavg": 0.6, "mlatsd": 0.06, "mount_point@host/addr": "/home/ubuntu/cephtest/mnt.1@smithi012/192.168.0.2"}}} 2024-09-11T23:05:20.161 DEBUG:teuthology.orchestra.run.smithi012:> sudo stdin-killer -- python3 -c ' 2024-09-11T23:05:20.162 DEBUG:teuthology.orchestra.run.smithi012:> import glob 2024-09-11T23:05:20.162 DEBUG:teuthology.orchestra.run.smithi012:> import re 2024-09-11T23:05:20.162 DEBUG:teuthology.orchestra.run.smithi012:> import os 2024-09-11T23:05:20.162 DEBUG:teuthology.orchestra.run.smithi012:> import subprocess 2024-09-11T23:05:20.162 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:05:20.162 DEBUG:teuthology.orchestra.run.smithi012:> def _find_admin_socket(client_name): 2024-09-11T23:05:20.162 DEBUG:teuthology.orchestra.run.smithi012:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-11T23:05:20.162 DEBUG:teuthology.orchestra.run.smithi012:> files = glob.glob(asok_path) 2024-09-11T23:05:20.162 DEBUG:teuthology.orchestra.run.smithi012:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-11T23:05:20.162 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:05:20.162 DEBUG:teuthology.orchestra.run.smithi012:> # Given a non-glob path, it better be there 2024-09-11T23:05:20.162 DEBUG:teuthology.orchestra.run.smithi012:> if "*" not in asok_path: 2024-09-11T23:05:20.162 DEBUG:teuthology.orchestra.run.smithi012:> assert(len(files) == 1) 2024-09-11T23:05:20.162 DEBUG:teuthology.orchestra.run.smithi012:> return files[0] 2024-09-11T23:05:20.163 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:05:20.163 DEBUG:teuthology.orchestra.run.smithi012:> for f in files: 2024-09-11T23:05:20.163 DEBUG:teuthology.orchestra.run.smithi012:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T23:05:20.163 DEBUG:teuthology.orchestra.run.smithi012:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T23:05:20.163 DEBUG:teuthology.orchestra.run.smithi012:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T23:05:20.163 DEBUG:teuthology.orchestra.run.smithi012:> contents = proc_f.read() 2024-09-11T23:05:20.163 DEBUG:teuthology.orchestra.run.smithi012:> if mountpoint in contents: 2024-09-11T23:05:20.163 DEBUG:teuthology.orchestra.run.smithi012:> return f 2024-09-11T23:05:20.163 DEBUG:teuthology.orchestra.run.smithi012:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T23:05:20.163 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:05:20.163 DEBUG:teuthology.orchestra.run.smithi012:> print(_find_admin_socket("client.1")) 2024-09-11T23:05:20.163 DEBUG:teuthology.orchestra.run.smithi012:> ' 2024-09-11T23:05:20.227 INFO:teuthology.orchestra.run.smithi012.stdout:/var/run/ceph/ceph-client.1.37588.asok 2024-09-11T23:05:20.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:05:20.238 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.37588.asok 2024-09-11T23:05:20.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:05:20.238 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.37588.asok mds_sessions 2024-09-11T23:05:20.392 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T23:05:20.393 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4675, 2024-09-11T23:05:20.393 INFO:teuthology.orchestra.run.smithi012.stdout: "inst": { 2024-09-11T23:05:20.393 INFO:teuthology.orchestra.run.smithi012.stdout: "name": { 2024-09-11T23:05:20.393 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "client", 2024-09-11T23:05:20.393 INFO:teuthology.orchestra.run.smithi012.stdout: "num": 4675 2024-09-11T23:05:20.393 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:05:20.393 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": { 2024-09-11T23:05:20.393 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T23:05:20.393 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "192.168.0.2:0", 2024-09-11T23:05:20.393 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2758010723 2024-09-11T23:05:20.393 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:05:20.393 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:05:20.394 INFO:teuthology.orchestra.run.smithi012.stdout: "inst_str": "client.4675 v1:192.168.0.2:0/2758010723", 2024-09-11T23:05:20.394 INFO:teuthology.orchestra.run.smithi012.stdout: "addr_str": "v1:192.168.0.2:0/2758010723", 2024-09-11T23:05:20.394 INFO:teuthology.orchestra.run.smithi012.stdout: "sessions": [ 2024-09-11T23:05:20.394 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:05:20.394 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": 0, 2024-09-11T23:05:20.394 INFO:teuthology.orchestra.run.smithi012.stdout: "addrs": { 2024-09-11T23:05:20.394 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-11T23:05:20.394 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:05:20.394 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-11T23:05:20.394 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6826", 2024-09-11T23:05:20.394 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1887547537 2024-09-11T23:05:20.394 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:05:20.394 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:05:20.394 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T23:05:20.395 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6827", 2024-09-11T23:05:20.395 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1887547537 2024-09-11T23:05:20.395 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:05:20.395 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T23:05:20.395 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:05:20.395 INFO:teuthology.orchestra.run.smithi012.stdout: "seq": 0, 2024-09-11T23:05:20.395 INFO:teuthology.orchestra.run.smithi012.stdout: "cap_gen": 0, 2024-09-11T23:05:20.395 INFO:teuthology.orchestra.run.smithi012.stdout: "cap_ttl": "2024-09-11T23:06:14.003667+0000", 2024-09-11T23:05:20.395 INFO:teuthology.orchestra.run.smithi012.stdout: "last_cap_renew_request": "2024-09-11T23:05:14.003667+0000", 2024-09-11T23:05:20.395 INFO:teuthology.orchestra.run.smithi012.stdout: "cap_renew_seq": 2, 2024-09-11T23:05:20.395 INFO:teuthology.orchestra.run.smithi012.stdout: "num_caps": 1, 2024-09-11T23:05:20.395 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "open" 2024-09-11T23:05:20.395 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:05:20.395 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-11T23:05:20.396 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 30 2024-09-11T23:05:20.396 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T23:05:20.406 DEBUG:tasks.cephfs.test_fstop:metrics={'cephfs_b': {'4675': {'mount_root': '/', 'chit': 66.67, 'dlease': 0.0, 'ofiles': '0', 'oicaps': '1', 'oinodes': '0', 'rtio': 0.0, 'raio': 0.0, 'rsp': 0.0, 'wtio': 0.0, 'waio': 0.0, 'wsp': 0.0, 'rlatavg': 0.0, 'rlatsd': 0.0, 'wlatavg': 0.0, 'wlatsd': 0.0, 'mlatavg': 0.6, 'mlatsd': 0.06, 'mount_point@host/addr': '/home/ubuntu/cephtest/mnt.1@smithi012/192.168.0.2'}}} 2024-09-11T23:05:20.407 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T23:05:20.407 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:05:20.413 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:05:20.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.583+0000 7f3c62653640 1 Processor -- start 2024-09-11T23:05:20.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.583+0000 7f3c62653640 1 -- start start 2024-09-11T23:05:20.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.583+0000 7f3c62653640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3c5c1381c0 0x7f3c5c13cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:20.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.583+0000 7f3c62653640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c5c09d690 con 0x7f3c5c137de0 2024-09-11T23:05:20.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.583+0000 7f3c62653640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f3c5c09ea90 con 0x7f3c5c1381c0 2024-09-11T23:05:20.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.583+0000 7f3c5bfff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f3c5c137de0 0x7f3c5c09f190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51356/0 (socket says 172.21.15.12:51356) 2024-09-11T23:05:20.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.583+0000 7f3c5b7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3c5c1381c0 0x7f3c5c13cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:20.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.583+0000 7f3c5bfff640 1 -- 172.21.15.12:0/1078902880 learned_addr learned my addr 172.21.15.12:0/1078902880 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:20.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.583+0000 7f3c5b7fe640 1 -- 172.21.15.12:0/1078902880 >> v1:172.21.15.12:6789/0 conn(0x7f3c5c137de0 legacy=0x7f3c5c09f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:20.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.583+0000 7f3c5b7fe640 1 -- 172.21.15.12:0/1078902880 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c5c09cf00 con 0x7f3c5c1381c0 2024-09-11T23:05:20.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.587+0000 7f3c5b7fe640 1 --2- 172.21.15.12:0/1078902880 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c5c1381c0 0x7f3c5c13cbc0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f3c50009740 tx=0x7f3c5001c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95fdbef83414c2bb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:20.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.587+0000 7f3c5affd640 1 -- 172.21.15.12:0/1078902880 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c500b0070 con 0x7f3c5c1381c0 2024-09-11T23:05:20.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.587+0000 7f3c5affd640 1 -- 172.21.15.12:0/1078902880 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c500ab530 con 0x7f3c5c1381c0 2024-09-11T23:05:20.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.587+0000 7f3c5affd640 1 -- 172.21.15.12:0/1078902880 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c500ab830 con 0x7f3c5c1381c0 2024-09-11T23:05:20.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.587+0000 7f3c62653640 1 -- 172.21.15.12:0/1078902880 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c5c1381c0 msgr2=0x7f3c5c13cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:20.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.587+0000 7f3c62653640 1 --2- 172.21.15.12:0/1078902880 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c5c1381c0 0x7f3c5c13cbc0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f3c50009740 tx=0x7f3c5001c390 comp rx=0 tx=0).stop 2024-09-11T23:05:20.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.587+0000 7f3c62653640 1 -- 172.21.15.12:0/1078902880 shutdown_connections 2024-09-11T23:05:20.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.587+0000 7f3c62653640 1 --2- 172.21.15.12:0/1078902880 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c5c1381c0 0x7f3c5c13cbc0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:20.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.587+0000 7f3c62653640 1 -- 172.21.15.12:0/1078902880 >> 172.21.15.12:0/1078902880 conn(0x7f3c5c0a82f0 msgr2=0x7f3c5c0a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:20.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.587+0000 7f3c62653640 1 -- 172.21.15.12:0/1078902880 shutdown_connections 2024-09-11T23:05:20.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.587+0000 7f3c62653640 1 -- 172.21.15.12:0/1078902880 wait complete. 2024-09-11T23:05:20.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.587+0000 7f3c62653640 1 Processor -- start 2024-09-11T23:05:20.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.587+0000 7f3c62653640 1 -- start start 2024-09-11T23:05:20.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.587+0000 7f3c62653640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c5c137de0 0x7f3c5c06fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:20.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.587+0000 7f3c62653640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3c5c137860 con 0x7f3c5c137de0 2024-09-11T23:05:20.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.587+0000 7f3c5bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c5c137de0 0x7f3c5c06fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:20.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.587+0000 7f3c5bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c5c137de0 0x7f3c5c06fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50424/0 (socket says 172.21.15.12:50424) 2024-09-11T23:05:20.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.587+0000 7f3c5bfff640 1 -- 172.21.15.12:0/2083729199 learned_addr learned my addr 172.21.15.12:0/2083729199 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:20.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.587+0000 7f3c5bfff640 1 -- 172.21.15.12:0/2083729199 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c5c11eaf0 con 0x7f3c5c137de0 2024-09-11T23:05:20.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.587+0000 7f3c5bfff640 1 --2- 172.21.15.12:0/2083729199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c5c137de0 0x7f3c5c06fd40 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f3c5400cb40 tx=0x7f3c5400cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:20.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.587+0000 7f3c58ff9640 1 -- 172.21.15.12:0/2083729199 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c54017070 con 0x7f3c5c137de0 2024-09-11T23:05:20.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.587+0000 7f3c58ff9640 1 -- 172.21.15.12:0/2083729199 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c5400ab30 con 0x7f3c5c137de0 2024-09-11T23:05:20.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.587+0000 7f3c62653640 1 -- 172.21.15.12:0/2083729199 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c5c072550 con 0x7f3c5c137de0 2024-09-11T23:05:20.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.587+0000 7f3c58ff9640 1 -- 172.21.15.12:0/2083729199 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c5400ae10 con 0x7f3c5c137de0 2024-09-11T23:05:20.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.587+0000 7f3c62653640 1 -- 172.21.15.12:0/2083729199 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c5c071990 con 0x7f3c5c137de0 2024-09-11T23:05:20.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.591+0000 7f3c58ff9640 1 -- 172.21.15.12:0/2083729199 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 20) ==== 44164+0+0 (secure 0 0 0) 0x7f3c5401a070 con 0x7f3c5c137de0 2024-09-11T23:05:20.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.591+0000 7f3c62653640 1 -- 172.21.15.12:0/2083729199 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c5c071c70 con 0x7f3c5c137de0 2024-09-11T23:05:20.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.591+0000 7f3c58ff9640 1 --2- 172.21.15.12:0/2083729199 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f3c48035ed0 0x7f3c48038390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:20.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.591+0000 7f3c58ff9640 1 -- 172.21.15.12:0/2083729199 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4643+0+0 (secure 0 0 0) 0x7f3c540489d0 con 0x7f3c5c137de0 2024-09-11T23:05:20.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.591+0000 7f3c5b7fe640 1 --2- 172.21.15.12:0/2083729199 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f3c48035ed0 0x7f3c48038390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:20.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.591+0000 7f3c5b7fe640 1 --2- 172.21.15.12:0/2083729199 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f3c48035ed0 0x7f3c48038390 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3c500ad000 tx=0x7f3c500a6000 comp rx=0 tx=0).ready entity=mgr.4612 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:20.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.595+0000 7f3c58ff9640 1 -- 172.21.15.12:0/2083729199 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3c54012ca0 con 0x7f3c5c137de0 2024-09-11T23:05:20.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.771+0000 7f3c62653640 1 -- 172.21.15.12:0/2083729199 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3c5c09f190 con 0x7f3c5c137de0 2024-09-11T23:05:20.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.771+0000 7f3c58ff9640 1 -- 172.21.15.12:0/2083729199 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v40) ==== 80+0+466 (secure 0 0 0) 0x7f3c5401a360 con 0x7f3c5c137de0 2024-09-11T23:05:20.774 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/2509166838 2024-09-12T23:05:06.494857+0000 2024-09-11T23:05:20.774 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:6825/718802078 2024-09-12T23:05:06.494857+0000 2024-09-11T23:05:20.774 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:6824/718802078 2024-09-12T23:05:06.494857+0000 2024-09-11T23:05:20.774 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/2490570290 2024-09-12T23:05:06.494857+0000 2024-09-11T23:05:20.774 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/2957476143 2024-09-12T23:05:06.494857+0000 2024-09-11T23:05:20.774 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/37905181 2024-09-12T23:05:06.494857+0000 2024-09-11T23:05:20.774 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/3294231065 2024-09-12T23:05:06.494857+0000 2024-09-11T23:05:20.774 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/2407367943 2024-09-12T23:05:06.494857+0000 2024-09-11T23:05:20.775 INFO:teuthology.orchestra.run.smithi012.stderr:listed 8 entries 2024-09-11T23:05:20.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.771+0000 7f3c62653640 1 -- 172.21.15.12:0/2083729199 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f3c48035ed0 msgr2=0x7f3c48038390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:20.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.771+0000 7f3c62653640 1 --2- 172.21.15.12:0/2083729199 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f3c48035ed0 0x7f3c48038390 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3c500ad000 tx=0x7f3c500a6000 comp rx=0 tx=0).stop 2024-09-11T23:05:20.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.771+0000 7f3c62653640 1 -- 172.21.15.12:0/2083729199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c5c137de0 msgr2=0x7f3c5c06fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:20.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.771+0000 7f3c62653640 1 --2- 172.21.15.12:0/2083729199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c5c137de0 0x7f3c5c06fd40 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f3c5400cb40 tx=0x7f3c5400cf40 comp rx=0 tx=0).stop 2024-09-11T23:05:20.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.771+0000 7f3c62653640 1 -- 172.21.15.12:0/2083729199 shutdown_connections 2024-09-11T23:05:20.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.775+0000 7f3c62653640 1 --2- 172.21.15.12:0/2083729199 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f3c48035ed0 0x7f3c48038390 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:20.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.775+0000 7f3c62653640 1 --2- 172.21.15.12:0/2083729199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c5c137de0 0x7f3c5c06fd40 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:20.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.775+0000 7f3c62653640 1 -- 172.21.15.12:0/2083729199 >> 172.21.15.12:0/2083729199 conn(0x7f3c5c0a82f0 msgr2=0x7f3c5c09fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:20.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.775+0000 7f3c62653640 1 -- 172.21.15.12:0/2083729199 shutdown_connections 2024-09-11T23:05:20.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.775+0000 7f3c62653640 1 -- 172.21.15.12:0/2083729199 wait complete. 2024-09-11T23:05:20.793 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T23:05:20.793 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:05:20.800 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:05:20.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.967+0000 7ff09fcfc640 1 Processor -- start 2024-09-11T23:05:20.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.967+0000 7ff09fcfc640 1 -- start start 2024-09-11T23:05:20.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.967+0000 7ff09fcfc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff09809fc40 0x7ff09813ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:20.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.967+0000 7ff09fcfc640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0980a1c00 con 0x7ff09813a200 2024-09-11T23:05:20.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.967+0000 7ff09fcfc640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7ff0980a0e40 con 0x7ff09809fc40 2024-09-11T23:05:20.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.967+0000 7ff09da98640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff09813a200 0x7ff09813a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51366/0 (socket says 172.21.15.12:51366) 2024-09-11T23:05:20.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.967+0000 7ff09d297640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff09809fc40 0x7ff09813ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:20.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.967+0000 7ff09da98640 1 -- 172.21.15.12:0/3932414326 learned_addr learned my addr 172.21.15.12:0/3932414326 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:20.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.967+0000 7ff09d297640 1 -- 172.21.15.12:0/3932414326 >> v1:172.21.15.12:6789/0 conn(0x7ff09813a200 legacy=0x7ff09813a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:20.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.967+0000 7ff09d297640 1 -- 172.21.15.12:0/3932414326 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff09809f350 con 0x7ff09809fc40 2024-09-11T23:05:20.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.971+0000 7ff09d297640 1 --2- 172.21.15.12:0/3932414326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff09809fc40 0x7ff09813ef80 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7ff088009740 tx=0x7ff08801c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9e96e5f10f73ff0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:20.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.971+0000 7ff09ca96640 1 -- 172.21.15.12:0/3932414326 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0880b0070 con 0x7ff09809fc40 2024-09-11T23:05:20.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.971+0000 7ff09ca96640 1 -- 172.21.15.12:0/3932414326 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0880ab530 con 0x7ff09809fc40 2024-09-11T23:05:20.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.971+0000 7ff09ca96640 1 -- 172.21.15.12:0/3932414326 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0880ab830 con 0x7ff09809fc40 2024-09-11T23:05:20.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.971+0000 7ff09fcfc640 1 -- 172.21.15.12:0/3932414326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff09809fc40 msgr2=0x7ff09813ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:20.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.971+0000 7ff09fcfc640 1 --2- 172.21.15.12:0/3932414326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff09809fc40 0x7ff09813ef80 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7ff088009740 tx=0x7ff08801c390 comp rx=0 tx=0).stop 2024-09-11T23:05:20.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.971+0000 7ff09fcfc640 1 -- 172.21.15.12:0/3932414326 shutdown_connections 2024-09-11T23:05:20.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.971+0000 7ff09fcfc640 1 --2- 172.21.15.12:0/3932414326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff09809fc40 0x7ff09813ef80 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:20.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.971+0000 7ff09fcfc640 1 -- 172.21.15.12:0/3932414326 >> 172.21.15.12:0/3932414326 conn(0x7ff09806da30 msgr2=0x7ff09806de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:20.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.971+0000 7ff09fcfc640 1 -- 172.21.15.12:0/3932414326 shutdown_connections 2024-09-11T23:05:20.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.971+0000 7ff09fcfc640 1 -- 172.21.15.12:0/3932414326 wait complete. 2024-09-11T23:05:20.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.971+0000 7ff09fcfc640 1 Processor -- start 2024-09-11T23:05:20.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.971+0000 7ff09fcfc640 1 -- start start 2024-09-11T23:05:20.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.975+0000 7ff09fcfc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff09813a200 0x7ff0980aafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:20.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.975+0000 7ff09fcfc640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff098141ce0 con 0x7ff09813a200 2024-09-11T23:05:20.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.975+0000 7ff09da98640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff09813a200 0x7ff0980aafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:20.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.975+0000 7ff09da98640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff09813a200 0x7ff0980aafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50450/0 (socket says 172.21.15.12:50450) 2024-09-11T23:05:20.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.975+0000 7ff09da98640 1 -- 172.21.15.12:0/1625112231 learned_addr learned my addr 172.21.15.12:0/1625112231 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:20.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.975+0000 7ff09da98640 1 -- 172.21.15.12:0/1625112231 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0980aa560 con 0x7ff09813a200 2024-09-11T23:05:20.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.975+0000 7ff09da98640 1 --2- 172.21.15.12:0/1625112231 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff09813a200 0x7ff0980aafa0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7ff09400c480 tx=0x7ff09400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:20.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.975+0000 7ff08e7fc640 1 -- 172.21.15.12:0/1625112231 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff094017070 con 0x7ff09813a200 2024-09-11T23:05:20.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.975+0000 7ff08e7fc640 1 -- 172.21.15.12:0/1625112231 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff094005c20 con 0x7ff09813a200 2024-09-11T23:05:20.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.975+0000 7ff08e7fc640 1 -- 172.21.15.12:0/1625112231 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff094007070 con 0x7ff09813a200 2024-09-11T23:05:20.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.975+0000 7ff09fcfc640 1 -- 172.21.15.12:0/1625112231 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0980abd10 con 0x7ff09813a200 2024-09-11T23:05:20.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.975+0000 7ff09fcfc640 1 -- 172.21.15.12:0/1625112231 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0980abfc0 con 0x7ff09813a200 2024-09-11T23:05:20.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.975+0000 7ff08e7fc640 1 -- 172.21.15.12:0/1625112231 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 20) ==== 44164+0+0 (secure 0 0 0) 0x7ff09401a070 con 0x7ff09813a200 2024-09-11T23:05:20.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.975+0000 7ff09fcfc640 1 -- 172.21.15.12:0/1625112231 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff09813a660 con 0x7ff09813a200 2024-09-11T23:05:20.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.975+0000 7ff08e7fc640 1 --2- 172.21.15.12:0/1625112231 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7ff07c035f20 0x7ff07c0383e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:20.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.975+0000 7ff08e7fc640 1 -- 172.21.15.12:0/1625112231 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4643+0+0 (secure 0 0 0) 0x7ff094047f90 con 0x7ff09813a200 2024-09-11T23:05:20.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.975+0000 7ff09d297640 1 --2- 172.21.15.12:0/1625112231 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7ff07c035f20 0x7ff07c0383e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:20.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.975+0000 7ff09d297640 1 --2- 172.21.15.12:0/1625112231 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7ff07c035f20 0x7ff07c0383e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff0880ad000 tx=0x7ff088008040 comp rx=0 tx=0).ready entity=mgr.4612 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:20.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:20.979+0000 7ff08e7fc640 1 -- 172.21.15.12:0/1625112231 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff094007210 con 0x7ff09813a200 2024-09-11T23:05:21.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:21.159+0000 7ff09fcfc640 1 -- 172.21.15.12:0/1625112231 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff098073580 con 0x7ff09813a200 2024-09-11T23:05:21.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:21.159+0000 7ff08e7fc640 1 -- 172.21.15.12:0/1625112231 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v40) ==== 80+0+466 (secure 0 0 0) 0x7ff09401b450 con 0x7ff09813a200 2024-09-11T23:05:21.161 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/2509166838 2024-09-12T23:05:06.494857+0000 2024-09-11T23:05:21.162 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:6825/718802078 2024-09-12T23:05:06.494857+0000 2024-09-11T23:05:21.162 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:6824/718802078 2024-09-12T23:05:06.494857+0000 2024-09-11T23:05:21.162 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/2490570290 2024-09-12T23:05:06.494857+0000 2024-09-11T23:05:21.162 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/2957476143 2024-09-12T23:05:06.494857+0000 2024-09-11T23:05:21.162 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/37905181 2024-09-12T23:05:06.494857+0000 2024-09-11T23:05:21.162 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/3294231065 2024-09-12T23:05:06.494857+0000 2024-09-11T23:05:21.162 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/2407367943 2024-09-12T23:05:06.494857+0000 2024-09-11T23:05:21.162 INFO:teuthology.orchestra.run.smithi012.stderr:listed 8 entries 2024-09-11T23:05:21.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:21.159+0000 7ff09fcfc640 1 -- 172.21.15.12:0/1625112231 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7ff07c035f20 msgr2=0x7ff07c0383e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:21.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:21.159+0000 7ff09fcfc640 1 --2- 172.21.15.12:0/1625112231 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7ff07c035f20 0x7ff07c0383e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff0880ad000 tx=0x7ff088008040 comp rx=0 tx=0).stop 2024-09-11T23:05:21.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:21.159+0000 7ff09fcfc640 1 -- 172.21.15.12:0/1625112231 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff09813a200 msgr2=0x7ff0980aafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:21.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:21.159+0000 7ff09fcfc640 1 --2- 172.21.15.12:0/1625112231 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff09813a200 0x7ff0980aafa0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7ff09400c480 tx=0x7ff09400c940 comp rx=0 tx=0).stop 2024-09-11T23:05:21.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:21.159+0000 7ff09fcfc640 1 -- 172.21.15.12:0/1625112231 shutdown_connections 2024-09-11T23:05:21.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:21.159+0000 7ff09fcfc640 1 --2- 172.21.15.12:0/1625112231 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7ff07c035f20 0x7ff07c0383e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:21.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:21.159+0000 7ff09fcfc640 1 --2- 172.21.15.12:0/1625112231 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff09813a200 0x7ff0980aafa0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:21.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:21.159+0000 7ff09fcfc640 1 -- 172.21.15.12:0/1625112231 >> 172.21.15.12:0/1625112231 conn(0x7ff09806da30 msgr2=0x7ff09809ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:21.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:21.159+0000 7ff09fcfc640 1 -- 172.21.15.12:0/1625112231 shutdown_connections 2024-09-11T23:05:21.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:21.163+0000 7ff09fcfc640 1 -- 172.21.15.12:0/1625112231 wait complete. 2024-09-11T23:05:21.181 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi012.front.sepia.ceph.com... 2024-09-11T23:05:21.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:05:21.181 DEBUG:teuthology.orchestra.run.smithi012:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-11T23:05:21.193 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi012.stderr:ceph-fuse[37588]: fuse finished with error 0 and tester_r 0 2024-09-11T23:05:21.194 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:05:24.649 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:05:27.296 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi012.front.sepia.ceph.com 2024-09-11T23:05:27.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:05:27.296 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-11T23:05:27.304 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T23:05:27.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.475+0000 7f863eb96640 1 Processor -- start 2024-09-11T23:05:27.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.479+0000 7f863eb96640 1 -- start start 2024-09-11T23:05:27.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.479+0000 7f863eb96640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f863809f6e0 0x7f863813cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:27.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.479+0000 7f863eb96640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f863809e930 con 0x7f8638137e60 2024-09-11T23:05:27.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.479+0000 7f863eb96640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f86381379e0 con 0x7f863809f6e0 2024-09-11T23:05:27.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.479+0000 7f863c932640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f8638137e60 0x7f8638138240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38078/0 (socket says 172.21.15.12:38078) 2024-09-11T23:05:27.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.479+0000 7f8637fff640 1 --2- 172.21.15.12:0/1576464410 >> v2:172.21.15.12:3300/0 conn(0x7f863809f6e0 0x7f863813cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:27.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.479+0000 7f863c932640 1 -- 172.21.15.12:0/1576464410 learned_addr learned my addr 172.21.15.12:0/1576464410 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:27.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.479+0000 7f8637fff640 1 -- 172.21.15.12:0/1576464410 >> v1:172.21.15.12:6789/0 conn(0x7f8638137e60 legacy=0x7f8638138240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:27.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.479+0000 7f8637fff640 1 -- 172.21.15.12:0/1576464410 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f863809d910 con 0x7f863809f6e0 2024-09-11T23:05:27.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.479+0000 7f86377fe640 1 -- 172.21.15.12:0/1576464410 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2646598257 0 0) 0x7f863809e930 con 0x7f8638137e60 2024-09-11T23:05:27.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.479+0000 7f8637fff640 1 --2- 172.21.15.12:0/1576464410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f863809f6e0 0x7f863813cc60 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f862c009740 tx=0x7f862c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf766df172812de4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:27.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.479+0000 7f86377fe640 1 -- 172.21.15.12:0/1576464410 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f862c0ab570 con 0x7f863809f6e0 2024-09-11T23:05:27.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.479+0000 7f86377fe640 1 -- 172.21.15.12:0/1576464410 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f862c0b0070 con 0x7f863809f6e0 2024-09-11T23:05:27.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.479+0000 7f86377fe640 1 -- 172.21.15.12:0/1576464410 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f862c0ab860 con 0x7f863809f6e0 2024-09-11T23:05:27.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.483+0000 7f863eb96640 1 -- 172.21.15.12:0/1576464410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f863809f6e0 msgr2=0x7f863813cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:27.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.483+0000 7f863eb96640 1 --2- 172.21.15.12:0/1576464410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f863809f6e0 0x7f863813cc60 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f862c009740 tx=0x7f862c01c420 comp rx=0 tx=0).stop 2024-09-11T23:05:27.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.483+0000 7f863eb96640 1 -- 172.21.15.12:0/1576464410 shutdown_connections 2024-09-11T23:05:27.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.483+0000 7f863eb96640 1 --2- 172.21.15.12:0/1576464410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f863809f6e0 0x7f863813cc60 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:27.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.483+0000 7f863eb96640 1 -- 172.21.15.12:0/1576464410 >> 172.21.15.12:0/1576464410 conn(0x7f86380a8450 msgr2=0x7f86380a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:27.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.483+0000 7f863eb96640 1 -- 172.21.15.12:0/1576464410 shutdown_connections 2024-09-11T23:05:27.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.483+0000 7f863eb96640 1 -- 172.21.15.12:0/1576464410 wait complete. 2024-09-11T23:05:27.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.483+0000 7f863eb96640 1 Processor -- start 2024-09-11T23:05:27.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.483+0000 7f863eb96640 1 -- start start 2024-09-11T23:05:27.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.483+0000 7f863eb96640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f863809f6e0 0x7f8638071d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:27.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.483+0000 7f863eb96640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f863813fd50 con 0x7f863809f6e0 2024-09-11T23:05:27.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.483+0000 7f863c932640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f863809f6e0 0x7f8638071d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:27.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.483+0000 7f863c932640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f863809f6e0 0x7f8638071d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42148/0 (socket says 172.21.15.12:42148) 2024-09-11T23:05:27.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.483+0000 7f863c932640 1 -- 172.21.15.12:0/2534539654 learned_addr learned my addr 172.21.15.12:0/2534539654 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:27.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.483+0000 7f863c932640 1 -- 172.21.15.12:0/2534539654 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86381201b0 con 0x7f863809f6e0 2024-09-11T23:05:27.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.483+0000 7f863c932640 1 --2- 172.21.15.12:0/2534539654 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f863809f6e0 0x7f8638071d80 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f862800c450 tx=0x7f862800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:27.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.483+0000 7f86357fa640 1 -- 172.21.15.12:0/2534539654 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8628005c20 con 0x7f863809f6e0 2024-09-11T23:05:27.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.483+0000 7f86357fa640 1 -- 172.21.15.12:0/2534539654 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8628005dc0 con 0x7f863809f6e0 2024-09-11T23:05:27.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.483+0000 7f86357fa640 1 -- 172.21.15.12:0/2534539654 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86280071a0 con 0x7f863809f6e0 2024-09-11T23:05:27.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.483+0000 7f863eb96640 1 -- 172.21.15.12:0/2534539654 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f863811e650 con 0x7f863809f6e0 2024-09-11T23:05:27.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.483+0000 7f863eb96640 1 -- 172.21.15.12:0/2534539654 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8638120900 con 0x7f863809f6e0 2024-09-11T23:05:27.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.483+0000 7f863eb96640 1 -- 172.21.15.12:0/2534539654 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f863811ef30 con 0x7f863809f6e0 2024-09-11T23:05:27.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.487+0000 7f86357fa640 1 -- 172.21.15.12:0/2534539654 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 20) ==== 44164+0+0 (secure 0 0 0) 0x7f8628007400 con 0x7f863809f6e0 2024-09-11T23:05:27.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.487+0000 7f86357fa640 1 --2- 172.21.15.12:0/2534539654 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f8624035ed0 0x7f8624038390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:27.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.487+0000 7f86357fa640 1 -- 172.21.15.12:0/2534539654 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4643+0+0 (secure 0 0 0) 0x7f8628048990 con 0x7f863809f6e0 2024-09-11T23:05:27.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.487+0000 7f8637fff640 1 --2- 172.21.15.12:0/2534539654 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f8624035ed0 0x7f8624038390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:27.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.487+0000 7f8637fff640 1 --2- 172.21.15.12:0/2534539654 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f8624035ed0 0x7f8624038390 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f862c0af000 tx=0x7f862c0a7000 comp rx=0 tx=0).ready entity=mgr.4612 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:27.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.491+0000 7f86357fa640 1 -- 172.21.15.12:0/2534539654 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f86280182b0 con 0x7f863809f6e0 2024-09-11T23:05:27.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.691+0000 7f863eb96640 1 -- 172.21.15.12:0/2534539654 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f863806bc60 con 0x7f863809f6e0 2024-09-11T23:05:27.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.695+0000 7f86357fa640 1 -- 172.21.15.12:0/2534539654 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v30) ==== 53+0+152 (secure 0 0 0) 0x7f86280076f0 con 0x7f863809f6e0 2024-09-11T23:05:27.696 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T23:05:27.697 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs_b, metadata pool: cephfs_b_metadata, data pools: [cephfs_b_data ] 2024-09-11T23:05:27.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.695+0000 7f863eb96640 1 -- 172.21.15.12:0/2534539654 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f8624035ed0 msgr2=0x7f8624038390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:27.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.695+0000 7f863eb96640 1 --2- 172.21.15.12:0/2534539654 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f8624035ed0 0x7f8624038390 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f862c0af000 tx=0x7f862c0a7000 comp rx=0 tx=0).stop 2024-09-11T23:05:27.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.695+0000 7f863eb96640 1 -- 172.21.15.12:0/2534539654 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f863809f6e0 msgr2=0x7f8638071d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:27.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.695+0000 7f863eb96640 1 --2- 172.21.15.12:0/2534539654 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f863809f6e0 0x7f8638071d80 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f862800c450 tx=0x7f862800c910 comp rx=0 tx=0).stop 2024-09-11T23:05:27.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.695+0000 7f863eb96640 1 -- 172.21.15.12:0/2534539654 shutdown_connections 2024-09-11T23:05:27.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.695+0000 7f863eb96640 1 --2- 172.21.15.12:0/2534539654 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f8624035ed0 0x7f8624038390 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:27.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.695+0000 7f863eb96640 1 --2- 172.21.15.12:0/2534539654 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f863809f6e0 0x7f8638071d80 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:27.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.695+0000 7f863eb96640 1 -- 172.21.15.12:0/2534539654 >> 172.21.15.12:0/2534539654 conn(0x7f86380a8450 msgr2=0x7f86381361d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:27.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.695+0000 7f863eb96640 1 -- 172.21.15.12:0/2534539654 shutdown_connections 2024-09-11T23:05:27.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27.695+0000 7f863eb96640 1 -- 172.21.15.12:0/2534539654 wait complete. 2024-09-11T23:05:27.715 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-11T23:05:27.715 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:05:27.715 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi012.front.sepia.ceph.com 2024-09-11T23:05:27.716 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-11T23:05:27.716 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-11T23:05:27.716 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-11T23:05:27.716 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T23:05:27.716 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:05:27.716 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:05:27.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:05:27.716 DEBUG:teuthology.orchestra.run.smithi012:> ip addr 2024-09-11T23:05:27.722 INFO:teuthology.orchestra.run.smithi012.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:05:27.722 INFO:teuthology.orchestra.run.smithi012.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:05:27.722 INFO:teuthology.orchestra.run.smithi012.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:05:27.722 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:05:27.722 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 ::1/128 scope host 2024-09-11T23:05:27.722 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:05:27.722 INFO:teuthology.orchestra.run.smithi012.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:05:27.722 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a4 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:05:27.723 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f0 2024-09-11T23:05:27.723 INFO:teuthology.orchestra.run.smithi012.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:05:27.723 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a5 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:05:27.723 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f1 2024-09-11T23:05:27.723 INFO:teuthology.orchestra.run.smithi012.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:05:27.723 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:ea brd ff:ff:ff:ff:ff:ff 2024-09-11T23:05:27.723 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f0 2024-09-11T23:05:27.723 INFO:teuthology.orchestra.run.smithi012.stdout: inet 172.21.15.12/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-11T23:05:27.723 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft 42413sec preferred_lft 42413sec 2024-09-11T23:05:27.723 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::ae1f:6bff:fef8:25ea/64 scope link 2024-09-11T23:05:27.723 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:05:27.723 INFO:teuthology.orchestra.run.smithi012.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:05:27.723 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:eb brd ff:ff:ff:ff:ff:ff 2024-09-11T23:05:27.724 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f1 2024-09-11T23:05:27.724 INFO:teuthology.orchestra.run.smithi012.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-11T23:05:27.724 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 02:42:d6:75:63:83 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:05:27.724 INFO:teuthology.orchestra.run.smithi012.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-11T23:05:27.724 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:05:27.724 INFO:teuthology.orchestra.run.smithi012.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:05:27.724 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-11T23:05:27.724 INFO:teuthology.orchestra.run.smithi012.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T23:05:27.724 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:05:27.724 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-11T23:05:27.724 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:05:27.724 INFO:teuthology.orchestra.run.smithi012.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:05:27.725 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:05:27.725 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-11T23:05:27.725 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:05:27.725 INFO:teuthology.orchestra.run.smithi012.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:05:27.725 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:05:27.725 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-11T23:05:27.725 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:05:27.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:05:27.725 DEBUG:teuthology.orchestra.run.smithi012:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:05:27.779 INFO:teuthology.orchestra.run.smithi012.stdout:1 2024-09-11T23:05:27.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:05:27.780 DEBUG:teuthology.orchestra.run.smithi012:> route 2024-09-11T23:05:27.830 INFO:teuthology.orchestra.run.smithi012.stdout:Kernel IP routing table 2024-09-11T23:05:27.830 INFO:teuthology.orchestra.run.smithi012.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:05:27.830 INFO:teuthology.orchestra.run.smithi012.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-11T23:05:27.830 INFO:teuthology.orchestra.run.smithi012.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-11T23:05:27.830 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-11T23:05:27.830 INFO:teuthology.orchestra.run.smithi012.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:05:27.831 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:05:27.831 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-09-11T23:05:27.831 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-11T23:05:27.831 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-11T23:05:27.831 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-11T23:05:27.831 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-09-11T23:05:27.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:05:27.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:05:27.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:05:27.953 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2024-09-11T23:05:27.957 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 1) 2024-09-11T23:05:27.958 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T23:05:27.958 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:05:27.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:05:27.958 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set brx.1 up 2024-09-11T23:05:28.012 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-11T23:05:28.012 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:05:28.012 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-11T23:05:28.061 INFO:teuthology.orchestra.run.smithi012.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:05:28.061 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:05:28.061 DEBUG:teuthology.orchestra.run.smithi012:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-11T23:05:28.109 DEBUG:teuthology.orchestra.run.smithi012:> sudo modprobe fuse 2024-09-11T23:05:28.167 DEBUG:teuthology.orchestra.run.smithi012:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:05:28.213 INFO:teuthology.orchestra.run.smithi012.stdout:/sys 2024-09-11T23:05:28.214 INFO:teuthology.orchestra.run.smithi012.stdout:/proc 2024-09-11T23:05:28.214 INFO:teuthology.orchestra.run.smithi012.stdout:/dev 2024-09-11T23:05:28.214 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/pts 2024-09-11T23:05:28.214 INFO:teuthology.orchestra.run.smithi012.stdout:/run 2024-09-11T23:05:28.214 INFO:teuthology.orchestra.run.smithi012.stdout:/ 2024-09-11T23:05:28.214 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/security 2024-09-11T23:05:28.214 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/shm 2024-09-11T23:05:28.214 INFO:teuthology.orchestra.run.smithi012.stdout:/run/lock 2024-09-11T23:05:28.214 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup 2024-09-11T23:05:28.214 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/pstore 2024-09-11T23:05:28.214 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/bpf 2024-09-11T23:05:28.214 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:05:28.215 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/hugepages 2024-09-11T23:05:28.215 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/mqueue 2024-09-11T23:05:28.215 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/debug 2024-09-11T23:05:28.215 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/tracing 2024-09-11T23:05:28.215 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/fs/nfsd 2024-09-11T23:05:28.215 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/fuse/connections 2024-09-11T23:05:28.215 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/config 2024-09-11T23:05:28.215 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:05:28.215 INFO:teuthology.orchestra.run.smithi012.stdout:/run/rpc_pipefs 2024-09-11T23:05:28.215 INFO:teuthology.orchestra.run.smithi012.stdout:/run/user/1000 2024-09-11T23:05:28.215 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph 2024-09-11T23:05:28.215 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:05:28.215 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:05:28.215 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:05:28.216 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns 2024-09-11T23:05:28.216 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:05:28.216 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:05:28.216 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:05:28.216 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:05:28.216 INFO:teuthology.orchestra.run.smithi012.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-11T23:05:28.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:05:28.217 DEBUG:teuthology.orchestra.run.smithi012:> ls /sys/fs/fuse/connections 2024-09-11T23:05:28.265 INFO:teuthology.orchestra.run.smithi012.stdout:45 2024-09-11T23:05:28.265 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [45] 2024-09-11T23:05:28.265 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1 --client_fs=cephfs) 2024-09-11T23:05:28.310 DEBUG:teuthology.orchestra.run.smithi012:> sudo modprobe fuse 2024-09-11T23:05:28.324 DEBUG:teuthology.orchestra.run.smithi012:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:05:28.373 INFO:teuthology.orchestra.run.smithi012.stdout:/sys 2024-09-11T23:05:28.373 INFO:teuthology.orchestra.run.smithi012.stdout:/proc 2024-09-11T23:05:28.373 INFO:teuthology.orchestra.run.smithi012.stdout:/dev 2024-09-11T23:05:28.373 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/pts 2024-09-11T23:05:28.373 INFO:teuthology.orchestra.run.smithi012.stdout:/run 2024-09-11T23:05:28.373 INFO:teuthology.orchestra.run.smithi012.stdout:/ 2024-09-11T23:05:28.373 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/security 2024-09-11T23:05:28.374 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/shm 2024-09-11T23:05:28.374 INFO:teuthology.orchestra.run.smithi012.stdout:/run/lock 2024-09-11T23:05:28.374 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup 2024-09-11T23:05:28.374 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/pstore 2024-09-11T23:05:28.374 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/bpf 2024-09-11T23:05:28.374 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:05:28.374 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/hugepages 2024-09-11T23:05:28.374 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/mqueue 2024-09-11T23:05:28.374 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/debug 2024-09-11T23:05:28.374 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/tracing 2024-09-11T23:05:28.374 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/fs/nfsd 2024-09-11T23:05:28.374 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/fuse/connections 2024-09-11T23:05:28.374 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/config 2024-09-11T23:05:28.375 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:05:28.375 INFO:teuthology.orchestra.run.smithi012.stdout:/run/rpc_pipefs 2024-09-11T23:05:28.375 INFO:teuthology.orchestra.run.smithi012.stdout:/run/user/1000 2024-09-11T23:05:28.375 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph 2024-09-11T23:05:28.375 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:05:28.375 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:05:28.375 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:05:28.375 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns 2024-09-11T23:05:28.375 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:05:28.375 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:05:28.375 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:05:28.375 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:05:28.375 INFO:teuthology.orchestra.run.smithi012.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-11T23:05:28.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:05:28.376 DEBUG:teuthology.orchestra.run.smithi012:> ls /sys/fs/fuse/connections 2024-09-11T23:05:28.389 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi012.stderr:2024-09-11T23:05:28.387+0000 7fa06842f580 -1 init, newargv = 0x56501870e820 newargc=15 2024-09-11T23:05:28.389 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi012.stderr:ceph-fuse[37876]: starting ceph client 2024-09-11T23:05:28.393 INFO:teuthology.orchestra.run.smithi012.stdout:45 2024-09-11T23:05:28.395 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi012.stderr:ceph-fuse[37876]: starting fuse 2024-09-11T23:05:29.495 DEBUG:teuthology.orchestra.run.smithi012:> sudo modprobe fuse 2024-09-11T23:05:29.511 DEBUG:teuthology.orchestra.run.smithi012:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:05:29.560 INFO:teuthology.orchestra.run.smithi012.stdout:/sys 2024-09-11T23:05:29.560 INFO:teuthology.orchestra.run.smithi012.stdout:/proc 2024-09-11T23:05:29.560 INFO:teuthology.orchestra.run.smithi012.stdout:/dev 2024-09-11T23:05:29.560 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/pts 2024-09-11T23:05:29.560 INFO:teuthology.orchestra.run.smithi012.stdout:/run 2024-09-11T23:05:29.560 INFO:teuthology.orchestra.run.smithi012.stdout:/ 2024-09-11T23:05:29.560 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/security 2024-09-11T23:05:29.560 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/shm 2024-09-11T23:05:29.560 INFO:teuthology.orchestra.run.smithi012.stdout:/run/lock 2024-09-11T23:05:29.560 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup 2024-09-11T23:05:29.561 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/pstore 2024-09-11T23:05:29.561 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/bpf 2024-09-11T23:05:29.561 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:05:29.561 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/hugepages 2024-09-11T23:05:29.561 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/mqueue 2024-09-11T23:05:29.561 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/debug 2024-09-11T23:05:29.561 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/tracing 2024-09-11T23:05:29.561 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/fs/nfsd 2024-09-11T23:05:29.561 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/fuse/connections 2024-09-11T23:05:29.561 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/config 2024-09-11T23:05:29.561 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:05:29.561 INFO:teuthology.orchestra.run.smithi012.stdout:/run/rpc_pipefs 2024-09-11T23:05:29.562 INFO:teuthology.orchestra.run.smithi012.stdout:/run/user/1000 2024-09-11T23:05:29.562 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph 2024-09-11T23:05:29.562 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:05:29.562 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:05:29.562 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:05:29.562 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns 2024-09-11T23:05:29.562 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:05:29.562 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:05:29.562 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:05:29.562 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:05:29.562 INFO:teuthology.orchestra.run.smithi012.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-11T23:05:29.562 INFO:teuthology.orchestra.run.smithi012.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-11T23:05:29.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:05:29.563 DEBUG:teuthology.orchestra.run.smithi012:> ls /sys/fs/fuse/connections 2024-09-11T23:05:29.609 INFO:teuthology.orchestra.run.smithi012.stdout:45 2024-09-11T23:05:29.609 INFO:teuthology.orchestra.run.smithi012.stdout:46 2024-09-11T23:05:29.609 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45, 46] 2024-09-11T23:05:29.610 DEBUG:teuthology.orchestra.run.smithi012:> sudo stdin-killer -- python3 -c ' 2024-09-11T23:05:29.610 DEBUG:teuthology.orchestra.run.smithi012:> import glob 2024-09-11T23:05:29.610 DEBUG:teuthology.orchestra.run.smithi012:> import re 2024-09-11T23:05:29.610 DEBUG:teuthology.orchestra.run.smithi012:> import os 2024-09-11T23:05:29.610 DEBUG:teuthology.orchestra.run.smithi012:> import subprocess 2024-09-11T23:05:29.610 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:05:29.610 DEBUG:teuthology.orchestra.run.smithi012:> def _find_admin_socket(client_name): 2024-09-11T23:05:29.610 DEBUG:teuthology.orchestra.run.smithi012:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-11T23:05:29.610 DEBUG:teuthology.orchestra.run.smithi012:> files = glob.glob(asok_path) 2024-09-11T23:05:29.610 DEBUG:teuthology.orchestra.run.smithi012:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-11T23:05:29.610 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:05:29.610 DEBUG:teuthology.orchestra.run.smithi012:> # Given a non-glob path, it better be there 2024-09-11T23:05:29.611 DEBUG:teuthology.orchestra.run.smithi012:> if "*" not in asok_path: 2024-09-11T23:05:29.611 DEBUG:teuthology.orchestra.run.smithi012:> assert(len(files) == 1) 2024-09-11T23:05:29.611 DEBUG:teuthology.orchestra.run.smithi012:> return files[0] 2024-09-11T23:05:29.611 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:05:29.611 DEBUG:teuthology.orchestra.run.smithi012:> for f in files: 2024-09-11T23:05:29.611 DEBUG:teuthology.orchestra.run.smithi012:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T23:05:29.611 DEBUG:teuthology.orchestra.run.smithi012:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T23:05:29.611 DEBUG:teuthology.orchestra.run.smithi012:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T23:05:29.611 DEBUG:teuthology.orchestra.run.smithi012:> contents = proc_f.read() 2024-09-11T23:05:29.611 DEBUG:teuthology.orchestra.run.smithi012:> if mountpoint in contents: 2024-09-11T23:05:29.611 DEBUG:teuthology.orchestra.run.smithi012:> return f 2024-09-11T23:05:29.611 DEBUG:teuthology.orchestra.run.smithi012:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T23:05:29.611 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:05:29.611 DEBUG:teuthology.orchestra.run.smithi012:> print(_find_admin_socket("client.1")) 2024-09-11T23:05:29.611 DEBUG:teuthology.orchestra.run.smithi012:> ' 2024-09-11T23:05:29.737 INFO:teuthology.orchestra.run.smithi012.stdout:/var/run/ceph/ceph-client.1.37876.asok 2024-09-11T23:05:29.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:05:29.749 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.37876.asok 2024-09-11T23:05:29.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:05:29.750 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.37876.asok status 2024-09-11T23:05:29.909 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T23:05:29.909 INFO:teuthology.orchestra.run.smithi012.stdout: "metadata": { 2024-09-11T23:05:29.909 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-11T23:05:29.909 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T23:05:29.909 INFO:teuthology.orchestra.run.smithi012.stdout: "entity_id": "1", 2024-09-11T23:05:29.909 INFO:teuthology.orchestra.run.smithi012.stdout: "hostname": "smithi012", 2024-09-11T23:05:29.910 INFO:teuthology.orchestra.run.smithi012.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-11T23:05:29.910 INFO:teuthology.orchestra.run.smithi012.stdout: "pid": "37876", 2024-09-11T23:05:29.910 INFO:teuthology.orchestra.run.smithi012.stdout: "root": "/" 2024-09-11T23:05:29.910 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:05:29.910 INFO:teuthology.orchestra.run.smithi012.stdout: "dentry_count": 0, 2024-09-11T23:05:29.910 INFO:teuthology.orchestra.run.smithi012.stdout: "dentry_pinned_count": 0, 2024-09-11T23:05:29.910 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4702, 2024-09-11T23:05:29.910 INFO:teuthology.orchestra.run.smithi012.stdout: "inst": { 2024-09-11T23:05:29.910 INFO:teuthology.orchestra.run.smithi012.stdout: "name": { 2024-09-11T23:05:29.910 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "client", 2024-09-11T23:05:29.911 INFO:teuthology.orchestra.run.smithi012.stdout: "num": 4702 2024-09-11T23:05:29.911 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:05:29.911 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": { 2024-09-11T23:05:29.911 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T23:05:29.911 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "192.168.0.2:0", 2024-09-11T23:05:29.911 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 3644227320 2024-09-11T23:05:29.911 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:05:29.911 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:05:29.911 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": { 2024-09-11T23:05:29.911 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T23:05:29.911 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "192.168.0.2:0", 2024-09-11T23:05:29.911 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 3644227320 2024-09-11T23:05:29.911 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:05:29.912 INFO:teuthology.orchestra.run.smithi012.stdout: "inst_str": "client.4702 192.168.0.2:0/3644227320", 2024-09-11T23:05:29.912 INFO:teuthology.orchestra.run.smithi012.stdout: "addr_str": "192.168.0.2:0/3644227320", 2024-09-11T23:05:29.912 INFO:teuthology.orchestra.run.smithi012.stdout: "inode_count": 1, 2024-09-11T23:05:29.912 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_epoch": 25, 2024-09-11T23:05:29.912 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_epoch": 40, 2024-09-11T23:05:29.912 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_epoch_barrier": 0, 2024-09-11T23:05:29.912 INFO:teuthology.orchestra.run.smithi012.stdout: "blocklisted": false, 2024-09-11T23:05:29.912 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs" 2024-09-11T23:05:29.912 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T23:05:29.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:05:29.923 DEBUG:teuthology.orchestra.run.smithi012:> stat --file-system '--printf=%T 2024-09-11T23:05:29.923 DEBUG:teuthology.orchestra.run.smithi012:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-11T23:05:29.930 INFO:teuthology.orchestra.run.smithi012.stdout:fuseblk 2024-09-11T23:05:29.931 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-11T23:05:29.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:05:29.931 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-11T23:05:29.985 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable stats 2024-09-11T23:05:30.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.155+0000 7fbb06378640 1 Processor -- start 2024-09-11T23:05:30.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.155+0000 7fbb06378640 1 -- start start 2024-09-11T23:05:30.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.155+0000 7fbb06378640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbb00137de0 0x7fbb0009f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:30.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.155+0000 7fbb06378640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb0009d690 con 0x7fbb001381c0 2024-09-11T23:05:30.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.155+0000 7fbb06378640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fbb0009ea90 con 0x7fbb00137de0 2024-09-11T23:05:30.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.159+0000 7fbafffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbb00137de0 0x7fbb0009f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:30.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.159+0000 7fbaff7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fbb001381c0 0x7fbb000a36a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38084/0 (socket says 172.21.15.12:38084) 2024-09-11T23:05:30.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.159+0000 7fbaff7fe640 1 -- 172.21.15.12:0/1897709988 learned_addr learned my addr 172.21.15.12:0/1897709988 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:30.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.159+0000 7fbafffff640 1 --2- 172.21.15.12:0/1897709988 >> v2:172.21.15.12:3300/0 conn(0x7fbb00137de0 0x7fbb0009f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42156/0 (socket says 172.21.15.12:42156) 2024-09-11T23:05:30.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.159+0000 7fbafffff640 1 -- 172.21.15.12:0/1897709988 >> v1:172.21.15.12:6789/0 conn(0x7fbb001381c0 legacy=0x7fbb000a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:30.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.159+0000 7fbafffff640 1 -- 172.21.15.12:0/1897709988 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb0009f6d0 con 0x7fbb00137de0 2024-09-11T23:05:30.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.159+0000 7fbafeffd640 1 -- 172.21.15.12:0/1897709988 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3535190962 0 0) 0x7fbb0009d690 con 0x7fbb001381c0 2024-09-11T23:05:30.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.163+0000 7fbafffff640 1 --2- 172.21.15.12:0/1897709988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb00137de0 0x7fbb0009f190 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fbaf0009740 tx=0x7fbaf001c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1038d4de455bb61c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:30.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.163+0000 7fbafeffd640 1 -- 172.21.15.12:0/1897709988 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbaf00b0070 con 0x7fbb00137de0 2024-09-11T23:05:30.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.163+0000 7fbafeffd640 1 -- 172.21.15.12:0/1897709988 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaf00a4e50 con 0x7fbb00137de0 2024-09-11T23:05:30.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.163+0000 7fbafeffd640 1 -- 172.21.15.12:0/1897709988 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbaf00ab680 con 0x7fbb00137de0 2024-09-11T23:05:30.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.163+0000 7fbb06378640 1 -- 172.21.15.12:0/1897709988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb00137de0 msgr2=0x7fbb0009f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:30.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.163+0000 7fbb06378640 1 --2- 172.21.15.12:0/1897709988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb00137de0 0x7fbb0009f190 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fbaf0009740 tx=0x7fbaf001c390 comp rx=0 tx=0).stop 2024-09-11T23:05:30.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.163+0000 7fbb06378640 1 -- 172.21.15.12:0/1897709988 shutdown_connections 2024-09-11T23:05:30.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.163+0000 7fbb06378640 1 --2- 172.21.15.12:0/1897709988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb00137de0 0x7fbb0009f190 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:30.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.163+0000 7fbb06378640 1 -- 172.21.15.12:0/1897709988 >> 172.21.15.12:0/1897709988 conn(0x7fbb000a82f0 msgr2=0x7fbb000a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:30.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.163+0000 7fbb06378640 1 -- 172.21.15.12:0/1897709988 shutdown_connections 2024-09-11T23:05:30.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.163+0000 7fbb06378640 1 -- 172.21.15.12:0/1897709988 wait complete. 2024-09-11T23:05:30.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.163+0000 7fbb06378640 1 Processor -- start 2024-09-11T23:05:30.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.163+0000 7fbb06378640 1 -- start start 2024-09-11T23:05:30.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.163+0000 7fbb06378640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb00137de0 0x7fbb00072390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:30.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.163+0000 7fbb06378640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbb0009e7d0 con 0x7fbb00137de0 2024-09-11T23:05:30.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.163+0000 7fbafffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb00137de0 0x7fbb00072390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:30.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.163+0000 7fbafffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb00137de0 0x7fbb00072390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42164/0 (socket says 172.21.15.12:42164) 2024-09-11T23:05:30.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.163+0000 7fbafffff640 1 -- 172.21.15.12:0/3540463248 learned_addr learned my addr 172.21.15.12:0/3540463248 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:30.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.163+0000 7fbafffff640 1 -- 172.21.15.12:0/3540463248 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb00071e80 con 0x7fbb00137de0 2024-09-11T23:05:30.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.167+0000 7fbafffff640 1 --2- 172.21.15.12:0/3540463248 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb00137de0 0x7fbb00072390 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fbaf0019fc0 tx=0x7fbaf001abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:30.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.167+0000 7fbafcff9640 1 -- 172.21.15.12:0/3540463248 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbaf00bb070 con 0x7fbb00137de0 2024-09-11T23:05:30.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.167+0000 7fbafcff9640 1 -- 172.21.15.12:0/3540463248 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaf00abc90 con 0x7fbb00137de0 2024-09-11T23:05:30.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.167+0000 7fbb06378640 1 -- 172.21.15.12:0/3540463248 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb000711e0 con 0x7fbb00137de0 2024-09-11T23:05:30.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.167+0000 7fbafcff9640 1 -- 172.21.15.12:0/3540463248 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbaf00b0040 con 0x7fbb00137de0 2024-09-11T23:05:30.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.167+0000 7fbb06378640 1 -- 172.21.15.12:0/3540463248 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb0013cfa0 con 0x7fbb00137de0 2024-09-11T23:05:30.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.167+0000 7fbb06378640 1 -- 172.21.15.12:0/3540463248 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb0009f190 con 0x7fbb00137de0 2024-09-11T23:05:30.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.167+0000 7fbafcff9640 1 -- 172.21.15.12:0/3540463248 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 20) ==== 44164+0+0 (secure 0 0 0) 0x7fbaf00b6470 con 0x7fbb00137de0 2024-09-11T23:05:30.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.167+0000 7fbafcff9640 1 --2- 172.21.15.12:0/3540463248 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7fbaec035ed0 0x7fbaec038390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:30.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.167+0000 7fbafcff9640 1 -- 172.21.15.12:0/3540463248 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4643+0+0 (secure 0 0 0) 0x7fbaf00e3200 con 0x7fbb00137de0 2024-09-11T23:05:30.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.167+0000 7fbaff7fe640 1 --2- 172.21.15.12:0/3540463248 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7fbaec035ed0 0x7fbaec038390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:30.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.167+0000 7fbaff7fe640 1 --2- 172.21.15.12:0/3540463248 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7fbaec035ed0 0x7fbaec038390 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4007fd0 tx=0x7fbaf4007980 comp rx=0 tx=0).ready entity=mgr.4612 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:30.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.171+0000 7fbafcff9640 1 -- 172.21.15.12:0/3540463248 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbb00071e80 con 0x7fbb00137de0 2024-09-11T23:05:30.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.379+0000 7fbb06378640 1 -- 172.21.15.12:0/3540463248 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "stats"} v 0) -- 0x7fbb00070fb0 con 0x7fbb00137de0 2024-09-11T23:05:30.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.583+0000 7fbafcff9640 1 -- 172.21.15.12:0/3540463248 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "stats"}]=0 v21) ==== 85+0+0 (secure 0 0 0) 0x7fbaf0016010 con 0x7fbb00137de0 2024-09-11T23:05:30.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.587+0000 7fbb06378640 1 -- 172.21.15.12:0/3540463248 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7fbaec035ed0 msgr2=0x7fbaec038390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:30.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.587+0000 7fbb06378640 1 --2- 172.21.15.12:0/3540463248 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7fbaec035ed0 0x7fbaec038390 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4007fd0 tx=0x7fbaf4007980 comp rx=0 tx=0).stop 2024-09-11T23:05:30.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.587+0000 7fbb06378640 1 -- 172.21.15.12:0/3540463248 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb00137de0 msgr2=0x7fbb00072390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:30.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.587+0000 7fbb06378640 1 --2- 172.21.15.12:0/3540463248 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb00137de0 0x7fbb00072390 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fbaf0019fc0 tx=0x7fbaf001abd0 comp rx=0 tx=0).stop 2024-09-11T23:05:30.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.587+0000 7fbb06378640 1 -- 172.21.15.12:0/3540463248 shutdown_connections 2024-09-11T23:05:30.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.587+0000 7fbb06378640 1 --2- 172.21.15.12:0/3540463248 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7fbaec035ed0 0x7fbaec038390 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:30.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.587+0000 7fbb06378640 1 --2- 172.21.15.12:0/3540463248 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb00137de0 0x7fbb00072390 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:30.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.587+0000 7fbb06378640 1 -- 172.21.15.12:0/3540463248 >> 172.21.15.12:0/3540463248 conn(0x7fbb000a82f0 msgr2=0x7fbb0013d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:30.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.587+0000 7fbb06378640 1 -- 172.21.15.12:0/3540463248 shutdown_connections 2024-09-11T23:05:30.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.587+0000 7fbb06378640 1 -- 172.21.15.12:0/3540463248 wait complete. 2024-09-11T23:05:30.610 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T23:05:30.610 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:05:30.650 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T23:05:30.650 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:05:30.650 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T23:05:30.650 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:05:30.700 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:05:30.717 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:30.715+0000 7f3060e35180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T23:05:30.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.835+0000 7f4751046640 1 Processor -- start 2024-09-11T23:05:30.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.835+0000 7f4751046640 1 -- start start 2024-09-11T23:05:30.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.835+0000 7f4751046640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f474c0a19b0 0x7f474c13a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:30.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.835+0000 7f4751046640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f474c139f60 con 0x7f474c13a130 2024-09-11T23:05:30.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.835+0000 7f4751046640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f474c09feb0 con 0x7f474c0a19b0 2024-09-11T23:05:30.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.835+0000 7f474ad9d640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f474c13a130 0x7f474c136500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38094/0 (socket says 172.21.15.12:38094) 2024-09-11T23:05:30.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.835+0000 7f474ad9d640 1 -- 172.21.15.12:0/2922654425 learned_addr learned my addr 172.21.15.12:0/2922654425 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:30.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.835+0000 7f474a59c640 1 --2- 172.21.15.12:0/2922654425 >> v2:172.21.15.12:3300/0 conn(0x7f474c0a19b0 0x7f474c13a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:30.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.835+0000 7f4749d9b640 1 -- 172.21.15.12:0/2922654425 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3924146335 0 0) 0x7f474c139f60 con 0x7f474c13a130 2024-09-11T23:05:30.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.835+0000 7f4749d9b640 1 -- 172.21.15.12:0/2922654425 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4734003530 con 0x7f474c13a130 2024-09-11T23:05:30.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.835+0000 7f474a59c640 1 -- 172.21.15.12:0/2922654425 >> v1:172.21.15.12:6789/0 conn(0x7f474c13a130 legacy=0x7f474c136500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:30.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.835+0000 7f474a59c640 1 -- 172.21.15.12:0/2922654425 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f474c0a0c60 con 0x7f474c0a19b0 2024-09-11T23:05:30.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.839+0000 7f474a59c640 1 --2- 172.21.15.12:0/2922654425 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f474c0a19b0 0x7f474c13a510 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f4740009740 tx=0x7f474001c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3c48522e6f1d8a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:30.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.839+0000 7f4749d9b640 1 -- 172.21.15.12:0/2922654425 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47400b0070 con 0x7f474c0a19b0 2024-09-11T23:05:30.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.839+0000 7f4749d9b640 1 -- 172.21.15.12:0/2922654425 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47400ab530 con 0x7f474c0a19b0 2024-09-11T23:05:30.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.839+0000 7f4749d9b640 1 -- 172.21.15.12:0/2922654425 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47400ab830 con 0x7f474c0a19b0 2024-09-11T23:05:30.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.839+0000 7f4751046640 1 -- 172.21.15.12:0/2922654425 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f474c0a19b0 msgr2=0x7f474c13a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:30.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.839+0000 7f4751046640 1 --2- 172.21.15.12:0/2922654425 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f474c0a19b0 0x7f474c13a510 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f4740009740 tx=0x7f474001c390 comp rx=0 tx=0).stop 2024-09-11T23:05:30.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.839+0000 7f4751046640 1 -- 172.21.15.12:0/2922654425 shutdown_connections 2024-09-11T23:05:30.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.839+0000 7f4751046640 1 --2- 172.21.15.12:0/2922654425 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f474c0a19b0 0x7f474c13a510 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:30.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.839+0000 7f4751046640 1 -- 172.21.15.12:0/2922654425 >> 172.21.15.12:0/2922654425 conn(0x7f474c068490 msgr2=0x7f474c06d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:30.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.839+0000 7f4751046640 1 -- 172.21.15.12:0/2922654425 shutdown_connections 2024-09-11T23:05:30.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.839+0000 7f4751046640 1 -- 172.21.15.12:0/2922654425 wait complete. 2024-09-11T23:05:30.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.839+0000 7f4751046640 1 Processor -- start 2024-09-11T23:05:30.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.839+0000 7f4751046640 1 -- start start 2024-09-11T23:05:30.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.839+0000 7f4751046640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f474c0a19b0 0x7f474c0a49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:30.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.839+0000 7f4751046640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f474c0a0360 con 0x7f474c0a19b0 2024-09-11T23:05:30.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.839+0000 7f474ad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f474c0a19b0 0x7f474c0a49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:30.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.839+0000 7f474ad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f474c0a19b0 0x7f474c0a49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42192/0 (socket says 172.21.15.12:42192) 2024-09-11T23:05:30.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.839+0000 7f474ad9d640 1 -- 172.21.15.12:0/429601120 learned_addr learned my addr 172.21.15.12:0/429601120 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:30.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.839+0000 7f474ad9d640 1 -- 172.21.15.12:0/429601120 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f474c0a3f90 con 0x7f474c0a19b0 2024-09-11T23:05:30.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.839+0000 7f474ad9d640 1 --2- 172.21.15.12:0/429601120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f474c0a19b0 0x7f474c0a49d0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f473c00c450 tx=0x7f473c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:30.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.839+0000 7f47337fe640 1 -- 172.21.15.12:0/429601120 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f473c017070 con 0x7f474c0a19b0 2024-09-11T23:05:30.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.839+0000 7f47337fe640 1 -- 172.21.15.12:0/429601120 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f473c005c20 con 0x7f474c0a19b0 2024-09-11T23:05:30.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.839+0000 7f4751046640 1 -- 172.21.15.12:0/429601120 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f474c0a31e0 con 0x7f474c0a19b0 2024-09-11T23:05:30.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.839+0000 7f47337fe640 1 -- 172.21.15.12:0/429601120 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f473c007070 con 0x7f474c0a19b0 2024-09-11T23:05:30.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.839+0000 7f4751046640 1 -- 172.21.15.12:0/429601120 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f474c0a3c80 con 0x7f474c0a19b0 2024-09-11T23:05:30.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.843+0000 7f4751046640 1 -- 172.21.15.12:0/429601120 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f474c0a4f10 con 0x7f474c0a19b0 2024-09-11T23:05:30.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.843+0000 7f47337fe640 1 -- 172.21.15.12:0/429601120 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 21) ==== 44155+0+0 (secure 0 0 0) 0x7f473c01a070 con 0x7f474c0a19b0 2024-09-11T23:05:30.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.843+0000 7f47337fe640 1 --2- 172.21.15.12:0/429601120 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f4738035e80 0x7f4738038340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:30.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.843+0000 7f474a59c640 1 -- 172.21.15.12:0/429601120 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f4738035e80 msgr2=0x7f4738038340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6824/2340508205 2024-09-11T23:05:30.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.843+0000 7f47337fe640 1 -- 172.21.15.12:0/429601120 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4643+0+0 (secure 0 0 0) 0x7f473c047fb0 con 0x7f474c0a19b0 2024-09-11T23:05:30.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.843+0000 7f474a59c640 1 --2- 172.21.15.12:0/429601120 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f4738035e80 0x7f4738038340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:05:30.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:30.851+0000 7f47337fe640 1 -- 172.21.15.12:0/429601120 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f473c01b450 con 0x7f474c0a19b0 2024-09-11T23:05:31.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.031+0000 7f4751046640 1 -- 172.21.15.12:0/429601120 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f474c073390 con 0x7f474c0a19b0 2024-09-11T23:05:31.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.031+0000 7f47337fe640 1 -- 172.21.15.12:0/429601120 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v40) ==== 80+0+466 (secure 0 0 0) 0x7f473c010c00 con 0x7f474c0a19b0 2024-09-11T23:05:31.036 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/2509166838 2024-09-12T23:05:06.494857+0000 2024-09-11T23:05:31.036 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:6825/718802078 2024-09-12T23:05:06.494857+0000 2024-09-11T23:05:31.036 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:6824/718802078 2024-09-12T23:05:06.494857+0000 2024-09-11T23:05:31.037 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/2490570290 2024-09-12T23:05:06.494857+0000 2024-09-11T23:05:31.037 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/2957476143 2024-09-12T23:05:06.494857+0000 2024-09-11T23:05:31.037 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/37905181 2024-09-12T23:05:06.494857+0000 2024-09-11T23:05:31.037 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/3294231065 2024-09-12T23:05:06.494857+0000 2024-09-11T23:05:31.037 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/2407367943 2024-09-12T23:05:06.494857+0000 2024-09-11T23:05:31.037 INFO:teuthology.orchestra.run.smithi012.stderr:listed 8 entries 2024-09-11T23:05:31.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.035+0000 7f4751046640 1 -- 172.21.15.12:0/429601120 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f4738035e80 msgr2=0x7f4738038340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:05:31.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.035+0000 7f4751046640 1 --2- 172.21.15.12:0/429601120 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f4738035e80 0x7f4738038340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:31.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.035+0000 7f4751046640 1 -- 172.21.15.12:0/429601120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f474c0a19b0 msgr2=0x7f474c0a49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:31.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.035+0000 7f4751046640 1 --2- 172.21.15.12:0/429601120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f474c0a19b0 0x7f474c0a49d0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f473c00c450 tx=0x7f473c00c910 comp rx=0 tx=0).stop 2024-09-11T23:05:31.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.035+0000 7f4751046640 1 -- 172.21.15.12:0/429601120 shutdown_connections 2024-09-11T23:05:31.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.035+0000 7f4751046640 1 --2- 172.21.15.12:0/429601120 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f4738035e80 0x7f4738038340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:31.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.035+0000 7f4751046640 1 --2- 172.21.15.12:0/429601120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f474c0a19b0 0x7f474c0a49d0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:31.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.035+0000 7f4751046640 1 -- 172.21.15.12:0/429601120 >> 172.21.15.12:0/429601120 conn(0x7f474c068490 msgr2=0x7f474c1335f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:31.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.035+0000 7f4751046640 1 -- 172.21.15.12:0/429601120 shutdown_connections 2024-09-11T23:05:31.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.035+0000 7f4751046640 1 -- 172.21.15.12:0/429601120 wait complete. 2024-09-11T23:05:31.055 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi012.front.sepia.ceph.com... 2024-09-11T23:05:31.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:05:31.055 DEBUG:teuthology.orchestra.run.smithi012:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-11T23:05:31.066 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi012.stderr:ceph-fuse[36762]: fuse finished with error 0 and tester_r 0 2024-09-11T23:05:31.068 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi012.front.sepia.ceph.com 2024-09-11T23:05:31.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:05:31.068 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-11T23:05:31.131 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:31.127+0000 7f3060e35180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T23:05:31.135 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:05:31.135 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T23:05:31.135 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:05:31.181 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:05:31.270 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:31.267+0000 7f3060e35180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T23:05:31.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.355+0000 7f4fd910c640 1 Processor -- start 2024-09-11T23:05:31.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.355+0000 7f4fd910c640 1 -- start start 2024-09-11T23:05:31.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.355+0000 7f4fd910c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4fd4137e80 0x7f4fd4138260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:31.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.355+0000 7f4fd910c640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fd4137c80 con 0x7f4fd4070040 2024-09-11T23:05:31.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.355+0000 7f4fd910c640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f4fd40a5440 con 0x7f4fd4137e80 2024-09-11T23:05:31.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.355+0000 7f4fd2d9d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4fd4137e80 0x7f4fd4138260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:31.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.355+0000 7f4fd259c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f4fd4070040 0x7f4fd406bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38102/0 (socket says 172.21.15.12:38102) 2024-09-11T23:05:31.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.355+0000 7f4fd2d9d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4fd4137e80 0x7f4fd4138260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42202/0 (socket says 172.21.15.12:42202) 2024-09-11T23:05:31.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.355+0000 7f4fd259c640 1 -- 172.21.15.12:0/499648321 learned_addr learned my addr 172.21.15.12:0/499648321 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:31.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.355+0000 7f4fd2d9d640 1 -- 172.21.15.12:0/499648321 >> v1:172.21.15.12:6789/0 conn(0x7f4fd4070040 legacy=0x7f4fd406bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:31.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.355+0000 7f4fd2d9d640 1 -- 172.21.15.12:0/499648321 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fd41387a0 con 0x7f4fd4137e80 2024-09-11T23:05:31.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.359+0000 7f4fd2d9d640 1 --2- 172.21.15.12:0/499648321 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fd4137e80 0x7f4fd4138260 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f4fc4009740 tx=0x7f4fc401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10cf981b96d85d58 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:31.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.359+0000 7f4fd1d9b640 1 -- 172.21.15.12:0/499648321 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fc40b0070 con 0x7f4fd4137e80 2024-09-11T23:05:31.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.359+0000 7f4fd1d9b640 1 -- 172.21.15.12:0/499648321 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fc40ab530 con 0x7f4fd4137e80 2024-09-11T23:05:31.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.359+0000 7f4fd1d9b640 1 -- 172.21.15.12:0/499648321 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fc40ab830 con 0x7f4fd4137e80 2024-09-11T23:05:31.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.359+0000 7f4fd910c640 1 -- 172.21.15.12:0/499648321 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fd4137e80 msgr2=0x7f4fd4138260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:31.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.359+0000 7f4fd910c640 1 --2- 172.21.15.12:0/499648321 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fd4137e80 0x7f4fd4138260 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f4fc4009740 tx=0x7f4fc401c390 comp rx=0 tx=0).stop 2024-09-11T23:05:31.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.359+0000 7f4fd910c640 1 -- 172.21.15.12:0/499648321 shutdown_connections 2024-09-11T23:05:31.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.359+0000 7f4fd910c640 1 --2- 172.21.15.12:0/499648321 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fd4137e80 0x7f4fd4138260 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:31.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.359+0000 7f4fd910c640 1 -- 172.21.15.12:0/499648321 >> 172.21.15.12:0/499648321 conn(0x7f4fd4067e00 msgr2=0x7f4fd4068210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:31.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.359+0000 7f4fd910c640 1 -- 172.21.15.12:0/499648321 shutdown_connections 2024-09-11T23:05:31.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.359+0000 7f4fd910c640 1 -- 172.21.15.12:0/499648321 wait complete. 2024-09-11T23:05:31.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.359+0000 7f4fd910c640 1 Processor -- start 2024-09-11T23:05:31.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.359+0000 7f4fd910c640 1 -- start start 2024-09-11T23:05:31.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.359+0000 7f4fd910c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fd4070040 0x7f4fd413b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:31.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.359+0000 7f4fd910c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd40a2820 con 0x7f4fd4070040 2024-09-11T23:05:31.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.359+0000 7f4fd2d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fd4070040 0x7f4fd413b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:31.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.359+0000 7f4fd2d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fd4070040 0x7f4fd413b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42214/0 (socket says 172.21.15.12:42214) 2024-09-11T23:05:31.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.359+0000 7f4fd2d9d640 1 -- 172.21.15.12:0/1710168207 learned_addr learned my addr 172.21.15.12:0/1710168207 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:31.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.359+0000 7f4fd2d9d640 1 -- 172.21.15.12:0/1710168207 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fd413c830 con 0x7f4fd4070040 2024-09-11T23:05:31.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.359+0000 7f4fd2d9d640 1 --2- 172.21.15.12:0/1710168207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fd4070040 0x7f4fd413b940 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f4fc40ae040 tx=0x7f4fc4019130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:31.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.359+0000 7f4fbb7fe640 1 -- 172.21.15.12:0/1710168207 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fc40b8020 con 0x7f4fd4070040 2024-09-11T23:05:31.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.359+0000 7f4fbb7fe640 1 -- 172.21.15.12:0/1710168207 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fc40b4410 con 0x7f4fd4070040 2024-09-11T23:05:31.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.359+0000 7f4fd910c640 1 -- 172.21.15.12:0/1710168207 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fd413b690 con 0x7f4fd4070040 2024-09-11T23:05:31.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.359+0000 7f4fbb7fe640 1 -- 172.21.15.12:0/1710168207 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fc40b0040 con 0x7f4fd4070040 2024-09-11T23:05:31.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.359+0000 7f4fd910c640 1 -- 172.21.15.12:0/1710168207 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fd413c520 con 0x7f4fd4070040 2024-09-11T23:05:31.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.359+0000 7f4fd910c640 1 -- 172.21.15.12:0/1710168207 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fd413a9f0 con 0x7f4fd4070040 2024-09-11T23:05:31.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.363+0000 7f4fbb7fe640 1 -- 172.21.15.12:0/1710168207 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 21) ==== 44155+0+0 (secure 0 0 0) 0x7f4fc40bb020 con 0x7f4fd4070040 2024-09-11T23:05:31.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.363+0000 7f4fbb7fe640 1 --2- 172.21.15.12:0/1710168207 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f4fc0035ed0 0x7f4fc0038390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:31.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.363+0000 7f4fbb7fe640 1 -- 172.21.15.12:0/1710168207 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4643+0+0 (secure 0 0 0) 0x7f4fc40e2ae0 con 0x7f4fd4070040 2024-09-11T23:05:31.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.363+0000 7f4fd259c640 1 -- 172.21.15.12:0/1710168207 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f4fc0035ed0 msgr2=0x7f4fc0038390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6824/2340508205 2024-09-11T23:05:31.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.363+0000 7f4fd259c640 1 --2- 172.21.15.12:0/1710168207 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f4fc0035ed0 0x7f4fc0038390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:05:31.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.367+0000 7f4fbb7fe640 1 -- 172.21.15.12:0/1710168207 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4fc40c2030 con 0x7f4fd4070040 2024-09-11T23:05:31.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.539+0000 7f4fd910c640 1 -- 172.21.15.12:0/1710168207 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4fd406cd70 con 0x7f4fd4070040 2024-09-11T23:05:31.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.543+0000 7f4fbb7fe640 1 -- 172.21.15.12:0/1710168207 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v40) ==== 80+0+466 (secure 0 0 0) 0x7f4fc4016010 con 0x7f4fd4070040 2024-09-11T23:05:31.544 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/2509166838 2024-09-12T23:05:06.494857+0000 2024-09-11T23:05:31.544 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:6825/718802078 2024-09-12T23:05:06.494857+0000 2024-09-11T23:05:31.545 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:6824/718802078 2024-09-12T23:05:06.494857+0000 2024-09-11T23:05:31.545 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/2490570290 2024-09-12T23:05:06.494857+0000 2024-09-11T23:05:31.545 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/2957476143 2024-09-12T23:05:06.494857+0000 2024-09-11T23:05:31.545 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/37905181 2024-09-12T23:05:06.494857+0000 2024-09-11T23:05:31.545 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/3294231065 2024-09-12T23:05:06.494857+0000 2024-09-11T23:05:31.545 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/2407367943 2024-09-12T23:05:06.494857+0000 2024-09-11T23:05:31.545 INFO:teuthology.orchestra.run.smithi012.stderr:listed 8 entries 2024-09-11T23:05:31.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.543+0000 7f4fd910c640 1 -- 172.21.15.12:0/1710168207 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f4fc0035ed0 msgr2=0x7f4fc0038390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:05:31.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.543+0000 7f4fd910c640 1 --2- 172.21.15.12:0/1710168207 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f4fc0035ed0 0x7f4fc0038390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:31.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.543+0000 7f4fd910c640 1 -- 172.21.15.12:0/1710168207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fd4070040 msgr2=0x7f4fd413b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:31.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.543+0000 7f4fd910c640 1 --2- 172.21.15.12:0/1710168207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fd4070040 0x7f4fd413b940 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f4fc40ae040 tx=0x7f4fc4019130 comp rx=0 tx=0).stop 2024-09-11T23:05:31.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.543+0000 7f4fd910c640 1 -- 172.21.15.12:0/1710168207 shutdown_connections 2024-09-11T23:05:31.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.543+0000 7f4fd910c640 1 --2- 172.21.15.12:0/1710168207 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f4fc0035ed0 0x7f4fc0038390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:31.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.543+0000 7f4fd910c640 1 --2- 172.21.15.12:0/1710168207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fd4070040 0x7f4fd413b940 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:31.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.543+0000 7f4fd910c640 1 -- 172.21.15.12:0/1710168207 >> 172.21.15.12:0/1710168207 conn(0x7f4fd4067e00 msgr2=0x7f4fd4134b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:31.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.543+0000 7f4fd910c640 1 -- 172.21.15.12:0/1710168207 shutdown_connections 2024-09-11T23:05:31.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.543+0000 7f4fd910c640 1 -- 172.21.15.12:0/1710168207 wait complete. 2024-09-11T23:05:31.563 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi012.front.sepia.ceph.com... 2024-09-11T23:05:31.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:05:31.563 DEBUG:teuthology.orchestra.run.smithi012:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-11T23:05:31.573 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi012.stderr:ceph-fuse[37876]: fuse finished with error 0 and tester_r 0 2024-09-11T23:05:31.575 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi012.front.sepia.ceph.com 2024-09-11T23:05:31.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:05:31.575 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-11T23:05:31.725 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:31.723+0000 7f3060e35180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T23:05:31.737 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:05:31.780 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:31.775+0000 7f3060e35180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T23:05:31.832 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:31.831+0000 7f3060e35180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T23:05:31.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.899+0000 7f7a74ea4640 1 Processor -- start 2024-09-11T23:05:31.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.899+0000 7f7a74ea4640 1 -- start start 2024-09-11T23:05:31.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.903+0000 7f7a74ea4640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7a70138000 0x7f7a701383e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:31.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.903+0000 7f7a74ea4640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a700a54d0 con 0x7f7a7006fca0 2024-09-11T23:05:31.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.903+0000 7f7a74ea4640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f7a70137860 con 0x7f7a70138000 2024-09-11T23:05:31.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.903+0000 7f7a6e59c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7a70138000 0x7f7a701383e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:31.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.903+0000 7f7a6e59c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7a70138000 0x7f7a701383e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42216/0 (socket says 172.21.15.12:42216) 2024-09-11T23:05:31.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.903+0000 7f7a6e59c640 1 -- 172.21.15.12:0/2766890365 learned_addr learned my addr 172.21.15.12:0/2766890365 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:31.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.903+0000 7f7a6e59c640 1 -- 172.21.15.12:0/2766890365 >> v1:172.21.15.12:6789/0 conn(0x7f7a7006fca0 legacy=0x7f7a7006bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:31.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.903+0000 7f7a6e59c640 1 -- 172.21.15.12:0/2766890365 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a700a51c0 con 0x7f7a70138000 2024-09-11T23:05:31.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.903+0000 7f7a6e59c640 1 --2- 172.21.15.12:0/2766890365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a70138000 0x7f7a701383e0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f7a580097f0 tx=0x7f7a5801c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2030aac13572c31b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:31.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.903+0000 7f7a6d59a640 1 -- 172.21.15.12:0/2766890365 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a580ab3f0 con 0x7f7a70138000 2024-09-11T23:05:31.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.903+0000 7f7a6d59a640 1 -- 172.21.15.12:0/2766890365 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a580b0070 con 0x7f7a70138000 2024-09-11T23:05:31.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.903+0000 7f7a6d59a640 1 -- 172.21.15.12:0/2766890365 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a580ab6e0 con 0x7f7a70138000 2024-09-11T23:05:31.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.907+0000 7f7a74ea4640 1 -- 172.21.15.12:0/2766890365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a70138000 msgr2=0x7f7a701383e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:31.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.907+0000 7f7a74ea4640 1 --2- 172.21.15.12:0/2766890365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a70138000 0x7f7a701383e0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f7a580097f0 tx=0x7f7a5801c4e0 comp rx=0 tx=0).stop 2024-09-11T23:05:31.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.907+0000 7f7a74ea4640 1 -- 172.21.15.12:0/2766890365 shutdown_connections 2024-09-11T23:05:31.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.907+0000 7f7a74ea4640 1 --2- 172.21.15.12:0/2766890365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a70138000 0x7f7a701383e0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:31.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.907+0000 7f7a74ea4640 1 -- 172.21.15.12:0/2766890365 >> 172.21.15.12:0/2766890365 conn(0x7f7a700a91a0 msgr2=0x7f7a700a95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:31.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.907+0000 7f7a74ea4640 1 -- 172.21.15.12:0/2766890365 shutdown_connections 2024-09-11T23:05:31.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.907+0000 7f7a74ea4640 1 -- 172.21.15.12:0/2766890365 wait complete. 2024-09-11T23:05:31.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.907+0000 7f7a74ea4640 1 Processor -- start 2024-09-11T23:05:31.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.907+0000 7f7a74ea4640 1 -- start start 2024-09-11T23:05:31.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.907+0000 7f7a74ea4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a7006fca0 0x7f7a70138ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:31.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.907+0000 7f7a74ea4640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7013ff30 con 0x7f7a7006fca0 2024-09-11T23:05:31.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.907+0000 7f7a6e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a7006fca0 0x7f7a70138ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:31.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.907+0000 7f7a6e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a7006fca0 0x7f7a70138ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42222/0 (socket says 172.21.15.12:42222) 2024-09-11T23:05:31.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.907+0000 7f7a6e59c640 1 -- 172.21.15.12:0/3081469027 learned_addr learned my addr 172.21.15.12:0/3081469027 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:31.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.907+0000 7f7a6e59c640 1 -- 172.21.15.12:0/3081469027 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a7013cc30 con 0x7f7a7006fca0 2024-09-11T23:05:31.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.907+0000 7f7a6e59c640 1 --2- 172.21.15.12:0/3081469027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a7006fca0 0x7f7a70138ea0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f7a5801a110 tx=0x7f7a5801ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:31.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.907+0000 7f7a66ffd640 1 -- 172.21.15.12:0/3081469027 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a580abe40 con 0x7f7a7006fca0 2024-09-11T23:05:31.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.907+0000 7f7a66ffd640 1 -- 172.21.15.12:0/3081469027 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a580be3f0 con 0x7f7a7006fca0 2024-09-11T23:05:31.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.907+0000 7f7a74ea4640 1 -- 172.21.15.12:0/3081469027 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a7009f7f0 con 0x7f7a7006fca0 2024-09-11T23:05:31.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.907+0000 7f7a66ffd640 1 -- 172.21.15.12:0/3081469027 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a580be710 con 0x7f7a7006fca0 2024-09-11T23:05:31.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.907+0000 7f7a74ea4640 1 -- 172.21.15.12:0/3081469027 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a7013b3c0 con 0x7f7a7006fca0 2024-09-11T23:05:31.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.907+0000 7f7a66ffd640 1 -- 172.21.15.12:0/3081469027 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 21) ==== 44155+0+0 (secure 0 0 0) 0x7f7a580c7440 con 0x7f7a7006fca0 2024-09-11T23:05:31.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.907+0000 7f7a74ea4640 1 -- 172.21.15.12:0/3081469027 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a7009b780 con 0x7f7a7006fca0 2024-09-11T23:05:31.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.907+0000 7f7a66ffd640 1 --2- 172.21.15.12:0/3081469027 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f7a50035ed0 0x7f7a50038390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:31.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.907+0000 7f7a66ffd640 1 -- 172.21.15.12:0/3081469027 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4643+0+0 (secure 0 0 0) 0x7f7a580e33a0 con 0x7f7a7006fca0 2024-09-11T23:05:31.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.907+0000 7f7a6dd9b640 1 -- 172.21.15.12:0/3081469027 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f7a50035ed0 msgr2=0x7f7a50038390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6824/2340508205 2024-09-11T23:05:31.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.907+0000 7f7a6dd9b640 1 --2- 172.21.15.12:0/3081469027 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f7a50035ed0 0x7f7a50038390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:05:31.914 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:31.911+0000 7f3060e35180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T23:05:31.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:31.911+0000 7f7a66ffd640 1 -- 172.21.15.12:0/3081469027 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7a7009b780 con 0x7f7a7006fca0 2024-09-11T23:05:31.966 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:31.963+0000 7f3060e35180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T23:05:32.045 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:32.043+0000 7f3060e35180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T23:05:32.098 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:32.095+0000 7f3060e35180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T23:05:32.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.107+0000 7f7a74ea4640 1 -- 172.21.15.12:0/3081469027 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7a7013c9f0 con 0x7f7a7006fca0 2024-09-11T23:05:32.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.107+0000 7f7a66ffd640 1 -- 172.21.15.12:0/3081469027 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+4890 (secure 0 0 0) 0x7f7a7013c9f0 con 0x7f7a7006fca0 2024-09-11T23:05:32.111 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:05:32.111 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":30,"btime":"2024-09-11T23:05:10:521996+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:04:45.641763+0000","modified":"2024-09-11T23:04:48.653841+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4528},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4528":{"gid":4528,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6829/2765393463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":2765393463},{"type":"v1","addr":"172.21.15.12:6829","nonce":2765393463}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4528,"qdb_cluster":[4528]},"id":3},{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:05:06.863235+0000","modified":"2024-09-11T23:05:09.896567+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4527},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4527":{"gid":4527,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":8,"addr":"172.21.15.12:6827/1887547537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":1887547537},{"type":"v1","addr":"172.21.15.12:6827","nonce":1887547537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs_b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4527,"qdb_cluster":[4527]},"id":4}]} 2024-09-11T23:05:32.111 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 30 2024-09-11T23:05:32.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.111+0000 7f7a6dd9b640 1 -- 172.21.15.12:0/3081469027 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f7a50035ed0 msgr2=0x7f7a50038390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6824/2340508205 2024-09-11T23:05:32.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.111+0000 7f7a6dd9b640 1 --2- 172.21.15.12:0/3081469027 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f7a50035ed0 0x7f7a50038390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T23:05:32.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.111+0000 7f7a74ea4640 1 -- 172.21.15.12:0/3081469027 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f7a50035ed0 msgr2=0x7f7a50038390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:05:32.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.111+0000 7f7a74ea4640 1 --2- 172.21.15.12:0/3081469027 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f7a50035ed0 0x7f7a50038390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:32.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.111+0000 7f7a74ea4640 1 -- 172.21.15.12:0/3081469027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a7006fca0 msgr2=0x7f7a70138ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:32.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.111+0000 7f7a74ea4640 1 --2- 172.21.15.12:0/3081469027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a7006fca0 0x7f7a70138ea0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f7a5801a110 tx=0x7f7a5801ad20 comp rx=0 tx=0).stop 2024-09-11T23:05:32.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.111+0000 7f7a74ea4640 1 -- 172.21.15.12:0/3081469027 shutdown_connections 2024-09-11T23:05:32.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.111+0000 7f7a74ea4640 1 --2- 172.21.15.12:0/3081469027 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f7a50035ed0 0x7f7a50038390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:32.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.111+0000 7f7a74ea4640 1 --2- 172.21.15.12:0/3081469027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a7006fca0 0x7f7a70138ea0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:32.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.111+0000 7f7a74ea4640 1 -- 172.21.15.12:0/3081469027 >> 172.21.15.12:0/3081469027 conn(0x7f7a700a91a0 msgr2=0x7f7a70134b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:32.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.111+0000 7f7a74ea4640 1 -- 172.21.15.12:0/3081469027 shutdown_connections 2024-09-11T23:05:32.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.111+0000 7f7a74ea4640 1 -- 172.21.15.12:0/3081469027 wait complete. 2024-09-11T23:05:32.129 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:05:32.249 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:32.247+0000 7f3060e35180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T23:05:32.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.251+0000 7fc44db2d640 1 Processor -- start 2024-09-11T23:05:32.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.251+0000 7fc44db2d640 1 -- start start 2024-09-11T23:05:32.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.251+0000 7fc44db2d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc448134900 0x7fc448134ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:32.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.251+0000 7fc44db2d640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc44806be20 con 0x7fc448135220 2024-09-11T23:05:32.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.251+0000 7fc44db2d640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fc44806cb80 con 0x7fc448134900 2024-09-11T23:05:32.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.251+0000 7fc4477fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc448134900 0x7fc448134ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:32.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.251+0000 7fc4477fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc448134900 0x7fc448134ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42224/0 (socket says 172.21.15.12:42224) 2024-09-11T23:05:32.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.251+0000 7fc4477fe640 1 -- 172.21.15.12:0/3277685659 learned_addr learned my addr 172.21.15.12:0/3277685659 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:32.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.251+0000 7fc4477fe640 1 -- 172.21.15.12:0/3277685659 >> v1:172.21.15.12:6789/0 conn(0x7fc448135220 legacy=0x7fc4480a24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:32.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.251+0000 7fc4477fe640 1 -- 172.21.15.12:0/3277685659 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4480a4af0 con 0x7fc448134900 2024-09-11T23:05:32.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.251+0000 7fc4477fe640 1 --2- 172.21.15.12:0/3277685659 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc448134900 0x7fc448134ce0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fc4380097f0 tx=0x7fc43801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b73b789265fcea7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:32.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.251+0000 7fc446ffd640 1 -- 172.21.15.12:0/3277685659 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4380a7070 con 0x7fc448134900 2024-09-11T23:05:32.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.251+0000 7fc446ffd640 1 -- 172.21.15.12:0/3277685659 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4380b0070 con 0x7fc448134900 2024-09-11T23:05:32.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.251+0000 7fc446ffd640 1 -- 172.21.15.12:0/3277685659 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4380ab5c0 con 0x7fc448134900 2024-09-11T23:05:32.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.255+0000 7fc44db2d640 1 -- 172.21.15.12:0/3277685659 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc448134900 msgr2=0x7fc448134ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:32.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.255+0000 7fc44db2d640 1 --2- 172.21.15.12:0/3277685659 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc448134900 0x7fc448134ce0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fc4380097f0 tx=0x7fc43801c450 comp rx=0 tx=0).stop 2024-09-11T23:05:32.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.255+0000 7fc44db2d640 1 -- 172.21.15.12:0/3277685659 shutdown_connections 2024-09-11T23:05:32.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.255+0000 7fc44db2d640 1 --2- 172.21.15.12:0/3277685659 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc448134900 0x7fc448134ce0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:32.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.255+0000 7fc44db2d640 1 -- 172.21.15.12:0/3277685659 >> 172.21.15.12:0/3277685659 conn(0x7fc448068000 msgr2=0x7fc4480a5910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:32.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.255+0000 7fc44db2d640 1 -- 172.21.15.12:0/3277685659 shutdown_connections 2024-09-11T23:05:32.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.255+0000 7fc44db2d640 1 -- 172.21.15.12:0/3277685659 wait complete. 2024-09-11T23:05:32.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.255+0000 7fc44db2d640 1 Processor -- start 2024-09-11T23:05:32.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.255+0000 7fc44db2d640 1 -- start start 2024-09-11T23:05:32.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.255+0000 7fc44db2d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc448134900 0x7fc4481393e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:32.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.255+0000 7fc44db2d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc44813ff00 con 0x7fc448134900 2024-09-11T23:05:32.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.255+0000 7fc4477fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc448134900 0x7fc4481393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:32.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.255+0000 7fc4477fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc448134900 0x7fc4481393e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42240/0 (socket says 172.21.15.12:42240) 2024-09-11T23:05:32.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.255+0000 7fc4477fe640 1 -- 172.21.15.12:0/2337868766 learned_addr learned my addr 172.21.15.12:0/2337868766 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:32.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.255+0000 7fc4477fe640 1 -- 172.21.15.12:0/2337868766 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc44813ce20 con 0x7fc448134900 2024-09-11T23:05:32.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.255+0000 7fc4477fe640 1 --2- 172.21.15.12:0/2337868766 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc448134900 0x7fc4481393e0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fc438019060 tx=0x7fc43801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:32.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.255+0000 7fc444ff9640 1 -- 172.21.15.12:0/2337868766 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4380be3f0 con 0x7fc448134900 2024-09-11T23:05:32.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.255+0000 7fc444ff9640 1 -- 172.21.15.12:0/2337868766 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4380be590 con 0x7fc448134900 2024-09-11T23:05:32.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.255+0000 7fc44db2d640 1 -- 172.21.15.12:0/2337868766 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc44813b2c0 con 0x7fc448134900 2024-09-11T23:05:32.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.255+0000 7fc444ff9640 1 -- 172.21.15.12:0/2337868766 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4380be870 con 0x7fc448134900 2024-09-11T23:05:32.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.255+0000 7fc44db2d640 1 -- 172.21.15.12:0/2337868766 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc44813cb10 con 0x7fc448134900 2024-09-11T23:05:32.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.255+0000 7fc44db2d640 1 -- 172.21.15.12:0/2337868766 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc448134ce0 con 0x7fc448134900 2024-09-11T23:05:32.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.255+0000 7fc444ff9640 1 -- 172.21.15.12:0/2337868766 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 21) ==== 44155+0+0 (secure 0 0 0) 0x7fc4380c7430 con 0x7fc448134900 2024-09-11T23:05:32.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.259+0000 7fc444ff9640 1 --2- 172.21.15.12:0/2337868766 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7fc428035ed0 0x7fc428038390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:32.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.259+0000 7fc43ffff640 1 -- 172.21.15.12:0/2337868766 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7fc428035ed0 msgr2=0x7fc428038390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6824/2340508205 2024-09-11T23:05:32.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.259+0000 7fc444ff9640 1 -- 172.21.15.12:0/2337868766 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4643+0+0 (secure 0 0 0) 0x7fc4380e3750 con 0x7fc448134900 2024-09-11T23:05:32.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.259+0000 7fc43ffff640 1 --2- 172.21.15.12:0/2337868766 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7fc428035ed0 0x7fc428038390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:05:32.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.267+0000 7fc444ff9640 1 -- 172.21.15.12:0/2337868766 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc4380160d0 con 0x7fc448134900 2024-09-11T23:05:32.308 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:32.307+0000 7f3060e35180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T23:05:32.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.463+0000 7fc43ffff640 1 -- 172.21.15.12:0/2337868766 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7fc428035ed0 msgr2=0x7fc428038390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6824/2340508205 2024-09-11T23:05:32.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.463+0000 7fc43ffff640 1 --2- 172.21.15.12:0/2337868766 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7fc428035ed0 0x7fc428038390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T23:05:32.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.507+0000 7fc44db2d640 1 -- 172.21.15.12:0/2337868766 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc44806cd70 con 0x7fc448134900 2024-09-11T23:05:32.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.507+0000 7fc444ff9640 1 -- 172.21.15.12:0/2337868766 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+4890 (secure 0 0 0) 0x7fc4380b3780 con 0x7fc448134900 2024-09-11T23:05:32.511 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:05:32.512 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":30,"btime":"2024-09-11T23:05:10:521996+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:04:45.641763+0000","modified":"2024-09-11T23:04:48.653841+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4528},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4528":{"gid":4528,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6829/2765393463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":2765393463},{"type":"v1","addr":"172.21.15.12:6829","nonce":2765393463}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4528,"qdb_cluster":[4528]},"id":3},{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:05:06.863235+0000","modified":"2024-09-11T23:05:09.896567+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4527},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4527":{"gid":4527,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":8,"addr":"172.21.15.12:6827/1887547537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":1887547537},{"type":"v1","addr":"172.21.15.12:6827","nonce":1887547537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs_b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4527,"qdb_cluster":[4527]},"id":4}]} 2024-09-11T23:05:32.512 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 30 2024-09-11T23:05:32.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.511+0000 7fc44db2d640 1 -- 172.21.15.12:0/2337868766 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7fc428035ed0 msgr2=0x7fc428038390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:05:32.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.511+0000 7fc44db2d640 1 --2- 172.21.15.12:0/2337868766 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7fc428035ed0 0x7fc428038390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:32.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.511+0000 7fc44db2d640 1 -- 172.21.15.12:0/2337868766 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc448134900 msgr2=0x7fc4481393e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:32.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.511+0000 7fc44db2d640 1 --2- 172.21.15.12:0/2337868766 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc448134900 0x7fc4481393e0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fc438019060 tx=0x7fc43801ac90 comp rx=0 tx=0).stop 2024-09-11T23:05:32.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.511+0000 7fc44db2d640 1 -- 172.21.15.12:0/2337868766 shutdown_connections 2024-09-11T23:05:32.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.511+0000 7fc44db2d640 1 --2- 172.21.15.12:0/2337868766 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7fc428035ed0 0x7fc428038390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:32.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.511+0000 7fc44db2d640 1 --2- 172.21.15.12:0/2337868766 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc448134900 0x7fc4481393e0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:32.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.511+0000 7fc44db2d640 1 -- 172.21.15.12:0/2337868766 >> 172.21.15.12:0/2337868766 conn(0x7fc448068000 msgr2=0x7fc4481364b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:32.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.511+0000 7fc44db2d640 1 -- 172.21.15.12:0/2337868766 shutdown_connections 2024-09-11T23:05:32.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.511+0000 7fc44db2d640 1 -- 172.21.15.12:0/2337868766 wait complete. 2024-09-11T23:05:32.529 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:05:32.536 INFO:tasks.ceph.mgr.x.smithi012.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-11T23:05:32.536 INFO:tasks.ceph.mgr.x.smithi012.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-11T23:05:32.536 INFO:tasks.ceph.mgr.x.smithi012.stderr: from numpy import show_config as show_numpy_config 2024-09-11T23:05:32.544 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:32.543+0000 7f3060e35180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T23:05:32.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.631+0000 7efe1a6e1640 1 Processor -- start 2024-09-11T23:05:32.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.635+0000 7efe1a6e1640 1 -- start start 2024-09-11T23:05:32.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.635+0000 7efe1a6e1640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efe14134ff0 0x7efe14137fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:32.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.635+0000 7efe1a6e1640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe140a0aa0 con 0x7efe14134c10 2024-09-11T23:05:32.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.635+0000 7efe1a6e1640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7efe140739f0 con 0x7efe14134ff0 2024-09-11T23:05:32.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.635+0000 7efe137fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efe14134ff0 0x7efe14137fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:32.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.635+0000 7efe137fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efe14134ff0 0x7efe14137fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42250/0 (socket says 172.21.15.12:42250) 2024-09-11T23:05:32.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.635+0000 7efe137fe640 1 -- 172.21.15.12:0/3610626546 learned_addr learned my addr 172.21.15.12:0/3610626546 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:32.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.635+0000 7efe137fe640 1 -- 172.21.15.12:0/3610626546 >> v1:172.21.15.12:6789/0 conn(0x7efe14134c10 legacy=0x7efe141378d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:32.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.635+0000 7efe137fe640 1 -- 172.21.15.12:0/3610626546 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe140733d0 con 0x7efe14134ff0 2024-09-11T23:05:32.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.635+0000 7efe137fe640 1 --2- 172.21.15.12:0/3610626546 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe14134ff0 0x7efe14137fe0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7efe040097f0 tx=0x7efe0401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e36d352a9fc9d94 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:32.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.635+0000 7efe12ffd640 1 -- 172.21.15.12:0/3610626546 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe040b0070 con 0x7efe14134ff0 2024-09-11T23:05:32.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.635+0000 7efe12ffd640 1 -- 172.21.15.12:0/3610626546 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe040ab530 con 0x7efe14134ff0 2024-09-11T23:05:32.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.635+0000 7efe12ffd640 1 -- 172.21.15.12:0/3610626546 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe040ab830 con 0x7efe14134ff0 2024-09-11T23:05:32.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.635+0000 7efe1a6e1640 1 -- 172.21.15.12:0/3610626546 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe14134ff0 msgr2=0x7efe14137fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:32.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.635+0000 7efe1a6e1640 1 --2- 172.21.15.12:0/3610626546 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe14134ff0 0x7efe14137fe0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7efe040097f0 tx=0x7efe0401c450 comp rx=0 tx=0).stop 2024-09-11T23:05:32.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.639+0000 7efe1a6e1640 1 -- 172.21.15.12:0/3610626546 shutdown_connections 2024-09-11T23:05:32.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.639+0000 7efe1a6e1640 1 --2- 172.21.15.12:0/3610626546 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe14134ff0 0x7efe14137fe0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:32.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.639+0000 7efe1a6e1640 1 -- 172.21.15.12:0/3610626546 >> 172.21.15.12:0/3610626546 conn(0x7efe140aa330 msgr2=0x7efe140aa740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:32.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.639+0000 7efe1a6e1640 1 -- 172.21.15.12:0/3610626546 shutdown_connections 2024-09-11T23:05:32.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.639+0000 7efe1a6e1640 1 -- 172.21.15.12:0/3610626546 wait complete. 2024-09-11T23:05:32.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.639+0000 7efe1a6e1640 1 Processor -- start 2024-09-11T23:05:32.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.639+0000 7efe1a6e1640 1 -- start start 2024-09-11T23:05:32.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.639+0000 7efe1a6e1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe14134c10 0x7efe1412eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:32.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.639+0000 7efe1a6e1640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7efe140722d0 con 0x7efe14134c10 2024-09-11T23:05:32.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.639+0000 7efe13fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe14134c10 0x7efe1412eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:32.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.639+0000 7efe13fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe14134c10 0x7efe1412eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42262/0 (socket says 172.21.15.12:42262) 2024-09-11T23:05:32.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.639+0000 7efe13fff640 1 -- 172.21.15.12:0/2849781043 learned_addr learned my addr 172.21.15.12:0/2849781043 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:32.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.639+0000 7efe13fff640 1 -- 172.21.15.12:0/2849781043 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe1409b4f0 con 0x7efe14134c10 2024-09-11T23:05:32.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.639+0000 7efe13fff640 1 --2- 172.21.15.12:0/2849781043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe14134c10 0x7efe1412eab0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7efdfc00c3a0 tx=0x7efdfc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:32.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.639+0000 7efe10ff9640 1 -- 172.21.15.12:0/2849781043 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdfc005150 con 0x7efe14134c10 2024-09-11T23:05:32.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.639+0000 7efe10ff9640 1 -- 172.21.15.12:0/2849781043 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdfc0052f0 con 0x7efe14134c10 2024-09-11T23:05:32.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.639+0000 7efe1a6e1640 1 -- 172.21.15.12:0/2849781043 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe1406e8c0 con 0x7efe14134c10 2024-09-11T23:05:32.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.639+0000 7efe10ff9640 1 -- 172.21.15.12:0/2849781043 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdfc0067e0 con 0x7efe14134c10 2024-09-11T23:05:32.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.639+0000 7efe1a6e1640 1 -- 172.21.15.12:0/2849781043 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe1406ddf0 con 0x7efe14134c10 2024-09-11T23:05:32.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.639+0000 7efe1a6e1640 1 -- 172.21.15.12:0/2849781043 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe140a3610 con 0x7efe14134c10 2024-09-11T23:05:32.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.639+0000 7efe10ff9640 1 -- 172.21.15.12:0/2849781043 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 21) ==== 44155+0+0 (secure 0 0 0) 0x7efdfc019020 con 0x7efe14134c10 2024-09-11T23:05:32.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.639+0000 7efe10ff9640 1 --2- 172.21.15.12:0/2849781043 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7efdf4035ed0 0x7efdf4038390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:32.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.639+0000 7efe10ff9640 1 -- 172.21.15.12:0/2849781043 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4643+0+0 (secure 0 0 0) 0x7efdfc047ec0 con 0x7efe14134c10 2024-09-11T23:05:32.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.639+0000 7efe137fe640 1 -- 172.21.15.12:0/2849781043 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7efdf4035ed0 msgr2=0x7efdf4038390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6824/2340508205 2024-09-11T23:05:32.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.639+0000 7efe137fe640 1 --2- 172.21.15.12:0/2849781043 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7efdf4035ed0 0x7efdf4038390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:05:32.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.647+0000 7efe10ff9640 1 -- 172.21.15.12:0/2849781043 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7efdfc01a560 con 0x7efe14134c10 2024-09-11T23:05:32.689 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:32.687+0000 7f3060e35180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:05:32.805 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:32.803+0000 7f3060e35180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T23:05:32.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.807+0000 7efe1a6e1640 1 -- 172.21.15.12:0/2849781043 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efe141378d0 con 0x7efe14134c10 2024-09-11T23:05:32.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.811+0000 7efe10ff9640 1 -- 172.21.15.12:0/2849781043 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+15062 (secure 0 0 0) 0x7efdfc01a7c0 con 0x7efe14134c10 2024-09-11T23:05:32.813 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:05:32.813 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":40,"fsid":"8be14356-3340-4500-91a2-4cbc6b511f65","created":"2024-09-11T23:03:10.620234+0000","modified":"2024-09-11T23:05:07.926161+0000","last_up_change":"2024-09-11T23:03:22.359028+0000","last_in_change":"2024-09-11T23:03:11.545817+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:03:23.587068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:04:43.298425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-11T23:04:44.624329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_b_metadata","create_time":"2024-09-11T23:05:05.624837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs_b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_b_data","create_time":"2024-09-11T23:05:06.296091+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs_b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"153b72a1-40b1-400d-93ea-333e733f9bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6817","nonce":3680911937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6819","nonce":3680911937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6823","nonce":3680911937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6821","nonce":3680911937}]},"public_addr":"172.21.15.12:6817/3680911937","cluster_addr":"172.21.15.12:6819/3680911937","heartbeat_back_addr":"172.21.15.12:6823/3680911937","heartbeat_front_addr":"172.21.15.12:6821/3680911937","state":["exists","up"]},{"osd":1,"uuid":"94669e49-ee4f-4acf-9e25-e94374dda8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6801","nonce":236825163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6803","nonce":236825163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6807","nonce":236825163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6805","nonce":236825163}]},"public_addr":"172.21.15.12:6801/236825163","cluster_addr":"172.21.15.12:6803/236825163","heartbeat_back_addr":"172.21.15.12:6807/236825163","heartbeat_front_addr":"172.21.15.12:6805/236825163","state":["exists","up"]},{"osd":2,"uuid":"826dae4d-8888-4ec5-8f00-425b3be93814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6809","nonce":3263521655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6811","nonce":3263521655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6815","nonce":3263521655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6813","nonce":3263521655}]},"public_addr":"172.21.15.12:6809/3263521655","cluster_addr":"172.21.15.12:6811/3263521655","heartbeat_back_addr":"172.21.15.12:6815/3263521655","heartbeat_front_addr":"172.21.15.12:6813/3263521655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:19.398518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.761524+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.904997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/2509166838":"2024-09-12T23:05:06.494857+0000","172.21.15.12:6825/718802078":"2024-09-12T23:05:06.494857+0000","172.21.15.12:6824/718802078":"2024-09-12T23:05:06.494857+0000","172.21.15.12:0/2490570290":"2024-09-12T23:05:06.494857+0000","172.21.15.12:0/2957476143":"2024-09-12T23:05:06.494857+0000","172.21.15.12:0/37905181":"2024-09-12T23:05:06.494857+0000","172.21.15.12:0/3294231065":"2024-09-12T23:05:06.494857+0000","172.21.15.12:0/2407367943":"2024-09-12T23:05:06.494857+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:05:32.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.811+0000 7efe1a6e1640 1 -- 172.21.15.12:0/2849781043 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7efdf4035ed0 msgr2=0x7efdf4038390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:05:32.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.811+0000 7efe1a6e1640 1 --2- 172.21.15.12:0/2849781043 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7efdf4035ed0 0x7efdf4038390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:32.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.811+0000 7efe1a6e1640 1 -- 172.21.15.12:0/2849781043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe14134c10 msgr2=0x7efe1412eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:32.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.811+0000 7efe1a6e1640 1 --2- 172.21.15.12:0/2849781043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe14134c10 0x7efe1412eab0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7efdfc00c3a0 tx=0x7efdfc00c860 comp rx=0 tx=0).stop 2024-09-11T23:05:32.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.811+0000 7efe1a6e1640 1 -- 172.21.15.12:0/2849781043 shutdown_connections 2024-09-11T23:05:32.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.811+0000 7efe1a6e1640 1 --2- 172.21.15.12:0/2849781043 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7efdf4035ed0 0x7efdf4038390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:32.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.811+0000 7efe1a6e1640 1 --2- 172.21.15.12:0/2849781043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe14134c10 0x7efe1412eab0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:32.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.811+0000 7efe1a6e1640 1 -- 172.21.15.12:0/2849781043 >> 172.21.15.12:0/2849781043 conn(0x7efe140aa330 msgr2=0x7efe140a8ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:32.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.811+0000 7efe1a6e1640 1 -- 172.21.15.12:0/2849781043 shutdown_connections 2024-09-11T23:05:32.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.811+0000 7efe1a6e1640 1 -- 172.21.15.12:0/2849781043 wait complete. 2024-09-11T23:05:32.832 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T23:05:32.832 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:05:32.870 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:32.867+0000 7f3060e35180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T23:05:32.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.979+0000 7f3c85cc6640 1 Processor -- start 2024-09-11T23:05:32.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.979+0000 7f3c85cc6640 1 -- start start 2024-09-11T23:05:32.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.979+0000 7f3c85cc6640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3c800a4b80 0x7f3c800a7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:32.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.979+0000 7f3c85cc6640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c800a82a0 con 0x7f3c8013a410 2024-09-11T23:05:32.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.979+0000 7f3c85cc6640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f3c800a3cb0 con 0x7f3c800a4b80 2024-09-11T23:05:32.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.983+0000 7f3c7effd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3c800a4b80 0x7f3c800a7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:32.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.983+0000 7f3c7effd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3c800a4b80 0x7f3c800a7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42272/0 (socket says 172.21.15.12:42272) 2024-09-11T23:05:32.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.983+0000 7f3c7effd640 1 -- 172.21.15.12:0/2741928985 learned_addr learned my addr 172.21.15.12:0/2741928985 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:32.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.983+0000 7f3c7f7fe640 1 --1- 172.21.15.12:0/2741928985 >> v1:172.21.15.12:6789/0 conn(0x7f3c8013a410 0x7f3c800a6af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38142/0 (socket says 172.21.15.12:38142) 2024-09-11T23:05:32.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.983+0000 7f3c7effd640 1 -- 172.21.15.12:0/2741928985 >> v1:172.21.15.12:6789/0 conn(0x7f3c8013a410 legacy=0x7f3c800a6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:32.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.983+0000 7f3c7effd640 1 -- 172.21.15.12:0/2741928985 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c80139fe0 con 0x7f3c800a4b80 2024-09-11T23:05:32.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.983+0000 7f3c7effd640 1 --2- 172.21.15.12:0/2741928985 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c800a4b80 0x7f3c800a7200 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f3c740097f0 tx=0x7f3c7401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a772174048e33172 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:32.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.983+0000 7f3c7e7fc640 1 -- 172.21.15.12:0/2741928985 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c740b2070 con 0x7f3c800a4b80 2024-09-11T23:05:32.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.983+0000 7f3c7e7fc640 1 -- 172.21.15.12:0/2741928985 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c740a9070 con 0x7f3c800a4b80 2024-09-11T23:05:32.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.983+0000 7f3c7e7fc640 1 -- 172.21.15.12:0/2741928985 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c740ad5b0 con 0x7f3c800a4b80 2024-09-11T23:05:32.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.983+0000 7f3c85cc6640 1 -- 172.21.15.12:0/2741928985 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c800a4b80 msgr2=0x7f3c800a7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:32.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.983+0000 7f3c85cc6640 1 --2- 172.21.15.12:0/2741928985 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c800a4b80 0x7f3c800a7200 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f3c740097f0 tx=0x7f3c7401c450 comp rx=0 tx=0).stop 2024-09-11T23:05:32.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.983+0000 7f3c85cc6640 1 -- 172.21.15.12:0/2741928985 shutdown_connections 2024-09-11T23:05:32.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.983+0000 7f3c85cc6640 1 --2- 172.21.15.12:0/2741928985 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c800a4b80 0x7f3c800a7200 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:32.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.983+0000 7f3c85cc6640 1 -- 172.21.15.12:0/2741928985 >> 172.21.15.12:0/2741928985 conn(0x7f3c800ac2c0 msgr2=0x7f3c800ac6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:32.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.983+0000 7f3c85cc6640 1 -- 172.21.15.12:0/2741928985 shutdown_connections 2024-09-11T23:05:32.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.983+0000 7f3c85cc6640 1 -- 172.21.15.12:0/2741928985 wait complete. 2024-09-11T23:05:32.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.987+0000 7f3c85cc6640 1 Processor -- start 2024-09-11T23:05:32.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.987+0000 7f3c85cc6640 1 -- start start 2024-09-11T23:05:32.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.987+0000 7f3c85cc6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c800a4b80 0x7f3c800a0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:32.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.987+0000 7f3c85cc6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3c800a7740 con 0x7f3c800a4b80 2024-09-11T23:05:32.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.987+0000 7f3c7f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c800a4b80 0x7f3c800a0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:32.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.987+0000 7f3c7f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c800a4b80 0x7f3c800a0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42286/0 (socket says 172.21.15.12:42286) 2024-09-11T23:05:32.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.987+0000 7f3c7f7fe640 1 -- 172.21.15.12:0/1220524303 learned_addr learned my addr 172.21.15.12:0/1220524303 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:32.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.987+0000 7f3c7f7fe640 1 -- 172.21.15.12:0/1220524303 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c800a1710 con 0x7f3c800a4b80 2024-09-11T23:05:32.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.987+0000 7f3c7f7fe640 1 --2- 172.21.15.12:0/1220524303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c800a4b80 0x7f3c800a0fd0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f3c7000c410 tx=0x7f3c7000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:32.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.987+0000 7f3c67fff640 1 -- 172.21.15.12:0/1220524303 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c70007410 con 0x7f3c800a4b80 2024-09-11T23:05:32.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.987+0000 7f3c67fff640 1 -- 172.21.15.12:0/1220524303 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c700075b0 con 0x7f3c800a4b80 2024-09-11T23:05:32.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.987+0000 7f3c85cc6640 1 -- 172.21.15.12:0/1220524303 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c800a1a30 con 0x7f3c800a4b80 2024-09-11T23:05:32.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.987+0000 7f3c67fff640 1 -- 172.21.15.12:0/1220524303 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c70004920 con 0x7f3c800a4b80 2024-09-11T23:05:32.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.987+0000 7f3c85cc6640 1 -- 172.21.15.12:0/1220524303 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c8009f590 con 0x7f3c800a4b80 2024-09-11T23:05:32.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.987+0000 7f3c67fff640 1 -- 172.21.15.12:0/1220524303 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 21) ==== 44155+0+0 (secure 0 0 0) 0x7f3c7001a020 con 0x7f3c800a4b80 2024-09-11T23:05:32.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.987+0000 7f3c85cc6640 1 -- 172.21.15.12:0/1220524303 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c800a1510 con 0x7f3c800a4b80 2024-09-11T23:05:32.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.987+0000 7f3c67fff640 1 --2- 172.21.15.12:0/1220524303 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f3c6c035e80 0x7f3c6c038340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:32.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.987+0000 7f3c67fff640 1 -- 172.21.15.12:0/1220524303 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4643+0+0 (secure 0 0 0) 0x7f3c700484f0 con 0x7f3c800a4b80 2024-09-11T23:05:32.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.987+0000 7f3c7effd640 1 -- 172.21.15.12:0/1220524303 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f3c6c035e80 msgr2=0x7f3c6c038340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6824/2340508205 2024-09-11T23:05:32.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.987+0000 7f3c7effd640 1 --2- 172.21.15.12:0/1220524303 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f3c6c035e80 0x7f3c6c038340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:05:32.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:32.991+0000 7f3c67fff640 1 -- 172.21.15.12:0/1220524303 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3c7001bbd0 con 0x7f3c800a4b80 2024-09-11T23:05:33.014 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:33.011+0000 7f3060e35180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:05:33.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.187+0000 7f3c85cc6640 1 -- 172.21.15.12:0/1220524303 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3c8009ecb0 con 0x7f3c800a4b80 2024-09-11T23:05:33.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.187+0000 7f3c67fff640 1 -- 172.21.15.12:0/1220524303 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+4890 (secure 0 0 0) 0x7f3c70004ac0 con 0x7f3c800a4b80 2024-09-11T23:05:33.192 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:05:33.192 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":30,"btime":"2024-09-11T23:05:10:521996+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:04:45.641763+0000","modified":"2024-09-11T23:04:48.653841+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4528},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4528":{"gid":4528,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6829/2765393463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":2765393463},{"type":"v1","addr":"172.21.15.12:6829","nonce":2765393463}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4528,"qdb_cluster":[4528]},"id":3},{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:05:06.863235+0000","modified":"2024-09-11T23:05:09.896567+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4527},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4527":{"gid":4527,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":8,"addr":"172.21.15.12:6827/1887547537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":1887547537},{"type":"v1","addr":"172.21.15.12:6827","nonce":1887547537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs_b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4527,"qdb_cluster":[4527]},"id":4}]} 2024-09-11T23:05:33.192 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 30 2024-09-11T23:05:33.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.191+0000 7f3c7effd640 1 -- 172.21.15.12:0/1220524303 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f3c6c035e80 msgr2=0x7f3c6c038340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6824/2340508205 2024-09-11T23:05:33.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.191+0000 7f3c7effd640 1 --2- 172.21.15.12:0/1220524303 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f3c6c035e80 0x7f3c6c038340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T23:05:33.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.191+0000 7f3c85cc6640 1 -- 172.21.15.12:0/1220524303 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f3c6c035e80 msgr2=0x7f3c6c038340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:05:33.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.191+0000 7f3c85cc6640 1 --2- 172.21.15.12:0/1220524303 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f3c6c035e80 0x7f3c6c038340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:33.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.191+0000 7f3c85cc6640 1 -- 172.21.15.12:0/1220524303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c800a4b80 msgr2=0x7f3c800a0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:33.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.191+0000 7f3c85cc6640 1 --2- 172.21.15.12:0/1220524303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c800a4b80 0x7f3c800a0fd0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f3c7000c410 tx=0x7f3c7000c8d0 comp rx=0 tx=0).stop 2024-09-11T23:05:33.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.191+0000 7f3c85cc6640 1 -- 172.21.15.12:0/1220524303 shutdown_connections 2024-09-11T23:05:33.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.191+0000 7f3c85cc6640 1 --2- 172.21.15.12:0/1220524303 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f3c6c035e80 0x7f3c6c038340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:33.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.191+0000 7f3c85cc6640 1 --2- 172.21.15.12:0/1220524303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c800a4b80 0x7f3c800a0fd0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:33.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.191+0000 7f3c85cc6640 1 -- 172.21.15.12:0/1220524303 >> 172.21.15.12:0/1220524303 conn(0x7f3c800ac2c0 msgr2=0x7f3c800aa560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:33.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.191+0000 7f3c85cc6640 1 -- 172.21.15.12:0/1220524303 shutdown_connections 2024-09-11T23:05:33.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.191+0000 7f3c85cc6640 1 -- 172.21.15.12:0/1220524303 wait complete. 2024-09-11T23:05:33.210 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:05:33.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.323+0000 7f683d236640 1 Processor -- start 2024-09-11T23:05:33.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.323+0000 7f683d236640 1 -- start start 2024-09-11T23:05:33.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.323+0000 7f683d236640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f683809f970 0x7f683813bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:33.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.323+0000 7f683d236640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6838136b30 con 0x7f6838136f60 2024-09-11T23:05:33.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.323+0000 7f683d236640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f6838072bd0 con 0x7f683809f970 2024-09-11T23:05:33.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.323+0000 7f6836d9d640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f6838136f60 0x7f6838137340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38154/0 (socket says 172.21.15.12:38154) 2024-09-11T23:05:33.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.323+0000 7f6836d9d640 1 -- 172.21.15.12:0/152188665 learned_addr learned my addr 172.21.15.12:0/152188665 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:33.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.323+0000 7f683659c640 1 --2- 172.21.15.12:0/152188665 >> v2:172.21.15.12:3300/0 conn(0x7f683809f970 0x7f683813bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:33.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.323+0000 7f683659c640 1 -- 172.21.15.12:0/152188665 >> v1:172.21.15.12:6789/0 conn(0x7f6838136f60 legacy=0x7f6838137340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:33.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.323+0000 7f683659c640 1 -- 172.21.15.12:0/152188665 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6838073cf0 con 0x7f683809f970 2024-09-11T23:05:33.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.327+0000 7f683659c640 1 --2- 172.21.15.12:0/152188665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f683809f970 0x7f683813bd40 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f6838136d00 tx=0x7f682c01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2d8ffd6fda861ea server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:33.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.327+0000 7f6835d9b640 1 -- 172.21.15.12:0/152188665 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f682c0b0070 con 0x7f683809f970 2024-09-11T23:05:33.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.327+0000 7f6835d9b640 1 -- 172.21.15.12:0/152188665 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f682c0ab400 con 0x7f683809f970 2024-09-11T23:05:33.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.327+0000 7f6835d9b640 1 -- 172.21.15.12:0/152188665 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f682c0ab700 con 0x7f683809f970 2024-09-11T23:05:33.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.327+0000 7f683d236640 1 -- 172.21.15.12:0/152188665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f683809f970 msgr2=0x7f683813bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:33.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.327+0000 7f683d236640 1 --2- 172.21.15.12:0/152188665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f683809f970 0x7f683813bd40 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f6838136d00 tx=0x7f682c01c390 comp rx=0 tx=0).stop 2024-09-11T23:05:33.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.327+0000 7f683d236640 1 -- 172.21.15.12:0/152188665 shutdown_connections 2024-09-11T23:05:33.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.327+0000 7f683d236640 1 --2- 172.21.15.12:0/152188665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f683809f970 0x7f683813bd40 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:33.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.327+0000 7f683d236640 1 -- 172.21.15.12:0/152188665 >> 172.21.15.12:0/152188665 conn(0x7f683809b910 msgr2=0x7f683806f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:33.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.327+0000 7f683d236640 1 -- 172.21.15.12:0/152188665 shutdown_connections 2024-09-11T23:05:33.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.327+0000 7f683d236640 1 -- 172.21.15.12:0/152188665 wait complete. 2024-09-11T23:05:33.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.327+0000 7f683d236640 1 Processor -- start 2024-09-11T23:05:33.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.327+0000 7f683d236640 1 -- start start 2024-09-11T23:05:33.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.327+0000 7f683d236640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f683809f970 0x7f68380a28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:33.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.327+0000 7f683d236640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f683813eaa0 con 0x7f683809f970 2024-09-11T23:05:33.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.327+0000 7f6836d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f683809f970 0x7f68380a28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:33.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.331+0000 7f6836d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f683809f970 0x7f68380a28b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42304/0 (socket says 172.21.15.12:42304) 2024-09-11T23:05:33.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.331+0000 7f6836d9d640 1 -- 172.21.15.12:0/3689645438 learned_addr learned my addr 172.21.15.12:0/3689645438 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:33.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.331+0000 7f6836d9d640 1 -- 172.21.15.12:0/3689645438 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68380a0310 con 0x7f683809f970 2024-09-11T23:05:33.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.331+0000 7f6836d9d640 1 --2- 172.21.15.12:0/3689645438 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f683809f970 0x7f68380a28b0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f682800c3a0 tx=0x7f682800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:33.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.331+0000 7f681f7fe640 1 -- 172.21.15.12:0/3689645438 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6828017070 con 0x7f683809f970 2024-09-11T23:05:33.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.331+0000 7f681f7fe640 1 -- 172.21.15.12:0/3689645438 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6828005c20 con 0x7f683809f970 2024-09-11T23:05:33.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.331+0000 7f681f7fe640 1 -- 172.21.15.12:0/3689645438 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68280070d0 con 0x7f683809f970 2024-09-11T23:05:33.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.331+0000 7f683d236640 1 -- 172.21.15.12:0/3689645438 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68380a0bf0 con 0x7f683809f970 2024-09-11T23:05:33.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.331+0000 7f683d236640 1 -- 172.21.15.12:0/3689645438 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68380a2130 con 0x7f683809f970 2024-09-11T23:05:33.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.331+0000 7f683d236640 1 -- 172.21.15.12:0/3689645438 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f683813b2f0 con 0x7f683809f970 2024-09-11T23:05:33.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.331+0000 7f681f7fe640 1 -- 172.21.15.12:0/3689645438 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 21) ==== 44155+0+0 (secure 0 0 0) 0x7f682801a070 con 0x7f683809f970 2024-09-11T23:05:33.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.331+0000 7f681f7fe640 1 --2- 172.21.15.12:0/3689645438 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f6824035ed0 0x7f6824038390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:33.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.331+0000 7f681f7fe640 1 -- 172.21.15.12:0/3689645438 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4643+0+0 (secure 0 0 0) 0x7f6828047ed0 con 0x7f683809f970 2024-09-11T23:05:33.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.331+0000 7f683659c640 1 -- 172.21.15.12:0/3689645438 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f6824035ed0 msgr2=0x7f6824038390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6824/2340508205 2024-09-11T23:05:33.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.331+0000 7f683659c640 1 --2- 172.21.15.12:0/3689645438 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f6824035ed0 0x7f6824038390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:05:33.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.339+0000 7f681f7fe640 1 -- 172.21.15.12:0/3689645438 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6828007270 con 0x7f683809f970 2024-09-11T23:05:33.533 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:33.531+0000 7f3060e35180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T23:05:33.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.531+0000 7f683d236640 1 -- 172.21.15.12:0/3689645438 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6838075480 con 0x7f683809f970 2024-09-11T23:05:33.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.531+0000 7f681f7fe640 1 -- 172.21.15.12:0/3689645438 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+4890 (secure 0 0 0) 0x7f6828012400 con 0x7f683809f970 2024-09-11T23:05:33.534 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:05:33.534 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":30,"btime":"2024-09-11T23:05:10:521996+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:04:45.641763+0000","modified":"2024-09-11T23:04:48.653841+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4528},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4528":{"gid":4528,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6829/2765393463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":2765393463},{"type":"v1","addr":"172.21.15.12:6829","nonce":2765393463}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4528,"qdb_cluster":[4528]},"id":3},{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:05:06.863235+0000","modified":"2024-09-11T23:05:09.896567+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4527},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4527":{"gid":4527,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":8,"addr":"172.21.15.12:6827/1887547537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":1887547537},{"type":"v1","addr":"172.21.15.12:6827","nonce":1887547537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs_b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4527,"qdb_cluster":[4527]},"id":4}]} 2024-09-11T23:05:33.534 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 30 2024-09-11T23:05:33.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.535+0000 7f683659c640 1 -- 172.21.15.12:0/3689645438 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f6824035ed0 msgr2=0x7f6824038390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6824/2340508205 2024-09-11T23:05:33.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.535+0000 7f683659c640 1 --2- 172.21.15.12:0/3689645438 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f6824035ed0 0x7f6824038390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T23:05:33.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.535+0000 7f683d236640 1 -- 172.21.15.12:0/3689645438 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f6824035ed0 msgr2=0x7f6824038390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:05:33.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.535+0000 7f683d236640 1 --2- 172.21.15.12:0/3689645438 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f6824035ed0 0x7f6824038390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:33.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.535+0000 7f683d236640 1 -- 172.21.15.12:0/3689645438 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f683809f970 msgr2=0x7f68380a28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:33.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.535+0000 7f683d236640 1 --2- 172.21.15.12:0/3689645438 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f683809f970 0x7f68380a28b0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f682800c3a0 tx=0x7f682800c860 comp rx=0 tx=0).stop 2024-09-11T23:05:33.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.535+0000 7f683d236640 1 -- 172.21.15.12:0/3689645438 shutdown_connections 2024-09-11T23:05:33.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.535+0000 7f683d236640 1 --2- 172.21.15.12:0/3689645438 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f6824035ed0 0x7f6824038390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:33.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.535+0000 7f683d236640 1 --2- 172.21.15.12:0/3689645438 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f683809f970 0x7f68380a28b0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:33.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.535+0000 7f683d236640 1 -- 172.21.15.12:0/3689645438 >> 172.21.15.12:0/3689645438 conn(0x7f683809b910 msgr2=0x7f6838135f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:33.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.535+0000 7f683d236640 1 -- 172.21.15.12:0/3689645438 shutdown_connections 2024-09-11T23:05:33.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.535+0000 7f683d236640 1 -- 172.21.15.12:0/3689645438 wait complete. 2024-09-11T23:05:33.553 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:05:33.613 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:33.611+0000 7f3060e35180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T23:05:33.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.671+0000 7f6a56605640 1 Processor -- start 2024-09-11T23:05:33.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.671+0000 7f6a56605640 1 -- start start 2024-09-11T23:05:33.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.675+0000 7f6a56605640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6a500a2ce0 0x7f6a50137180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:33.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.675+0000 7f6a56605640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a501367e0 con 0x7f6a50136da0 2024-09-11T23:05:33.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.675+0000 7f6a56605640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f6a500a2300 con 0x7f6a500a2ce0 2024-09-11T23:05:33.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.675+0000 7f6a4f7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6a500a2ce0 0x7f6a50137180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:33.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.675+0000 7f6a4f7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6a500a2ce0 0x7f6a50137180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42316/0 (socket says 172.21.15.12:42316) 2024-09-11T23:05:33.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.675+0000 7f6a4f7fe640 1 -- 172.21.15.12:0/639766286 learned_addr learned my addr 172.21.15.12:0/639766286 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:33.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.675+0000 7f6a4f7fe640 1 -- 172.21.15.12:0/639766286 >> v1:172.21.15.12:6789/0 conn(0x7f6a50136da0 legacy=0x7f6a500a4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:33.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.675+0000 7f6a4f7fe640 1 -- 172.21.15.12:0/639766286 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a500a1000 con 0x7f6a500a2ce0 2024-09-11T23:05:33.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.675+0000 7f6a4f7fe640 1 --2- 172.21.15.12:0/639766286 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a500a2ce0 0x7f6a50137180 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f6a440097f0 tx=0x7f6a4401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abdd88e30b187819 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:33.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.675+0000 7f6a4effd640 1 -- 172.21.15.12:0/639766286 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a440b0070 con 0x7f6a500a2ce0 2024-09-11T23:05:33.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.675+0000 7f6a4effd640 1 -- 172.21.15.12:0/639766286 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a440ab530 con 0x7f6a500a2ce0 2024-09-11T23:05:33.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.675+0000 7f6a4effd640 1 -- 172.21.15.12:0/639766286 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a440ab830 con 0x7f6a500a2ce0 2024-09-11T23:05:33.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.675+0000 7f6a56605640 1 -- 172.21.15.12:0/639766286 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a500a2ce0 msgr2=0x7f6a50137180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:33.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.675+0000 7f6a56605640 1 --2- 172.21.15.12:0/639766286 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a500a2ce0 0x7f6a50137180 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f6a440097f0 tx=0x7f6a4401c450 comp rx=0 tx=0).stop 2024-09-11T23:05:33.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.675+0000 7f6a56605640 1 -- 172.21.15.12:0/639766286 shutdown_connections 2024-09-11T23:05:33.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.675+0000 7f6a56605640 1 --2- 172.21.15.12:0/639766286 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a500a2ce0 0x7f6a50137180 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:33.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.675+0000 7f6a56605640 1 -- 172.21.15.12:0/639766286 >> 172.21.15.12:0/639766286 conn(0x7f6a50068000 msgr2=0x7f6a500a5910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:33.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.675+0000 7f6a56605640 1 -- 172.21.15.12:0/639766286 shutdown_connections 2024-09-11T23:05:33.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.675+0000 7f6a56605640 1 -- 172.21.15.12:0/639766286 wait complete. 2024-09-11T23:05:33.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.679+0000 7f6a56605640 1 Processor -- start 2024-09-11T23:05:33.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.679+0000 7f6a56605640 1 -- start start 2024-09-11T23:05:33.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.679+0000 7f6a56605640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a500a2ce0 0x7f6a50137830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:33.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.679+0000 7f6a56605640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6a500a6400 con 0x7f6a500a2ce0 2024-09-11T23:05:33.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.679+0000 7f6a4ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a500a2ce0 0x7f6a50137830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:33.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.679+0000 7f6a4ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a500a2ce0 0x7f6a50137830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42322/0 (socket says 172.21.15.12:42322) 2024-09-11T23:05:33.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.679+0000 7f6a4ffff640 1 -- 172.21.15.12:0/753533187 learned_addr learned my addr 172.21.15.12:0/753533187 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:33.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.679+0000 7f6a4ffff640 1 -- 172.21.15.12:0/753533187 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a5013b480 con 0x7f6a500a2ce0 2024-09-11T23:05:33.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.679+0000 7f6a4ffff640 1 --2- 172.21.15.12:0/753533187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a500a2ce0 0x7f6a50137830 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f6a4800c480 tx=0x7f6a4800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:33.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.679+0000 7f6a4cff9640 1 -- 172.21.15.12:0/753533187 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a48005150 con 0x7f6a500a2ce0 2024-09-11T23:05:33.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.679+0000 7f6a4cff9640 1 -- 172.21.15.12:0/753533187 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a480052f0 con 0x7f6a500a2ce0 2024-09-11T23:05:33.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.679+0000 7f6a56605640 1 -- 172.21.15.12:0/753533187 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a5013ac00 con 0x7f6a500a2ce0 2024-09-11T23:05:33.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.679+0000 7f6a4cff9640 1 -- 172.21.15.12:0/753533187 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a48007030 con 0x7f6a500a2ce0 2024-09-11T23:05:33.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.679+0000 7f6a56605640 1 -- 172.21.15.12:0/753533187 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a5013bdb0 con 0x7f6a500a2ce0 2024-09-11T23:05:33.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.679+0000 7f6a4cff9640 1 -- 172.21.15.12:0/753533187 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 21) ==== 44155+0+0 (secure 0 0 0) 0x7f6a48019020 con 0x7f6a500a2ce0 2024-09-11T23:05:33.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.679+0000 7f6a56605640 1 -- 172.21.15.12:0/753533187 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a500008e0 con 0x7f6a500a2ce0 2024-09-11T23:05:33.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.679+0000 7f6a4cff9640 1 --2- 172.21.15.12:0/753533187 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f6a3c035ed0 0x7f6a3c038390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:33.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.679+0000 7f6a4f7fe640 1 -- 172.21.15.12:0/753533187 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f6a3c035ed0 msgr2=0x7f6a3c038390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6824/2340508205 2024-09-11T23:05:33.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.679+0000 7f6a4cff9640 1 -- 172.21.15.12:0/753533187 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4643+0+0 (secure 0 0 0) 0x7f6a48047f90 con 0x7f6a500a2ce0 2024-09-11T23:05:33.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.679+0000 7f6a4f7fe640 1 --2- 172.21.15.12:0/753533187 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f6a3c035ed0 0x7f6a3c038390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:05:33.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.687+0000 7f6a4cff9640 1 -- 172.21.15.12:0/753533187 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6a4801a560 con 0x7f6a500a2ce0 2024-09-11T23:05:33.786 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:33.783+0000 7f3060e35180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T23:05:33.864 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:33.863+0000 7f3060e35180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T23:05:33.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.879+0000 7f6a56605640 1 -- 172.21.15.12:0/753533187 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6a50138dc0 con 0x7f6a500a2ce0 2024-09-11T23:05:33.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.879+0000 7f6a4cff9640 1 -- 172.21.15.12:0/753533187 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+15062 (secure 0 0 0) 0x7f6a4801a780 con 0x7f6a500a2ce0 2024-09-11T23:05:33.883 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:05:33.883 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":40,"fsid":"8be14356-3340-4500-91a2-4cbc6b511f65","created":"2024-09-11T23:03:10.620234+0000","modified":"2024-09-11T23:05:07.926161+0000","last_up_change":"2024-09-11T23:03:22.359028+0000","last_in_change":"2024-09-11T23:03:11.545817+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:03:23.587068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:04:43.298425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-11T23:04:44.624329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_b_metadata","create_time":"2024-09-11T23:05:05.624837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs_b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_b_data","create_time":"2024-09-11T23:05:06.296091+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs_b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"153b72a1-40b1-400d-93ea-333e733f9bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6817","nonce":3680911937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6819","nonce":3680911937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6823","nonce":3680911937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6821","nonce":3680911937}]},"public_addr":"172.21.15.12:6817/3680911937","cluster_addr":"172.21.15.12:6819/3680911937","heartbeat_back_addr":"172.21.15.12:6823/3680911937","heartbeat_front_addr":"172.21.15.12:6821/3680911937","state":["exists","up"]},{"osd":1,"uuid":"94669e49-ee4f-4acf-9e25-e94374dda8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6801","nonce":236825163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6803","nonce":236825163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6807","nonce":236825163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6805","nonce":236825163}]},"public_addr":"172.21.15.12:6801/236825163","cluster_addr":"172.21.15.12:6803/236825163","heartbeat_back_addr":"172.21.15.12:6807/236825163","heartbeat_front_addr":"172.21.15.12:6805/236825163","state":["exists","up"]},{"osd":2,"uuid":"826dae4d-8888-4ec5-8f00-425b3be93814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6809","nonce":3263521655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6811","nonce":3263521655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6815","nonce":3263521655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6813","nonce":3263521655}]},"public_addr":"172.21.15.12:6809/3263521655","cluster_addr":"172.21.15.12:6811/3263521655","heartbeat_back_addr":"172.21.15.12:6815/3263521655","heartbeat_front_addr":"172.21.15.12:6813/3263521655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:19.398518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.761524+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.904997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/2509166838":"2024-09-12T23:05:06.494857+0000","172.21.15.12:6825/718802078":"2024-09-12T23:05:06.494857+0000","172.21.15.12:6824/718802078":"2024-09-12T23:05:06.494857+0000","172.21.15.12:0/2490570290":"2024-09-12T23:05:06.494857+0000","172.21.15.12:0/2957476143":"2024-09-12T23:05:06.494857+0000","172.21.15.12:0/37905181":"2024-09-12T23:05:06.494857+0000","172.21.15.12:0/3294231065":"2024-09-12T23:05:06.494857+0000","172.21.15.12:0/2407367943":"2024-09-12T23:05:06.494857+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:05:33.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.883+0000 7f6a4f7fe640 1 -- 172.21.15.12:0/753533187 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f6a3c035ed0 msgr2=0x7f6a3c038390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6824/2340508205 2024-09-11T23:05:33.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.883+0000 7f6a4f7fe640 1 --2- 172.21.15.12:0/753533187 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f6a3c035ed0 0x7f6a3c038390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T23:05:33.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.883+0000 7f6a56605640 1 -- 172.21.15.12:0/753533187 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f6a3c035ed0 msgr2=0x7f6a3c038390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:05:33.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.883+0000 7f6a56605640 1 --2- 172.21.15.12:0/753533187 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f6a3c035ed0 0x7f6a3c038390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:33.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.883+0000 7f6a56605640 1 -- 172.21.15.12:0/753533187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a500a2ce0 msgr2=0x7f6a50137830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:33.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.883+0000 7f6a56605640 1 --2- 172.21.15.12:0/753533187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a500a2ce0 0x7f6a50137830 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f6a4800c480 tx=0x7f6a4800c940 comp rx=0 tx=0).stop 2024-09-11T23:05:33.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.883+0000 7f6a56605640 1 -- 172.21.15.12:0/753533187 shutdown_connections 2024-09-11T23:05:33.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.883+0000 7f6a56605640 1 --2- 172.21.15.12:0/753533187 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f6a3c035ed0 0x7f6a3c038390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:33.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.883+0000 7f6a56605640 1 --2- 172.21.15.12:0/753533187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a500a2ce0 0x7f6a50137830 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:33.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.883+0000 7f6a56605640 1 -- 172.21.15.12:0/753533187 >> 172.21.15.12:0/753533187 conn(0x7f6a50068000 msgr2=0x7f6a500731b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:33.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.883+0000 7f6a56605640 1 -- 172.21.15.12:0/753533187 shutdown_connections 2024-09-11T23:05:33.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:33.883+0000 7f6a56605640 1 -- 172.21.15.12:0/753533187 wait complete. 2024-09-11T23:05:33.901 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-11T23:05:34.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.011+0000 7f878878b640 1 Processor -- start 2024-09-11T23:05:34.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.011+0000 7f878878b640 1 -- start start 2024-09-11T23:05:34.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.011+0000 7f878878b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f878013ac80 0x7f878013d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:34.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.011+0000 7f878878b640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8780137950 con 0x7f8780137f10 2024-09-11T23:05:34.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.011+0000 7f878878b640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f878009ff80 con 0x7f878013ac80 2024-09-11T23:05:34.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.011+0000 7f8786527640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f8780137f10 0x7f87801382f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38182/0 (socket says 172.21.15.12:38182) 2024-09-11T23:05:34.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.011+0000 7f8786527640 1 -- 172.21.15.12:0/3870377054 learned_addr learned my addr 172.21.15.12:0/3870377054 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:34.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.011+0000 7f8785d26640 1 --2- 172.21.15.12:0/3870377054 >> v2:172.21.15.12:3300/0 conn(0x7f878013ac80 0x7f878013d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:34.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.011+0000 7f8785525640 1 -- 172.21.15.12:0/3870377054 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 78442445 0 0) 0x7f8774001120 con 0x7f8780137f10 2024-09-11T23:05:34.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.011+0000 7f8785525640 1 -- 172.21.15.12:0/3870377054 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f876c003530 con 0x7f8780137f10 2024-09-11T23:05:34.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.011+0000 7f8785d26640 1 -- 172.21.15.12:0/3870377054 >> v1:172.21.15.12:6789/0 conn(0x7f8780137f10 legacy=0x7f87801382f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:34.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.011+0000 7f8785d26640 1 -- 172.21.15.12:0/3870377054 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8780073d00 con 0x7f878013ac80 2024-09-11T23:05:34.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.015+0000 7f8785d26640 1 --2- 172.21.15.12:0/3870377054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f878013ac80 0x7f878013d070 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f877c009740 tx=0x7f877c01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2f85682f01121b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:34.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.015+0000 7f8785525640 1 -- 172.21.15.12:0/3870377054 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f877c0b0070 con 0x7f878013ac80 2024-09-11T23:05:34.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.015+0000 7f8785525640 1 -- 172.21.15.12:0/3870377054 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f877c0ab530 con 0x7f878013ac80 2024-09-11T23:05:34.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.015+0000 7f8785525640 1 -- 172.21.15.12:0/3870377054 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f877c0ab830 con 0x7f878013ac80 2024-09-11T23:05:34.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.015+0000 7f878878b640 1 -- 172.21.15.12:0/3870377054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f878013ac80 msgr2=0x7f878013d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:34.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.015+0000 7f878878b640 1 --2- 172.21.15.12:0/3870377054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f878013ac80 0x7f878013d070 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f877c009740 tx=0x7f877c01c390 comp rx=0 tx=0).stop 2024-09-11T23:05:34.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.015+0000 7f878878b640 1 -- 172.21.15.12:0/3870377054 shutdown_connections 2024-09-11T23:05:34.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.015+0000 7f878878b640 1 --2- 172.21.15.12:0/3870377054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f878013ac80 0x7f878013d070 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:34.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.015+0000 7f878878b640 1 -- 172.21.15.12:0/3870377054 >> 172.21.15.12:0/3870377054 conn(0x7f878009a9d0 msgr2=0x7f878009ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:34.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.015+0000 7f878878b640 1 -- 172.21.15.12:0/3870377054 shutdown_connections 2024-09-11T23:05:34.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.015+0000 7f878878b640 1 -- 172.21.15.12:0/3870377054 wait complete. 2024-09-11T23:05:34.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.015+0000 7f878878b640 1 Processor -- start 2024-09-11T23:05:34.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.015+0000 7f878878b640 1 -- start start 2024-09-11T23:05:34.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.015+0000 7f878878b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8780137f10 0x7f87801322c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:34.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.015+0000 7f878878b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8780073730 con 0x7f8780137f10 2024-09-11T23:05:34.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.015+0000 7f8786527640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8780137f10 0x7f87801322c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:34.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.015+0000 7f8786527640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8780137f10 0x7f87801322c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42350/0 (socket says 172.21.15.12:42350) 2024-09-11T23:05:34.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.015+0000 7f8786527640 1 -- 172.21.15.12:0/4040516742 learned_addr learned my addr 172.21.15.12:0/4040516742 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:34.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.015+0000 7f8786527640 1 -- 172.21.15.12:0/4040516742 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8780133770 con 0x7f8780137f10 2024-09-11T23:05:34.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.015+0000 7f8786527640 1 --2- 172.21.15.12:0/4040516742 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8780137f10 0x7f87801322c0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f877400c3b0 tx=0x7f877400c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:34.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.015+0000 7f8772ffd640 1 -- 172.21.15.12:0/4040516742 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8774017070 con 0x7f8780137f10 2024-09-11T23:05:34.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.015+0000 7f8772ffd640 1 -- 172.21.15.12:0/4040516742 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8774005c20 con 0x7f8780137f10 2024-09-11T23:05:34.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.015+0000 7f8772ffd640 1 -- 172.21.15.12:0/4040516742 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87740070d0 con 0x7f8780137f10 2024-09-11T23:05:34.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.015+0000 7f878878b640 1 -- 172.21.15.12:0/4040516742 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8780070390 con 0x7f8780137f10 2024-09-11T23:05:34.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.015+0000 7f878878b640 1 -- 172.21.15.12:0/4040516742 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8780133bc0 con 0x7f8780137f10 2024-09-11T23:05:34.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.019+0000 7f878878b640 1 -- 172.21.15.12:0/4040516742 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87801382f0 con 0x7f8780137f10 2024-09-11T23:05:34.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.019+0000 7f8772ffd640 1 -- 172.21.15.12:0/4040516742 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 21) ==== 44155+0+0 (secure 0 0 0) 0x7f877401a070 con 0x7f8780137f10 2024-09-11T23:05:34.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.019+0000 7f8772ffd640 1 --2- 172.21.15.12:0/4040516742 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f8764035ed0 0x7f8764038390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:34.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.019+0000 7f8772ffd640 1 -- 172.21.15.12:0/4040516742 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4643+0+0 (secure 0 0 0) 0x7f8774047f90 con 0x7f8780137f10 2024-09-11T23:05:34.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.019+0000 7f8785d26640 1 -- 172.21.15.12:0/4040516742 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f8764035ed0 msgr2=0x7f8764038390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6824/2340508205 2024-09-11T23:05:34.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.019+0000 7f8785d26640 1 --2- 172.21.15.12:0/4040516742 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f8764035ed0 0x7f8764038390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:05:34.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.023+0000 7f8772ffd640 1 -- 172.21.15.12:0/4040516742 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8780137950 con 0x7f8780137f10 2024-09-11T23:05:34.174 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:34.171+0000 7f3060e35180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T23:05:34.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.215+0000 7f878878b640 1 -- 172.21.15.12:0/4040516742 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f87800a1f00 con 0x7f8780137f10 2024-09-11T23:05:34.218 INFO:tasks.ceph.mon.a.smithi012.stderr:2024-09-11T23:05:34.215+0000 7fd71c996640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T23:05:34.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.215+0000 7f8772ffd640 1 -- 172.21.15.12:0/4040516742 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v31) ==== 161+0+0 (secure 0 0 0) 0x7f8774007270 con 0x7f8780137f10 2024-09-11T23:05:34.220 INFO:teuthology.orchestra.run.smithi012.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T23:05:34.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.223+0000 7f8785d26640 1 -- 172.21.15.12:0/4040516742 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f8764035ed0 msgr2=0x7f8764038390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6824/2340508205 2024-09-11T23:05:34.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.223+0000 7f8785d26640 1 --2- 172.21.15.12:0/4040516742 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f8764035ed0 0x7f8764038390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T23:05:34.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.227+0000 7f878878b640 1 -- 172.21.15.12:0/4040516742 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f8764035ed0 msgr2=0x7f8764038390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:05:34.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.227+0000 7f878878b640 1 --2- 172.21.15.12:0/4040516742 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f8764035ed0 0x7f8764038390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:34.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.227+0000 7f878878b640 1 -- 172.21.15.12:0/4040516742 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8780137f10 msgr2=0x7f87801322c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:34.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.227+0000 7f878878b640 1 --2- 172.21.15.12:0/4040516742 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8780137f10 0x7f87801322c0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f877400c3b0 tx=0x7f877400c870 comp rx=0 tx=0).stop 2024-09-11T23:05:34.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.227+0000 7f878878b640 1 -- 172.21.15.12:0/4040516742 shutdown_connections 2024-09-11T23:05:34.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.227+0000 7f878878b640 1 --2- 172.21.15.12:0/4040516742 >> [v2:172.21.15.12:6824/2340508205,v1:172.21.15.12:6825/2340508205] conn(0x7f8764035ed0 0x7f8764038390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:34.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.227+0000 7f878878b640 1 --2- 172.21.15.12:0/4040516742 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8780137f10 0x7f87801322c0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:34.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.227+0000 7f878878b640 1 -- 172.21.15.12:0/4040516742 >> 172.21.15.12:0/4040516742 conn(0x7f878009a9d0 msgr2=0x7f87801315d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:34.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.227+0000 7f878878b640 1 -- 172.21.15.12:0/4040516742 shutdown_connections 2024-09-11T23:05:34.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.227+0000 7f878878b640 1 -- 172.21.15.12:0/4040516742 wait complete. 2024-09-11T23:05:34.229 INFO:tasks.ceph.mds.b.smithi012.stderr: -4303> 2024-09-11T23:04:48.248+0000 7fc8e8ed3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T23:05:34.233 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:34.231+0000 7f3060e35180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T23:05:34.245 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-11T23:05:34.274 INFO:tasks.ceph.mds.b.smithi012.stdout:starting mds.b at 2024-09-11T23:05:34.333 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:34.331+0000 7f2fe892a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:05:34.333 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:34.331+0000 7f2fe892a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:05:34.333 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:34.331+0000 7f2fe892a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:05:34.333 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:34.331+0000 7f2fe892a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:05:34.333 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:34.331+0000 7f2fe892a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:05:34.334 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:34.331+0000 7f2feb930640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:05:34.334 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:34.331+0000 7f2feb930640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:05:34.334 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:34.331+0000 7f2feb930640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:05:34.334 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:34.331+0000 7f2feb930640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:05:34.334 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:05:34.331+0000 7f2feb930640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:05:34.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.359+0000 7fbdc9f9e640 1 Processor -- start 2024-09-11T23:05:34.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.359+0000 7fbdc9f9e640 1 -- start start 2024-09-11T23:05:34.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.359+0000 7fbdc9f9e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbdc40a8110 0x7fbdc413ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:34.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.359+0000 7fbdc9f9e640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdc40a4e40 con 0x7fbdc40a71c0 2024-09-11T23:05:34.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.363+0000 7fbdc9f9e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fbdc40a6af0 con 0x7fbdc40a8110 2024-09-11T23:05:34.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.363+0000 7fbdc2ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbdc40a8110 0x7fbdc413ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:34.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.363+0000 7fbdc37fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fbdc40a71c0 0x7fbdc40a75a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:45456/0 (socket says 172.21.15.12:45456) 2024-09-11T23:05:34.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.363+0000 7fbdc37fe640 1 -- 172.21.15.12:0/1830649713 learned_addr learned my addr 172.21.15.12:0/1830649713 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:34.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.363+0000 7fbdc2ffd640 1 -- 172.21.15.12:0/1830649713 >> v1:172.21.15.12:6789/0 conn(0x7fbdc40a71c0 legacy=0x7fbdc40a75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:34.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.363+0000 7fbdc2ffd640 1 -- 172.21.15.12:0/1830649713 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdc40a3f50 con 0x7fbdc40a8110 2024-09-11T23:05:34.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.363+0000 7fbdc27fc640 1 -- 172.21.15.12:0/1830649713 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 507540629 0 0) 0x7fbdc40a4e40 con 0x7fbdc40a71c0 2024-09-11T23:05:34.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.363+0000 7fbdc2ffd640 1 --2- 172.21.15.12:0/1830649713 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbdc40a8110 0x7fbdc413ef50 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fbdac009740 tx=0x7fbdac01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f05ca83de4e4249c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:34.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.363+0000 7fbdc27fc640 1 -- 172.21.15.12:0/1830649713 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdac0b0070 con 0x7fbdc40a8110 2024-09-11T23:05:34.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.363+0000 7fbdc27fc640 1 -- 172.21.15.12:0/1830649713 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdac0ab530 con 0x7fbdc40a8110 2024-09-11T23:05:34.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.363+0000 7fbdc27fc640 1 -- 172.21.15.12:0/1830649713 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdac0ab830 con 0x7fbdc40a8110 2024-09-11T23:05:34.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.363+0000 7fbdc9f9e640 1 -- 172.21.15.12:0/1830649713 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbdc40a8110 msgr2=0x7fbdc413ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:34.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.363+0000 7fbdc9f9e640 1 --2- 172.21.15.12:0/1830649713 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbdc40a8110 0x7fbdc413ef50 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fbdac009740 tx=0x7fbdac01c390 comp rx=0 tx=0).stop 2024-09-11T23:05:34.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.363+0000 7fbdc9f9e640 1 -- 172.21.15.12:0/1830649713 shutdown_connections 2024-09-11T23:05:34.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.363+0000 7fbdc9f9e640 1 --2- 172.21.15.12:0/1830649713 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbdc40a8110 0x7fbdc413ef50 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:34.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.363+0000 7fbdc9f9e640 1 -- 172.21.15.12:0/1830649713 >> 172.21.15.12:0/1830649713 conn(0x7fbdc40ac4f0 msgr2=0x7fbdc40ac900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:34.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.363+0000 7fbdc9f9e640 1 -- 172.21.15.12:0/1830649713 shutdown_connections 2024-09-11T23:05:34.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.363+0000 7fbdc9f9e640 1 -- 172.21.15.12:0/1830649713 wait complete. 2024-09-11T23:05:34.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.363+0000 7fbdc9f9e640 1 Processor -- start 2024-09-11T23:05:34.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.367+0000 7fbdc9f9e640 1 -- start start 2024-09-11T23:05:34.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.367+0000 7fbdc9f9e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbdc40a71c0 0x7fbdc41ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:34.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.367+0000 7fbdc9f9e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc406dd50 con 0x7fbdc40a71c0 2024-09-11T23:05:34.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.367+0000 7fbdc37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbdc40a71c0 0x7fbdc41ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:34.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.367+0000 7fbdc37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbdc40a71c0 0x7fbdc41ce0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52644/0 (socket says 172.21.15.12:52644) 2024-09-11T23:05:34.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.367+0000 7fbdc37fe640 1 -- 172.21.15.12:0/2041814872 learned_addr learned my addr 172.21.15.12:0/2041814872 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:34.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.367+0000 7fbdc37fe640 1 -- 172.21.15.12:0/2041814872 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdc40a0620 con 0x7fbdc40a71c0 2024-09-11T23:05:34.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.367+0000 7fbdc37fe640 1 --2- 172.21.15.12:0/2041814872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbdc40a71c0 0x7fbdc41ce0e0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fbdb400c840 tx=0x7fbdb400cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:34.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.367+0000 7fbdbbfff640 1 -- 172.21.15.12:0/2041814872 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdb4018070 con 0x7fbdc40a71c0 2024-09-11T23:05:34.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.367+0000 7fbdbbfff640 1 -- 172.21.15.12:0/2041814872 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdb400a660 con 0x7fbdc40a71c0 2024-09-11T23:05:34.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.367+0000 7fbdc9f9e640 1 -- 172.21.15.12:0/2041814872 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdc409eac0 con 0x7fbdc40a71c0 2024-09-11T23:05:34.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.367+0000 7fbdbbfff640 1 -- 172.21.15.12:0/2041814872 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdb400a850 con 0x7fbdc40a71c0 2024-09-11T23:05:34.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.367+0000 7fbdc9f9e640 1 -- 172.21.15.12:0/2041814872 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdc409e7e0 con 0x7fbdc40a71c0 2024-09-11T23:05:34.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.367+0000 7fbdbbfff640 1 -- 172.21.15.12:0/2041814872 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 22) ==== 43764+0+0 (secure 0 0 0) 0x7fbdb401b070 con 0x7fbdc40a71c0 2024-09-11T23:05:34.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.367+0000 7fbdc9f9e640 1 -- 172.21.15.12:0/2041814872 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdc40a0310 con 0x7fbdc40a71c0 2024-09-11T23:05:34.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.367+0000 7fbdbbfff640 1 -- 172.21.15.12:0/2041814872 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5073+0+0 (secure 0 0 0) 0x7fbdb4047f80 con 0x7fbdc40a71c0 2024-09-11T23:05:34.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.371+0000 7fbdbbfff640 1 -- 172.21.15.12:0/2041814872 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbdb401c3b0 con 0x7fbdc40a71c0 2024-09-11T23:05:34.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:34.563+0000 7fbdc9f9e640 1 -- 172.21.15.12:0/2041814872 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fbdc40a75a0 con 0x7fbdc40a71c0 2024-09-11T23:05:35.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:35.255+0000 7fbdbbfff640 1 -- 172.21.15.12:0/2041814872 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v32) ==== 104+0+0 (secure 0 0 0) 0x7fbdb400ac80 con 0x7fbdc40a71c0 2024-09-11T23:05:35.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:35.255+0000 7fbdc9f9e640 1 -- 172.21.15.12:0/2041814872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbdc40a71c0 msgr2=0x7fbdc41ce0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:35.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:35.255+0000 7fbdc9f9e640 1 --2- 172.21.15.12:0/2041814872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbdc40a71c0 0x7fbdc41ce0e0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fbdb400c840 tx=0x7fbdb400cd00 comp rx=0 tx=0).stop 2024-09-11T23:05:35.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:35.259+0000 7fbdc9f9e640 1 -- 172.21.15.12:0/2041814872 shutdown_connections 2024-09-11T23:05:35.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:35.259+0000 7fbdc9f9e640 1 --2- 172.21.15.12:0/2041814872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbdc40a71c0 0x7fbdc41ce0e0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:35.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:35.259+0000 7fbdc9f9e640 1 -- 172.21.15.12:0/2041814872 >> 172.21.15.12:0/2041814872 conn(0x7fbdc40ac4f0 msgr2=0x7fbdc4139690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:35.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:35.259+0000 7fbdc9f9e640 1 -- 172.21.15.12:0/2041814872 shutdown_connections 2024-09-11T23:05:35.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:35.259+0000 7fbdc9f9e640 1 -- 172.21.15.12:0/2041814872 wait complete. 2024-09-11T23:05:35.288 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-11T23:05:35.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:35.463+0000 7f809b60d640 1 Processor -- start 2024-09-11T23:05:35.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:35.463+0000 7f809b60d640 1 -- start start 2024-09-11T23:05:35.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:35.463+0000 7f809b60d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f80940a17f0 0x7f809413ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:35.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:35.463+0000 7f809b60d640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80940a1e30 con 0x7f809413a090 2024-09-11T23:05:35.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:35.463+0000 7f809b60d640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f80940a10a0 con 0x7f80940a17f0 2024-09-11T23:05:35.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:35.463+0000 7f8098ba8640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f80940a17f0 0x7f809413ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:35.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:35.463+0000 7f8098ba8640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f80940a17f0 0x7f809413ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52652/0 (socket says 172.21.15.12:52652) 2024-09-11T23:05:35.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:35.463+0000 7f8098ba8640 1 -- 172.21.15.12:0/2768759059 learned_addr learned my addr 172.21.15.12:0/2768759059 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:35.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:35.463+0000 7f80993a9640 1 --1- 172.21.15.12:0/2768759059 >> v1:172.21.15.12:6789/0 conn(0x7f809413a090 0x7f809413a470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:45464/0 (socket says 172.21.15.12:45464) 2024-09-11T23:05:35.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:35.463+0000 7f8098ba8640 1 -- 172.21.15.12:0/2768759059 >> v1:172.21.15.12:6789/0 conn(0x7f809413a090 legacy=0x7f809413a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:35.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:35.463+0000 7f8098ba8640 1 -- 172.21.15.12:0/2768759059 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f809409f380 con 0x7f80940a17f0 2024-09-11T23:05:35.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:35.463+0000 7f8098ba8640 1 --2- 172.21.15.12:0/2768759059 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80940a17f0 0x7f809413ef10 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f80900097f0 tx=0x7f809001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b51117b996178f0a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:35.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:35.463+0000 7f808bfff640 1 -- 172.21.15.12:0/2768759059 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80900b0070 con 0x7f80940a17f0 2024-09-11T23:05:35.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:35.463+0000 7f808bfff640 1 -- 172.21.15.12:0/2768759059 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80900ab530 con 0x7f80940a17f0 2024-09-11T23:05:35.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:35.463+0000 7f808bfff640 1 -- 172.21.15.12:0/2768759059 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80900ab830 con 0x7f80940a17f0 2024-09-11T23:05:35.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:35.467+0000 7f809b60d640 1 -- 172.21.15.12:0/2768759059 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80940a17f0 msgr2=0x7f809413ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:35.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:35.467+0000 7f809b60d640 1 --2- 172.21.15.12:0/2768759059 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80940a17f0 0x7f809413ef10 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f80900097f0 tx=0x7f809001c450 comp rx=0 tx=0).stop 2024-09-11T23:05:35.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:35.467+0000 7f809b60d640 1 -- 172.21.15.12:0/2768759059 shutdown_connections 2024-09-11T23:05:35.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:35.467+0000 7f809b60d640 1 --2- 172.21.15.12:0/2768759059 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80940a17f0 0x7f809413ef10 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:35.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:35.467+0000 7f809b60d640 1 -- 172.21.15.12:0/2768759059 >> 172.21.15.12:0/2768759059 conn(0x7f809406da30 msgr2=0x7f809406de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:35.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:35.467+0000 7f809b60d640 1 -- 172.21.15.12:0/2768759059 shutdown_connections 2024-09-11T23:05:35.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:35.467+0000 7f809b60d640 1 -- 172.21.15.12:0/2768759059 wait complete. 2024-09-11T23:05:35.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:35.467+0000 7f809b60d640 1 Processor -- start 2024-09-11T23:05:35.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:35.467+0000 7f809b60d640 1 -- start start 2024-09-11T23:05:35.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:35.467+0000 7f809b60d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80940a17f0 0x7f80940a4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:35.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:35.467+0000 7f809b60d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8094141df0 con 0x7f80940a17f0 2024-09-11T23:05:35.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:35.467+0000 7f80993a9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80940a17f0 0x7f80940a4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:35.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:35.467+0000 7f80993a9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80940a17f0 0x7f80940a4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52664/0 (socket says 172.21.15.12:52664) 2024-09-11T23:05:35.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:35.467+0000 7f80993a9640 1 -- 172.21.15.12:0/1419936266 learned_addr learned my addr 172.21.15.12:0/1419936266 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:35.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:35.467+0000 7f80993a9640 1 -- 172.21.15.12:0/1419936266 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80940a81b0 con 0x7f80940a17f0 2024-09-11T23:05:35.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:35.467+0000 7f80993a9640 1 --2- 172.21.15.12:0/1419936266 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80940a17f0 0x7f80940a4720 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f808400c410 tx=0x7f808400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:35.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:35.467+0000 7f8089ffb640 1 -- 172.21.15.12:0/1419936266 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8084007410 con 0x7f80940a17f0 2024-09-11T23:05:35.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:35.467+0000 7f8089ffb640 1 -- 172.21.15.12:0/1419936266 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80840075b0 con 0x7f80940a17f0 2024-09-11T23:05:35.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:35.467+0000 7f809b60d640 1 -- 172.21.15.12:0/1419936266 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80940a6650 con 0x7f80940a17f0 2024-09-11T23:05:35.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:35.467+0000 7f8089ffb640 1 -- 172.21.15.12:0/1419936266 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8084004920 con 0x7f80940a17f0 2024-09-11T23:05:35.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:35.467+0000 7f809b60d640 1 -- 172.21.15.12:0/1419936266 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80940a7ea0 con 0x7f80940a17f0 2024-09-11T23:05:35.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:35.467+0000 7f8089ffb640 1 -- 172.21.15.12:0/1419936266 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 23) ==== 43891+0+0 (secure 0 0 0) 0x7f808401a020 con 0x7f80940a17f0 2024-09-11T23:05:35.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:35.467+0000 7f809b60d640 1 -- 172.21.15.12:0/1419936266 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80940008e0 con 0x7f80940a17f0 2024-09-11T23:05:35.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:35.471+0000 7f8089ffb640 1 --2- 172.21.15.12:0/1419936266 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f8078035c00 0x7f80780380c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:35.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:35.471+0000 7f8089ffb640 1 -- 172.21.15.12:0/1419936266 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5073+0+0 (secure 0 0 0) 0x7f80840481d0 con 0x7f80940a17f0 2024-09-11T23:05:35.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:35.471+0000 7f8098ba8640 1 --2- 172.21.15.12:0/1419936266 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f8078035c00 0x7f80780380c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:35.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:35.471+0000 7f8098ba8640 1 --2- 172.21.15.12:0/1419936266 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f8078035c00 0x7f80780380c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f80900ad000 tx=0x7f80900a6000 comp rx=0 tx=0).ready entity=mgr.4708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:35.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:35.475+0000 7f8089ffb640 1 -- 172.21.15.12:0/1419936266 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f808401bc00 con 0x7f80940a17f0 2024-09-11T23:05:35.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:35.635+0000 7f809b60d640 1 -- 172.21.15.12:0/1419936266 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f80940a6370 con 0x7f80940a17f0 2024-09-11T23:05:36.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.591+0000 7f8089ffb640 1 -- 172.21.15.12:0/1419936266 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v43) ==== 181+0+0 (secure 0 0 0) 0x7f8084019d50 con 0x7f80940a17f0 2024-09-11T23:05:36.595 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' removed 2024-09-11T23:05:36.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.595+0000 7f809b60d640 1 -- 172.21.15.12:0/1419936266 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f8078035c00 msgr2=0x7f80780380c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:36.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.595+0000 7f809b60d640 1 --2- 172.21.15.12:0/1419936266 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f8078035c00 0x7f80780380c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f80900ad000 tx=0x7f80900a6000 comp rx=0 tx=0).stop 2024-09-11T23:05:36.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.595+0000 7f809b60d640 1 -- 172.21.15.12:0/1419936266 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80940a17f0 msgr2=0x7f80940a4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:36.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.595+0000 7f809b60d640 1 --2- 172.21.15.12:0/1419936266 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80940a17f0 0x7f80940a4720 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f808400c410 tx=0x7f808400c8d0 comp rx=0 tx=0).stop 2024-09-11T23:05:36.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.595+0000 7f809b60d640 1 -- 172.21.15.12:0/1419936266 shutdown_connections 2024-09-11T23:05:36.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.595+0000 7f809b60d640 1 --2- 172.21.15.12:0/1419936266 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f8078035c00 0x7f80780380c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:36.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.595+0000 7f809b60d640 1 --2- 172.21.15.12:0/1419936266 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80940a17f0 0x7f80940a4720 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:36.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.595+0000 7f809b60d640 1 -- 172.21.15.12:0/1419936266 >> 172.21.15.12:0/1419936266 conn(0x7f809406da30 msgr2=0x7f80941391f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:36.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.595+0000 7f809b60d640 1 -- 172.21.15.12:0/1419936266 shutdown_connections 2024-09-11T23:05:36.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.595+0000 7f809b60d640 1 -- 172.21.15.12:0/1419936266 wait complete. 2024-09-11T23:05:36.623 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-11T23:05:36.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.747+0000 7f1b2cbe9640 1 Processor -- start 2024-09-11T23:05:36.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.747+0000 7f1b2cbe9640 1 -- start start 2024-09-11T23:05:36.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.751+0000 7f1b2cbe9640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1b2813a090 0x7f1b280a17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:36.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.751+0000 7f1b2cbe9640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b280a1e30 con 0x7f1b2813a470 2024-09-11T23:05:36.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.751+0000 7f1b2cbe9640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f1b280a10a0 con 0x7f1b2813a090 2024-09-11T23:05:36.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.751+0000 7f1b2659c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1b2813a090 0x7f1b280a17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:36.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.751+0000 7f1b2659c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1b2813a090 0x7f1b280a17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52698/0 (socket says 172.21.15.12:52698) 2024-09-11T23:05:36.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.751+0000 7f1b2659c640 1 -- 172.21.15.12:0/2654358178 learned_addr learned my addr 172.21.15.12:0/2654358178 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:36.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.751+0000 7f1b25d9b640 1 --1- 172.21.15.12:0/2654358178 >> v1:172.21.15.12:6789/0 conn(0x7f1b2813a470 0x7f1b2809d9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:45480/0 (socket says 172.21.15.12:45480) 2024-09-11T23:05:36.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.751+0000 7f1b2659c640 1 -- 172.21.15.12:0/2654358178 >> v1:172.21.15.12:6789/0 conn(0x7f1b2813a470 legacy=0x7f1b2809d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:36.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.751+0000 7f1b2659c640 1 -- 172.21.15.12:0/2654358178 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b2809f380 con 0x7f1b2813a090 2024-09-11T23:05:36.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.751+0000 7f1b2659c640 1 --2- 172.21.15.12:0/2654358178 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b2813a090 0x7f1b280a17f0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f1b20009e50 tx=0x7f1b2001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37f93104b21e7729 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:36.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.751+0000 7f1b2559a640 1 -- 172.21.15.12:0/2654358178 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b20009200 con 0x7f1b2813a090 2024-09-11T23:05:36.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.751+0000 7f1b2559a640 1 -- 172.21.15.12:0/2654358178 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b200a5700 con 0x7f1b2813a090 2024-09-11T23:05:36.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.751+0000 7f1b2559a640 1 -- 172.21.15.12:0/2654358178 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b200a5a00 con 0x7f1b2813a090 2024-09-11T23:05:36.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.755+0000 7f1b2cbe9640 1 -- 172.21.15.12:0/2654358178 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b2813a090 msgr2=0x7f1b280a17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:36.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.755+0000 7f1b2cbe9640 1 --2- 172.21.15.12:0/2654358178 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b2813a090 0x7f1b280a17f0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f1b20009e50 tx=0x7f1b2001c9a0 comp rx=0 tx=0).stop 2024-09-11T23:05:36.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.755+0000 7f1b2cbe9640 1 -- 172.21.15.12:0/2654358178 shutdown_connections 2024-09-11T23:05:36.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.755+0000 7f1b2cbe9640 1 --2- 172.21.15.12:0/2654358178 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b2813a090 0x7f1b280a17f0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:36.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.755+0000 7f1b2cbe9640 1 -- 172.21.15.12:0/2654358178 >> 172.21.15.12:0/2654358178 conn(0x7f1b2806da30 msgr2=0x7f1b2806de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:36.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.755+0000 7f1b2cbe9640 1 -- 172.21.15.12:0/2654358178 shutdown_connections 2024-09-11T23:05:36.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.755+0000 7f1b2cbe9640 1 -- 172.21.15.12:0/2654358178 wait complete. 2024-09-11T23:05:36.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.755+0000 7f1b2cbe9640 1 Processor -- start 2024-09-11T23:05:36.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.755+0000 7f1b2cbe9640 1 -- start start 2024-09-11T23:05:36.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.755+0000 7f1b2cbe9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b2813a090 0x7f1b280a8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:36.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.755+0000 7f1b2cbe9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1b281420b0 con 0x7f1b2813a090 2024-09-11T23:05:36.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.755+0000 7f1b2659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b2813a090 0x7f1b280a8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:36.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.755+0000 7f1b2659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b2813a090 0x7f1b280a8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52708/0 (socket says 172.21.15.12:52708) 2024-09-11T23:05:36.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.755+0000 7f1b2659c640 1 -- 172.21.15.12:0/3763804693 learned_addr learned my addr 172.21.15.12:0/3763804693 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:36.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.755+0000 7f1b2659c640 1 -- 172.21.15.12:0/3763804693 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b2813af80 con 0x7f1b2813a090 2024-09-11T23:05:36.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.755+0000 7f1b2659c640 1 --2- 172.21.15.12:0/3763804693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b2813a090 0x7f1b280a8a50 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f1b2001a5d0 tx=0x7f1b20019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:36.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.755+0000 7f1b16ffd640 1 -- 172.21.15.12:0/3763804693 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b200bc020 con 0x7f1b2813a090 2024-09-11T23:05:36.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.755+0000 7f1b16ffd640 1 -- 172.21.15.12:0/3763804693 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b200b8470 con 0x7f1b2813a090 2024-09-11T23:05:36.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.755+0000 7f1b16ffd640 1 -- 172.21.15.12:0/3763804693 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b200b8750 con 0x7f1b2813a090 2024-09-11T23:05:36.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.755+0000 7f1b2cbe9640 1 -- 172.21.15.12:0/3763804693 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b281233e0 con 0x7f1b2813a090 2024-09-11T23:05:36.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.755+0000 7f1b2cbe9640 1 -- 172.21.15.12:0/3763804693 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b280ac1d0 con 0x7f1b2813a090 2024-09-11T23:05:36.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.755+0000 7f1b16ffd640 1 -- 172.21.15.12:0/3763804693 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 23) ==== 43891+0+0 (secure 0 0 0) 0x7f1b200bf020 con 0x7f1b2813a090 2024-09-11T23:05:36.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.755+0000 7f1b16ffd640 1 --2- 172.21.15.12:0/3763804693 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f1b08035c00 0x7f1b080380c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:36.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.755+0000 7f1b2cbe9640 1 -- 172.21.15.12:0/3763804693 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b280aa980 con 0x7f1b2813a090 2024-09-11T23:05:36.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.755+0000 7f1b16ffd640 1 -- 172.21.15.12:0/3763804693 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4635+0+0 (secure 0 0 0) 0x7f1b200e39a0 con 0x7f1b2813a090 2024-09-11T23:05:36.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.755+0000 7f1b25d9b640 1 --2- 172.21.15.12:0/3763804693 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f1b08035c00 0x7f1b080380c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:36.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.759+0000 7f1b25d9b640 1 --2- 172.21.15.12:0/3763804693 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f1b08035c00 0x7f1b080380c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c001600 tx=0x7f1b1c007a50 comp rx=0 tx=0).ready entity=mgr.4708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:36.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.763+0000 7f1b16ffd640 1 -- 172.21.15.12:0/3763804693 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1b200c6030 con 0x7f1b2813a090 2024-09-11T23:05:36.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:36.935+0000 7f1b2cbe9640 1 -- 172.21.15.12:0/3763804693 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f1b280a17f0 con 0x7f1b2813a090 2024-09-11T23:05:37.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.275+0000 7f1b16ffd640 1 -- 172.21.15.12:0/3763804693 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 24) ==== 43997+0+0 (secure 0 0 0) 0x7f1b200b5c90 con 0x7f1b2813a090 2024-09-11T23:05:37.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.607+0000 7f1b16ffd640 1 -- 172.21.15.12:0/3763804693 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v44) ==== 169+0+0 (secure 0 0 0) 0x7f1b20016620 con 0x7f1b2813a090 2024-09-11T23:05:37.609 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' removed 2024-09-11T23:05:37.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.611+0000 7f1b2cbe9640 1 -- 172.21.15.12:0/3763804693 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f1b08035c00 msgr2=0x7f1b080380c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:37.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.611+0000 7f1b2cbe9640 1 --2- 172.21.15.12:0/3763804693 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f1b08035c00 0x7f1b080380c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c001600 tx=0x7f1b1c007a50 comp rx=0 tx=0).stop 2024-09-11T23:05:37.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.611+0000 7f1b2cbe9640 1 -- 172.21.15.12:0/3763804693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b2813a090 msgr2=0x7f1b280a8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:37.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.611+0000 7f1b2cbe9640 1 --2- 172.21.15.12:0/3763804693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b2813a090 0x7f1b280a8a50 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f1b2001a5d0 tx=0x7f1b20019740 comp rx=0 tx=0).stop 2024-09-11T23:05:37.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.611+0000 7f1b2cbe9640 1 -- 172.21.15.12:0/3763804693 shutdown_connections 2024-09-11T23:05:37.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.611+0000 7f1b2cbe9640 1 --2- 172.21.15.12:0/3763804693 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f1b08035c00 0x7f1b080380c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:37.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.611+0000 7f1b2cbe9640 1 --2- 172.21.15.12:0/3763804693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b2813a090 0x7f1b280a8a50 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:37.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.611+0000 7f1b2cbe9640 1 -- 172.21.15.12:0/3763804693 >> 172.21.15.12:0/3763804693 conn(0x7f1b2806da30 msgr2=0x7f1b2813ee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:37.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.611+0000 7f1b2cbe9640 1 -- 172.21.15.12:0/3763804693 shutdown_connections 2024-09-11T23:05:37.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.611+0000 7f1b2cbe9640 1 -- 172.21.15.12:0/3763804693 wait complete. 2024-09-11T23:05:37.644 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:05:37.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.771+0000 7fc967a99640 1 Processor -- start 2024-09-11T23:05:37.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.771+0000 7fc967a99640 1 -- start start 2024-09-11T23:05:37.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.771+0000 7fc967a99640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc960137e60 0x7fc960138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:37.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.771+0000 7fc967a99640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc96009e930 con 0x7fc96009f6e0 2024-09-11T23:05:37.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.771+0000 7fc967a99640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fc9601379e0 con 0x7fc960137e60 2024-09-11T23:05:37.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.771+0000 7fc965835640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc960137e60 0x7fc960138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:37.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.771+0000 7fc965034640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fc96009f6e0 0x7fc9600a36a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:45486/0 (socket says 172.21.15.12:45486) 2024-09-11T23:05:37.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.771+0000 7fc965034640 1 -- 172.21.15.12:0/1039303919 learned_addr learned my addr 172.21.15.12:0/1039303919 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:37.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.771+0000 7fc965835640 1 -- 172.21.15.12:0/1039303919 >> v1:172.21.15.12:6789/0 conn(0x7fc96009f6e0 legacy=0x7fc9600a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:37.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.771+0000 7fc965835640 1 -- 172.21.15.12:0/1039303919 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc96009d910 con 0x7fc960137e60 2024-09-11T23:05:37.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.771+0000 7fc965835640 1 --2- 172.21.15.12:0/1039303919 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc960137e60 0x7fc960138240 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fc950009740 tx=0x7fc95001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75c37d0d1381cf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:37.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.775+0000 7fc964833640 1 -- 172.21.15.12:0/1039303919 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9500ab570 con 0x7fc960137e60 2024-09-11T23:05:37.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.775+0000 7fc964833640 1 -- 172.21.15.12:0/1039303919 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9500b0070 con 0x7fc960137e60 2024-09-11T23:05:37.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.775+0000 7fc964833640 1 -- 172.21.15.12:0/1039303919 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9500ab860 con 0x7fc960137e60 2024-09-11T23:05:37.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.775+0000 7fc967a99640 1 -- 172.21.15.12:0/1039303919 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc960137e60 msgr2=0x7fc960138240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:37.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.775+0000 7fc967a99640 1 --2- 172.21.15.12:0/1039303919 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc960137e60 0x7fc960138240 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fc950009740 tx=0x7fc95001c420 comp rx=0 tx=0).stop 2024-09-11T23:05:37.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.775+0000 7fc967a99640 1 -- 172.21.15.12:0/1039303919 shutdown_connections 2024-09-11T23:05:37.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.775+0000 7fc967a99640 1 --2- 172.21.15.12:0/1039303919 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc960137e60 0x7fc960138240 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:37.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.775+0000 7fc967a99640 1 -- 172.21.15.12:0/1039303919 >> 172.21.15.12:0/1039303919 conn(0x7fc9600a8450 msgr2=0x7fc9600a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:37.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.775+0000 7fc967a99640 1 -- 172.21.15.12:0/1039303919 shutdown_connections 2024-09-11T23:05:37.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.775+0000 7fc967a99640 1 -- 172.21.15.12:0/1039303919 wait complete. 2024-09-11T23:05:37.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.775+0000 7fc967a99640 1 Processor -- start 2024-09-11T23:05:37.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.775+0000 7fc967a99640 1 -- start start 2024-09-11T23:05:37.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.775+0000 7fc967a99640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc96009f6e0 0x7fc96011e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:37.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.775+0000 7fc967a99640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc96013fe00 con 0x7fc96009f6e0 2024-09-11T23:05:37.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.775+0000 7fc965835640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc96009f6e0 0x7fc96011e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:37.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.775+0000 7fc965835640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc96009f6e0 0x7fc96011e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52730/0 (socket says 172.21.15.12:52730) 2024-09-11T23:05:37.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.775+0000 7fc965835640 1 -- 172.21.15.12:0/3761718178 learned_addr learned my addr 172.21.15.12:0/3761718178 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:37.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.775+0000 7fc965835640 1 -- 172.21.15.12:0/3761718178 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9600721a0 con 0x7fc96009f6e0 2024-09-11T23:05:37.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.775+0000 7fc965835640 1 --2- 172.21.15.12:0/3761718178 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc96009f6e0 0x7fc96011e8e0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fc95001a050 tx=0x7fc95001ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:37.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.775+0000 7fc9567fc640 1 -- 172.21.15.12:0/3761718178 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9500abe10 con 0x7fc96009f6e0 2024-09-11T23:05:37.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.775+0000 7fc9567fc640 1 -- 172.21.15.12:0/3761718178 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9500bf410 con 0x7fc96009f6e0 2024-09-11T23:05:37.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.775+0000 7fc9567fc640 1 -- 172.21.15.12:0/3761718178 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9500bf6f0 con 0x7fc96009f6e0 2024-09-11T23:05:37.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.775+0000 7fc967a99640 1 -- 172.21.15.12:0/3761718178 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc960073420 con 0x7fc96009f6e0 2024-09-11T23:05:37.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.775+0000 7fc967a99640 1 -- 172.21.15.12:0/3761718178 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc960072470 con 0x7fc96009f6e0 2024-09-11T23:05:37.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.779+0000 7fc967a99640 1 -- 172.21.15.12:0/3761718178 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc960070e90 con 0x7fc96009f6e0 2024-09-11T23:05:37.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.779+0000 7fc9567fc640 1 -- 172.21.15.12:0/3761718178 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 24) ==== 43997+0+0 (secure 0 0 0) 0x7fc9500bd020 con 0x7fc96009f6e0 2024-09-11T23:05:37.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.779+0000 7fc9567fc640 1 --2- 172.21.15.12:0/3761718178 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fc944035d20 0x7fc9440381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:37.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.779+0000 7fc9567fc640 1 -- 172.21.15.12:0/3761718178 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 4221+0+0 (secure 0 0 0) 0x7fc9500e2f30 con 0x7fc96009f6e0 2024-09-11T23:05:37.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.779+0000 7fc965034640 1 --2- 172.21.15.12:0/3761718178 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fc944035d20 0x7fc9440381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:37.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.779+0000 7fc965034640 1 --2- 172.21.15.12:0/3761718178 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fc944035d20 0x7fc9440381e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc95c001610 tx=0x7fc95c007ad0 comp rx=0 tx=0).ready entity=mgr.4708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:37.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.783+0000 7fc9567fc640 1 -- 172.21.15.12:0/3761718178 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc950016010 con 0x7fc96009f6e0 2024-09-11T23:05:37.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.979+0000 7fc967a99640 1 -- 172.21.15.12:0/3761718178 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc960072a90 con 0x7fc96009f6e0 2024-09-11T23:05:37.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.979+0000 7fc9567fc640 1 -- 172.21.15.12:0/3761718178 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+3576 (secure 0 0 0) 0x7fc9500b5d50 con 0x7fc96009f6e0 2024-09-11T23:05:37.984 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:05:37.984 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":32,"btime":"2024-09-11T23:05:35:255637+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4737,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6829/3926932517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3926932517},{"type":"v1","addr":"172.21.15.12:6829","nonce":3926932517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:05:06.863235+0000","modified":"2024-09-11T23:05:09.896567+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4527},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4527":{"gid":4527,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":8,"addr":"172.21.15.12:6827/1887547537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":1887547537},{"type":"v1","addr":"172.21.15.12:6827","nonce":1887547537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs_b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4527,"qdb_cluster":[4527]},"id":4}]} 2024-09-11T23:05:37.984 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 32 2024-09-11T23:05:37.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.983+0000 7fc967a99640 1 -- 172.21.15.12:0/3761718178 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fc944035d20 msgr2=0x7fc9440381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:37.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.983+0000 7fc967a99640 1 --2- 172.21.15.12:0/3761718178 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fc944035d20 0x7fc9440381e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc95c001610 tx=0x7fc95c007ad0 comp rx=0 tx=0).stop 2024-09-11T23:05:37.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.983+0000 7fc967a99640 1 -- 172.21.15.12:0/3761718178 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc96009f6e0 msgr2=0x7fc96011e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:37.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.983+0000 7fc967a99640 1 --2- 172.21.15.12:0/3761718178 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc96009f6e0 0x7fc96011e8e0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fc95001a050 tx=0x7fc95001ac60 comp rx=0 tx=0).stop 2024-09-11T23:05:37.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.983+0000 7fc967a99640 1 -- 172.21.15.12:0/3761718178 shutdown_connections 2024-09-11T23:05:37.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.983+0000 7fc967a99640 1 --2- 172.21.15.12:0/3761718178 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fc944035d20 0x7fc9440381e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:37.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.983+0000 7fc967a99640 1 --2- 172.21.15.12:0/3761718178 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc96009f6e0 0x7fc96011e8e0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:37.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.983+0000 7fc967a99640 1 -- 172.21.15.12:0/3761718178 >> 172.21.15.12:0/3761718178 conn(0x7fc9600a8450 msgr2=0x7fc960136e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:37.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.983+0000 7fc967a99640 1 -- 172.21.15.12:0/3761718178 shutdown_connections 2024-09-11T23:05:37.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:37.983+0000 7fc967a99640 1 -- 172.21.15.12:0/3761718178 wait complete. 2024-09-11T23:05:38.003 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:05:38.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.119+0000 7f566f659640 1 Processor -- start 2024-09-11T23:05:38.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.119+0000 7f566f659640 1 -- start start 2024-09-11T23:05:38.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.119+0000 7f566f659640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f566809f6e0 0x7f566813cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:38.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.119+0000 7f566f659640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f566809e930 con 0x7f5668137e60 2024-09-11T23:05:38.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.119+0000 7f566f659640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f56681379e0 con 0x7f566809f6e0 2024-09-11T23:05:38.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.119+0000 7f566cbf4640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f566809f6e0 0x7f566813cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:38.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.119+0000 7f566d3f5640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f5668137e60 0x7f5668138240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:45496/0 (socket says 172.21.15.12:45496) 2024-09-11T23:05:38.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.119+0000 7f566d3f5640 1 -- 172.21.15.12:0/3566180142 learned_addr learned my addr 172.21.15.12:0/3566180142 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:38.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.119+0000 7f566cbf4640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f566809f6e0 0x7f566813cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52742/0 (socket says 172.21.15.12:52742) 2024-09-11T23:05:38.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.119+0000 7f566cbf4640 1 -- 172.21.15.12:0/3566180142 >> v1:172.21.15.12:6789/0 conn(0x7f5668137e60 legacy=0x7f5668138240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:38.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.119+0000 7f566cbf4640 1 -- 172.21.15.12:0/3566180142 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f566809d910 con 0x7f566809f6e0 2024-09-11T23:05:38.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.119+0000 7f566cbf4640 1 --2- 172.21.15.12:0/3566180142 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f566809f6e0 0x7f566813cc60 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f5658009740 tx=0x7f565801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f086d11e8417757 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:38.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.123+0000 7f565ffff640 1 -- 172.21.15.12:0/3566180142 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56580ab570 con 0x7f566809f6e0 2024-09-11T23:05:38.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.123+0000 7f565ffff640 1 -- 172.21.15.12:0/3566180142 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56580b0070 con 0x7f566809f6e0 2024-09-11T23:05:38.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.123+0000 7f565ffff640 1 -- 172.21.15.12:0/3566180142 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56580ab860 con 0x7f566809f6e0 2024-09-11T23:05:38.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.123+0000 7f566f659640 1 -- 172.21.15.12:0/3566180142 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f566809f6e0 msgr2=0x7f566813cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:38.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.123+0000 7f566f659640 1 --2- 172.21.15.12:0/3566180142 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f566809f6e0 0x7f566813cc60 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f5658009740 tx=0x7f565801c420 comp rx=0 tx=0).stop 2024-09-11T23:05:38.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.123+0000 7f566f659640 1 -- 172.21.15.12:0/3566180142 shutdown_connections 2024-09-11T23:05:38.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.123+0000 7f566f659640 1 --2- 172.21.15.12:0/3566180142 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f566809f6e0 0x7f566813cc60 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:38.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.123+0000 7f566f659640 1 -- 172.21.15.12:0/3566180142 >> 172.21.15.12:0/3566180142 conn(0x7f56680a8450 msgr2=0x7f56680a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:38.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.123+0000 7f566f659640 1 -- 172.21.15.12:0/3566180142 shutdown_connections 2024-09-11T23:05:38.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.123+0000 7f566f659640 1 -- 172.21.15.12:0/3566180142 wait complete. 2024-09-11T23:05:38.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.123+0000 7f566f659640 1 Processor -- start 2024-09-11T23:05:38.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.123+0000 7f566f659640 1 -- start start 2024-09-11T23:05:38.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.123+0000 7f566f659640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f566809f6e0 0x7f566806fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:38.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.123+0000 7f566f659640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f566813fd50 con 0x7f566809f6e0 2024-09-11T23:05:38.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.123+0000 7f566d3f5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f566809f6e0 0x7f566806fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:38.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.123+0000 7f566d3f5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f566809f6e0 0x7f566806fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52754/0 (socket says 172.21.15.12:52754) 2024-09-11T23:05:38.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.123+0000 7f566d3f5640 1 -- 172.21.15.12:0/2531922003 learned_addr learned my addr 172.21.15.12:0/2531922003 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:38.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.123+0000 7f566d3f5640 1 -- 172.21.15.12:0/2531922003 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56681350d0 con 0x7f566809f6e0 2024-09-11T23:05:38.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.123+0000 7f566d3f5640 1 --2- 172.21.15.12:0/2531922003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f566809f6e0 0x7f566806fc40 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f566400c3a0 tx=0x7f566400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:38.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.123+0000 7f565dffb640 1 -- 172.21.15.12:0/2531922003 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5664017070 con 0x7f566809f6e0 2024-09-11T23:05:38.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.123+0000 7f565dffb640 1 -- 172.21.15.12:0/2531922003 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5664005c20 con 0x7f566809f6e0 2024-09-11T23:05:38.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.123+0000 7f566f659640 1 -- 172.21.15.12:0/2531922003 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f566811e2e0 con 0x7f566809f6e0 2024-09-11T23:05:38.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.123+0000 7f565dffb640 1 -- 172.21.15.12:0/2531922003 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56640070d0 con 0x7f566809f6e0 2024-09-11T23:05:38.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.123+0000 7f566f659640 1 -- 172.21.15.12:0/2531922003 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5668073560 con 0x7f566809f6e0 2024-09-11T23:05:38.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.123+0000 7f565dffb640 1 -- 172.21.15.12:0/2531922003 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 24) ==== 43997+0+0 (secure 0 0 0) 0x7f566401a070 con 0x7f566809f6e0 2024-09-11T23:05:38.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.123+0000 7f565dffb640 1 --2- 172.21.15.12:0/2531922003 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f564c035d70 0x7f564c038230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:38.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.123+0000 7f566f659640 1 -- 172.21.15.12:0/2531922003 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f566811efb0 con 0x7f566809f6e0 2024-09-11T23:05:38.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.127+0000 7f565dffb640 1 -- 172.21.15.12:0/2531922003 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 4221+0+0 (secure 0 0 0) 0x7f5664047bb0 con 0x7f566809f6e0 2024-09-11T23:05:38.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.127+0000 7f566cbf4640 1 --2- 172.21.15.12:0/2531922003 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f564c035d70 0x7f564c038230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:38.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.127+0000 7f566cbf4640 1 --2- 172.21.15.12:0/2531922003 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f564c035d70 0x7f564c038230 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f56580af000 tx=0x7f56580a7000 comp rx=0 tx=0).ready entity=mgr.4708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:38.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.131+0000 7f565dffb640 1 -- 172.21.15.12:0/2531922003 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5664007270 con 0x7f566809f6e0 2024-09-11T23:05:38.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.295+0000 7f566f659640 1 -- 172.21.15.12:0/2531922003 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5668071a00 con 0x7f566809f6e0 2024-09-11T23:05:38.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.299+0000 7f565dffb640 1 -- 172.21.15.12:0/2531922003 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) ==== 74+0+11810 (secure 0 0 0) 0x7f5664012400 con 0x7f566809f6e0 2024-09-11T23:05:38.300 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:05:38.300 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":44,"fsid":"8be14356-3340-4500-91a2-4cbc6b511f65","created":"2024-09-11T23:03:10.620234+0000","modified":"2024-09-11T23:05:37.604443+0000","last_up_change":"2024-09-11T23:03:22.359028+0000","last_in_change":"2024-09-11T23:03:11.545817+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:03:23.587068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_b_metadata","create_time":"2024-09-11T23:05:05.624837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs_b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_b_data","create_time":"2024-09-11T23:05:06.296091+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs_b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"153b72a1-40b1-400d-93ea-333e733f9bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6817","nonce":3680911937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6819","nonce":3680911937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6823","nonce":3680911937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6821","nonce":3680911937}]},"public_addr":"172.21.15.12:6817/3680911937","cluster_addr":"172.21.15.12:6819/3680911937","heartbeat_back_addr":"172.21.15.12:6823/3680911937","heartbeat_front_addr":"172.21.15.12:6821/3680911937","state":["exists","up"]},{"osd":1,"uuid":"94669e49-ee4f-4acf-9e25-e94374dda8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6801","nonce":236825163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6803","nonce":236825163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6807","nonce":236825163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6805","nonce":236825163}]},"public_addr":"172.21.15.12:6801/236825163","cluster_addr":"172.21.15.12:6803/236825163","heartbeat_back_addr":"172.21.15.12:6807/236825163","heartbeat_front_addr":"172.21.15.12:6805/236825163","state":["exists","up"]},{"osd":2,"uuid":"826dae4d-8888-4ec5-8f00-425b3be93814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6809","nonce":3263521655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6811","nonce":3263521655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6815","nonce":3263521655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6813","nonce":3263521655}]},"public_addr":"172.21.15.12:6809/3263521655","cluster_addr":"172.21.15.12:6811/3263521655","heartbeat_back_addr":"172.21.15.12:6815/3263521655","heartbeat_front_addr":"172.21.15.12:6813/3263521655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:19.398518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.761524+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.904997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/1793382360":"2024-09-12T23:05:34.254367+0000","172.21.15.12:0/906705049":"2024-09-12T23:05:34.254367+0000","172.21.15.12:0/751872097":"2024-09-12T23:05:34.254367+0000","172.21.15.12:0/1572670263":"2024-09-12T23:05:34.254367+0000","172.21.15.12:6825/2340508205":"2024-09-12T23:05:34.254367+0000","172.21.15.12:6824/2340508205":"2024-09-12T23:05:34.254367+0000","172.21.15.12:0/2857800363":"2024-09-12T23:05:34.254367+0000","172.21.15.12:6829/2765393463":"2024-09-12T23:05:34.219324+0000","172.21.15.12:6828/2765393463":"2024-09-12T23:05:34.219324+0000","172.21.15.12:0/2509166838":"2024-09-12T23:05:06.494857+0000","172.21.15.12:6825/718802078":"2024-09-12T23:05:06.494857+0000","172.21.15.12:0/1378363537":"2024-09-12T23:05:34.254367+0000","172.21.15.12:6824/718802078":"2024-09-12T23:05:06.494857+0000","172.21.15.12:0/2490570290":"2024-09-12T23:05:06.494857+0000","172.21.15.12:0/2957476143":"2024-09-12T23:05:06.494857+0000","172.21.15.12:0/37905181":"2024-09-12T23:05:06.494857+0000","172.21.15.12:0/3294231065":"2024-09-12T23:05:06.494857+0000","172.21.15.12:0/2407367943":"2024-09-12T23:05:06.494857+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:05:38.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.299+0000 7f566f659640 1 -- 172.21.15.12:0/2531922003 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f564c035d70 msgr2=0x7f564c038230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:38.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.299+0000 7f566f659640 1 --2- 172.21.15.12:0/2531922003 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f564c035d70 0x7f564c038230 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f56580af000 tx=0x7f56580a7000 comp rx=0 tx=0).stop 2024-09-11T23:05:38.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.299+0000 7f566f659640 1 -- 172.21.15.12:0/2531922003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f566809f6e0 msgr2=0x7f566806fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:38.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.299+0000 7f566f659640 1 --2- 172.21.15.12:0/2531922003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f566809f6e0 0x7f566806fc40 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f566400c3a0 tx=0x7f566400c860 comp rx=0 tx=0).stop 2024-09-11T23:05:38.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.299+0000 7f566f659640 1 -- 172.21.15.12:0/2531922003 shutdown_connections 2024-09-11T23:05:38.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.299+0000 7f566f659640 1 --2- 172.21.15.12:0/2531922003 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f564c035d70 0x7f564c038230 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:38.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.299+0000 7f566f659640 1 --2- 172.21.15.12:0/2531922003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f566809f6e0 0x7f566806fc40 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:38.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.299+0000 7f566f659640 1 -- 172.21.15.12:0/2531922003 >> 172.21.15.12:0/2531922003 conn(0x7f56680a8450 msgr2=0x7f56680a7260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:38.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.299+0000 7f566f659640 1 -- 172.21.15.12:0/2531922003 shutdown_connections 2024-09-11T23:05:38.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.299+0000 7f566f659640 1 -- 172.21.15.12:0/2531922003 wait complete. 2024-09-11T23:05:38.320 INFO:tasks.cephfs.filesystem:Destroying file system cephfs_b and related pools 2024-09-11T23:05:38.320 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:05:38.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.443+0000 7f58998f2640 1 Processor -- start 2024-09-11T23:05:38.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.443+0000 7f58998f2640 1 -- start start 2024-09-11T23:05:38.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.443+0000 7f58998f2640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5894137e60 0x7f5894138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:38.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.443+0000 7f58998f2640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f589409e930 con 0x7f589409f6e0 2024-09-11T23:05:38.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.443+0000 7f58998f2640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f58941379e0 con 0x7f5894137e60 2024-09-11T23:05:38.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.443+0000 7f5892ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5894137e60 0x7f5894138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:38.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.443+0000 7f58927fc640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f589409f6e0 0x7f58940a36a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:45510/0 (socket says 172.21.15.12:45510) 2024-09-11T23:05:38.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.443+0000 7f58927fc640 1 -- 172.21.15.12:0/3491112353 learned_addr learned my addr 172.21.15.12:0/3491112353 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:38.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.443+0000 7f5892ffd640 1 -- 172.21.15.12:0/3491112353 >> v1:172.21.15.12:6789/0 conn(0x7f589409f6e0 legacy=0x7f58940a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:38.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.443+0000 7f5892ffd640 1 -- 172.21.15.12:0/3491112353 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f589409d910 con 0x7f5894137e60 2024-09-11T23:05:38.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.443+0000 7f5891ffb640 1 -- 172.21.15.12:0/3491112353 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 318754760 0 0) 0x7f589409e930 con 0x7f589409f6e0 2024-09-11T23:05:38.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.447+0000 7f5892ffd640 1 --2- 172.21.15.12:0/3491112353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5894137e60 0x7f5894138240 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f5884009740 tx=0x7f588401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39e22a88f7252546 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:38.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.447+0000 7f5891ffb640 1 -- 172.21.15.12:0/3491112353 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58840ab570 con 0x7f5894137e60 2024-09-11T23:05:38.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.447+0000 7f5891ffb640 1 -- 172.21.15.12:0/3491112353 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58840b0070 con 0x7f5894137e60 2024-09-11T23:05:38.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.447+0000 7f5891ffb640 1 -- 172.21.15.12:0/3491112353 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58840ab860 con 0x7f5894137e60 2024-09-11T23:05:38.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.447+0000 7f58998f2640 1 -- 172.21.15.12:0/3491112353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5894137e60 msgr2=0x7f5894138240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:38.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.447+0000 7f58998f2640 1 --2- 172.21.15.12:0/3491112353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5894137e60 0x7f5894138240 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f5884009740 tx=0x7f588401c420 comp rx=0 tx=0).stop 2024-09-11T23:05:38.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.447+0000 7f58998f2640 1 -- 172.21.15.12:0/3491112353 shutdown_connections 2024-09-11T23:05:38.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.447+0000 7f58998f2640 1 --2- 172.21.15.12:0/3491112353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5894137e60 0x7f5894138240 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:38.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.447+0000 7f58998f2640 1 -- 172.21.15.12:0/3491112353 >> 172.21.15.12:0/3491112353 conn(0x7f58940a8450 msgr2=0x7f58940a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:38.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.447+0000 7f58998f2640 1 -- 172.21.15.12:0/3491112353 shutdown_connections 2024-09-11T23:05:38.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.447+0000 7f58998f2640 1 -- 172.21.15.12:0/3491112353 wait complete. 2024-09-11T23:05:38.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.451+0000 7f58998f2640 1 Processor -- start 2024-09-11T23:05:38.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.451+0000 7f58998f2640 1 -- start start 2024-09-11T23:05:38.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.451+0000 7f58998f2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f589409f6e0 0x7f5894133780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:38.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.451+0000 7f58998f2640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f589413fe00 con 0x7f589409f6e0 2024-09-11T23:05:38.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.451+0000 7f5892ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f589409f6e0 0x7f5894133780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:38.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.451+0000 7f5892ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f589409f6e0 0x7f5894133780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52764/0 (socket says 172.21.15.12:52764) 2024-09-11T23:05:38.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.451+0000 7f5892ffd640 1 -- 172.21.15.12:0/468023497 learned_addr learned my addr 172.21.15.12:0/468023497 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:38.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.451+0000 7f5892ffd640 1 -- 172.21.15.12:0/468023497 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5894070860 con 0x7f589409f6e0 2024-09-11T23:05:38.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.451+0000 7f5892ffd640 1 --2- 172.21.15.12:0/468023497 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f589409f6e0 0x7f5894133780 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f5884019030 tx=0x7f588401ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:38.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.451+0000 7f588bfff640 1 -- 172.21.15.12:0/468023497 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58840abdd0 con 0x7f589409f6e0 2024-09-11T23:05:38.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.451+0000 7f588bfff640 1 -- 172.21.15.12:0/468023497 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5884004020 con 0x7f589409f6e0 2024-09-11T23:05:38.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.451+0000 7f588bfff640 1 -- 172.21.15.12:0/468023497 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5884004320 con 0x7f589409f6e0 2024-09-11T23:05:38.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.451+0000 7f58998f2640 1 -- 172.21.15.12:0/468023497 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5894070580 con 0x7f589409f6e0 2024-09-11T23:05:38.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.451+0000 7f58998f2640 1 -- 172.21.15.12:0/468023497 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5894073060 con 0x7f589409f6e0 2024-09-11T23:05:38.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.451+0000 7f58998f2640 1 -- 172.21.15.12:0/468023497 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5894073290 con 0x7f589409f6e0 2024-09-11T23:05:38.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.451+0000 7f588bfff640 1 -- 172.21.15.12:0/468023497 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 24) ==== 43997+0+0 (secure 0 0 0) 0x7f5884003620 con 0x7f589409f6e0 2024-09-11T23:05:38.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.451+0000 7f588bfff640 1 --2- 172.21.15.12:0/468023497 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f5874035d20 0x7f58740381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:38.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.451+0000 7f588bfff640 1 -- 172.21.15.12:0/468023497 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 4221+0+0 (secure 0 0 0) 0x7f58840e30a0 con 0x7f589409f6e0 2024-09-11T23:05:38.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.451+0000 7f58927fc640 1 --2- 172.21.15.12:0/468023497 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f5874035d20 0x7f58740381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:38.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.451+0000 7f58927fc640 1 --2- 172.21.15.12:0/468023497 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f5874035d20 0x7f58740381e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f587c007fd0 tx=0x7f587c007920 comp rx=0 tx=0).ready entity=mgr.4708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:38.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.459+0000 7f588bfff640 1 -- 172.21.15.12:0/468023497 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5884016010 con 0x7f589409f6e0 2024-09-11T23:05:38.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.619+0000 7f588bfff640 1 -- 172.21.15.12:0/468023497 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 25) ==== 44053+0+0 (secure 0 0 0) 0x7f5884003910 con 0x7f589409f6e0 2024-09-11T23:05:38.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.671+0000 7f58998f2640 1 -- 172.21.15.12:0/468023497 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f589406bc60 con 0x7f589409f6e0 2024-09-11T23:05:38.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.671+0000 7f588bfff640 1 -- 172.21.15.12:0/468023497 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+3576 (secure 0 0 0) 0x7f58840b2310 con 0x7f589409f6e0 2024-09-11T23:05:38.673 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:05:38.673 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":32,"btime":"2024-09-11T23:05:35:255637+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4737,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6829/3926932517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3926932517},{"type":"v1","addr":"172.21.15.12:6829","nonce":3926932517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:05:06.863235+0000","modified":"2024-09-11T23:05:09.896567+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4527},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4527":{"gid":4527,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":8,"addr":"172.21.15.12:6827/1887547537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":1887547537},{"type":"v1","addr":"172.21.15.12:6827","nonce":1887547537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs_b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4527,"qdb_cluster":[4527]},"id":4}]} 2024-09-11T23:05:38.674 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 32 2024-09-11T23:05:38.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.671+0000 7f58998f2640 1 -- 172.21.15.12:0/468023497 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f5874035d20 msgr2=0x7f58740381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:38.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.671+0000 7f58998f2640 1 --2- 172.21.15.12:0/468023497 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f5874035d20 0x7f58740381e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f587c007fd0 tx=0x7f587c007920 comp rx=0 tx=0).stop 2024-09-11T23:05:38.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.671+0000 7f58998f2640 1 -- 172.21.15.12:0/468023497 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f589409f6e0 msgr2=0x7f5894133780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:38.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.671+0000 7f58998f2640 1 --2- 172.21.15.12:0/468023497 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f589409f6e0 0x7f5894133780 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f5884019030 tx=0x7f588401ac60 comp rx=0 tx=0).stop 2024-09-11T23:05:38.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.671+0000 7f58998f2640 1 -- 172.21.15.12:0/468023497 shutdown_connections 2024-09-11T23:05:38.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.671+0000 7f58998f2640 1 --2- 172.21.15.12:0/468023497 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f5874035d20 0x7f58740381e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:38.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.671+0000 7f58998f2640 1 --2- 172.21.15.12:0/468023497 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f589409f6e0 0x7f5894133780 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:38.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.671+0000 7f58998f2640 1 -- 172.21.15.12:0/468023497 >> 172.21.15.12:0/468023497 conn(0x7f58940a8450 msgr2=0x7f5894134650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:38.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.671+0000 7f58998f2640 1 -- 172.21.15.12:0/468023497 shutdown_connections 2024-09-11T23:05:38.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.671+0000 7f58998f2640 1 -- 172.21.15.12:0/468023497 wait complete. 2024-09-11T23:05:38.691 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:05:38.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.811+0000 7f4d9b297640 1 Processor -- start 2024-09-11T23:05:38.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.811+0000 7f4d9b297640 1 -- start start 2024-09-11T23:05:38.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.811+0000 7f4d9b297640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4d94133690 0x7f4d94067c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:38.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.811+0000 7f4d9b297640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d94072f00 con 0x7f4d9409f600 2024-09-11T23:05:38.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.811+0000 7f4d9b297640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f4d94133260 con 0x7f4d94133690 2024-09-11T23:05:38.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.811+0000 7f4d99033640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4d94133690 0x7f4d94067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:38.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.811+0000 7f4d99033640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4d94133690 0x7f4d94067c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52776/0 (socket says 172.21.15.12:52776) 2024-09-11T23:05:38.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.811+0000 7f4d99033640 1 -- 172.21.15.12:0/3160265570 learned_addr learned my addr 172.21.15.12:0/3160265570 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:38.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.811+0000 7f4d99033640 1 -- 172.21.15.12:0/3160265570 >> v1:172.21.15.12:6789/0 conn(0x7f4d9409f600 legacy=0x7f4d94133a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:38.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.811+0000 7f4d99033640 1 -- 172.21.15.12:0/3160265570 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d94134180 con 0x7f4d94133690 2024-09-11T23:05:38.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.811+0000 7f4d8bfff640 1 -- 172.21.15.12:0/3160265570 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3444150772 0 0) 0x7f4d94072f00 con 0x7f4d9409f600 2024-09-11T23:05:38.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.811+0000 7f4d99033640 1 --2- 172.21.15.12:0/3160265570 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d94133690 0x7f4d94067c60 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f4d9000ba90 tx=0x7f4d9001eb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80fab1f6918ae499 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:38.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.811+0000 7f4d8bfff640 1 -- 172.21.15.12:0/3160265570 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d900b4070 con 0x7f4d94133690 2024-09-11T23:05:38.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.811+0000 7f4d8bfff640 1 -- 172.21.15.12:0/3160265570 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d900a7910 con 0x7f4d94133690 2024-09-11T23:05:38.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.811+0000 7f4d8bfff640 1 -- 172.21.15.12:0/3160265570 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d900a7c10 con 0x7f4d94133690 2024-09-11T23:05:38.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.815+0000 7f4d9b297640 1 -- 172.21.15.12:0/3160265570 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d94133690 msgr2=0x7f4d94067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:38.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.815+0000 7f4d9b297640 1 --2- 172.21.15.12:0/3160265570 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d94133690 0x7f4d94067c60 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f4d9000ba90 tx=0x7f4d9001eb00 comp rx=0 tx=0).stop 2024-09-11T23:05:38.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.815+0000 7f4d9b297640 1 -- 172.21.15.12:0/3160265570 shutdown_connections 2024-09-11T23:05:38.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.815+0000 7f4d9b297640 1 --2- 172.21.15.12:0/3160265570 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d94133690 0x7f4d94067c60 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:38.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.815+0000 7f4d9b297640 1 -- 172.21.15.12:0/3160265570 >> 172.21.15.12:0/3160265570 conn(0x7f4d9409b910 msgr2=0x7f4d9409dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:38.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.815+0000 7f4d9b297640 1 -- 172.21.15.12:0/3160265570 shutdown_connections 2024-09-11T23:05:38.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.815+0000 7f4d9b297640 1 -- 172.21.15.12:0/3160265570 wait complete. 2024-09-11T23:05:38.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.815+0000 7f4d9b297640 1 Processor -- start 2024-09-11T23:05:38.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.815+0000 7f4d9b297640 1 -- start start 2024-09-11T23:05:38.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.815+0000 7f4d9b297640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d9409f600 0x7f4d940a0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:38.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.815+0000 7f4d9b297640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4d94070c30 con 0x7f4d9409f600 2024-09-11T23:05:38.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.815+0000 7f4d99033640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d9409f600 0x7f4d940a0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:38.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.815+0000 7f4d99033640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d9409f600 0x7f4d940a0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52778/0 (socket says 172.21.15.12:52778) 2024-09-11T23:05:38.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.815+0000 7f4d99033640 1 -- 172.21.15.12:0/3668091921 learned_addr learned my addr 172.21.15.12:0/3668091921 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:38.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.815+0000 7f4d99033640 1 -- 172.21.15.12:0/3668091921 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d94137480 con 0x7f4d9409f600 2024-09-11T23:05:38.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.815+0000 7f4d99033640 1 --2- 172.21.15.12:0/3668091921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d9409f600 0x7f4d940a0370 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f4d9001c730 tx=0x7f4d9001b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:38.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.815+0000 7f4d89ffb640 1 -- 172.21.15.12:0/3668091921 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d900be070 con 0x7f4d9409f600 2024-09-11T23:05:38.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.815+0000 7f4d89ffb640 1 -- 172.21.15.12:0/3668091921 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d900af970 con 0x7f4d9409f600 2024-09-11T23:05:38.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.815+0000 7f4d9b297640 1 -- 172.21.15.12:0/3668091921 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d940a0a20 con 0x7f4d9409f600 2024-09-11T23:05:38.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.815+0000 7f4d89ffb640 1 -- 172.21.15.12:0/3668091921 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d900b4040 con 0x7f4d9409f600 2024-09-11T23:05:38.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.815+0000 7f4d9b297640 1 -- 172.21.15.12:0/3668091921 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d94136190 con 0x7f4d9409f600 2024-09-11T23:05:38.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.815+0000 7f4d89ffb640 1 -- 172.21.15.12:0/3668091921 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 44053+0+0 (secure 0 0 0) 0x7f4d900c1070 con 0x7f4d9409f600 2024-09-11T23:05:38.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.815+0000 7f4d9b297640 1 -- 172.21.15.12:0/3668091921 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d94067c60 con 0x7f4d9409f600 2024-09-11T23:05:38.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.815+0000 7f4d89ffb640 1 --2- 172.21.15.12:0/3668091921 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f4d78035db0 0x7f4d78038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:38.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.815+0000 7f4d89ffb640 1 -- 172.21.15.12:0/3668091921 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 4221+0+0 (secure 0 0 0) 0x7f4d900e5ec0 con 0x7f4d9409f600 2024-09-11T23:05:38.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.819+0000 7f4d98832640 1 --2- 172.21.15.12:0/3668091921 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f4d78035db0 0x7f4d78038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:38.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.819+0000 7f4d98832640 1 --2- 172.21.15.12:0/3668091921 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f4d78035db0 0x7f4d78038270 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4d84000f70 tx=0x7f4d84007910 comp rx=0 tx=0).ready entity=mgr.4708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:38.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:38.823+0000 7f4d89ffb640 1 -- 172.21.15.12:0/3668091921 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4d90018780 con 0x7f4d9409f600 2024-09-11T23:05:39.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.043+0000 7f4d9b297640 1 -- 172.21.15.12:0/3668091921 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4d940754b0 con 0x7f4d9409f600 2024-09-11T23:05:39.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.043+0000 7f4d89ffb640 1 -- 172.21.15.12:0/3668091921 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+3576 (secure 0 0 0) 0x7f4d900e4ab0 con 0x7f4d9409f600 2024-09-11T23:05:39.048 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:05:39.048 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":32,"btime":"2024-09-11T23:05:35:255637+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4737,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6829/3926932517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3926932517},{"type":"v1","addr":"172.21.15.12:6829","nonce":3926932517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:05:06.863235+0000","modified":"2024-09-11T23:05:09.896567+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4527},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4527":{"gid":4527,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":8,"addr":"172.21.15.12:6827/1887547537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":1887547537},{"type":"v1","addr":"172.21.15.12:6827","nonce":1887547537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs_b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4527,"qdb_cluster":[4527]},"id":4}]} 2024-09-11T23:05:39.048 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 32 2024-09-11T23:05:39.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.047+0000 7f4d9b297640 1 -- 172.21.15.12:0/3668091921 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f4d78035db0 msgr2=0x7f4d78038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:39.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.047+0000 7f4d9b297640 1 --2- 172.21.15.12:0/3668091921 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f4d78035db0 0x7f4d78038270 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4d84000f70 tx=0x7f4d84007910 comp rx=0 tx=0).stop 2024-09-11T23:05:39.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.047+0000 7f4d9b297640 1 -- 172.21.15.12:0/3668091921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d9409f600 msgr2=0x7f4d940a0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:39.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.047+0000 7f4d9b297640 1 --2- 172.21.15.12:0/3668091921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d9409f600 0x7f4d940a0370 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f4d9001c730 tx=0x7f4d9001b8a0 comp rx=0 tx=0).stop 2024-09-11T23:05:39.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.047+0000 7f4d9b297640 1 -- 172.21.15.12:0/3668091921 shutdown_connections 2024-09-11T23:05:39.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.047+0000 7f4d9b297640 1 --2- 172.21.15.12:0/3668091921 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f4d78035db0 0x7f4d78038270 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:39.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.047+0000 7f4d9b297640 1 --2- 172.21.15.12:0/3668091921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d9409f600 0x7f4d940a0370 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:39.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.047+0000 7f4d9b297640 1 -- 172.21.15.12:0/3668091921 >> 172.21.15.12:0/3668091921 conn(0x7f4d9409b910 msgr2=0x7f4d94130580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:39.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.047+0000 7f4d9b297640 1 -- 172.21.15.12:0/3668091921 shutdown_connections 2024-09-11T23:05:39.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.047+0000 7f4d9b297640 1 -- 172.21.15.12:0/3668091921 wait complete. 2024-09-11T23:05:39.066 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:05:39.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.203+0000 7f680651f640 1 Processor -- start 2024-09-11T23:05:39.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.203+0000 7f680651f640 1 -- start start 2024-09-11T23:05:39.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.203+0000 7f680651f640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f680009f6e0 0x7f680013cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:39.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.203+0000 7f680651f640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f680009e930 con 0x7f6800137e60 2024-09-11T23:05:39.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.203+0000 7f680651f640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f68001379e0 con 0x7f680009f6e0 2024-09-11T23:05:39.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.203+0000 7f67fffff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f6800137e60 0x7f6800138240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:45518/0 (socket says 172.21.15.12:45518) 2024-09-11T23:05:39.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.203+0000 7f67fffff640 1 -- 172.21.15.12:0/1557658356 learned_addr learned my addr 172.21.15.12:0/1557658356 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:39.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.203+0000 7f67ff7fe640 1 --2- 172.21.15.12:0/1557658356 >> v2:172.21.15.12:3300/0 conn(0x7f680009f6e0 0x7f680013cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:39.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.203+0000 7f67feffd640 1 -- 172.21.15.12:0/1557658356 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1473038724 0 0) 0x7f680009e930 con 0x7f6800137e60 2024-09-11T23:05:39.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.203+0000 7f67feffd640 1 -- 172.21.15.12:0/1557658356 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67e8003530 con 0x7f6800137e60 2024-09-11T23:05:39.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.203+0000 7f67ff7fe640 1 -- 172.21.15.12:0/1557658356 >> v1:172.21.15.12:6789/0 conn(0x7f6800137e60 legacy=0x7f6800138240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:39.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.203+0000 7f67ff7fe640 1 -- 172.21.15.12:0/1557658356 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f680009d910 con 0x7f680009f6e0 2024-09-11T23:05:39.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.203+0000 7f67ff7fe640 1 --2- 172.21.15.12:0/1557658356 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f680009f6e0 0x7f680013cc60 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f67f4009740 tx=0x7f67f401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dc2e2c4b46170a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:39.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.203+0000 7f67feffd640 1 -- 172.21.15.12:0/1557658356 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67f40ab570 con 0x7f680009f6e0 2024-09-11T23:05:39.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.203+0000 7f67feffd640 1 -- 172.21.15.12:0/1557658356 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67f40b0070 con 0x7f680009f6e0 2024-09-11T23:05:39.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.203+0000 7f67feffd640 1 -- 172.21.15.12:0/1557658356 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67f40ab840 con 0x7f680009f6e0 2024-09-11T23:05:39.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.207+0000 7f680651f640 1 -- 172.21.15.12:0/1557658356 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f680009f6e0 msgr2=0x7f680013cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:39.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.207+0000 7f680651f640 1 --2- 172.21.15.12:0/1557658356 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f680009f6e0 0x7f680013cc60 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f67f4009740 tx=0x7f67f401c420 comp rx=0 tx=0).stop 2024-09-11T23:05:39.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.207+0000 7f680651f640 1 -- 172.21.15.12:0/1557658356 shutdown_connections 2024-09-11T23:05:39.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.207+0000 7f680651f640 1 --2- 172.21.15.12:0/1557658356 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f680009f6e0 0x7f680013cc60 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:39.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.207+0000 7f680651f640 1 -- 172.21.15.12:0/1557658356 >> 172.21.15.12:0/1557658356 conn(0x7f68000a8450 msgr2=0x7f68000a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:39.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.207+0000 7f680651f640 1 -- 172.21.15.12:0/1557658356 shutdown_connections 2024-09-11T23:05:39.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.207+0000 7f680651f640 1 -- 172.21.15.12:0/1557658356 wait complete. 2024-09-11T23:05:39.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.207+0000 7f680651f640 1 Processor -- start 2024-09-11T23:05:39.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.207+0000 7f680651f640 1 -- start start 2024-09-11T23:05:39.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.207+0000 7f680651f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f680009f6e0 0x7f680011e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:39.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.207+0000 7f680651f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f680013fd50 con 0x7f680009f6e0 2024-09-11T23:05:39.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.207+0000 7f67fffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f680009f6e0 0x7f680011e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:39.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.207+0000 7f67fffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f680009f6e0 0x7f680011e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52782/0 (socket says 172.21.15.12:52782) 2024-09-11T23:05:39.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.207+0000 7f67fffff640 1 -- 172.21.15.12:0/857087676 learned_addr learned my addr 172.21.15.12:0/857087676 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:39.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.207+0000 7f67fffff640 1 -- 172.21.15.12:0/857087676 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68000714d0 con 0x7f680009f6e0 2024-09-11T23:05:39.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.207+0000 7f67fffff640 1 --2- 172.21.15.12:0/857087676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f680009f6e0 0x7f680011e490 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f67f000cb40 tx=0x7f67f00021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:39.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.207+0000 7f67fcff9640 1 -- 172.21.15.12:0/857087676 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67f0017070 con 0x7f680009f6e0 2024-09-11T23:05:39.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.207+0000 7f67fcff9640 1 -- 172.21.15.12:0/857087676 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67f000ab80 con 0x7f680009f6e0 2024-09-11T23:05:39.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.207+0000 7f680651f640 1 -- 172.21.15.12:0/857087676 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6800071740 con 0x7f680009f6e0 2024-09-11T23:05:39.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.207+0000 7f67fcff9640 1 -- 172.21.15.12:0/857087676 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67f0012400 con 0x7f680009f6e0 2024-09-11T23:05:39.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.207+0000 7f680651f640 1 -- 172.21.15.12:0/857087676 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6800072390 con 0x7f680009f6e0 2024-09-11T23:05:39.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.207+0000 7f680651f640 1 -- 172.21.15.12:0/857087676 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6800073200 con 0x7f680009f6e0 2024-09-11T23:05:39.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.211+0000 7f67fcff9640 1 -- 172.21.15.12:0/857087676 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 44053+0+0 (secure 0 0 0) 0x7f67f001a070 con 0x7f680009f6e0 2024-09-11T23:05:39.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.211+0000 7f67fcff9640 1 --2- 172.21.15.12:0/857087676 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f67ec035db0 0x7f67ec038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:39.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.211+0000 7f67fcff9640 1 -- 172.21.15.12:0/857087676 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 4221+0+0 (secure 0 0 0) 0x7f67f0048700 con 0x7f680009f6e0 2024-09-11T23:05:39.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.211+0000 7f67ff7fe640 1 --2- 172.21.15.12:0/857087676 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f67ec035db0 0x7f67ec038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:39.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.211+0000 7f67ff7fe640 1 --2- 172.21.15.12:0/857087676 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f67ec035db0 0x7f67ec038270 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f67f40af000 tx=0x7f67f40a7000 comp rx=0 tx=0).ready entity=mgr.4708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:39.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.215+0000 7f67fcff9640 1 -- 172.21.15.12:0/857087676 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f67f001b3b0 con 0x7f680009f6e0 2024-09-11T23:05:39.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.379+0000 7f680651f640 1 -- 172.21.15.12:0/857087676 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f680006bc60 con 0x7f680009f6e0 2024-09-11T23:05:39.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.379+0000 7f67fcff9640 1 -- 172.21.15.12:0/857087676 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) ==== 74+0+11810 (secure 0 0 0) 0x7f67f0048400 con 0x7f680009f6e0 2024-09-11T23:05:39.383 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:05:39.383 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":44,"fsid":"8be14356-3340-4500-91a2-4cbc6b511f65","created":"2024-09-11T23:03:10.620234+0000","modified":"2024-09-11T23:05:37.604443+0000","last_up_change":"2024-09-11T23:03:22.359028+0000","last_in_change":"2024-09-11T23:03:11.545817+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:03:23.587068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_b_metadata","create_time":"2024-09-11T23:05:05.624837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs_b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_b_data","create_time":"2024-09-11T23:05:06.296091+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs_b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"153b72a1-40b1-400d-93ea-333e733f9bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6817","nonce":3680911937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6819","nonce":3680911937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6823","nonce":3680911937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6821","nonce":3680911937}]},"public_addr":"172.21.15.12:6817/3680911937","cluster_addr":"172.21.15.12:6819/3680911937","heartbeat_back_addr":"172.21.15.12:6823/3680911937","heartbeat_front_addr":"172.21.15.12:6821/3680911937","state":["exists","up"]},{"osd":1,"uuid":"94669e49-ee4f-4acf-9e25-e94374dda8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6801","nonce":236825163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6803","nonce":236825163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6807","nonce":236825163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6805","nonce":236825163}]},"public_addr":"172.21.15.12:6801/236825163","cluster_addr":"172.21.15.12:6803/236825163","heartbeat_back_addr":"172.21.15.12:6807/236825163","heartbeat_front_addr":"172.21.15.12:6805/236825163","state":["exists","up"]},{"osd":2,"uuid":"826dae4d-8888-4ec5-8f00-425b3be93814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6809","nonce":3263521655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6811","nonce":3263521655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6815","nonce":3263521655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6813","nonce":3263521655}]},"public_addr":"172.21.15.12:6809/3263521655","cluster_addr":"172.21.15.12:6811/3263521655","heartbeat_back_addr":"172.21.15.12:6815/3263521655","heartbeat_front_addr":"172.21.15.12:6813/3263521655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:19.398518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.761524+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.904997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/1793382360":"2024-09-12T23:05:34.254367+0000","172.21.15.12:0/906705049":"2024-09-12T23:05:34.254367+0000","172.21.15.12:0/751872097":"2024-09-12T23:05:34.254367+0000","172.21.15.12:0/1572670263":"2024-09-12T23:05:34.254367+0000","172.21.15.12:6825/2340508205":"2024-09-12T23:05:34.254367+0000","172.21.15.12:6824/2340508205":"2024-09-12T23:05:34.254367+0000","172.21.15.12:0/2857800363":"2024-09-12T23:05:34.254367+0000","172.21.15.12:6829/2765393463":"2024-09-12T23:05:34.219324+0000","172.21.15.12:6828/2765393463":"2024-09-12T23:05:34.219324+0000","172.21.15.12:0/2509166838":"2024-09-12T23:05:06.494857+0000","172.21.15.12:6825/718802078":"2024-09-12T23:05:06.494857+0000","172.21.15.12:0/1378363537":"2024-09-12T23:05:34.254367+0000","172.21.15.12:6824/718802078":"2024-09-12T23:05:06.494857+0000","172.21.15.12:0/2490570290":"2024-09-12T23:05:06.494857+0000","172.21.15.12:0/2957476143":"2024-09-12T23:05:06.494857+0000","172.21.15.12:0/37905181":"2024-09-12T23:05:06.494857+0000","172.21.15.12:0/3294231065":"2024-09-12T23:05:06.494857+0000","172.21.15.12:0/2407367943":"2024-09-12T23:05:06.494857+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:05:39.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.383+0000 7f680651f640 1 -- 172.21.15.12:0/857087676 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f67ec035db0 msgr2=0x7f67ec038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:39.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.383+0000 7f680651f640 1 --2- 172.21.15.12:0/857087676 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f67ec035db0 0x7f67ec038270 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f67f40af000 tx=0x7f67f40a7000 comp rx=0 tx=0).stop 2024-09-11T23:05:39.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.383+0000 7f680651f640 1 -- 172.21.15.12:0/857087676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f680009f6e0 msgr2=0x7f680011e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:39.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.383+0000 7f680651f640 1 --2- 172.21.15.12:0/857087676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f680009f6e0 0x7f680011e490 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f67f000cb40 tx=0x7f67f00021f0 comp rx=0 tx=0).stop 2024-09-11T23:05:39.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.383+0000 7f680651f640 1 -- 172.21.15.12:0/857087676 shutdown_connections 2024-09-11T23:05:39.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.383+0000 7f680651f640 1 --2- 172.21.15.12:0/857087676 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f67ec035db0 0x7f67ec038270 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:39.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.383+0000 7f680651f640 1 --2- 172.21.15.12:0/857087676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f680009f6e0 0x7f680011e490 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:39.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.383+0000 7f680651f640 1 -- 172.21.15.12:0/857087676 >> 172.21.15.12:0/857087676 conn(0x7f68000a8450 msgr2=0x7f68000a14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:39.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.383+0000 7f680651f640 1 -- 172.21.15.12:0/857087676 shutdown_connections 2024-09-11T23:05:39.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.383+0000 7f680651f640 1 -- 172.21.15.12:0/857087676 wait complete. 2024-09-11T23:05:39.402 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs_b 2024-09-11T23:05:39.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.523+0000 7f45ee274640 1 Processor -- start 2024-09-11T23:05:39.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.523+0000 7f45ee274640 1 -- start start 2024-09-11T23:05:39.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.523+0000 7f45ee274640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f45e8139ff0 0x7f45e813a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:39.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.523+0000 7f45ee274640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45e809fe00 con 0x7f45e80a0780 2024-09-11T23:05:39.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.523+0000 7f45ee274640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f45e8139bc0 con 0x7f45e8139ff0 2024-09-11T23:05:39.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.523+0000 7f45e7fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f45e8139ff0 0x7f45e813a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:39.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.523+0000 7f45e7fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f45e8139ff0 0x7f45e813a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52794/0 (socket says 172.21.15.12:52794) 2024-09-11T23:05:39.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.523+0000 7f45e7fff640 1 -- 172.21.15.12:0/512122269 learned_addr learned my addr 172.21.15.12:0/512122269 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:39.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.523+0000 7f45e77fe640 1 --1- 172.21.15.12:0/512122269 >> v1:172.21.15.12:6789/0 conn(0x7f45e80a0780 0x7f45e80a36a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:45520/0 (socket says 172.21.15.12:45520) 2024-09-11T23:05:39.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.523+0000 7f45e7fff640 1 -- 172.21.15.12:0/512122269 >> v1:172.21.15.12:6789/0 conn(0x7f45e80a0780 legacy=0x7f45e80a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:39.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.523+0000 7f45e6ffd640 1 -- 172.21.15.12:0/512122269 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 514521059 0 0) 0x7f45e809fe00 con 0x7f45e80a0780 2024-09-11T23:05:39.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.523+0000 7f45e7fff640 1 -- 172.21.15.12:0/512122269 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45e813a910 con 0x7f45e8139ff0 2024-09-11T23:05:39.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.527+0000 7f45e7fff640 1 --2- 172.21.15.12:0/512122269 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45e8139ff0 0x7f45e813a3d0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f45e0009e50 tx=0x7f45e001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9f6ae31dc75b294 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:39.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.527+0000 7f45e6ffd640 1 -- 172.21.15.12:0/512122269 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45e0009200 con 0x7f45e8139ff0 2024-09-11T23:05:39.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.527+0000 7f45e6ffd640 1 -- 172.21.15.12:0/512122269 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45e00a5610 con 0x7f45e8139ff0 2024-09-11T23:05:39.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.527+0000 7f45e6ffd640 1 -- 172.21.15.12:0/512122269 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45e00a5910 con 0x7f45e8139ff0 2024-09-11T23:05:39.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.527+0000 7f45ee274640 1 -- 172.21.15.12:0/512122269 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45e8139ff0 msgr2=0x7f45e813a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:39.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.527+0000 7f45ee274640 1 --2- 172.21.15.12:0/512122269 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45e8139ff0 0x7f45e813a3d0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f45e0009e50 tx=0x7f45e001c9a0 comp rx=0 tx=0).stop 2024-09-11T23:05:39.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.527+0000 7f45ee274640 1 -- 172.21.15.12:0/512122269 shutdown_connections 2024-09-11T23:05:39.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.527+0000 7f45ee274640 1 --2- 172.21.15.12:0/512122269 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45e8139ff0 0x7f45e813a3d0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:39.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.527+0000 7f45ee274640 1 -- 172.21.15.12:0/512122269 >> 172.21.15.12:0/512122269 conn(0x7f45e80a82f0 msgr2=0x7f45e80a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:39.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.527+0000 7f45ee274640 1 -- 172.21.15.12:0/512122269 shutdown_connections 2024-09-11T23:05:39.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.527+0000 7f45ee274640 1 -- 172.21.15.12:0/512122269 wait complete. 2024-09-11T23:05:39.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.527+0000 7f45ee274640 1 Processor -- start 2024-09-11T23:05:39.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.527+0000 7f45ee274640 1 -- start start 2024-09-11T23:05:39.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.527+0000 7f45ee274640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45e80a0780 0x7f45e81d1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:39.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.527+0000 7f45ee274640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f45e80a0d10 con 0x7f45e80a0780 2024-09-11T23:05:39.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.527+0000 7f45e7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45e80a0780 0x7f45e81d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:39.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.527+0000 7f45e7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45e80a0780 0x7f45e81d1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52798/0 (socket says 172.21.15.12:52798) 2024-09-11T23:05:39.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.527+0000 7f45e7fff640 1 -- 172.21.15.12:0/1202130935 learned_addr learned my addr 172.21.15.12:0/1202130935 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:39.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.527+0000 7f45e7fff640 1 -- 172.21.15.12:0/1202130935 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45e813c6b0 con 0x7f45e80a0780 2024-09-11T23:05:39.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.527+0000 7f45e7fff640 1 --2- 172.21.15.12:0/1202130935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45e80a0780 0x7f45e81d1400 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f45e00195b0 tx=0x7f45e0019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:39.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.527+0000 7f45e4ff9640 1 -- 172.21.15.12:0/1202130935 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45e00bc020 con 0x7f45e80a0780 2024-09-11T23:05:39.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.527+0000 7f45e4ff9640 1 -- 172.21.15.12:0/1202130935 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45e00b8470 con 0x7f45e80a0780 2024-09-11T23:05:39.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.527+0000 7f45ee274640 1 -- 172.21.15.12:0/1202130935 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45e813b820 con 0x7f45e80a0780 2024-09-11T23:05:39.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.527+0000 7f45e4ff9640 1 -- 172.21.15.12:0/1202130935 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45e00b8790 con 0x7f45e80a0780 2024-09-11T23:05:39.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.527+0000 7f45ee274640 1 -- 172.21.15.12:0/1202130935 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45e809da00 con 0x7f45e80a0780 2024-09-11T23:05:39.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.531+0000 7f45e4ff9640 1 -- 172.21.15.12:0/1202130935 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 44053+0+0 (secure 0 0 0) 0x7f45e00bf020 con 0x7f45e80a0780 2024-09-11T23:05:39.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.531+0000 7f45ee274640 1 -- 172.21.15.12:0/1202130935 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45e813b510 con 0x7f45e80a0780 2024-09-11T23:05:39.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.531+0000 7f45e4ff9640 1 --2- 172.21.15.12:0/1202130935 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f45c8035db0 0x7f45c8038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:39.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.531+0000 7f45e4ff9640 1 -- 172.21.15.12:0/1202130935 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 4221+0+0 (secure 0 0 0) 0x7f45e00e3c40 con 0x7f45e80a0780 2024-09-11T23:05:39.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.531+0000 7f45e77fe640 1 --2- 172.21.15.12:0/1202130935 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f45c8035db0 0x7f45c8038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:39.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.531+0000 7f45e77fe640 1 --2- 172.21.15.12:0/1202130935 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f45c8035db0 0x7f45c8038270 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f45d0007fd0 tx=0x7f45d0007920 comp rx=0 tx=0).ready entity=mgr.4708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:39.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.535+0000 7f45e4ff9640 1 -- 172.21.15.12:0/1202130935 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f45e00c6030 con 0x7f45e80a0780 2024-09-11T23:05:39.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.735+0000 7f45ee274640 1 -- 172.21.15.12:0/1202130935 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs_b"} v 0) -- 0x7f45e813a450 con 0x7f45e80a0780 2024-09-11T23:05:39.738 INFO:tasks.ceph.mon.a.smithi012.stderr:2024-09-11T23:05:39.735+0000 7fd71c996640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T23:05:39.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.739+0000 7f45e4ff9640 1 -- 172.21.15.12:0/1202130935 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs_b"}]=0 cephfs_b marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v33) ==== 165+0+0 (secure 0 0 0) 0x7f45e0016620 con 0x7f45e80a0780 2024-09-11T23:05:39.742 INFO:teuthology.orchestra.run.smithi012.stderr:cephfs_b marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T23:05:39.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.743+0000 7f45ee274640 1 -- 172.21.15.12:0/1202130935 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f45c8035db0 msgr2=0x7f45c8038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:39.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.743+0000 7f45ee274640 1 --2- 172.21.15.12:0/1202130935 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f45c8035db0 0x7f45c8038270 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f45d0007fd0 tx=0x7f45d0007920 comp rx=0 tx=0).stop 2024-09-11T23:05:39.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.743+0000 7f45ee274640 1 -- 172.21.15.12:0/1202130935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45e80a0780 msgr2=0x7f45e81d1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:39.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.743+0000 7f45ee274640 1 --2- 172.21.15.12:0/1202130935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45e80a0780 0x7f45e81d1400 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f45e00195b0 tx=0x7f45e0019740 comp rx=0 tx=0).stop 2024-09-11T23:05:39.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.743+0000 7f45ee274640 1 -- 172.21.15.12:0/1202130935 shutdown_connections 2024-09-11T23:05:39.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.743+0000 7f45ee274640 1 --2- 172.21.15.12:0/1202130935 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f45c8035db0 0x7f45c8038270 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:39.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.743+0000 7f45ee274640 1 --2- 172.21.15.12:0/1202130935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45e80a0780 0x7f45e81d1400 secure :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f45e00195b0 tx=0x7f45e0019740 comp rx=0 tx=0).stop 2024-09-11T23:05:39.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.743+0000 7f45ee274640 1 -- 172.21.15.12:0/1202130935 >> 172.21.15.12:0/1202130935 conn(0x7f45e80a82f0 msgr2=0x7f45e81358f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:39.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.743+0000 7f45ee274640 1 -- 172.21.15.12:0/1202130935 shutdown_connections 2024-09-11T23:05:39.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.743+0000 7f45ee274640 1 -- 172.21.15.12:0/1202130935 wait complete. 2024-09-11T23:05:39.750 INFO:tasks.ceph.mds.a.smithi012.stderr: -1354> 2024-09-11T23:05:12.515+0000 7f276699d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T23:05:39.764 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs_b --yes-i-really-mean-it 2024-09-11T23:05:39.785 INFO:tasks.ceph.mds.a.smithi012.stdout:starting mds.a at 2024-09-11T23:05:39.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.895+0000 7fdcc492c640 1 Processor -- start 2024-09-11T23:05:39.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.895+0000 7fdcc492c640 1 -- start start 2024-09-11T23:05:39.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.895+0000 7fdcc492c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdcc0137de0 0x7fdcc009f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:39.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.895+0000 7fdcc492c640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcc009d690 con 0x7fdcc01381c0 2024-09-11T23:05:39.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.895+0000 7fdcc492c640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fdcc009ea90 con 0x7fdcc0137de0 2024-09-11T23:05:39.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.899+0000 7fdcbdd9b640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fdcc01381c0 0x7fdcc00a36a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:45550/0 (socket says 172.21.15.12:45550) 2024-09-11T23:05:39.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.899+0000 7fdcbe59c640 1 --2- 172.21.15.12:0/3961568681 >> v2:172.21.15.12:3300/0 conn(0x7fdcc0137de0 0x7fdcc009f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:39.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.899+0000 7fdcbdd9b640 1 -- 172.21.15.12:0/3961568681 learned_addr learned my addr 172.21.15.12:0/3961568681 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:39.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.899+0000 7fdcbd59a640 1 -- 172.21.15.12:0/3961568681 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1675099730 0 0) 0x7fdcc009d690 con 0x7fdcc01381c0 2024-09-11T23:05:39.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.899+0000 7fdcbd59a640 1 -- 172.21.15.12:0/3961568681 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdca8003530 con 0x7fdcc01381c0 2024-09-11T23:05:39.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.899+0000 7fdcbd59a640 1 -- 172.21.15.12:0/3961568681 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2716606068 0 0) 0x7fdca8003530 con 0x7fdcc01381c0 2024-09-11T23:05:39.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.899+0000 7fdcbd59a640 1 -- 172.21.15.12:0/3961568681 >> v2:172.21.15.12:3300/0 conn(0x7fdcc0137de0 msgr2=0x7fdcc009f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:05:39.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.899+0000 7fdcbd59a640 1 --2- 172.21.15.12:0/3961568681 >> v2:172.21.15.12:3300/0 conn(0x7fdcc0137de0 0x7fdcc009f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:39.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.899+0000 7fdcbd59a640 1 -- 172.21.15.12:0/3961568681 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcc009f6d0 con 0x7fdcc01381c0 2024-09-11T23:05:39.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.899+0000 7fdcbd59a640 1 -- 172.21.15.12:0/3961568681 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 2106515244 0 0) 0x7fdcb40015b0 con 0x7fdcc01381c0 2024-09-11T23:05:39.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.899+0000 7fdcbd59a640 1 -- 172.21.15.12:0/3961568681 >> v1:172.21.15.12:6789/0 conn(0x7fdcc01381c0 legacy=0x7fdcc00a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:39.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.899+0000 7fdcbd59a640 1 --2- 172.21.15.12:0/3961568681 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdca80039c0 0x7fdca8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:39.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.899+0000 7fdcbd59a640 1 -- 172.21.15.12:0/3961568681 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fdca8004480 con 0x7fdca80039c0 2024-09-11T23:05:39.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.899+0000 7fdcbe59c640 1 --2- 172.21.15.12:0/3961568681 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdca80039c0 0x7fdca8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:39.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.899+0000 7fdcbe59c640 1 -- 172.21.15.12:0/3961568681 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdca8003530 con 0x7fdca80039c0 2024-09-11T23:05:39.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.899+0000 7fdcbe59c640 1 --2- 172.21.15.12:0/3961568681 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdca80039c0 0x7fdca8003dc0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fdcb0009a60 tx=0x7fdcb001cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0a840a8e9bc925f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:39.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.899+0000 7fdcbd59a640 1 -- 172.21.15.12:0/3961568681 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcb00b2070 con 0x7fdca80039c0 2024-09-11T23:05:39.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.899+0000 7fdcbd59a640 1 -- 172.21.15.12:0/3961568681 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcb00a5710 con 0x7fdca80039c0 2024-09-11T23:05:39.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.899+0000 7fdcbd59a640 1 -- 172.21.15.12:0/3961568681 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcb00096b0 con 0x7fdca80039c0 2024-09-11T23:05:39.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.903+0000 7fdcc492c640 1 -- 172.21.15.12:0/3961568681 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdca80039c0 msgr2=0x7fdca8003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:39.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.903+0000 7fdcc492c640 1 --2- 172.21.15.12:0/3961568681 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdca80039c0 0x7fdca8003dc0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fdcb0009a60 tx=0x7fdcb001cb70 comp rx=0 tx=0).stop 2024-09-11T23:05:39.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.903+0000 7fdcc492c640 1 -- 172.21.15.12:0/3961568681 shutdown_connections 2024-09-11T23:05:39.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.903+0000 7fdcc492c640 1 --2- 172.21.15.12:0/3961568681 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdca80039c0 0x7fdca8003dc0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:39.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.903+0000 7fdcc492c640 1 --2- 172.21.15.12:0/3961568681 >> v2:172.21.15.12:3300/0 conn(0x7fdcc0137de0 0x7fdcc009f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:39.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.903+0000 7fdcc492c640 1 -- 172.21.15.12:0/3961568681 >> 172.21.15.12:0/3961568681 conn(0x7fdcc00a82f0 msgr2=0x7fdcc00a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:39.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.903+0000 7fdcc492c640 1 -- 172.21.15.12:0/3961568681 shutdown_connections 2024-09-11T23:05:39.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.903+0000 7fdcc492c640 1 -- 172.21.15.12:0/3961568681 wait complete. 2024-09-11T23:05:39.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.903+0000 7fdcc492c640 1 Processor -- start 2024-09-11T23:05:39.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.903+0000 7fdcc492c640 1 -- start start 2024-09-11T23:05:39.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.903+0000 7fdcc492c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdca80039c0 0x7fdcc0072bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:39.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.903+0000 7fdcc492c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc009e7d0 con 0x7fdca80039c0 2024-09-11T23:05:39.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.903+0000 7fdcbe59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdca80039c0 0x7fdcc0072bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:39.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.903+0000 7fdcbe59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdca80039c0 0x7fdcc0072bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52842/0 (socket says 172.21.15.12:52842) 2024-09-11T23:05:39.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.903+0000 7fdcbe59c640 1 -- 172.21.15.12:0/4002634915 learned_addr learned my addr 172.21.15.12:0/4002634915 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:39.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.903+0000 7fdcbe59c640 1 -- 172.21.15.12:0/4002634915 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcc0073320 con 0x7fdca80039c0 2024-09-11T23:05:39.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.903+0000 7fdcbe59c640 1 --2- 172.21.15.12:0/4002634915 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdca80039c0 0x7fdcc0072bb0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fdcb001a7a0 tx=0x7fdcb0019910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:39.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.903+0000 7fdcaeffd640 1 -- 172.21.15.12:0/4002634915 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcb00b2040 con 0x7fdca80039c0 2024-09-11T23:05:39.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.903+0000 7fdcaeffd640 1 -- 172.21.15.12:0/4002634915 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcb00bd070 con 0x7fdca80039c0 2024-09-11T23:05:39.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.903+0000 7fdcc492c640 1 -- 172.21.15.12:0/4002634915 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcc0070610 con 0x7fdca80039c0 2024-09-11T23:05:39.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.903+0000 7fdcaeffd640 1 -- 172.21.15.12:0/4002634915 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcb00b8450 con 0x7fdca80039c0 2024-09-11T23:05:39.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.903+0000 7fdcc492c640 1 -- 172.21.15.12:0/4002634915 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcc0070330 con 0x7fdca80039c0 2024-09-11T23:05:39.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.903+0000 7fdcaeffd640 1 -- 172.21.15.12:0/4002634915 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 44053+0+0 (secure 0 0 0) 0x7fdcb00b85f0 con 0x7fdca80039c0 2024-09-11T23:05:39.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.903+0000 7fdcc492c640 1 -- 172.21.15.12:0/4002634915 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcc00734f0 con 0x7fdca80039c0 2024-09-11T23:05:39.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.903+0000 7fdcaeffd640 1 --2- 172.21.15.12:0/4002634915 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fdca0035db0 0x7fdca0038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:39.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.907+0000 7fdcaeffd640 1 -- 172.21.15.12:0/4002634915 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 4307+0+0 (secure 0 0 0) 0x7fdcb000f040 con 0x7fdca80039c0 2024-09-11T23:05:39.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.907+0000 7fdcbdd9b640 1 --2- 172.21.15.12:0/4002634915 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fdca0035db0 0x7fdca0038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:39.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.907+0000 7fdcbdd9b640 1 --2- 172.21.15.12:0/4002634915 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fdca0035db0 0x7fdca0038270 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4001ea0 tx=0x7fdcb40011b0 comp rx=0 tx=0).ready entity=mgr.4708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:39.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:39.911+0000 7fdcaeffd640 1 -- 172.21.15.12:0/4002634915 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fdcb0016760 con 0x7fdca80039c0 2024-09-11T23:05:40.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.107+0000 7fdcc492c640 1 -- 172.21.15.12:0/4002634915 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs_b", "yes_i_really_mean_it": true} v 0) -- 0x7fdcc009f110 con 0x7fdca80039c0 2024-09-11T23:05:40.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.743+0000 7fdcaeffd640 1 -- 172.21.15.12:0/4002634915 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs_b", "yes_i_really_mean_it": true}]=0 v34) ==== 106+0+0 (secure 0 0 0) 0x7fdcb00c2460 con 0x7fdca80039c0 2024-09-11T23:05:40.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.747+0000 7fdcc492c640 1 -- 172.21.15.12:0/4002634915 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fdca0035db0 msgr2=0x7fdca0038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:40.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.747+0000 7fdcc492c640 1 --2- 172.21.15.12:0/4002634915 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fdca0035db0 0x7fdca0038270 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4001ea0 tx=0x7fdcb40011b0 comp rx=0 tx=0).stop 2024-09-11T23:05:40.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.747+0000 7fdcc492c640 1 -- 172.21.15.12:0/4002634915 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdca80039c0 msgr2=0x7fdcc0072bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:40.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.747+0000 7fdcc492c640 1 --2- 172.21.15.12:0/4002634915 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdca80039c0 0x7fdcc0072bb0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fdcb001a7a0 tx=0x7fdcb0019910 comp rx=0 tx=0).stop 2024-09-11T23:05:40.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.747+0000 7fdcc492c640 1 -- 172.21.15.12:0/4002634915 shutdown_connections 2024-09-11T23:05:40.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.747+0000 7fdcc492c640 1 --2- 172.21.15.12:0/4002634915 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fdca0035db0 0x7fdca0038270 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:40.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.747+0000 7fdcc492c640 1 --2- 172.21.15.12:0/4002634915 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdca80039c0 0x7fdcc0072bb0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:40.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.747+0000 7fdcc492c640 1 -- 172.21.15.12:0/4002634915 >> 172.21.15.12:0/4002634915 conn(0x7fdcc00a82f0 msgr2=0x7fdcc013cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:40.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.747+0000 7fdcc492c640 1 -- 172.21.15.12:0/4002634915 shutdown_connections 2024-09-11T23:05:40.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.747+0000 7fdcc492c640 1 -- 172.21.15.12:0/4002634915 wait complete. 2024-09-11T23:05:40.777 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_b_metadata cephfs_b_metadata --yes-i-really-really-mean-it 2024-09-11T23:05:40.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.955+0000 7f7d550ef640 1 Processor -- start 2024-09-11T23:05:40.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.955+0000 7f7d550ef640 1 -- start start 2024-09-11T23:05:40.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.955+0000 7f7d550ef640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7d500a0620 0x7f7d500a50b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:40.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.955+0000 7f7d550ef640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d500a4200 con 0x7f7d50132cf0 2024-09-11T23:05:40.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.955+0000 7f7d550ef640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f7d500a0ec0 con 0x7f7d500a0620 2024-09-11T23:05:40.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.955+0000 7f7d4ed9d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7d500a0620 0x7f7d500a50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:40.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.955+0000 7f7d4e59c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f7d50132cf0 0x7f7d50133160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:45566/0 (socket says 172.21.15.12:45566) 2024-09-11T23:05:40.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.955+0000 7f7d4ed9d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7d500a0620 0x7f7d500a50b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52850/0 (socket says 172.21.15.12:52850) 2024-09-11T23:05:40.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.955+0000 7f7d4e59c640 1 -- 172.21.15.12:0/3281784027 learned_addr learned my addr 172.21.15.12:0/3281784027 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:40.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.955+0000 7f7d4ed9d640 1 -- 172.21.15.12:0/3281784027 >> v1:172.21.15.12:6789/0 conn(0x7f7d50132cf0 legacy=0x7f7d50133160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:40.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.955+0000 7f7d4ed9d640 1 -- 172.21.15.12:0/3281784027 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d500a1660 con 0x7f7d500a0620 2024-09-11T23:05:40.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.959+0000 7f7d4ed9d640 1 --2- 172.21.15.12:0/3281784027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d500a0620 0x7f7d500a50b0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f7d48009740 tx=0x7f7d4801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55c0596a375e827 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:40.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.959+0000 7f7d4dd9b640 1 -- 172.21.15.12:0/3281784027 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d480b0070 con 0x7f7d500a0620 2024-09-11T23:05:40.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.959+0000 7f7d4dd9b640 1 -- 172.21.15.12:0/3281784027 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d480ab530 con 0x7f7d500a0620 2024-09-11T23:05:40.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.959+0000 7f7d4dd9b640 1 -- 172.21.15.12:0/3281784027 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d480ab830 con 0x7f7d500a0620 2024-09-11T23:05:40.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.959+0000 7f7d550ef640 1 -- 172.21.15.12:0/3281784027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d500a0620 msgr2=0x7f7d500a50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:40.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.959+0000 7f7d550ef640 1 --2- 172.21.15.12:0/3281784027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d500a0620 0x7f7d500a50b0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f7d48009740 tx=0x7f7d4801c420 comp rx=0 tx=0).stop 2024-09-11T23:05:40.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.959+0000 7f7d550ef640 1 -- 172.21.15.12:0/3281784027 shutdown_connections 2024-09-11T23:05:40.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.959+0000 7f7d550ef640 1 --2- 172.21.15.12:0/3281784027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d500a0620 0x7f7d500a50b0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:40.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.959+0000 7f7d550ef640 1 -- 172.21.15.12:0/3281784027 >> 172.21.15.12:0/3281784027 conn(0x7f7d500a85b0 msgr2=0x7f7d500a49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:40.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.959+0000 7f7d550ef640 1 -- 172.21.15.12:0/3281784027 shutdown_connections 2024-09-11T23:05:40.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.959+0000 7f7d550ef640 1 -- 172.21.15.12:0/3281784027 wait complete. 2024-09-11T23:05:40.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.959+0000 7f7d550ef640 1 Processor -- start 2024-09-11T23:05:40.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.959+0000 7f7d550ef640 1 -- start start 2024-09-11T23:05:40.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.959+0000 7f7d550ef640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d500a0620 0x7f7d5006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:40.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.959+0000 7f7d550ef640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7d501339f0 con 0x7f7d500a0620 2024-09-11T23:05:40.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.959+0000 7f7d4ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d500a0620 0x7f7d5006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:40.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.959+0000 7f7d4ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d500a0620 0x7f7d5006e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52864/0 (socket says 172.21.15.12:52864) 2024-09-11T23:05:40.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.959+0000 7f7d4ed9d640 1 -- 172.21.15.12:0/536596154 learned_addr learned my addr 172.21.15.12:0/536596154 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:40.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.963+0000 7f7d4ed9d640 1 -- 172.21.15.12:0/536596154 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d50070870 con 0x7f7d500a0620 2024-09-11T23:05:40.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.963+0000 7f7d4ed9d640 1 --2- 172.21.15.12:0/536596154 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d500a0620 0x7f7d5006e9a0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f7d480ae040 tx=0x7f7d480191c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:40.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.963+0000 7f7d477fe640 1 -- 172.21.15.12:0/536596154 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d480b8070 con 0x7f7d500a0620 2024-09-11T23:05:40.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.963+0000 7f7d477fe640 1 -- 172.21.15.12:0/536596154 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d480b4410 con 0x7f7d500a0620 2024-09-11T23:05:40.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.963+0000 7f7d550ef640 1 -- 172.21.15.12:0/536596154 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d50071740 con 0x7f7d500a0620 2024-09-11T23:05:40.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.963+0000 7f7d477fe640 1 -- 172.21.15.12:0/536596154 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d480b0040 con 0x7f7d500a0620 2024-09-11T23:05:40.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.963+0000 7f7d550ef640 1 -- 172.21.15.12:0/536596154 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d500704c0 con 0x7f7d500a0620 2024-09-11T23:05:40.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.963+0000 7f7d477fe640 1 -- 172.21.15.12:0/536596154 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 44053+0+0 (secure 0 0 0) 0x7f7d480bb070 con 0x7f7d500a0620 2024-09-11T23:05:40.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.963+0000 7f7d550ef640 1 -- 172.21.15.12:0/536596154 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d500a50b0 con 0x7f7d500a0620 2024-09-11T23:05:40.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.963+0000 7f7d477fe640 1 --2- 172.21.15.12:0/536596154 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f7d30035db0 0x7f7d30038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:40.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.963+0000 7f7d477fe640 1 -- 172.21.15.12:0/536596154 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 4307+0+0 (secure 0 0 0) 0x7f7d480e2680 con 0x7f7d500a0620 2024-09-11T23:05:40.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.963+0000 7f7d4e59c640 1 --2- 172.21.15.12:0/536596154 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f7d30035db0 0x7f7d30038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:40.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.963+0000 7f7d4e59c640 1 --2- 172.21.15.12:0/536596154 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f7d30035db0 0x7f7d30038270 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7d38002090 tx=0x7f7d38001680 comp rx=0 tx=0).ready entity=mgr.4708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:40.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:40.967+0000 7f7d477fe640 1 -- 172.21.15.12:0/536596154 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7d48016010 con 0x7f7d500a0620 2024-09-11T23:05:41.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.127+0000 7f7d550ef640 1 -- 172.21.15.12:0/536596154 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_b_metadata", "pool2": "cephfs_b_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7d500726a0 con 0x7f7d500a0620 2024-09-11T23:05:41.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.751+0000 7f7d477fe640 1 -- 172.21.15.12:0/536596154 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_b_metadata", "pool2": "cephfs_b_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_b_metadata' removed v46) ==== 187+0+0 (secure 0 0 0) 0x7f7d480b4730 con 0x7f7d500a0620 2024-09-11T23:05:41.753 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_b_metadata' removed 2024-09-11T23:05:41.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.755+0000 7f7d550ef640 1 -- 172.21.15.12:0/536596154 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f7d30035db0 msgr2=0x7f7d30038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:41.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.755+0000 7f7d550ef640 1 --2- 172.21.15.12:0/536596154 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f7d30035db0 0x7f7d30038270 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7d38002090 tx=0x7f7d38001680 comp rx=0 tx=0).stop 2024-09-11T23:05:41.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.755+0000 7f7d550ef640 1 -- 172.21.15.12:0/536596154 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d500a0620 msgr2=0x7f7d5006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:41.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.755+0000 7f7d550ef640 1 --2- 172.21.15.12:0/536596154 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d500a0620 0x7f7d5006e9a0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f7d480ae040 tx=0x7f7d480191c0 comp rx=0 tx=0).stop 2024-09-11T23:05:41.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.755+0000 7f7d550ef640 1 -- 172.21.15.12:0/536596154 shutdown_connections 2024-09-11T23:05:41.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.755+0000 7f7d550ef640 1 --2- 172.21.15.12:0/536596154 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f7d30035db0 0x7f7d30038270 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:41.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.755+0000 7f7d550ef640 1 --2- 172.21.15.12:0/536596154 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d500a0620 0x7f7d5006e9a0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:41.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.755+0000 7f7d550ef640 1 -- 172.21.15.12:0/536596154 >> 172.21.15.12:0/536596154 conn(0x7f7d500a85b0 msgr2=0x7f7d500a69e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:41.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.755+0000 7f7d550ef640 1 -- 172.21.15.12:0/536596154 shutdown_connections 2024-09-11T23:05:41.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.755+0000 7f7d550ef640 1 -- 172.21.15.12:0/536596154 wait complete. 2024-09-11T23:05:41.781 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_b_data cephfs_b_data --yes-i-really-really-mean-it 2024-09-11T23:05:41.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.907+0000 7f8fa5fc5640 1 Processor -- start 2024-09-11T23:05:41.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.907+0000 7f8fa5fc5640 1 -- start start 2024-09-11T23:05:41.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.907+0000 7f8fa5fc5640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8fa00a0620 0x7f8fa013b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:41.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.907+0000 7f8fa5fc5640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fa0132cf0 con 0x7f8fa0132ef0 2024-09-11T23:05:41.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.907+0000 7f8fa5fc5640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f8fa00a4200 con 0x7f8fa00a0620 2024-09-11T23:05:41.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.907+0000 7f8f9f7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f8fa0132ef0 0x7f8fa01332d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:45576/0 (socket says 172.21.15.12:45576) 2024-09-11T23:05:41.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.907+0000 7f8f9f7fe640 1 -- 172.21.15.12:0/3706812658 learned_addr learned my addr 172.21.15.12:0/3706812658 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:41.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.907+0000 7f8f9effd640 1 --2- 172.21.15.12:0/3706812658 >> v2:172.21.15.12:3300/0 conn(0x7f8fa00a0620 0x7f8fa013b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:41.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.907+0000 7f8f9e7fc640 1 -- 172.21.15.12:0/3706812658 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1639785829 0 0) 0x7f8fa0132cf0 con 0x7f8fa0132ef0 2024-09-11T23:05:41.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.907+0000 7f8f9e7fc640 1 -- 172.21.15.12:0/3706812658 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f88003530 con 0x7f8fa0132ef0 2024-09-11T23:05:41.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.907+0000 7f8f9effd640 1 -- 172.21.15.12:0/3706812658 >> v1:172.21.15.12:6789/0 conn(0x7f8fa0132ef0 legacy=0x7f8fa01332d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:41.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.911+0000 7f8f9e7fc640 1 -- 172.21.15.12:0/3706812658 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3687259482 0 0) 0x7f8f88003530 con 0x7f8fa0132ef0 2024-09-11T23:05:41.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.911+0000 7f8f9effd640 1 -- 172.21.15.12:0/3706812658 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fa00a0a90 con 0x7f8fa00a0620 2024-09-11T23:05:41.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.911+0000 7f8f9effd640 1 --2- 172.21.15.12:0/3706812658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fa00a0620 0x7f8fa013b390 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f8f94009740 tx=0x7f8f9401c2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b26d6f3d93b79b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:41.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.911+0000 7f8f9e7fc640 1 -- 172.21.15.12:0/3706812658 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f940b0070 con 0x7f8fa00a0620 2024-09-11T23:05:41.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.911+0000 7f8f9e7fc640 1 -- 172.21.15.12:0/3706812658 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f940ab400 con 0x7f8fa00a0620 2024-09-11T23:05:41.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.911+0000 7f8f9e7fc640 1 -- 172.21.15.12:0/3706812658 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f900015b0 con 0x7f8fa00a0620 2024-09-11T23:05:41.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.911+0000 7f8fa5fc5640 1 -- 172.21.15.12:0/3706812658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fa00a0620 msgr2=0x7f8fa013b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:41.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.911+0000 7f8fa5fc5640 1 --2- 172.21.15.12:0/3706812658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fa00a0620 0x7f8fa013b390 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f8f94009740 tx=0x7f8f9401c2b0 comp rx=0 tx=0).stop 2024-09-11T23:05:41.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.911+0000 7f8fa5fc5640 1 -- 172.21.15.12:0/3706812658 shutdown_connections 2024-09-11T23:05:41.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.911+0000 7f8fa5fc5640 1 --2- 172.21.15.12:0/3706812658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fa00a0620 0x7f8fa013b390 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:41.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.911+0000 7f8fa5fc5640 1 -- 172.21.15.12:0/3706812658 >> 172.21.15.12:0/3706812658 conn(0x7f8fa00a85b0 msgr2=0x7f8fa00a49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:41.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.911+0000 7f8fa5fc5640 1 -- 172.21.15.12:0/3706812658 shutdown_connections 2024-09-11T23:05:41.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.911+0000 7f8fa5fc5640 1 -- 172.21.15.12:0/3706812658 wait complete. 2024-09-11T23:05:41.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.915+0000 7f8fa5fc5640 1 Processor -- start 2024-09-11T23:05:41.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.915+0000 7f8fa5fc5640 1 -- start start 2024-09-11T23:05:41.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.915+0000 7f8fa5fc5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fa00a0620 0x7f8fa009d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:41.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.915+0000 7f8fa5fc5640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa00a3c90 con 0x7f8fa00a0620 2024-09-11T23:05:41.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.915+0000 7f8f9f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fa00a0620 0x7f8fa009d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:41.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.915+0000 7f8f9f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fa00a0620 0x7f8fa009d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52878/0 (socket says 172.21.15.12:52878) 2024-09-11T23:05:41.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.915+0000 7f8f9f7fe640 1 -- 172.21.15.12:0/972936733 learned_addr learned my addr 172.21.15.12:0/972936733 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:41.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.915+0000 7f8f9f7fe640 1 -- 172.21.15.12:0/972936733 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fa006f680 con 0x7f8fa00a0620 2024-09-11T23:05:41.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.915+0000 7f8f9f7fe640 1 --2- 172.21.15.12:0/972936733 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fa00a0620 0x7f8fa009d560 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f8f9000c6b0 tx=0x7f8f9000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:41.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.915+0000 7f8f87fff640 1 -- 172.21.15.12:0/972936733 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f90017070 con 0x7f8fa00a0620 2024-09-11T23:05:41.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.915+0000 7f8f87fff640 1 -- 172.21.15.12:0/972936733 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f900058e0 con 0x7f8fa00a0620 2024-09-11T23:05:41.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.915+0000 7f8fa5fc5640 1 -- 172.21.15.12:0/972936733 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fa006eb90 con 0x7f8fa00a0620 2024-09-11T23:05:41.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.915+0000 7f8f87fff640 1 -- 172.21.15.12:0/972936733 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f90005c00 con 0x7f8fa00a0620 2024-09-11T23:05:41.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.915+0000 7f8fa5fc5640 1 -- 172.21.15.12:0/972936733 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fa013c2f0 con 0x7f8fa00a0620 2024-09-11T23:05:41.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.915+0000 7f8fa5fc5640 1 -- 172.21.15.12:0/972936733 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fa00008e0 con 0x7f8fa00a0620 2024-09-11T23:05:41.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.915+0000 7f8f87fff640 1 -- 172.21.15.12:0/972936733 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 44053+0+0 (secure 0 0 0) 0x7f8f9001a070 con 0x7f8fa00a0620 2024-09-11T23:05:41.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.915+0000 7f8f87fff640 1 --2- 172.21.15.12:0/972936733 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f8f8c035db0 0x7f8f8c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:41.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.915+0000 7f8f87fff640 1 -- 172.21.15.12:0/972936733 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 3865+0+0 (secure 0 0 0) 0x7f8f90047bf0 con 0x7f8fa00a0620 2024-09-11T23:05:41.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.915+0000 7f8f9effd640 1 --2- 172.21.15.12:0/972936733 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f8f8c035db0 0x7f8f8c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:41.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.915+0000 7f8f9effd640 1 --2- 172.21.15.12:0/972936733 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f8f8c035db0 0x7f8f8c038270 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8f940ad000 tx=0x7f8f940a6000 comp rx=0 tx=0).ready entity=mgr.4708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:41.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:41.919+0000 7f8f87fff640 1 -- 172.21.15.12:0/972936733 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8f90005da0 con 0x7f8fa00a0620 2024-09-11T23:05:42.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.083+0000 7f8fa5fc5640 1 -- 172.21.15.12:0/972936733 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_b_data", "pool2": "cephfs_b_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8fa00733a0 con 0x7f8fa00a0620 2024-09-11T23:05:42.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.755+0000 7f8f87fff640 1 -- 172.21.15.12:0/972936733 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_b_data", "pool2": "cephfs_b_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_b_data' removed v47) ==== 175+0+0 (secure 0 0 0) 0x7f8f90007590 con 0x7f8fa00a0620 2024-09-11T23:05:42.758 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_b_data' removed 2024-09-11T23:05:42.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.759+0000 7f8fa5fc5640 1 -- 172.21.15.12:0/972936733 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f8f8c035db0 msgr2=0x7f8f8c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:42.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.759+0000 7f8fa5fc5640 1 --2- 172.21.15.12:0/972936733 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f8f8c035db0 0x7f8f8c038270 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8f940ad000 tx=0x7f8f940a6000 comp rx=0 tx=0).stop 2024-09-11T23:05:42.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.759+0000 7f8fa5fc5640 1 -- 172.21.15.12:0/972936733 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fa00a0620 msgr2=0x7f8fa009d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:42.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.759+0000 7f8fa5fc5640 1 --2- 172.21.15.12:0/972936733 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fa00a0620 0x7f8fa009d560 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f8f9000c6b0 tx=0x7f8f9000cb70 comp rx=0 tx=0).stop 2024-09-11T23:05:42.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.759+0000 7f8fa5fc5640 1 -- 172.21.15.12:0/972936733 shutdown_connections 2024-09-11T23:05:42.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.759+0000 7f8fa5fc5640 1 --2- 172.21.15.12:0/972936733 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f8f8c035db0 0x7f8f8c038270 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:42.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.759+0000 7f8fa5fc5640 1 --2- 172.21.15.12:0/972936733 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fa00a0620 0x7f8fa009d560 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:42.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.759+0000 7f8fa5fc5640 1 -- 172.21.15.12:0/972936733 >> 172.21.15.12:0/972936733 conn(0x7f8fa00a85b0 msgr2=0x7f8fa013ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:42.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.759+0000 7f8fa5fc5640 1 -- 172.21.15.12:0/972936733 shutdown_connections 2024-09-11T23:05:42.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.759+0000 7f8fa5fc5640 1 -- 172.21.15.12:0/972936733 wait complete. 2024-09-11T23:05:42.790 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-11T23:05:42.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.915+0000 7f09c709d640 1 Processor -- start 2024-09-11T23:05:42.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.915+0000 7f09c709d640 1 -- start start 2024-09-11T23:05:42.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.915+0000 7f09c709d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f09c00a0780 0x7f09c013ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:42.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.915+0000 7f09c709d640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09c009fe00 con 0x7f09c0139ff0 2024-09-11T23:05:42.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.915+0000 7f09c709d640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f09c0139bc0 con 0x7f09c00a0780 2024-09-11T23:05:42.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.919+0000 7f09bffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f09c00a0780 0x7f09c013ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:42.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.919+0000 7f09c4e39640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f09c0139ff0 0x7f09c013a3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:45590/0 (socket says 172.21.15.12:45590) 2024-09-11T23:05:42.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.919+0000 7f09c4e39640 1 -- 172.21.15.12:0/3750643154 learned_addr learned my addr 172.21.15.12:0/3750643154 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:42.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.919+0000 7f09bffff640 1 -- 172.21.15.12:0/3750643154 >> v1:172.21.15.12:6789/0 conn(0x7f09c0139ff0 legacy=0x7f09c013a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:42.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.919+0000 7f09bf7fe640 1 -- 172.21.15.12:0/3750643154 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3304975428 0 0) 0x7f09c009fe00 con 0x7f09c0139ff0 2024-09-11T23:05:42.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.919+0000 7f09bffff640 1 -- 172.21.15.12:0/3750643154 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09c009faf0 con 0x7f09c00a0780 2024-09-11T23:05:42.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.919+0000 7f09bffff640 1 --2- 172.21.15.12:0/3750643154 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09c00a0780 0x7f09c013ed60 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f09a8009740 tx=0x7f09a801c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65665b42b04b18fa server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:42.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.919+0000 7f09bf7fe640 1 -- 172.21.15.12:0/3750643154 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09a80b0070 con 0x7f09c00a0780 2024-09-11T23:05:42.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.919+0000 7f09bf7fe640 1 -- 172.21.15.12:0/3750643154 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09a80ab530 con 0x7f09c00a0780 2024-09-11T23:05:42.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.919+0000 7f09bf7fe640 1 -- 172.21.15.12:0/3750643154 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09a80ab830 con 0x7f09c00a0780 2024-09-11T23:05:42.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.923+0000 7f09c709d640 1 -- 172.21.15.12:0/3750643154 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09c00a0780 msgr2=0x7f09c013ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:42.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.923+0000 7f09c709d640 1 --2- 172.21.15.12:0/3750643154 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09c00a0780 0x7f09c013ed60 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f09a8009740 tx=0x7f09a801c390 comp rx=0 tx=0).stop 2024-09-11T23:05:42.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.923+0000 7f09c709d640 1 -- 172.21.15.12:0/3750643154 shutdown_connections 2024-09-11T23:05:42.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.923+0000 7f09c709d640 1 --2- 172.21.15.12:0/3750643154 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09c00a0780 0x7f09c013ed60 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:42.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.923+0000 7f09c709d640 1 -- 172.21.15.12:0/3750643154 >> 172.21.15.12:0/3750643154 conn(0x7f09c00a82f0 msgr2=0x7f09c00a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:42.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.923+0000 7f09c709d640 1 -- 172.21.15.12:0/3750643154 shutdown_connections 2024-09-11T23:05:42.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.923+0000 7f09c709d640 1 -- 172.21.15.12:0/3750643154 wait complete. 2024-09-11T23:05:42.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.923+0000 7f09c709d640 1 Processor -- start 2024-09-11T23:05:42.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.923+0000 7f09c709d640 1 -- start start 2024-09-11T23:05:42.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.923+0000 7f09c709d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09c00a0780 0x7f09c013c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:42.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.923+0000 7f09c709d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f09c0141c40 con 0x7f09c00a0780 2024-09-11T23:05:42.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.923+0000 7f09c4e39640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09c00a0780 0x7f09c013c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:42.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.923+0000 7f09c4e39640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09c00a0780 0x7f09c013c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52904/0 (socket says 172.21.15.12:52904) 2024-09-11T23:05:42.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.923+0000 7f09c4e39640 1 -- 172.21.15.12:0/3616226320 learned_addr learned my addr 172.21.15.12:0/3616226320 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:42.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.923+0000 7f09c4e39640 1 -- 172.21.15.12:0/3616226320 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09c009e730 con 0x7f09c00a0780 2024-09-11T23:05:42.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.923+0000 7f09c4e39640 1 --2- 172.21.15.12:0/3616226320 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09c00a0780 0x7f09c013c230 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f09b800cb80 tx=0x7f09b800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:42.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.923+0000 7f09bd7fa640 1 -- 172.21.15.12:0/3616226320 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09b800ac90 con 0x7f09c00a0780 2024-09-11T23:05:42.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.923+0000 7f09bd7fa640 1 -- 172.21.15.12:0/3616226320 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09b800ae30 con 0x7f09c00a0780 2024-09-11T23:05:42.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.923+0000 7f09c709d640 1 -- 172.21.15.12:0/3616226320 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09c013b7f0 con 0x7f09c00a0780 2024-09-11T23:05:42.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.923+0000 7f09bd7fa640 1 -- 172.21.15.12:0/3616226320 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09b8012530 con 0x7f09c00a0780 2024-09-11T23:05:42.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.923+0000 7f09c709d640 1 -- 172.21.15.12:0/3616226320 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09c013b4e0 con 0x7f09c00a0780 2024-09-11T23:05:42.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.923+0000 7f09bd7fa640 1 -- 172.21.15.12:0/3616226320 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 44053+0+0 (secure 0 0 0) 0x7f09b80126d0 con 0x7f09c00a0780 2024-09-11T23:05:42.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.923+0000 7f09c709d640 1 -- 172.21.15.12:0/3616226320 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09c009ee70 con 0x7f09c00a0780 2024-09-11T23:05:42.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.927+0000 7f09bd7fa640 1 --2- 172.21.15.12:0/3616226320 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f09a0035db0 0x7f09a0038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:42.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.927+0000 7f09bd7fa640 1 -- 172.21.15.12:0/3616226320 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 3447+0+0 (secure 0 0 0) 0x7f09b8048de0 con 0x7f09c00a0780 2024-09-11T23:05:42.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.927+0000 7f09bffff640 1 --2- 172.21.15.12:0/3616226320 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f09a0035db0 0x7f09a0038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:42.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.927+0000 7f09bffff640 1 --2- 172.21.15.12:0/3616226320 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f09a0035db0 0x7f09a0038270 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f09a80ad000 tx=0x7f09a8008040 comp rx=0 tx=0).ready entity=mgr.4708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:42.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:42.931+0000 7f09bd7fa640 1 -- 172.21.15.12:0/3616226320 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f09b8047cd0 con 0x7f09c00a0780 2024-09-11T23:05:43.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.095+0000 7f09c709d640 1 -- 172.21.15.12:0/3616226320 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f09c009e460 con 0x7f09c00a0780 2024-09-11T23:05:43.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.099+0000 7f09bd7fa640 1 -- 172.21.15.12:0/3616226320 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v8) ==== 104+0+0 (secure 0 0 0) 0x7f09b8019de0 con 0x7f09c00a0780 2024-09-11T23:05:43.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.099+0000 7f09c709d640 1 -- 172.21.15.12:0/3616226320 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f09a0035db0 msgr2=0x7f09a0038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:43.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.099+0000 7f09c709d640 1 --2- 172.21.15.12:0/3616226320 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f09a0035db0 0x7f09a0038270 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f09a80ad000 tx=0x7f09a8008040 comp rx=0 tx=0).stop 2024-09-11T23:05:43.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.099+0000 7f09c709d640 1 -- 172.21.15.12:0/3616226320 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09c00a0780 msgr2=0x7f09c013c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:43.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.099+0000 7f09c709d640 1 --2- 172.21.15.12:0/3616226320 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09c00a0780 0x7f09c013c230 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f09b800cb80 tx=0x7f09b800a430 comp rx=0 tx=0).stop 2024-09-11T23:05:43.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.099+0000 7f09c709d640 1 -- 172.21.15.12:0/3616226320 shutdown_connections 2024-09-11T23:05:43.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.099+0000 7f09c709d640 1 --2- 172.21.15.12:0/3616226320 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f09a0035db0 0x7f09a0038270 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:43.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.099+0000 7f09c709d640 1 --2- 172.21.15.12:0/3616226320 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09c00a0780 0x7f09c013c230 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:43.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.099+0000 7f09c709d640 1 -- 172.21.15.12:0/3616226320 >> 172.21.15.12:0/3616226320 conn(0x7f09c00a82f0 msgr2=0x7f09c0135a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:43.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.099+0000 7f09c709d640 1 -- 172.21.15.12:0/3616226320 shutdown_connections 2024-09-11T23:05:43.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.099+0000 7f09c709d640 1 -- 172.21.15.12:0/3616226320 wait complete. 2024-09-11T23:05:43.121 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_fstop.TestFSTop.test_dumpfs' 2024-09-11T23:05:43.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.235+0000 7f6846c4a640 1 Processor -- start 2024-09-11T23:05:43.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.235+0000 7f6846c4a640 1 -- start start 2024-09-11T23:05:43.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.235+0000 7f6846c4a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f684009f6e0 0x7f684013cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:43.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.235+0000 7f6846c4a640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f684009e930 con 0x7f6840137e60 2024-09-11T23:05:43.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.235+0000 7f6846c4a640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f68401379e0 con 0x7f684009f6e0 2024-09-11T23:05:43.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.239+0000 7f683ffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f684009f6e0 0x7f684013cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:43.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.239+0000 7f68449e6640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f6840137e60 0x7f6840138240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:45596/0 (socket says 172.21.15.12:45596) 2024-09-11T23:05:43.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.239+0000 7f68449e6640 1 -- 172.21.15.12:0/3842318424 learned_addr learned my addr 172.21.15.12:0/3842318424 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:43.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.239+0000 7f683ffff640 1 -- 172.21.15.12:0/3842318424 >> v1:172.21.15.12:6789/0 conn(0x7f6840137e60 legacy=0x7f6840138240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:43.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.239+0000 7f683f7fe640 1 -- 172.21.15.12:0/3842318424 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1113201969 0 0) 0x7f684009e930 con 0x7f6840137e60 2024-09-11T23:05:43.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.239+0000 7f683ffff640 1 -- 172.21.15.12:0/3842318424 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f684009d910 con 0x7f684009f6e0 2024-09-11T23:05:43.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.239+0000 7f683ffff640 1 --2- 172.21.15.12:0/3842318424 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f684009f6e0 0x7f684013cc60 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f682c009740 tx=0x7f682c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eeea061ad0fc65 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:43.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.239+0000 7f683f7fe640 1 -- 172.21.15.12:0/3842318424 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f682c0ab570 con 0x7f684009f6e0 2024-09-11T23:05:43.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.239+0000 7f683f7fe640 1 -- 172.21.15.12:0/3842318424 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f682c0b0070 con 0x7f684009f6e0 2024-09-11T23:05:43.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.239+0000 7f683f7fe640 1 -- 172.21.15.12:0/3842318424 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f682c0ab860 con 0x7f684009f6e0 2024-09-11T23:05:43.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.243+0000 7f6846c4a640 1 -- 172.21.15.12:0/3842318424 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f684009f6e0 msgr2=0x7f684013cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:43.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.243+0000 7f6846c4a640 1 --2- 172.21.15.12:0/3842318424 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f684009f6e0 0x7f684013cc60 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f682c009740 tx=0x7f682c01c420 comp rx=0 tx=0).stop 2024-09-11T23:05:43.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.243+0000 7f6846c4a640 1 -- 172.21.15.12:0/3842318424 shutdown_connections 2024-09-11T23:05:43.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.243+0000 7f6846c4a640 1 --2- 172.21.15.12:0/3842318424 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f684009f6e0 0x7f684013cc60 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:43.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.243+0000 7f6846c4a640 1 -- 172.21.15.12:0/3842318424 >> 172.21.15.12:0/3842318424 conn(0x7f68400a8450 msgr2=0x7f68400a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:43.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.243+0000 7f6846c4a640 1 -- 172.21.15.12:0/3842318424 shutdown_connections 2024-09-11T23:05:43.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.243+0000 7f6846c4a640 1 -- 172.21.15.12:0/3842318424 wait complete. 2024-09-11T23:05:43.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.243+0000 7f6846c4a640 1 Processor -- start 2024-09-11T23:05:43.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.243+0000 7f6846c4a640 1 -- start start 2024-09-11T23:05:43.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.243+0000 7f6846c4a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f684009f6e0 0x7f684011e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:43.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.243+0000 7f6846c4a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f684013fd50 con 0x7f684009f6e0 2024-09-11T23:05:43.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.243+0000 7f68449e6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f684009f6e0 0x7f684011e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:43.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.243+0000 7f68449e6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f684009f6e0 0x7f684011e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52928/0 (socket says 172.21.15.12:52928) 2024-09-11T23:05:43.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.243+0000 7f68449e6640 1 -- 172.21.15.12:0/3549247452 learned_addr learned my addr 172.21.15.12:0/3549247452 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:43.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.243+0000 7f68449e6640 1 -- 172.21.15.12:0/3549247452 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6840073310 con 0x7f684009f6e0 2024-09-11T23:05:43.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.243+0000 7f68449e6640 1 --2- 172.21.15.12:0/3549247452 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f684009f6e0 0x7f684011e820 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f683000c450 tx=0x7f683000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:43.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.243+0000 7f683d7fa640 1 -- 172.21.15.12:0/3549247452 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6830005c20 con 0x7f684009f6e0 2024-09-11T23:05:43.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.243+0000 7f683d7fa640 1 -- 172.21.15.12:0/3549247452 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6830005dc0 con 0x7f684009f6e0 2024-09-11T23:05:43.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.243+0000 7f683d7fa640 1 -- 172.21.15.12:0/3549247452 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68300071a0 con 0x7f684009f6e0 2024-09-11T23:05:43.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.243+0000 7f6846c4a640 1 -- 172.21.15.12:0/3549247452 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68400725c0 con 0x7f684009f6e0 2024-09-11T23:05:43.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.243+0000 7f6846c4a640 1 -- 172.21.15.12:0/3549247452 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6840072090 con 0x7f684009f6e0 2024-09-11T23:05:43.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.243+0000 7f6846c4a640 1 -- 172.21.15.12:0/3549247452 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68400714d0 con 0x7f684009f6e0 2024-09-11T23:05:43.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.243+0000 7f683d7fa640 1 -- 172.21.15.12:0/3549247452 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 44053+0+0 (secure 0 0 0) 0x7f6830007400 con 0x7f684009f6e0 2024-09-11T23:05:43.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.243+0000 7f683d7fa640 1 --2- 172.21.15.12:0/3549247452 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f6828035d60 0x7f6828038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:43.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.243+0000 7f683d7fa640 1 -- 172.21.15.12:0/3549247452 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 3447+0+0 (secure 0 0 0) 0x7f6830048360 con 0x7f684009f6e0 2024-09-11T23:05:43.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.247+0000 7f683ffff640 1 --2- 172.21.15.12:0/3549247452 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f6828035d60 0x7f6828038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:43.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.247+0000 7f683ffff640 1 --2- 172.21.15.12:0/3549247452 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f6828035d60 0x7f6828038220 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f682c0af000 tx=0x7f682c008040 comp rx=0 tx=0).ready entity=mgr.4708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:43.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.251+0000 7f683d7fa640 1 -- 172.21.15.12:0/3549247452 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f68300182b0 con 0x7f684009f6e0 2024-09-11T23:05:43.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.471+0000 7f6846c4a640 1 -- 172.21.15.12:0/3549247452 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_fstop.TestFSTop.test_dumpfs"]} v 0) -- 0x7f684011ed60 con 0x7f684009f6e0 2024-09-11T23:05:43.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.755+0000 7f683d7fa640 1 -- 172.21.15.12:0/3549247452 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_fstop.TestFSTop.test_dumpfs"]}]=0 v136) ==== 124+0+0 (secure 0 0 0) 0x7f683001bca0 con 0x7f684009f6e0 2024-09-11T23:05:43.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.759+0000 7f6846c4a640 1 -- 172.21.15.12:0/3549247452 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f6828035d60 msgr2=0x7f6828038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:43.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.759+0000 7f6846c4a640 1 --2- 172.21.15.12:0/3549247452 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f6828035d60 0x7f6828038220 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f682c0af000 tx=0x7f682c008040 comp rx=0 tx=0).stop 2024-09-11T23:05:43.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.759+0000 7f6846c4a640 1 -- 172.21.15.12:0/3549247452 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f684009f6e0 msgr2=0x7f684011e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:43.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.759+0000 7f6846c4a640 1 --2- 172.21.15.12:0/3549247452 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f684009f6e0 0x7f684011e820 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f683000c450 tx=0x7f683000c910 comp rx=0 tx=0).stop 2024-09-11T23:05:43.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.759+0000 7f6846c4a640 1 -- 172.21.15.12:0/3549247452 shutdown_connections 2024-09-11T23:05:43.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.759+0000 7f6846c4a640 1 --2- 172.21.15.12:0/3549247452 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f6828035d60 0x7f6828038220 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:43.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.759+0000 7f6846c4a640 1 --2- 172.21.15.12:0/3549247452 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f684009f6e0 0x7f684011e820 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:43.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.759+0000 7f6846c4a640 1 -- 172.21.15.12:0/3549247452 >> 172.21.15.12:0/3549247452 conn(0x7f68400a8450 msgr2=0x7f68400a1430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:43.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.759+0000 7f6846c4a640 1 -- 172.21.15.12:0/3549247452 shutdown_connections 2024-09-11T23:05:43.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.759+0000 7f6846c4a640 1 -- 172.21.15.12:0/3549247452 wait complete. 2024-09-11T23:05:43.784 INFO:tasks.cephfs_test_runner:Tests 'cephfs-top --dumpfs' output is valid ... ok 2024-09-11T23:05:43.784 INFO:tasks.cephfs_test_runner:Starting test: test_fstop (tasks.cephfs.test_fstop.TestFSTop) 2024-09-11T23:05:43.784 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:05:43.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.911+0000 7f0a46a68640 1 Processor -- start 2024-09-11T23:05:43.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.911+0000 7f0a46a68640 1 -- start start 2024-09-11T23:05:43.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.915+0000 7f0a46a68640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0a400a4b80 0x7f0a400a7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:43.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.915+0000 7f0a46a68640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a400a82a0 con 0x7f0a4013a410 2024-09-11T23:05:43.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.915+0000 7f0a46a68640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f0a400a3cb0 con 0x7f0a400a4b80 2024-09-11T23:05:43.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.915+0000 7f0a44804640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f0a4013a410 0x7f0a400a6af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:45612/0 (socket says 172.21.15.12:45612) 2024-09-11T23:05:43.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.915+0000 7f0a44804640 1 -- 172.21.15.12:0/1322938765 learned_addr learned my addr 172.21.15.12:0/1322938765 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:43.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.915+0000 7f0a3ffff640 1 --2- 172.21.15.12:0/1322938765 >> v2:172.21.15.12:3300/0 conn(0x7f0a400a4b80 0x7f0a400a7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:43.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.915+0000 7f0a3f7fe640 1 -- 172.21.15.12:0/1322938765 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2275067778 0 0) 0x7f0a400a82a0 con 0x7f0a4013a410 2024-09-11T23:05:43.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.915+0000 7f0a3f7fe640 1 -- 172.21.15.12:0/1322938765 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a28003530 con 0x7f0a4013a410 2024-09-11T23:05:43.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.915+0000 7f0a3ffff640 1 -- 172.21.15.12:0/1322938765 >> v1:172.21.15.12:6789/0 conn(0x7f0a4013a410 legacy=0x7f0a400a6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:43.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.915+0000 7f0a3ffff640 1 -- 172.21.15.12:0/1322938765 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a40139fe0 con 0x7f0a400a4b80 2024-09-11T23:05:43.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.915+0000 7f0a3ffff640 1 --2- 172.21.15.12:0/1322938765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a400a4b80 0x7f0a400a7200 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f0a34009740 tx=0x7f0a3401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dc02dce90ffa203 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:43.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.915+0000 7f0a3f7fe640 1 -- 172.21.15.12:0/1322938765 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a340b0070 con 0x7f0a400a4b80 2024-09-11T23:05:43.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.915+0000 7f0a3f7fe640 1 -- 172.21.15.12:0/1322938765 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a340ab530 con 0x7f0a400a4b80 2024-09-11T23:05:43.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.915+0000 7f0a3f7fe640 1 -- 172.21.15.12:0/1322938765 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a340ab830 con 0x7f0a400a4b80 2024-09-11T23:05:43.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.915+0000 7f0a46a68640 1 -- 172.21.15.12:0/1322938765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a400a4b80 msgr2=0x7f0a400a7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:43.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.919+0000 7f0a46a68640 1 --2- 172.21.15.12:0/1322938765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a400a4b80 0x7f0a400a7200 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f0a34009740 tx=0x7f0a3401c390 comp rx=0 tx=0).stop 2024-09-11T23:05:43.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.919+0000 7f0a46a68640 1 -- 172.21.15.12:0/1322938765 shutdown_connections 2024-09-11T23:05:43.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.919+0000 7f0a46a68640 1 --2- 172.21.15.12:0/1322938765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a400a4b80 0x7f0a400a7200 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:43.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.919+0000 7f0a46a68640 1 -- 172.21.15.12:0/1322938765 >> 172.21.15.12:0/1322938765 conn(0x7f0a400ac2c0 msgr2=0x7f0a400ac6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:43.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.919+0000 7f0a46a68640 1 -- 172.21.15.12:0/1322938765 shutdown_connections 2024-09-11T23:05:43.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.919+0000 7f0a46a68640 1 -- 172.21.15.12:0/1322938765 wait complete. 2024-09-11T23:05:43.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.919+0000 7f0a46a68640 1 Processor -- start 2024-09-11T23:05:43.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.919+0000 7f0a46a68640 1 -- start start 2024-09-11T23:05:43.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.919+0000 7f0a46a68640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a400a4b80 0x7f0a401ce810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:43.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.919+0000 7f0a46a68640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0a400a7740 con 0x7f0a400a4b80 2024-09-11T23:05:43.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.919+0000 7f0a44804640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a400a4b80 0x7f0a401ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:43.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.919+0000 7f0a44804640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a400a4b80 0x7f0a401ce810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52942/0 (socket says 172.21.15.12:52942) 2024-09-11T23:05:43.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.919+0000 7f0a44804640 1 -- 172.21.15.12:0/512158572 learned_addr learned my addr 172.21.15.12:0/512158572 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:43.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.919+0000 7f0a44804640 1 -- 172.21.15.12:0/512158572 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a4013ef40 con 0x7f0a400a4b80 2024-09-11T23:05:43.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.919+0000 7f0a44804640 1 --2- 172.21.15.12:0/512158572 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a400a4b80 0x7f0a401ce810 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f0a3000c3d0 tx=0x7f0a3000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:43.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.919+0000 7f0a3d7fa640 1 -- 172.21.15.12:0/512158572 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a30017070 con 0x7f0a400a4b80 2024-09-11T23:05:43.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.919+0000 7f0a3d7fa640 1 -- 172.21.15.12:0/512158572 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a30005ce0 con 0x7f0a400a4b80 2024-09-11T23:05:43.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.919+0000 7f0a46a68640 1 -- 172.21.15.12:0/512158572 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a4013eb60 con 0x7f0a400a4b80 2024-09-11T23:05:43.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.919+0000 7f0a3d7fa640 1 -- 172.21.15.12:0/512158572 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a300070d0 con 0x7f0a400a4b80 2024-09-11T23:05:43.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.919+0000 7f0a46a68640 1 -- 172.21.15.12:0/512158572 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a4009b430 con 0x7f0a400a4b80 2024-09-11T23:05:43.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.919+0000 7f0a3d7fa640 1 -- 172.21.15.12:0/512158572 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 44053+0+0 (secure 0 0 0) 0x7f0a3001a070 con 0x7f0a400a4b80 2024-09-11T23:05:43.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.919+0000 7f0a46a68640 1 -- 172.21.15.12:0/512158572 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a400a6af0 con 0x7f0a400a4b80 2024-09-11T23:05:43.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.923+0000 7f0a3d7fa640 1 --2- 172.21.15.12:0/512158572 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f0a2c035db0 0x7f0a2c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:43.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.923+0000 7f0a3d7fa640 1 -- 172.21.15.12:0/512158572 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 3447+0+0 (secure 0 0 0) 0x7f0a30047b00 con 0x7f0a400a4b80 2024-09-11T23:05:43.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.923+0000 7f0a3ffff640 1 --2- 172.21.15.12:0/512158572 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f0a2c035db0 0x7f0a2c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:43.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.923+0000 7f0a3ffff640 1 --2- 172.21.15.12:0/512158572 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f0a2c035db0 0x7f0a2c038270 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0a340ad000 tx=0x7f0a34008040 comp rx=0 tx=0).ready entity=mgr.4708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:43.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:43.927+0000 7f0a3d7fa640 1 -- 172.21.15.12:0/512158572 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0a30019e10 con 0x7f0a400a4b80 2024-09-11T23:05:44.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.091+0000 7f0a46a68640 1 -- 172.21.15.12:0/512158572 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0a400a2e90 con 0x7f0a400a4b80 2024-09-11T23:05:44.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.095+0000 7f0a3d7fa640 1 -- 172.21.15.12:0/512158572 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) ==== 74+0+8050 (secure 0 0 0) 0x7f0a3001b8d0 con 0x7f0a400a4b80 2024-09-11T23:05:44.096 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:05:44.097 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":47,"fsid":"8be14356-3340-4500-91a2-4cbc6b511f65","created":"2024-09-11T23:03:10.620234+0000","modified":"2024-09-11T23:05:42.753432+0000","last_up_change":"2024-09-11T23:03:22.359028+0000","last_in_change":"2024-09-11T23:03:11.545817+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:03:23.587068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"153b72a1-40b1-400d-93ea-333e733f9bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6817","nonce":3680911937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6819","nonce":3680911937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6823","nonce":3680911937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6821","nonce":3680911937}]},"public_addr":"172.21.15.12:6817/3680911937","cluster_addr":"172.21.15.12:6819/3680911937","heartbeat_back_addr":"172.21.15.12:6823/3680911937","heartbeat_front_addr":"172.21.15.12:6821/3680911937","state":["exists","up"]},{"osd":1,"uuid":"94669e49-ee4f-4acf-9e25-e94374dda8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6801","nonce":236825163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6803","nonce":236825163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6807","nonce":236825163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6805","nonce":236825163}]},"public_addr":"172.21.15.12:6801/236825163","cluster_addr":"172.21.15.12:6803/236825163","heartbeat_back_addr":"172.21.15.12:6807/236825163","heartbeat_front_addr":"172.21.15.12:6805/236825163","state":["exists","up"]},{"osd":2,"uuid":"826dae4d-8888-4ec5-8f00-425b3be93814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6809","nonce":3263521655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6811","nonce":3263521655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6815","nonce":3263521655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6813","nonce":3263521655}]},"public_addr":"172.21.15.12:6809/3263521655","cluster_addr":"172.21.15.12:6811/3263521655","heartbeat_back_addr":"172.21.15.12:6815/3263521655","heartbeat_front_addr":"172.21.15.12:6813/3263521655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:19.398518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.761524+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.904997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/1793382360":"2024-09-12T23:05:34.254367+0000","172.21.15.12:0/906705049":"2024-09-12T23:05:34.254367+0000","172.21.15.12:6827/1887547537":"2024-09-12T23:05:39.738997+0000","172.21.15.12:0/751872097":"2024-09-12T23:05:34.254367+0000","172.21.15.12:0/1572670263":"2024-09-12T23:05:34.254367+0000","172.21.15.12:6825/2340508205":"2024-09-12T23:05:34.254367+0000","172.21.15.12:6824/2340508205":"2024-09-12T23:05:34.254367+0000","172.21.15.12:0/2857800363":"2024-09-12T23:05:34.254367+0000","172.21.15.12:6829/2765393463":"2024-09-12T23:05:34.219324+0000","172.21.15.12:6828/2765393463":"2024-09-12T23:05:34.219324+0000","172.21.15.12:0/2509166838":"2024-09-12T23:05:06.494857+0000","172.21.15.12:6825/718802078":"2024-09-12T23:05:06.494857+0000","172.21.15.12:0/1378363537":"2024-09-12T23:05:34.254367+0000","172.21.15.12:6824/718802078":"2024-09-12T23:05:06.494857+0000","172.21.15.12:0/2490570290":"2024-09-12T23:05:06.494857+0000","172.21.15.12:0/2957476143":"2024-09-12T23:05:06.494857+0000","172.21.15.12:0/37905181":"2024-09-12T23:05:06.494857+0000","172.21.15.12:0/3294231065":"2024-09-12T23:05:06.494857+0000","172.21.15.12:6826/1887547537":"2024-09-12T23:05:39.738997+0000","172.21.15.12:0/2407367943":"2024-09-12T23:05:06.494857+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:05:44.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.095+0000 7f0a46a68640 1 -- 172.21.15.12:0/512158572 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f0a2c035db0 msgr2=0x7f0a2c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:44.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.095+0000 7f0a46a68640 1 --2- 172.21.15.12:0/512158572 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f0a2c035db0 0x7f0a2c038270 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0a340ad000 tx=0x7f0a34008040 comp rx=0 tx=0).stop 2024-09-11T23:05:44.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.095+0000 7f0a46a68640 1 -- 172.21.15.12:0/512158572 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a400a4b80 msgr2=0x7f0a401ce810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:44.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.095+0000 7f0a46a68640 1 --2- 172.21.15.12:0/512158572 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a400a4b80 0x7f0a401ce810 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f0a3000c3d0 tx=0x7f0a3000c890 comp rx=0 tx=0).stop 2024-09-11T23:05:44.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.095+0000 7f0a46a68640 1 -- 172.21.15.12:0/512158572 shutdown_connections 2024-09-11T23:05:44.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.095+0000 7f0a46a68640 1 --2- 172.21.15.12:0/512158572 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f0a2c035db0 0x7f0a2c038270 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:44.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.095+0000 7f0a46a68640 1 --2- 172.21.15.12:0/512158572 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a400a4b80 0x7f0a401ce810 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:44.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.095+0000 7f0a46a68640 1 -- 172.21.15.12:0/512158572 >> 172.21.15.12:0/512158572 conn(0x7f0a400ac2c0 msgr2=0x7f0a4013f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:44.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.095+0000 7f0a46a68640 1 -- 172.21.15.12:0/512158572 shutdown_connections 2024-09-11T23:05:44.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.095+0000 7f0a46a68640 1 -- 172.21.15.12:0/512158572 wait complete. 2024-09-11T23:05:44.116 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T23:03:23.587068+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T23:05:44.116 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-11T23:05:44.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.239+0000 7f865309b640 1 Processor -- start 2024-09-11T23:05:44.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.239+0000 7f865309b640 1 -- start start 2024-09-11T23:05:44.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.239+0000 7f865309b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f864c137de0 0x7f864c09f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:44.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.239+0000 7f865309b640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f864c09d690 con 0x7f864c1381c0 2024-09-11T23:05:44.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.239+0000 7f865309b640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f864c09ea90 con 0x7f864c137de0 2024-09-11T23:05:44.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.239+0000 7f8650e37640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f864c137de0 0x7f864c09f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:44.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.239+0000 7f864bfff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f864c1381c0 0x7f864c0a36a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55576/0 (socket says 172.21.15.12:55576) 2024-09-11T23:05:44.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.239+0000 7f8650e37640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f864c137de0 0x7f864c09f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42922/0 (socket says 172.21.15.12:42922) 2024-09-11T23:05:44.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.239+0000 7f864bfff640 1 -- 172.21.15.12:0/3165237928 learned_addr learned my addr 172.21.15.12:0/3165237928 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:44.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.239+0000 7f8650e37640 1 -- 172.21.15.12:0/3165237928 >> v1:172.21.15.12:6789/0 conn(0x7f864c1381c0 legacy=0x7f864c0a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:44.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.239+0000 7f864b7fe640 1 -- 172.21.15.12:0/3165237928 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2822624750 0 0) 0x7f864c09d690 con 0x7f864c1381c0 2024-09-11T23:05:44.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.239+0000 7f8650e37640 1 -- 172.21.15.12:0/3165237928 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f864c09f6d0 con 0x7f864c137de0 2024-09-11T23:05:44.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.239+0000 7f8650e37640 1 --2- 172.21.15.12:0/3165237928 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f864c137de0 0x7f864c09f190 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f863c009740 tx=0x7f863c01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d327b24dd9badda1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:44.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.239+0000 7f864b7fe640 1 -- 172.21.15.12:0/3165237928 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f863c0b0070 con 0x7f864c137de0 2024-09-11T23:05:44.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.239+0000 7f864b7fe640 1 -- 172.21.15.12:0/3165237928 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f863c0a4e50 con 0x7f864c137de0 2024-09-11T23:05:44.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.239+0000 7f864b7fe640 1 -- 172.21.15.12:0/3165237928 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f863c0ab680 con 0x7f864c137de0 2024-09-11T23:05:44.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.243+0000 7f865309b640 1 -- 172.21.15.12:0/3165237928 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f864c137de0 msgr2=0x7f864c09f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:44.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.243+0000 7f865309b640 1 --2- 172.21.15.12:0/3165237928 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f864c137de0 0x7f864c09f190 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f863c009740 tx=0x7f863c01c390 comp rx=0 tx=0).stop 2024-09-11T23:05:44.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.243+0000 7f865309b640 1 -- 172.21.15.12:0/3165237928 shutdown_connections 2024-09-11T23:05:44.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.243+0000 7f865309b640 1 --2- 172.21.15.12:0/3165237928 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f864c137de0 0x7f864c09f190 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:44.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.243+0000 7f865309b640 1 -- 172.21.15.12:0/3165237928 >> 172.21.15.12:0/3165237928 conn(0x7f864c0a82f0 msgr2=0x7f864c0a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:44.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.243+0000 7f865309b640 1 -- 172.21.15.12:0/3165237928 shutdown_connections 2024-09-11T23:05:44.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.243+0000 7f865309b640 1 -- 172.21.15.12:0/3165237928 wait complete. 2024-09-11T23:05:44.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.243+0000 7f865309b640 1 Processor -- start 2024-09-11T23:05:44.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.243+0000 7f865309b640 1 -- start start 2024-09-11T23:05:44.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.243+0000 7f865309b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f864c137de0 0x7f864c072390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:44.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.243+0000 7f865309b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f864c09e7d0 con 0x7f864c137de0 2024-09-11T23:05:44.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.243+0000 7f8650e37640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f864c137de0 0x7f864c072390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:44.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.243+0000 7f8650e37640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f864c137de0 0x7f864c072390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42934/0 (socket says 172.21.15.12:42934) 2024-09-11T23:05:44.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.243+0000 7f8650e37640 1 -- 172.21.15.12:0/2932467972 learned_addr learned my addr 172.21.15.12:0/2932467972 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:44.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.243+0000 7f8650e37640 1 -- 172.21.15.12:0/2932467972 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f864c071e80 con 0x7f864c137de0 2024-09-11T23:05:44.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.243+0000 7f8650e37640 1 --2- 172.21.15.12:0/2932467972 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f864c137de0 0x7f864c072390 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f863c019fc0 tx=0x7f863c01abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:44.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.243+0000 7f86497fa640 1 -- 172.21.15.12:0/2932467972 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f863c0bb070 con 0x7f864c137de0 2024-09-11T23:05:44.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.243+0000 7f86497fa640 1 -- 172.21.15.12:0/2932467972 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f863c0abc90 con 0x7f864c137de0 2024-09-11T23:05:44.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.243+0000 7f865309b640 1 -- 172.21.15.12:0/2932467972 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f864c0711e0 con 0x7f864c137de0 2024-09-11T23:05:44.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.243+0000 7f86497fa640 1 -- 172.21.15.12:0/2932467972 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f863c0b0040 con 0x7f864c137de0 2024-09-11T23:05:44.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.243+0000 7f865309b640 1 -- 172.21.15.12:0/2932467972 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f864c13cfa0 con 0x7f864c137de0 2024-09-11T23:05:44.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.243+0000 7f86497fa640 1 -- 172.21.15.12:0/2932467972 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 44053+0+0 (secure 0 0 0) 0x7f863c004020 con 0x7f864c137de0 2024-09-11T23:05:44.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.247+0000 7f86497fa640 1 --2- 172.21.15.12:0/2932467972 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f8638035d60 0x7f8638038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:44.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.247+0000 7f86497fa640 1 -- 172.21.15.12:0/2932467972 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 3447+0+0 (secure 0 0 0) 0x7f863c0e2ab0 con 0x7f864c137de0 2024-09-11T23:05:44.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.247+0000 7f865309b640 1 -- 172.21.15.12:0/2932467972 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f864c09f190 con 0x7f864c137de0 2024-09-11T23:05:44.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.247+0000 7f864bfff640 1 --2- 172.21.15.12:0/2932467972 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f8638035d60 0x7f8638038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:44.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.247+0000 7f864bfff640 1 --2- 172.21.15.12:0/2932467972 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f8638035d60 0x7f8638038220 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8640000f90 tx=0x7f86400016c0 comp rx=0 tx=0).ready entity=mgr.4708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:44.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.251+0000 7f86497fa640 1 -- 172.21.15.12:0/2932467972 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f864c071e80 con 0x7f864c137de0 2024-09-11T23:05:44.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.415+0000 7f865309b640 1 -- 172.21.15.12:0/2932467972 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f864c070fb0 con 0x7f864c137de0 2024-09-11T23:05:44.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.415+0000 7f86497fa640 1 -- 172.21.15.12:0/2932467972 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) ==== 93+0+10 (secure 0 0 0) 0x7f863c016010 con 0x7f864c137de0 2024-09-11T23:05:44.419 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2024-09-11T23:05:44.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.419+0000 7f865309b640 1 -- 172.21.15.12:0/2932467972 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f8638035d60 msgr2=0x7f8638038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:44.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.419+0000 7f865309b640 1 --2- 172.21.15.12:0/2932467972 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f8638035d60 0x7f8638038220 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8640000f90 tx=0x7f86400016c0 comp rx=0 tx=0).stop 2024-09-11T23:05:44.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.419+0000 7f865309b640 1 -- 172.21.15.12:0/2932467972 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f864c137de0 msgr2=0x7f864c072390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:44.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.419+0000 7f865309b640 1 --2- 172.21.15.12:0/2932467972 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f864c137de0 0x7f864c072390 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f863c019fc0 tx=0x7f863c01abd0 comp rx=0 tx=0).stop 2024-09-11T23:05:44.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.419+0000 7f865309b640 1 -- 172.21.15.12:0/2932467972 shutdown_connections 2024-09-11T23:05:44.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.419+0000 7f865309b640 1 --2- 172.21.15.12:0/2932467972 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f8638035d60 0x7f8638038220 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:44.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.419+0000 7f865309b640 1 --2- 172.21.15.12:0/2932467972 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f864c137de0 0x7f864c072390 secure :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f863c019fc0 tx=0x7f863c01abd0 comp rx=0 tx=0).stop 2024-09-11T23:05:44.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.419+0000 7f865309b640 1 -- 172.21.15.12:0/2932467972 >> 172.21.15.12:0/2932467972 conn(0x7f864c0a82f0 msgr2=0x7f864c13d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:44.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.419+0000 7f865309b640 1 -- 172.21.15.12:0/2932467972 shutdown_connections 2024-09-11T23:05:44.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.419+0000 7f865309b640 1 -- 172.21.15.12:0/2932467972 wait complete. 2024-09-11T23:05:44.439 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_fstop.TestFSTop.test_fstop' 2024-09-11T23:05:44.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.563+0000 7f35a6c45640 1 Processor -- start 2024-09-11T23:05:44.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.563+0000 7f35a6c45640 1 -- start start 2024-09-11T23:05:44.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.563+0000 7f35a6c45640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f35a013a410 0x7f35a00a6af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:44.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.563+0000 7f35a6c45640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35a00a82a0 con 0x7f35a00a4b80 2024-09-11T23:05:44.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.563+0000 7f35a6c45640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f35a00a3cb0 con 0x7f35a013a410 2024-09-11T23:05:44.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.563+0000 7f35a49e1640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f35a013a410 0x7f35a00a6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:44.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.563+0000 7f359ffff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f35a00a4b80 0x7f35a00a7030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55580/0 (socket says 172.21.15.12:55580) 2024-09-11T23:05:44.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.563+0000 7f359ffff640 1 -- 172.21.15.12:0/4131911253 learned_addr learned my addr 172.21.15.12:0/4131911253 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:44.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.563+0000 7f35a49e1640 1 -- 172.21.15.12:0/4131911253 >> v1:172.21.15.12:6789/0 conn(0x7f35a00a4b80 legacy=0x7f35a00a7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:44.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.563+0000 7f35a49e1640 1 -- 172.21.15.12:0/4131911253 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35a0139fe0 con 0x7f35a013a410 2024-09-11T23:05:44.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.563+0000 7f359f7fe640 1 -- 172.21.15.12:0/4131911253 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2497802136 0 0) 0x7f35a00a82a0 con 0x7f35a00a4b80 2024-09-11T23:05:44.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.563+0000 7f35a49e1640 1 --2- 172.21.15.12:0/4131911253 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35a013a410 0x7f35a00a6af0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f3594009740 tx=0x7f359401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea26b5befe350887 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:44.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.567+0000 7f359f7fe640 1 -- 172.21.15.12:0/4131911253 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35940b0070 con 0x7f35a013a410 2024-09-11T23:05:44.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.567+0000 7f359f7fe640 1 -- 172.21.15.12:0/4131911253 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35940ab530 con 0x7f35a013a410 2024-09-11T23:05:44.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.567+0000 7f359f7fe640 1 -- 172.21.15.12:0/4131911253 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35940ab830 con 0x7f35a013a410 2024-09-11T23:05:44.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.567+0000 7f35a6c45640 1 -- 172.21.15.12:0/4131911253 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35a013a410 msgr2=0x7f35a00a6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:44.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.567+0000 7f35a6c45640 1 --2- 172.21.15.12:0/4131911253 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35a013a410 0x7f35a00a6af0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f3594009740 tx=0x7f359401c390 comp rx=0 tx=0).stop 2024-09-11T23:05:44.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.567+0000 7f35a6c45640 1 -- 172.21.15.12:0/4131911253 shutdown_connections 2024-09-11T23:05:44.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.567+0000 7f35a6c45640 1 --2- 172.21.15.12:0/4131911253 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35a013a410 0x7f35a00a6af0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:44.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.567+0000 7f35a6c45640 1 -- 172.21.15.12:0/4131911253 >> 172.21.15.12:0/4131911253 conn(0x7f35a00ac2c0 msgr2=0x7f35a00ac6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:44.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.567+0000 7f35a6c45640 1 -- 172.21.15.12:0/4131911253 shutdown_connections 2024-09-11T23:05:44.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.567+0000 7f35a6c45640 1 -- 172.21.15.12:0/4131911253 wait complete. 2024-09-11T23:05:44.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.567+0000 7f35a6c45640 1 Processor -- start 2024-09-11T23:05:44.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.567+0000 7f35a6c45640 1 -- start start 2024-09-11T23:05:44.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.567+0000 7f35a6c45640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35a00a4b80 0x7f35a009b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:44.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.567+0000 7f35a6c45640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f35a00a7740 con 0x7f35a00a4b80 2024-09-11T23:05:44.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.567+0000 7f35a49e1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35a00a4b80 0x7f35a009b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:44.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.567+0000 7f35a49e1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35a00a4b80 0x7f35a009b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42954/0 (socket says 172.21.15.12:42954) 2024-09-11T23:05:44.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.567+0000 7f35a49e1640 1 -- 172.21.15.12:0/1249679077 learned_addr learned my addr 172.21.15.12:0/1249679077 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:44.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.567+0000 7f35a49e1640 1 -- 172.21.15.12:0/1249679077 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35a013eef0 con 0x7f35a00a4b80 2024-09-11T23:05:44.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.567+0000 7f35a49e1640 1 --2- 172.21.15.12:0/1249679077 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35a00a4b80 0x7f35a009b1d0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f35940ae040 tx=0x7f359401abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:44.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.567+0000 7f359d7fa640 1 -- 172.21.15.12:0/1249679077 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35940b0050 con 0x7f35a00a4b80 2024-09-11T23:05:44.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.567+0000 7f359d7fa640 1 -- 172.21.15.12:0/1249679077 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35940b1040 con 0x7f35a00a4b80 2024-09-11T23:05:44.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.567+0000 7f35a6c45640 1 -- 172.21.15.12:0/1249679077 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35a01ce500 con 0x7f35a00a4b80 2024-09-11T23:05:44.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.567+0000 7f359d7fa640 1 -- 172.21.15.12:0/1249679077 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35940b5780 con 0x7f35a00a4b80 2024-09-11T23:05:44.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.567+0000 7f35a6c45640 1 -- 172.21.15.12:0/1249679077 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35a009d110 con 0x7f35a00a4b80 2024-09-11T23:05:44.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.571+0000 7f359d7fa640 1 -- 172.21.15.12:0/1249679077 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 44053+0+0 (secure 0 0 0) 0x7f35940be030 con 0x7f35a00a4b80 2024-09-11T23:05:44.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.571+0000 7f35a6c45640 1 -- 172.21.15.12:0/1249679077 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35a00a6af0 con 0x7f35a00a4b80 2024-09-11T23:05:44.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.571+0000 7f359d7fa640 1 --2- 172.21.15.12:0/1249679077 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f358c035db0 0x7f358c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:44.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.571+0000 7f359d7fa640 1 -- 172.21.15.12:0/1249679077 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 3447+0+0 (secure 0 0 0) 0x7f35940bc070 con 0x7f35a00a4b80 2024-09-11T23:05:44.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.571+0000 7f359ffff640 1 --2- 172.21.15.12:0/1249679077 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f358c035db0 0x7f358c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:44.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.571+0000 7f359ffff640 1 --2- 172.21.15.12:0/1249679077 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f358c035db0 0x7f358c038270 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3590007fd0 tx=0x7f3590007920 comp rx=0 tx=0).ready entity=mgr.4708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:44.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.575+0000 7f359d7fa640 1 -- 172.21.15.12:0/1249679077 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f35940c5060 con 0x7f35a00a4b80 2024-09-11T23:05:44.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:44.803+0000 7f35a6c45640 1 -- 172.21.15.12:0/1249679077 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fstop.TestFSTop.test_fstop"]} v 0) -- 0x7f35a00a2e90 con 0x7f35a00a4b80 2024-09-11T23:05:45.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:45.759+0000 7f359d7fa640 1 -- 172.21.15.12:0/1249679077 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fstop.TestFSTop.test_fstop"]}]=0 v138) ==== 126+0+0 (secure 0 0 0) 0x7f3594016010 con 0x7f35a00a4b80 2024-09-11T23:05:45.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:45.763+0000 7f35a6c45640 1 -- 172.21.15.12:0/1249679077 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f358c035db0 msgr2=0x7f358c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:45.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:45.763+0000 7f35a6c45640 1 --2- 172.21.15.12:0/1249679077 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f358c035db0 0x7f358c038270 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3590007fd0 tx=0x7f3590007920 comp rx=0 tx=0).stop 2024-09-11T23:05:45.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:45.763+0000 7f35a6c45640 1 -- 172.21.15.12:0/1249679077 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35a00a4b80 msgr2=0x7f35a009b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:45.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:45.763+0000 7f35a6c45640 1 --2- 172.21.15.12:0/1249679077 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35a00a4b80 0x7f35a009b1d0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f35940ae040 tx=0x7f359401abd0 comp rx=0 tx=0).stop 2024-09-11T23:05:45.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:45.763+0000 7f35a6c45640 1 -- 172.21.15.12:0/1249679077 shutdown_connections 2024-09-11T23:05:45.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:45.763+0000 7f35a6c45640 1 --2- 172.21.15.12:0/1249679077 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f358c035db0 0x7f358c038270 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:45.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:45.763+0000 7f35a6c45640 1 --2- 172.21.15.12:0/1249679077 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35a00a4b80 0x7f35a009b1d0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:45.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:45.763+0000 7f35a6c45640 1 -- 172.21.15.12:0/1249679077 >> 172.21.15.12:0/1249679077 conn(0x7f35a00ac2c0 msgr2=0x7f35a013f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:45.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:45.763+0000 7f35a6c45640 1 -- 172.21.15.12:0/1249679077 shutdown_connections 2024-09-11T23:05:45.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:45.763+0000 7f35a6c45640 1 -- 172.21.15.12:0/1249679077 wait complete. 2024-09-11T23:05:45.788 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-11T23:05:45.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:45.915+0000 7fa0b7c96640 1 Processor -- start 2024-09-11T23:05:45.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:45.915+0000 7fa0b7c96640 1 -- start start 2024-09-11T23:05:45.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:45.919+0000 7fa0b7c96640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa0b01381c0 0x7fa0b013cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:45.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:45.919+0000 7fa0b7c96640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0b009d690 con 0x7fa0b0137de0 2024-09-11T23:05:45.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:45.919+0000 7fa0b7c96640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fa0b009ea90 con 0x7fa0b01381c0 2024-09-11T23:05:45.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:45.919+0000 7fa0b5231640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa0b01381c0 0x7fa0b013cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:45.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:45.919+0000 7fa0b5a32640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa0b0137de0 0x7fa0b009f190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55584/0 (socket says 172.21.15.12:55584) 2024-09-11T23:05:45.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:45.919+0000 7fa0b5a32640 1 -- 172.21.15.12:0/689422563 learned_addr learned my addr 172.21.15.12:0/689422563 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:45.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:45.919+0000 7fa0b5231640 1 -- 172.21.15.12:0/689422563 >> v1:172.21.15.12:6789/0 conn(0x7fa0b0137de0 legacy=0x7fa0b009f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:45.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:45.919+0000 7fa0b5231640 1 -- 172.21.15.12:0/689422563 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0b009cf00 con 0x7fa0b01381c0 2024-09-11T23:05:45.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:45.919+0000 7fa0b5231640 1 --2- 172.21.15.12:0/689422563 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0b01381c0 0x7fa0b013cbc0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fa0a4009740 tx=0x7fa0a401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52d586a2b59fafaf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:45.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:45.919+0000 7fa0b4a30640 1 -- 172.21.15.12:0/689422563 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0a40b0070 con 0x7fa0b01381c0 2024-09-11T23:05:45.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:45.919+0000 7fa0b4a30640 1 -- 172.21.15.12:0/689422563 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0a40ab530 con 0x7fa0b01381c0 2024-09-11T23:05:45.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:45.919+0000 7fa0b4a30640 1 -- 172.21.15.12:0/689422563 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0a40ab830 con 0x7fa0b01381c0 2024-09-11T23:05:45.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:45.919+0000 7fa0b7c96640 1 -- 172.21.15.12:0/689422563 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0b01381c0 msgr2=0x7fa0b013cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:45.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:45.919+0000 7fa0b7c96640 1 --2- 172.21.15.12:0/689422563 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0b01381c0 0x7fa0b013cbc0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fa0a4009740 tx=0x7fa0a401c390 comp rx=0 tx=0).stop 2024-09-11T23:05:45.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:45.919+0000 7fa0b7c96640 1 -- 172.21.15.12:0/689422563 shutdown_connections 2024-09-11T23:05:45.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:45.919+0000 7fa0b7c96640 1 --2- 172.21.15.12:0/689422563 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0b01381c0 0x7fa0b013cbc0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:45.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:45.919+0000 7fa0b7c96640 1 -- 172.21.15.12:0/689422563 >> 172.21.15.12:0/689422563 conn(0x7fa0b00a82f0 msgr2=0x7fa0b00a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:45.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:45.919+0000 7fa0b7c96640 1 -- 172.21.15.12:0/689422563 shutdown_connections 2024-09-11T23:05:45.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:45.919+0000 7fa0b7c96640 1 -- 172.21.15.12:0/689422563 wait complete. 2024-09-11T23:05:45.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:45.923+0000 7fa0b7c96640 1 Processor -- start 2024-09-11T23:05:45.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:45.923+0000 7fa0b7c96640 1 -- start start 2024-09-11T23:05:45.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:45.923+0000 7fa0b7c96640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0b0137de0 0x7fa0b006fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:45.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:45.923+0000 7fa0b7c96640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b0137860 con 0x7fa0b0137de0 2024-09-11T23:05:45.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:45.923+0000 7fa0b5a32640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0b0137de0 0x7fa0b006fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:45.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:45.923+0000 7fa0b5a32640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0b0137de0 0x7fa0b006fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42970/0 (socket says 172.21.15.12:42970) 2024-09-11T23:05:45.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:45.923+0000 7fa0b5a32640 1 -- 172.21.15.12:0/1223542832 learned_addr learned my addr 172.21.15.12:0/1223542832 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:45.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:45.923+0000 7fa0b5a32640 1 -- 172.21.15.12:0/1223542832 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0b011eaf0 con 0x7fa0b0137de0 2024-09-11T23:05:45.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:45.923+0000 7fa0b5a32640 1 --2- 172.21.15.12:0/1223542832 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0b0137de0 0x7fa0b006fd40 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fa0a800cb40 tx=0x7fa0a800cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:45.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:45.923+0000 7fa0a27fc640 1 -- 172.21.15.12:0/1223542832 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0a8017070 con 0x7fa0b0137de0 2024-09-11T23:05:45.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:45.923+0000 7fa0a27fc640 1 -- 172.21.15.12:0/1223542832 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0a800ab30 con 0x7fa0b0137de0 2024-09-11T23:05:45.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:45.923+0000 7fa0b7c96640 1 -- 172.21.15.12:0/1223542832 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0b0072550 con 0x7fa0b0137de0 2024-09-11T23:05:45.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:45.923+0000 7fa0a27fc640 1 -- 172.21.15.12:0/1223542832 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0a800ae10 con 0x7fa0b0137de0 2024-09-11T23:05:45.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:45.923+0000 7fa0b7c96640 1 -- 172.21.15.12:0/1223542832 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0b0071990 con 0x7fa0b0137de0 2024-09-11T23:05:45.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:45.923+0000 7fa0a27fc640 1 -- 172.21.15.12:0/1223542832 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 44053+0+0 (secure 0 0 0) 0x7fa0a801a070 con 0x7fa0b0137de0 2024-09-11T23:05:45.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:45.923+0000 7fa0b7c96640 1 -- 172.21.15.12:0/1223542832 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0b0071c70 con 0x7fa0b0137de0 2024-09-11T23:05:45.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:45.923+0000 7fa0a27fc640 1 --2- 172.21.15.12:0/1223542832 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fa094035d60 0x7fa094038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:45.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:45.923+0000 7fa0a27fc640 1 -- 172.21.15.12:0/1223542832 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 3447+0+0 (secure 0 0 0) 0x7fa0a8048380 con 0x7fa0b0137de0 2024-09-11T23:05:45.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:45.923+0000 7fa0b5231640 1 --2- 172.21.15.12:0/1223542832 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fa094035d60 0x7fa094038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:45.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:45.923+0000 7fa0b5231640 1 --2- 172.21.15.12:0/1223542832 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fa094035d60 0x7fa094038220 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa0a40ad000 tx=0x7fa0a40a6000 comp rx=0 tx=0).ready entity=mgr.4708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:45.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:45.931+0000 7fa0a27fc640 1 -- 172.21.15.12:0/1223542832 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa0a8010300 con 0x7fa0b0137de0 2024-09-11T23:05:46.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.083+0000 7fa0b7c96640 1 -- 172.21.15.12:0/1223542832 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fa0b009f190 con 0x7fa0b0137de0 2024-09-11T23:05:46.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.087+0000 7fa0a27fc640 1 -- 172.21.15.12:0/1223542832 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v9)=0 v9) ==== 122+0+0 (secure 0 0 0) 0x7fa0a80078c0 con 0x7fa0b0137de0 2024-09-11T23:05:46.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.091+0000 7fa0b7c96640 1 -- 172.21.15.12:0/1223542832 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fa094035d60 msgr2=0x7fa094038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:46.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.091+0000 7fa0b7c96640 1 --2- 172.21.15.12:0/1223542832 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fa094035d60 0x7fa094038220 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa0a40ad000 tx=0x7fa0a40a6000 comp rx=0 tx=0).stop 2024-09-11T23:05:46.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.091+0000 7fa0b7c96640 1 -- 172.21.15.12:0/1223542832 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0b0137de0 msgr2=0x7fa0b006fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:46.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.091+0000 7fa0b7c96640 1 --2- 172.21.15.12:0/1223542832 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0b0137de0 0x7fa0b006fd40 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fa0a800cb40 tx=0x7fa0a800cf40 comp rx=0 tx=0).stop 2024-09-11T23:05:46.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.091+0000 7fa0b7c96640 1 -- 172.21.15.12:0/1223542832 shutdown_connections 2024-09-11T23:05:46.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.091+0000 7fa0b7c96640 1 --2- 172.21.15.12:0/1223542832 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fa094035d60 0x7fa094038220 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:46.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.091+0000 7fa0b7c96640 1 --2- 172.21.15.12:0/1223542832 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0b0137de0 0x7fa0b006fd40 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:46.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.091+0000 7fa0b7c96640 1 -- 172.21.15.12:0/1223542832 >> 172.21.15.12:0/1223542832 conn(0x7fa0b00a82f0 msgr2=0x7fa0b009fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:46.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.091+0000 7fa0b7c96640 1 -- 172.21.15.12:0/1223542832 shutdown_connections 2024-09-11T23:05:46.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.091+0000 7fa0b7c96640 1 -- 172.21.15.12:0/1223542832 wait complete. 2024-09-11T23:05:46.109 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T23:05:46.109 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:05:46.149 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T23:05:46.150 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T23:05:46.150 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:05:46.196 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339568k,nr_inodes=4084892,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15839 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275300k,nr_inodes=818825,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-09-11T23:05:46.197 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T23:05:46.197 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:05:46.244 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339568k,nr_inodes=4084892,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15839 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275300k,nr_inodes=818825,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-09-11T23:05:46.245 INFO:tasks.cephfs.cephfs_test_case:[, ] 2024-09-11T23:05:46.245 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:05:46.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.415+0000 7f3da92d1640 1 Processor -- start 2024-09-11T23:05:46.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.415+0000 7f3da92d1640 1 -- start start 2024-09-11T23:05:46.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.415+0000 7f3da92d1640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3da4137e60 0x7f3da4138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:46.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.415+0000 7f3da92d1640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3da409e930 con 0x7f3da409f6e0 2024-09-11T23:05:46.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.415+0000 7f3da92d1640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f3da41379e0 con 0x7f3da4137e60 2024-09-11T23:05:46.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.415+0000 7f3da2ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3da4137e60 0x7f3da4138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:46.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.415+0000 7f3da27fc640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f3da409f6e0 0x7f3da40a36a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55596/0 (socket says 172.21.15.12:55596) 2024-09-11T23:05:46.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.415+0000 7f3da27fc640 1 -- 172.21.15.12:0/2886624369 learned_addr learned my addr 172.21.15.12:0/2886624369 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:46.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.415+0000 7f3da2ffd640 1 -- 172.21.15.12:0/2886624369 >> v1:172.21.15.12:6789/0 conn(0x7f3da409f6e0 legacy=0x7f3da40a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:46.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.415+0000 7f3da2ffd640 1 -- 172.21.15.12:0/2886624369 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3da409d910 con 0x7f3da4137e60 2024-09-11T23:05:46.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.419+0000 7f3da2ffd640 1 --2- 172.21.15.12:0/2886624369 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3da4137e60 0x7f3da4138240 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c009d90 tx=0x7f3d9c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cd0b541211755d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:46.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.419+0000 7f3da1ffb640 1 -- 172.21.15.12:0/2886624369 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d9c0b2070 con 0x7f3da4137e60 2024-09-11T23:05:46.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.419+0000 7f3da1ffb640 1 -- 172.21.15.12:0/2886624369 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d9c0a5900 con 0x7f3da4137e60 2024-09-11T23:05:46.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.419+0000 7f3da1ffb640 1 -- 172.21.15.12:0/2886624369 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d9c0a5c00 con 0x7f3da4137e60 2024-09-11T23:05:46.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.419+0000 7f3da92d1640 1 -- 172.21.15.12:0/2886624369 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3da4137e60 msgr2=0x7f3da4138240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:46.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.419+0000 7f3da92d1640 1 --2- 172.21.15.12:0/2886624369 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3da4137e60 0x7f3da4138240 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c009d90 tx=0x7f3d9c01c970 comp rx=0 tx=0).stop 2024-09-11T23:05:46.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.419+0000 7f3da92d1640 1 -- 172.21.15.12:0/2886624369 shutdown_connections 2024-09-11T23:05:46.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.419+0000 7f3da92d1640 1 --2- 172.21.15.12:0/2886624369 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3da4137e60 0x7f3da4138240 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:46.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.419+0000 7f3da92d1640 1 -- 172.21.15.12:0/2886624369 >> 172.21.15.12:0/2886624369 conn(0x7f3da40a8450 msgr2=0x7f3da40a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:46.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.419+0000 7f3da92d1640 1 -- 172.21.15.12:0/2886624369 shutdown_connections 2024-09-11T23:05:46.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.419+0000 7f3da92d1640 1 -- 172.21.15.12:0/2886624369 wait complete. 2024-09-11T23:05:46.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.419+0000 7f3da92d1640 1 Processor -- start 2024-09-11T23:05:46.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.419+0000 7f3da92d1640 1 -- start start 2024-09-11T23:05:46.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.419+0000 7f3da92d1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3da409f6e0 0x7f3da41d2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:46.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.419+0000 7f3da92d1640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3da413fe00 con 0x7f3da409f6e0 2024-09-11T23:05:46.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.419+0000 7f3da2ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3da409f6e0 0x7f3da41d2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:46.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.419+0000 7f3da2ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3da409f6e0 0x7f3da41d2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42998/0 (socket says 172.21.15.12:42998) 2024-09-11T23:05:46.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.419+0000 7f3da2ffd640 1 -- 172.21.15.12:0/273725822 learned_addr learned my addr 172.21.15.12:0/273725822 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:46.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.419+0000 7f3da2ffd640 1 -- 172.21.15.12:0/273725822 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3da4072820 con 0x7f3da409f6e0 2024-09-11T23:05:46.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.423+0000 7f3da2ffd640 1 --2- 172.21.15.12:0/273725822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3da409f6e0 0x7f3da41d2090 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c01a5a0 tx=0x7f3d9c019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:46.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.423+0000 7f3d9b7fe640 1 -- 172.21.15.12:0/273725822 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d9c0bd020 con 0x7f3da409f6e0 2024-09-11T23:05:46.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.423+0000 7f3d9b7fe640 1 -- 172.21.15.12:0/273725822 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d9c0ad730 con 0x7f3da409f6e0 2024-09-11T23:05:46.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.423+0000 7f3da92d1640 1 -- 172.21.15.12:0/273725822 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3da40a71f0 con 0x7f3da409f6e0 2024-09-11T23:05:46.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.423+0000 7f3d9b7fe640 1 -- 172.21.15.12:0/273725822 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d9c0b2040 con 0x7f3da409f6e0 2024-09-11T23:05:46.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.423+0000 7f3da92d1640 1 -- 172.21.15.12:0/273725822 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3da409c5a0 con 0x7f3da409f6e0 2024-09-11T23:05:46.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.423+0000 7f3d9b7fe640 1 -- 172.21.15.12:0/273725822 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 44053+0+0 (secure 0 0 0) 0x7f3d9c0c0020 con 0x7f3da409f6e0 2024-09-11T23:05:46.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.423+0000 7f3da92d1640 1 -- 172.21.15.12:0/273725822 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3da40725c0 con 0x7f3da409f6e0 2024-09-11T23:05:46.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.423+0000 7f3d9b7fe640 1 --2- 172.21.15.12:0/273725822 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f3d84035db0 0x7f3d84038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:46.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.423+0000 7f3d9b7fe640 1 -- 172.21.15.12:0/273725822 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 3447+0+0 (secure 0 0 0) 0x7f3d9c0e37d0 con 0x7f3da409f6e0 2024-09-11T23:05:46.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.423+0000 7f3da27fc640 1 --2- 172.21.15.12:0/273725822 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f3d84035db0 0x7f3d84038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:46.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.423+0000 7f3da27fc640 1 --2- 172.21.15.12:0/273725822 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f3d84035db0 0x7f3d84038270 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c000f70 tx=0x7f3d8c007a90 comp rx=0 tx=0).ready entity=mgr.4708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:46.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.427+0000 7f3d9b7fe640 1 -- 172.21.15.12:0/273725822 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3d9c0c7030 con 0x7f3da409f6e0 2024-09-11T23:05:46.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.627+0000 7f3da92d1640 1 -- 172.21.15.12:0/273725822 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3da406bc60 con 0x7f3da409f6e0 2024-09-11T23:05:46.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.627+0000 7f3d9b7fe640 1 -- 172.21.15.12:0/273725822 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+2261 (secure 0 0 0) 0x7f3d9c016560 con 0x7f3da409f6e0 2024-09-11T23:05:46.631 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:05:46.631 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":34,"btime":"2024-09-11T23:05:40:742864+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4737,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6829/3926932517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3926932517},{"type":"v1","addr":"172.21.15.12:6829","nonce":3926932517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":4777,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6827/1555580411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":1555580411},{"type":"v1","addr":"172.21.15.12:6827","nonce":1555580411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[]} 2024-09-11T23:05:46.631 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 34 2024-09-11T23:05:46.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.631+0000 7f3da92d1640 1 -- 172.21.15.12:0/273725822 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f3d84035db0 msgr2=0x7f3d84038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:46.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.631+0000 7f3da92d1640 1 --2- 172.21.15.12:0/273725822 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f3d84035db0 0x7f3d84038270 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c000f70 tx=0x7f3d8c007a90 comp rx=0 tx=0).stop 2024-09-11T23:05:46.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.631+0000 7f3da92d1640 1 -- 172.21.15.12:0/273725822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3da409f6e0 msgr2=0x7f3da41d2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:46.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.631+0000 7f3da92d1640 1 --2- 172.21.15.12:0/273725822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3da409f6e0 0x7f3da41d2090 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c01a5a0 tx=0x7f3d9c019710 comp rx=0 tx=0).stop 2024-09-11T23:05:46.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.631+0000 7f3da92d1640 1 -- 172.21.15.12:0/273725822 shutdown_connections 2024-09-11T23:05:46.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.631+0000 7f3da92d1640 1 --2- 172.21.15.12:0/273725822 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f3d84035db0 0x7f3d84038270 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:46.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.631+0000 7f3da92d1640 1 --2- 172.21.15.12:0/273725822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3da409f6e0 0x7f3da41d2090 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:46.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.631+0000 7f3da92d1640 1 -- 172.21.15.12:0/273725822 >> 172.21.15.12:0/273725822 conn(0x7f3da40a8450 msgr2=0x7f3da4134b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:46.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.631+0000 7f3da92d1640 1 -- 172.21.15.12:0/273725822 shutdown_connections 2024-09-11T23:05:46.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.631+0000 7f3da92d1640 1 -- 172.21.15.12:0/273725822 wait complete. 2024-09-11T23:05:46.651 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-11T23:05:46.651 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-11T23:05:46.651 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-11T23:05:46.651 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:05:46.651 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-11T23:05:46.651 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-11T23:05:46.652 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-11T23:05:46.652 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:05:46.668 INFO:tasks.ceph.mds.a:Stopped 2024-09-11T23:05:46.668 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-11T23:05:46.669 INFO:tasks.ceph.mds.b:Stopped 2024-09-11T23:05:46.669 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-11T23:05:46.714 INFO:tasks.ceph.mds.a:Started 2024-09-11T23:05:46.714 DEBUG:teuthology.parallel:result is None 2024-09-11T23:05:46.714 INFO:tasks.ceph.mds.b:Started 2024-09-11T23:05:46.715 DEBUG:teuthology.parallel:result is None 2024-09-11T23:05:46.715 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-11T23:05:46.785 INFO:tasks.ceph.mds.b.smithi012.stdout:starting mds.b at 2024-09-11T23:05:46.786 INFO:tasks.ceph.mds.a.smithi012.stdout:starting mds.a at 2024-09-11T23:05:46.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.839+0000 7f1381116640 1 Processor -- start 2024-09-11T23:05:46.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.839+0000 7f1381116640 1 -- start start 2024-09-11T23:05:46.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.839+0000 7f1381116640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f137c09fc40 0x7f137c13ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:46.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.839+0000 7f1381116640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f137c0a1c00 con 0x7f137c13a200 2024-09-11T23:05:46.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.839+0000 7f1381116640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f137c0a0e40 con 0x7f137c09fc40 2024-09-11T23:05:46.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.839+0000 7f137a59c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f137c09fc40 0x7f137c13ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:46.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.839+0000 7f137ad9d640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f137c13a200 0x7f137c13a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55616/0 (socket says 172.21.15.12:55616) 2024-09-11T23:05:46.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.839+0000 7f137ad9d640 1 -- 172.21.15.12:0/3198218858 learned_addr learned my addr 172.21.15.12:0/3198218858 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:46.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.839+0000 7f137a59c640 1 -- 172.21.15.12:0/3198218858 >> v1:172.21.15.12:6789/0 conn(0x7f137c13a200 legacy=0x7f137c13a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:46.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.839+0000 7f137a59c640 1 -- 172.21.15.12:0/3198218858 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f137c09f350 con 0x7f137c09fc40 2024-09-11T23:05:46.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.839+0000 7f137a59c640 1 --2- 172.21.15.12:0/3198218858 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f137c09fc40 0x7f137c13ef80 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f1370009740 tx=0x7f137001c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c07267782c105ea server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:46.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.839+0000 7f1379d9b640 1 -- 172.21.15.12:0/3198218858 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13700b0070 con 0x7f137c09fc40 2024-09-11T23:05:46.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.839+0000 7f1379d9b640 1 -- 172.21.15.12:0/3198218858 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13700ab530 con 0x7f137c09fc40 2024-09-11T23:05:46.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.839+0000 7f1379d9b640 1 -- 172.21.15.12:0/3198218858 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13700ab830 con 0x7f137c09fc40 2024-09-11T23:05:46.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.843+0000 7f1381116640 1 -- 172.21.15.12:0/3198218858 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f137c09fc40 msgr2=0x7f137c13ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:46.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.843+0000 7f1381116640 1 --2- 172.21.15.12:0/3198218858 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f137c09fc40 0x7f137c13ef80 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f1370009740 tx=0x7f137001c390 comp rx=0 tx=0).stop 2024-09-11T23:05:46.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.843+0000 7f1381116640 1 -- 172.21.15.12:0/3198218858 shutdown_connections 2024-09-11T23:05:46.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.843+0000 7f1381116640 1 --2- 172.21.15.12:0/3198218858 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f137c09fc40 0x7f137c13ef80 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:46.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.843+0000 7f1381116640 1 -- 172.21.15.12:0/3198218858 >> 172.21.15.12:0/3198218858 conn(0x7f137c06da30 msgr2=0x7f137c06de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:46.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.843+0000 7f1381116640 1 -- 172.21.15.12:0/3198218858 shutdown_connections 2024-09-11T23:05:46.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.843+0000 7f1381116640 1 -- 172.21.15.12:0/3198218858 wait complete. 2024-09-11T23:05:46.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.843+0000 7f1381116640 1 Processor -- start 2024-09-11T23:05:46.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.843+0000 7f1381116640 1 -- start start 2024-09-11T23:05:46.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.843+0000 7f1381116640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f137c13a200 0x7f137c0aafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:46.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.843+0000 7f1381116640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f137c141ce0 con 0x7f137c13a200 2024-09-11T23:05:46.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.843+0000 7f137ad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f137c13a200 0x7f137c0aafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:46.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.843+0000 7f137ad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f137c13a200 0x7f137c0aafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43052/0 (socket says 172.21.15.12:43052) 2024-09-11T23:05:46.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.843+0000 7f137ad9d640 1 -- 172.21.15.12:0/773274433 learned_addr learned my addr 172.21.15.12:0/773274433 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:46.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.843+0000 7f137ad9d640 1 -- 172.21.15.12:0/773274433 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f137c0aa560 con 0x7f137c13a200 2024-09-11T23:05:46.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.843+0000 7f137ad9d640 1 --2- 172.21.15.12:0/773274433 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f137c13a200 0x7f137c0aafa0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f136c00c480 tx=0x7f136c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:46.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.843+0000 7f13637fe640 1 -- 172.21.15.12:0/773274433 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f136c017070 con 0x7f137c13a200 2024-09-11T23:05:46.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.843+0000 7f13637fe640 1 -- 172.21.15.12:0/773274433 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f136c005c20 con 0x7f137c13a200 2024-09-11T23:05:46.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.843+0000 7f1381116640 1 -- 172.21.15.12:0/773274433 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f137c0abd10 con 0x7f137c13a200 2024-09-11T23:05:46.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.843+0000 7f13637fe640 1 -- 172.21.15.12:0/773274433 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f136c007070 con 0x7f137c13a200 2024-09-11T23:05:46.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.843+0000 7f1381116640 1 -- 172.21.15.12:0/773274433 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f137c0abfc0 con 0x7f137c13a200 2024-09-11T23:05:46.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.843+0000 7f1381116640 1 -- 172.21.15.12:0/773274433 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f137c13a660 con 0x7f137c13a200 2024-09-11T23:05:46.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.843+0000 7f13637fe640 1 -- 172.21.15.12:0/773274433 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 44053+0+0 (secure 0 0 0) 0x7f136c01a070 con 0x7f137c13a200 2024-09-11T23:05:46.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.843+0000 7f13637fe640 1 --2- 172.21.15.12:0/773274433 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f1368035db0 0x7f1368038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:46.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.847+0000 7f13637fe640 1 -- 172.21.15.12:0/773274433 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 3447+0+0 (secure 0 0 0) 0x7f136c047940 con 0x7f137c13a200 2024-09-11T23:05:46.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.847+0000 7f137a59c640 1 --2- 172.21.15.12:0/773274433 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f1368035db0 0x7f1368038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:46.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.847+0000 7f137a59c640 1 --2- 172.21.15.12:0/773274433 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f1368035db0 0x7f1368038270 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f13700ad000 tx=0x7f1370008040 comp rx=0 tx=0).ready entity=mgr.4708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:46.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:46.851+0000 7f13637fe640 1 -- 172.21.15.12:0/773274433 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f136c007210 con 0x7f137c13a200 2024-09-11T23:05:47.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:47.031+0000 7f1381116640 1 -- 172.21.15.12:0/773274433 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f137c073580 con 0x7f137c13a200 2024-09-11T23:05:48.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.099+0000 7f13637fe640 1 -- 172.21.15.12:0/773274433 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v50) ==== 97+0+0 (secure 0 0 0) 0x7f136c012450 con 0x7f137c13a200 2024-09-11T23:05:48.104 INFO:teuthology.orchestra.run.smithi012.stderr: removed all blocklist entries 2024-09-11T23:05:48.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.103+0000 7f1381116640 1 -- 172.21.15.12:0/773274433 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f1368035db0 msgr2=0x7f1368038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:48.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.103+0000 7f1381116640 1 --2- 172.21.15.12:0/773274433 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f1368035db0 0x7f1368038270 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f13700ad000 tx=0x7f1370008040 comp rx=0 tx=0).stop 2024-09-11T23:05:48.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.103+0000 7f1381116640 1 -- 172.21.15.12:0/773274433 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f137c13a200 msgr2=0x7f137c0aafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:48.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.103+0000 7f1381116640 1 --2- 172.21.15.12:0/773274433 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f137c13a200 0x7f137c0aafa0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f136c00c480 tx=0x7f136c00c940 comp rx=0 tx=0).stop 2024-09-11T23:05:48.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.103+0000 7f1381116640 1 -- 172.21.15.12:0/773274433 shutdown_connections 2024-09-11T23:05:48.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.103+0000 7f1381116640 1 --2- 172.21.15.12:0/773274433 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f1368035db0 0x7f1368038270 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:48.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.103+0000 7f1381116640 1 --2- 172.21.15.12:0/773274433 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f137c13a200 0x7f137c0aafa0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:48.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.103+0000 7f1381116640 1 -- 172.21.15.12:0/773274433 >> 172.21.15.12:0/773274433 conn(0x7f137c06da30 msgr2=0x7f137c09ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:48.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.103+0000 7f1381116640 1 -- 172.21.15.12:0/773274433 shutdown_connections 2024-09-11T23:05:48.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.103+0000 7f1381116640 1 -- 172.21.15.12:0/773274433 wait complete. 2024-09-11T23:05:48.130 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-11T23:05:48.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.255+0000 7f6c23885640 1 Processor -- start 2024-09-11T23:05:48.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.255+0000 7f6c23885640 1 -- start start 2024-09-11T23:05:48.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.255+0000 7f6c23885640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6c1c137e60 0x7f6c1c138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:48.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.255+0000 7f6c23885640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c1c09e930 con 0x7f6c1c09f6e0 2024-09-11T23:05:48.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.255+0000 7f6c23885640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f6c1c1379e0 con 0x7f6c1c137e60 2024-09-11T23:05:48.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.255+0000 7f6c21621640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6c1c137e60 0x7f6c1c138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:48.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.255+0000 7f6c20e20640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f6c1c09f6e0 0x7f6c1c0a36a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55618/0 (socket says 172.21.15.12:55618) 2024-09-11T23:05:48.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.255+0000 7f6c20e20640 1 -- 172.21.15.12:0/1888257425 learned_addr learned my addr 172.21.15.12:0/1888257425 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:48.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.255+0000 7f6c21621640 1 -- 172.21.15.12:0/1888257425 >> v1:172.21.15.12:6789/0 conn(0x7f6c1c09f6e0 legacy=0x7f6c1c0a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:48.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.255+0000 7f6c21621640 1 -- 172.21.15.12:0/1888257425 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c1c09d910 con 0x7f6c1c137e60 2024-09-11T23:05:48.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.259+0000 7f6c21621640 1 --2- 172.21.15.12:0/1888257425 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c1c137e60 0x7f6c1c138240 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f6c18009740 tx=0x7f6c1801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=127df69acd9aee6d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:48.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.259+0000 7f6c0ffff640 1 -- 172.21.15.12:0/1888257425 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c180ab570 con 0x7f6c1c137e60 2024-09-11T23:05:48.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.259+0000 7f6c0ffff640 1 -- 172.21.15.12:0/1888257425 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c180b0070 con 0x7f6c1c137e60 2024-09-11T23:05:48.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.259+0000 7f6c0ffff640 1 -- 172.21.15.12:0/1888257425 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c180ab860 con 0x7f6c1c137e60 2024-09-11T23:05:48.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.259+0000 7f6c23885640 1 -- 172.21.15.12:0/1888257425 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c1c137e60 msgr2=0x7f6c1c138240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:48.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.259+0000 7f6c23885640 1 --2- 172.21.15.12:0/1888257425 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c1c137e60 0x7f6c1c138240 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f6c18009740 tx=0x7f6c1801c420 comp rx=0 tx=0).stop 2024-09-11T23:05:48.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.259+0000 7f6c23885640 1 -- 172.21.15.12:0/1888257425 shutdown_connections 2024-09-11T23:05:48.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.259+0000 7f6c23885640 1 --2- 172.21.15.12:0/1888257425 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c1c137e60 0x7f6c1c138240 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:48.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.259+0000 7f6c23885640 1 -- 172.21.15.12:0/1888257425 >> 172.21.15.12:0/1888257425 conn(0x7f6c1c0a8450 msgr2=0x7f6c1c0a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:48.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.259+0000 7f6c23885640 1 -- 172.21.15.12:0/1888257425 shutdown_connections 2024-09-11T23:05:48.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.259+0000 7f6c23885640 1 -- 172.21.15.12:0/1888257425 wait complete. 2024-09-11T23:05:48.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.259+0000 7f6c23885640 1 Processor -- start 2024-09-11T23:05:48.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.259+0000 7f6c23885640 1 -- start start 2024-09-11T23:05:48.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.259+0000 7f6c23885640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c1c09f6e0 0x7f6c1c1cf920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:48.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.259+0000 7f6c23885640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1c13fe00 con 0x7f6c1c09f6e0 2024-09-11T23:05:48.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.259+0000 7f6c21621640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c1c09f6e0 0x7f6c1c1cf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:48.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.259+0000 7f6c21621640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c1c09f6e0 0x7f6c1c1cf920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43072/0 (socket says 172.21.15.12:43072) 2024-09-11T23:05:48.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.259+0000 7f6c21621640 1 -- 172.21.15.12:0/238146617 learned_addr learned my addr 172.21.15.12:0/238146617 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:48.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.259+0000 7f6c21621640 1 -- 172.21.15.12:0/238146617 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c1c1389f0 con 0x7f6c1c09f6e0 2024-09-11T23:05:48.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.263+0000 7f6c21621640 1 --2- 172.21.15.12:0/238146617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c1c09f6e0 0x7f6c1c1cf920 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f6c18019030 tx=0x7f6c1801ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:48.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.263+0000 7f6c0dffb640 1 -- 172.21.15.12:0/238146617 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c180bf410 con 0x7f6c1c09f6e0 2024-09-11T23:05:48.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.263+0000 7f6c0dffb640 1 -- 172.21.15.12:0/238146617 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c180bf5d0 con 0x7f6c1c09f6e0 2024-09-11T23:05:48.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.263+0000 7f6c23885640 1 -- 172.21.15.12:0/238146617 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c1c138c30 con 0x7f6c1c09f6e0 2024-09-11T23:05:48.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.263+0000 7f6c0dffb640 1 -- 172.21.15.12:0/238146617 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c180bf8f0 con 0x7f6c1c09f6e0 2024-09-11T23:05:48.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.263+0000 7f6c23885640 1 -- 172.21.15.12:0/238146617 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c1c13a520 con 0x7f6c1c09f6e0 2024-09-11T23:05:48.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.263+0000 7f6c23885640 1 -- 172.21.15.12:0/238146617 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c1c0008e0 con 0x7f6c1c09f6e0 2024-09-11T23:05:48.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.263+0000 7f6c0dffb640 1 -- 172.21.15.12:0/238146617 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 44053+0+0 (secure 0 0 0) 0x7f6c180bd020 con 0x7f6c1c09f6e0 2024-09-11T23:05:48.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.263+0000 7f6c0dffb640 1 --2- 172.21.15.12:0/238146617 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f6c00035db0 0x7f6c00038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:48.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.263+0000 7f6c0dffb640 1 -- 172.21.15.12:0/238146617 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 2587+0+0 (secure 0 0 0) 0x7f6c180e2a10 con 0x7f6c1c09f6e0 2024-09-11T23:05:48.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.263+0000 7f6c20e20640 1 --2- 172.21.15.12:0/238146617 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f6c00035db0 0x7f6c00038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:48.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.263+0000 7f6c20e20640 1 --2- 172.21.15.12:0/238146617 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f6c00035db0 0x7f6c00038270 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6c10001610 tx=0x7f6c10007ad0 comp rx=0 tx=0).ready entity=mgr.4708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:48.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.267+0000 7f6c0dffb640 1 -- 172.21.15.12:0/238146617 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6c18016010 con 0x7f6c1c09f6e0 2024-09-11T23:05:48.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.491+0000 7f6c23885640 1 -- 172.21.15.12:0/238146617 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f6c1c0726f0 con 0x7f6c1c09f6e0 2024-09-11T23:05:48.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.495+0000 7f6c0dffb640 1 -- 172.21.15.12:0/238146617 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v10) ==== 80+0+2534 (secure 0 0 0) 0x7f6c180b5df0 con 0x7f6c1c09f6e0 2024-09-11T23:05:48.497 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:05:48.497 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T23:05:48.497 INFO:teuthology.orchestra.run.smithi012.stdout: "auth_dump": [ 2024-09-11T23:05:48.497 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:05:48.497 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.a", 2024-09-11T23:05:48.498 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCgIeJmhYe5CRAAlzmzDPKc12SodkPehqtl6w==", 2024-09-11T23:05:48.498 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-11T23:05:48.498 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2024-09-11T23:05:48.498 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2024-09-11T23:05:48.498 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2024-09-11T23:05:48.498 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-09-11T23:05:48.498 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:05:48.498 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:05:48.498 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:05:48.498 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.b", 2024-09-11T23:05:48.499 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCgIeJmnvKREhAAp9c3Qvihpy4qTm50E9U26Q==", 2024-09-11T23:05:48.499 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-11T23:05:48.499 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2024-09-11T23:05:48.499 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2024-09-11T23:05:48.499 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2024-09-11T23:05:48.499 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-09-11T23:05:48.499 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:05:48.499 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:05:48.500 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:05:48.500 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.0", 2024-09-11T23:05:48.500 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCiIeJmy2qOLxAARUVUTFfFVrdRIhNhThjbTw==", 2024-09-11T23:05:48.500 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-11T23:05:48.500 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2024-09-11T23:05:48.500 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2024-09-11T23:05:48.500 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-09-11T23:05:48.500 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:05:48.500 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:05:48.500 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:05:48.500 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.1", 2024-09-11T23:05:48.500 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCmIeJmuc99HxAA0QxYJ1hvAsHb4uZPlh9GdA==", 2024-09-11T23:05:48.500 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-11T23:05:48.501 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2024-09-11T23:05:48.501 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2024-09-11T23:05:48.501 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-09-11T23:05:48.501 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:05:48.501 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:05:48.501 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:05:48.501 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.2", 2024-09-11T23:05:48.501 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCpIeJmBDhCMBAAipbJzeGy0AughJ+PfcX8ZA==", 2024-09-11T23:05:48.501 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-11T23:05:48.501 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2024-09-11T23:05:48.501 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2024-09-11T23:05:48.502 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-09-11T23:05:48.502 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:05:48.502 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:05:48.502 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:05:48.502 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.0", 2024-09-11T23:05:48.502 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCgIeJmTz6nGhAAveLcJxI+RD0GsD9nnR2S/w==", 2024-09-11T23:05:48.502 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-11T23:05:48.502 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2024-09-11T23:05:48.502 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow r", 2024-09-11T23:05:48.502 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-11T23:05:48.502 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:05:48.503 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:05:48.503 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:05:48.503 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.1", 2024-09-11T23:05:48.503 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCgIeJmkfu2HxAAKhML2j7GrGF1q/7cuNJtSA==", 2024-09-11T23:05:48.503 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-11T23:05:48.503 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2024-09-11T23:05:48.503 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow r", 2024-09-11T23:05:48.503 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow rw", 2024-09-11T23:05:48.503 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rwx" 2024-09-11T23:05:48.503 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:05:48.503 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:05:48.503 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:05:48.504 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.admin", 2024-09-11T23:05:48.504 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCfIeJml/f1MBAAdf0RuoLeBB0rcTxgaS2N3w==", 2024-09-11T23:05:48.504 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-11T23:05:48.504 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2024-09-11T23:05:48.504 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2024-09-11T23:05:48.504 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2024-09-11T23:05:48.504 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-09-11T23:05:48.504 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:05:48.504 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:05:48.504 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:05:48.504 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.x", 2024-09-11T23:05:48.504 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCgIeJmgNCCBBAAS9gR6zgZL5ZX8chT2/0RUw==", 2024-09-11T23:05:48.504 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-11T23:05:48.505 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2024-09-11T23:05:48.505 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2024-09-11T23:05:48.505 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-09-11T23:05:48.505 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:05:48.505 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:05:48.505 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T23:05:48.505 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T23:05:48.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.495+0000 7f6c23885640 1 -- 172.21.15.12:0/238146617 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f6c00035db0 msgr2=0x7f6c00038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:48.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.495+0000 7f6c23885640 1 --2- 172.21.15.12:0/238146617 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f6c00035db0 0x7f6c00038270 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6c10001610 tx=0x7f6c10007ad0 comp rx=0 tx=0).stop 2024-09-11T23:05:48.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.495+0000 7f6c23885640 1 -- 172.21.15.12:0/238146617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c1c09f6e0 msgr2=0x7f6c1c1cf920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:48.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.495+0000 7f6c23885640 1 --2- 172.21.15.12:0/238146617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c1c09f6e0 0x7f6c1c1cf920 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f6c18019030 tx=0x7f6c1801ac60 comp rx=0 tx=0).stop 2024-09-11T23:05:48.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.495+0000 7f6c23885640 1 -- 172.21.15.12:0/238146617 shutdown_connections 2024-09-11T23:05:48.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.495+0000 7f6c23885640 1 --2- 172.21.15.12:0/238146617 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f6c00035db0 0x7f6c00038270 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:48.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.495+0000 7f6c23885640 1 --2- 172.21.15.12:0/238146617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c1c09f6e0 0x7f6c1c1cf920 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:48.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.495+0000 7f6c23885640 1 -- 172.21.15.12:0/238146617 >> 172.21.15.12:0/238146617 conn(0x7f6c1c0a8450 msgr2=0x7f6c1c134b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:48.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.495+0000 7f6c23885640 1 -- 172.21.15.12:0/238146617 shutdown_connections 2024-09-11T23:05:48.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.495+0000 7f6c23885640 1 -- 172.21.15.12:0/238146617 wait complete. 2024-09-11T23:05:48.517 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-11T23:05:48.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.631+0000 7f090f926640 1 Processor -- start 2024-09-11T23:05:48.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.631+0000 7f090f926640 1 -- start start 2024-09-11T23:05:48.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.631+0000 7f090f926640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0908136ca0 0x7f090809ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:48.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.631+0000 7f090f926640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09080a1ff0 con 0x7f0908137080 2024-09-11T23:05:48.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.631+0000 7f090f926640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f09080a12e0 con 0x7f0908136ca0 2024-09-11T23:05:48.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.635+0000 7f090d6c2640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0908136ca0 0x7f090809ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:48.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.635+0000 7f090d6c2640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0908136ca0 0x7f090809ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43086/0 (socket says 172.21.15.12:43086) 2024-09-11T23:05:48.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.635+0000 7f090d6c2640 1 -- 172.21.15.12:0/3551069034 learned_addr learned my addr 172.21.15.12:0/3551069034 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:48.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.635+0000 7f090cec1640 1 --1- 172.21.15.12:0/3551069034 >> v1:172.21.15.12:6789/0 conn(0x7f0908137080 0x7f09080a36a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55624/0 (socket says 172.21.15.12:55624) 2024-09-11T23:05:48.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.635+0000 7f090d6c2640 1 -- 172.21.15.12:0/3551069034 >> v1:172.21.15.12:6789/0 conn(0x7f0908137080 legacy=0x7f09080a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:48.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.635+0000 7f090d6c2640 1 -- 172.21.15.12:0/3551069034 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09080a0eb0 con 0x7f0908136ca0 2024-09-11T23:05:48.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.635+0000 7f090d6c2640 1 --2- 172.21.15.12:0/3551069034 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0908136ca0 0x7f090809ad90 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f09040097f0 tx=0x7f090401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7731e8a8fe7fcd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:48.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.635+0000 7f08fffff640 1 -- 172.21.15.12:0/3551069034 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09040ab3f0 con 0x7f0908136ca0 2024-09-11T23:05:48.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.635+0000 7f08fffff640 1 -- 172.21.15.12:0/3551069034 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09040b0070 con 0x7f0908136ca0 2024-09-11T23:05:48.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.635+0000 7f08fffff640 1 -- 172.21.15.12:0/3551069034 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09040ab6e0 con 0x7f0908136ca0 2024-09-11T23:05:48.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.635+0000 7f090f926640 1 -- 172.21.15.12:0/3551069034 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0908136ca0 msgr2=0x7f090809ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:48.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.635+0000 7f090f926640 1 --2- 172.21.15.12:0/3551069034 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0908136ca0 0x7f090809ad90 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f09040097f0 tx=0x7f090401c4e0 comp rx=0 tx=0).stop 2024-09-11T23:05:48.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.635+0000 7f090f926640 1 -- 172.21.15.12:0/3551069034 shutdown_connections 2024-09-11T23:05:48.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.635+0000 7f090f926640 1 --2- 172.21.15.12:0/3551069034 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0908136ca0 0x7f090809ad90 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:48.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.635+0000 7f090f926640 1 -- 172.21.15.12:0/3551069034 >> 172.21.15.12:0/3551069034 conn(0x7f09080a8450 msgr2=0x7f09080a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:48.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.635+0000 7f090f926640 1 -- 172.21.15.12:0/3551069034 shutdown_connections 2024-09-11T23:05:48.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.635+0000 7f090f926640 1 -- 172.21.15.12:0/3551069034 wait complete. 2024-09-11T23:05:48.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.639+0000 7f090f926640 1 Processor -- start 2024-09-11T23:05:48.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.639+0000 7f090f926640 1 -- start start 2024-09-11T23:05:48.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.639+0000 7f090f926640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0908136ca0 0x7f090806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:48.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.639+0000 7f090f926640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f090813ed10 con 0x7f0908136ca0 2024-09-11T23:05:48.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.639+0000 7f090d6c2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0908136ca0 0x7f090806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:48.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.639+0000 7f090d6c2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0908136ca0 0x7f090806fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43088/0 (socket says 172.21.15.12:43088) 2024-09-11T23:05:48.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.639+0000 7f090d6c2640 1 -- 172.21.15.12:0/3280351776 learned_addr learned my addr 172.21.15.12:0/3280351776 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:48.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.639+0000 7f090d6c2640 1 -- 172.21.15.12:0/3280351776 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09080718c0 con 0x7f0908136ca0 2024-09-11T23:05:48.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.639+0000 7f090d6c2640 1 --2- 172.21.15.12:0/3280351776 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0908136ca0 0x7f090806fd50 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f090401a110 tx=0x7f090401ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:48.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.639+0000 7f08fdffb640 1 -- 172.21.15.12:0/3280351776 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09040abe40 con 0x7f0908136ca0 2024-09-11T23:05:48.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.639+0000 7f090f926640 1 -- 172.21.15.12:0/3280351776 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0908134150 con 0x7f0908136ca0 2024-09-11T23:05:48.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.639+0000 7f08fdffb640 1 -- 172.21.15.12:0/3280351776 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09040be3f0 con 0x7f0908136ca0 2024-09-11T23:05:48.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.639+0000 7f08fdffb640 1 -- 172.21.15.12:0/3280351776 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09040be6d0 con 0x7f0908136ca0 2024-09-11T23:05:48.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.639+0000 7f090f926640 1 -- 172.21.15.12:0/3280351776 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0908071ba0 con 0x7f0908136ca0 2024-09-11T23:05:48.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.639+0000 7f08fdffb640 1 -- 172.21.15.12:0/3280351776 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 44053+0+0 (secure 0 0 0) 0x7f09040c7440 con 0x7f0908136ca0 2024-09-11T23:05:48.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.639+0000 7f090f926640 1 -- 172.21.15.12:0/3280351776 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f090811e2e0 con 0x7f0908136ca0 2024-09-11T23:05:48.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.639+0000 7f08fdffb640 1 --2- 172.21.15.12:0/3280351776 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f08ec035d60 0x7f08ec038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:48.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.639+0000 7f08fdffb640 1 -- 172.21.15.12:0/3280351776 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 2587+0+0 (secure 0 0 0) 0x7f09040e29a0 con 0x7f0908136ca0 2024-09-11T23:05:48.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.639+0000 7f090cec1640 1 --2- 172.21.15.12:0/3280351776 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f08ec035d60 0x7f08ec038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:48.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.639+0000 7f090cec1640 1 --2- 172.21.15.12:0/3280351776 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f08ec035d60 0x7f08ec038220 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f08f8001600 tx=0x7f08f8007a50 comp rx=0 tx=0).ready entity=mgr.4708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:48.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.647+0000 7f08fdffb640 1 -- 172.21.15.12:0/3280351776 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f09040160d0 con 0x7f0908136ca0 2024-09-11T23:05:48.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.811+0000 7f090f926640 1 -- 172.21.15.12:0/3280351776 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f090809ad90 con 0x7f0908136ca0 2024-09-11T23:05:48.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.811+0000 7f08fdffb640 1 -- 172.21.15.12:0/3280351776 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v50) ==== 84+0+65 (secure 0 0 0) 0x7f09040b43f0 con 0x7f0908136ca0 2024-09-11T23:05:48.814 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:05:48.814 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2024-09-11T23:05:48.815 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:05:48.815 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 1, 2024-09-11T23:05:48.815 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": ".mgr" 2024-09-11T23:05:48.815 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:05:48.815 INFO:teuthology.orchestra.run.smithi012.stdout:] 2024-09-11T23:05:48.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.815+0000 7f090f926640 1 -- 172.21.15.12:0/3280351776 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f08ec035d60 msgr2=0x7f08ec038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:48.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.815+0000 7f090f926640 1 --2- 172.21.15.12:0/3280351776 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f08ec035d60 0x7f08ec038220 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f08f8001600 tx=0x7f08f8007a50 comp rx=0 tx=0).stop 2024-09-11T23:05:48.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.815+0000 7f090f926640 1 -- 172.21.15.12:0/3280351776 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0908136ca0 msgr2=0x7f090806fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:48.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.815+0000 7f090f926640 1 --2- 172.21.15.12:0/3280351776 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0908136ca0 0x7f090806fd50 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f090401a110 tx=0x7f090401ad20 comp rx=0 tx=0).stop 2024-09-11T23:05:48.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.815+0000 7f090f926640 1 -- 172.21.15.12:0/3280351776 shutdown_connections 2024-09-11T23:05:48.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.815+0000 7f090f926640 1 --2- 172.21.15.12:0/3280351776 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f08ec035d60 0x7f08ec038220 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:48.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.815+0000 7f090f926640 1 --2- 172.21.15.12:0/3280351776 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0908136ca0 0x7f090806fd50 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:48.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.815+0000 7f090f926640 1 -- 172.21.15.12:0/3280351776 >> 172.21.15.12:0/3280351776 conn(0x7f09080a8450 msgr2=0x7f09080a74b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:48.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.815+0000 7f090f926640 1 -- 172.21.15.12:0/3280351776 shutdown_connections 2024-09-11T23:05:48.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.815+0000 7f090f926640 1 -- 172.21.15.12:0/3280351776 wait complete. 2024-09-11T23:05:48.833 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T23:05:48.833 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T23:05:48.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.947+0000 7f4a13a69640 1 Processor -- start 2024-09-11T23:05:48.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.947+0000 7f4a13a69640 1 -- start start 2024-09-11T23:05:48.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.947+0000 7f4a13a69640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4a0c0a3c90 0x7f4a0c0a4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:48.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.947+0000 7f4a13a69640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a0c0a09c0 con 0x7f4a0c0a38b0 2024-09-11T23:05:48.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.947+0000 7f4a13a69640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f4a0c0a1330 con 0x7f4a0c0a3c90 2024-09-11T23:05:48.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.947+0000 7f4a11004640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4a0c0a3c90 0x7f4a0c0a4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:48.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.947+0000 7f4a11805640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f4a0c0a38b0 0x7f4a0c09ad90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55640/0 (socket says 172.21.15.12:55640) 2024-09-11T23:05:48.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.947+0000 7f4a11805640 1 -- 172.21.15.12:0/1727684497 learned_addr learned my addr 172.21.15.12:0/1727684497 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:48.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.947+0000 7f4a11004640 1 -- 172.21.15.12:0/1727684497 >> v1:172.21.15.12:6789/0 conn(0x7f4a0c0a38b0 legacy=0x7f4a0c09ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:48.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.947+0000 7f4a11004640 1 -- 172.21.15.12:0/1727684497 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a0c0a1ef0 con 0x7f4a0c0a3c90 2024-09-11T23:05:48.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.951+0000 7f4a11004640 1 --2- 172.21.15.12:0/1727684497 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a0c0a3c90 0x7f4a0c0a4100 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f49fc009740 tx=0x7f49fc01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd986dc6ee3ff3e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:48.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.951+0000 7f4a10803640 1 -- 172.21.15.12:0/1727684497 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49fc0b0070 con 0x7f4a0c0a3c90 2024-09-11T23:05:48.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.951+0000 7f4a10803640 1 -- 172.21.15.12:0/1727684497 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49fc0ab530 con 0x7f4a0c0a3c90 2024-09-11T23:05:48.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.951+0000 7f4a10803640 1 -- 172.21.15.12:0/1727684497 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49fc0ab830 con 0x7f4a0c0a3c90 2024-09-11T23:05:48.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.951+0000 7f4a13a69640 1 -- 172.21.15.12:0/1727684497 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a0c0a3c90 msgr2=0x7f4a0c0a4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:48.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.951+0000 7f4a13a69640 1 --2- 172.21.15.12:0/1727684497 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a0c0a3c90 0x7f4a0c0a4100 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f49fc009740 tx=0x7f49fc01c390 comp rx=0 tx=0).stop 2024-09-11T23:05:48.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.951+0000 7f4a13a69640 1 -- 172.21.15.12:0/1727684497 shutdown_connections 2024-09-11T23:05:48.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.951+0000 7f4a13a69640 1 --2- 172.21.15.12:0/1727684497 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a0c0a3c90 0x7f4a0c0a4100 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:48.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.951+0000 7f4a13a69640 1 -- 172.21.15.12:0/1727684497 >> 172.21.15.12:0/1727684497 conn(0x7f4a0c0a85b0 msgr2=0x7f4a0c0a49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:48.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.951+0000 7f4a13a69640 1 -- 172.21.15.12:0/1727684497 shutdown_connections 2024-09-11T23:05:48.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.951+0000 7f4a13a69640 1 -- 172.21.15.12:0/1727684497 wait complete. 2024-09-11T23:05:48.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.951+0000 7f4a13a69640 1 Processor -- start 2024-09-11T23:05:48.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.951+0000 7f4a13a69640 1 -- start start 2024-09-11T23:05:48.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.951+0000 7f4a13a69640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a0c0a38b0 0x7f4a0c072870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:48.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.951+0000 7f4a13a69640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0c13ea40 con 0x7f4a0c0a38b0 2024-09-11T23:05:48.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.951+0000 7f4a11805640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a0c0a38b0 0x7f4a0c072870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:48.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.951+0000 7f4a11805640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a0c0a38b0 0x7f4a0c072870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43108/0 (socket says 172.21.15.12:43108) 2024-09-11T23:05:48.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.951+0000 7f4a11805640 1 -- 172.21.15.12:0/3067840180 learned_addr learned my addr 172.21.15.12:0/3067840180 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:48.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.951+0000 7f4a11805640 1 -- 172.21.15.12:0/3067840180 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a0c134530 con 0x7f4a0c0a38b0 2024-09-11T23:05:48.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.951+0000 7f4a11805640 1 --2- 172.21.15.12:0/3067840180 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a0c0a38b0 0x7f4a0c072870 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f4a0800c2f0 tx=0x7f4a0800c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:48.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.955+0000 7f4a027fc640 1 -- 172.21.15.12:0/3067840180 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a08017070 con 0x7f4a0c0a38b0 2024-09-11T23:05:48.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.955+0000 7f4a027fc640 1 -- 172.21.15.12:0/3067840180 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a08005c20 con 0x7f4a0c0a38b0 2024-09-11T23:05:48.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.955+0000 7f4a13a69640 1 -- 172.21.15.12:0/3067840180 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a0c0716c0 con 0x7f4a0c0a38b0 2024-09-11T23:05:48.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.955+0000 7f4a027fc640 1 -- 172.21.15.12:0/3067840180 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a080070d0 con 0x7f4a0c0a38b0 2024-09-11T23:05:48.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.955+0000 7f4a13a69640 1 -- 172.21.15.12:0/3067840180 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a0c09d4c0 con 0x7f4a0c0a38b0 2024-09-11T23:05:48.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.955+0000 7f4a027fc640 1 -- 172.21.15.12:0/3067840180 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 44053+0+0 (secure 0 0 0) 0x7f4a0801a070 con 0x7f4a0c0a38b0 2024-09-11T23:05:48.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.955+0000 7f4a027fc640 1 --2- 172.21.15.12:0/3067840180 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f49f0035db0 0x7f49f0038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:48.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.955+0000 7f4a027fc640 1 -- 172.21.15.12:0/3067840180 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 2587+0+0 (secure 0 0 0) 0x7f4a08047570 con 0x7f4a0c0a38b0 2024-09-11T23:05:48.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.955+0000 7f4a13a69640 1 -- 172.21.15.12:0/3067840180 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a0c0a4100 con 0x7f4a0c0a38b0 2024-09-11T23:05:48.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.955+0000 7f4a11004640 1 --2- 172.21.15.12:0/3067840180 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f49f0035db0 0x7f49f0038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:48.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.955+0000 7f4a11004640 1 --2- 172.21.15.12:0/3067840180 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f49f0035db0 0x7f49f0038270 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f49fc0ad000 tx=0x7f49fc008040 comp rx=0 tx=0).ready entity=mgr.4708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:48.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:48.959+0000 7f4a027fc640 1 -- 172.21.15.12:0/3067840180 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4a08007270 con 0x7f4a0c0a38b0 2024-09-11T23:05:49.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:49.119+0000 7f4a13a69640 1 -- 172.21.15.12:0/3067840180 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f4a0c0008e0 con 0x7f4a0c0a38b0 2024-09-11T23:05:50.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.107+0000 7f4a027fc640 1 -- 172.21.15.12:0/3067840180 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v51) ==== 138+0+0 (secure 0 0 0) 0x7f4a08012400 con 0x7f4a0c0a38b0 2024-09-11T23:05:50.112 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' created 2024-09-11T23:05:50.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.111+0000 7f4a13a69640 1 -- 172.21.15.12:0/3067840180 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f49f0035db0 msgr2=0x7f49f0038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:50.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.111+0000 7f4a13a69640 1 --2- 172.21.15.12:0/3067840180 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f49f0035db0 0x7f49f0038270 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f49fc0ad000 tx=0x7f49fc008040 comp rx=0 tx=0).stop 2024-09-11T23:05:50.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.111+0000 7f4a13a69640 1 -- 172.21.15.12:0/3067840180 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a0c0a38b0 msgr2=0x7f4a0c072870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:50.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.111+0000 7f4a13a69640 1 --2- 172.21.15.12:0/3067840180 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a0c0a38b0 0x7f4a0c072870 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f4a0800c2f0 tx=0x7f4a0800c7b0 comp rx=0 tx=0).stop 2024-09-11T23:05:50.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.111+0000 7f4a13a69640 1 -- 172.21.15.12:0/3067840180 shutdown_connections 2024-09-11T23:05:50.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.111+0000 7f4a13a69640 1 --2- 172.21.15.12:0/3067840180 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f49f0035db0 0x7f49f0038270 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:50.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.111+0000 7f4a13a69640 1 --2- 172.21.15.12:0/3067840180 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a0c0a38b0 0x7f4a0c072870 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:50.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.111+0000 7f4a13a69640 1 -- 172.21.15.12:0/3067840180 >> 172.21.15.12:0/3067840180 conn(0x7f4a0c0a85b0 msgr2=0x7f4a0c1356b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:50.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.111+0000 7f4a13a69640 1 -- 172.21.15.12:0/3067840180 shutdown_connections 2024-09-11T23:05:50.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.111+0000 7f4a13a69640 1 -- 172.21.15.12:0/3067840180 wait complete. 2024-09-11T23:05:50.144 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T23:05:50.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.275+0000 7fd77c0c2640 1 Processor -- start 2024-09-11T23:05:50.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.275+0000 7fd77c0c2640 1 -- start start 2024-09-11T23:05:50.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.279+0000 7fd77c0c2640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd7740aacb0 0x7fd77409e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:50.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.279+0000 7fd77c0c2640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd77406e6a0 con 0x7fd77409dd10 2024-09-11T23:05:50.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.279+0000 7fd77c0c2640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fd77409f4e0 con 0x7fd7740aacb0 2024-09-11T23:05:50.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.279+0000 7fd779e5e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd7740aacb0 0x7fd77409e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:50.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.279+0000 7fd77965d640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd77409dd10 0x7fd77409e770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55646/0 (socket says 172.21.15.12:55646) 2024-09-11T23:05:50.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.279+0000 7fd77965d640 1 -- 172.21.15.12:0/1444238154 learned_addr learned my addr 172.21.15.12:0/1444238154 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:50.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.279+0000 7fd779e5e640 1 -- 172.21.15.12:0/1444238154 >> v1:172.21.15.12:6789/0 conn(0x7fd77409dd10 legacy=0x7fd77409e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:50.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.279+0000 7fd779e5e640 1 -- 172.21.15.12:0/1444238154 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd77406eb90 con 0x7fd7740aacb0 2024-09-11T23:05:50.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.279+0000 7fd779e5e640 1 --2- 172.21.15.12:0/1444238154 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7740aacb0 0x7fd77409e230 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fd770009740 tx=0x7fd77001c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e036747e2d5dde8b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:50.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.279+0000 7fd778e5c640 1 -- 172.21.15.12:0/1444238154 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7700b0070 con 0x7fd7740aacb0 2024-09-11T23:05:50.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.279+0000 7fd778e5c640 1 -- 172.21.15.12:0/1444238154 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7700ab530 con 0x7fd7740aacb0 2024-09-11T23:05:50.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.279+0000 7fd778e5c640 1 -- 172.21.15.12:0/1444238154 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7700ab830 con 0x7fd7740aacb0 2024-09-11T23:05:50.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.279+0000 7fd77c0c2640 1 -- 172.21.15.12:0/1444238154 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7740aacb0 msgr2=0x7fd77409e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:50.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.279+0000 7fd77c0c2640 1 --2- 172.21.15.12:0/1444238154 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7740aacb0 0x7fd77409e230 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fd770009740 tx=0x7fd77001c390 comp rx=0 tx=0).stop 2024-09-11T23:05:50.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.279+0000 7fd77c0c2640 1 -- 172.21.15.12:0/1444238154 shutdown_connections 2024-09-11T23:05:50.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.279+0000 7fd77c0c2640 1 --2- 172.21.15.12:0/1444238154 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7740aacb0 0x7fd77409e230 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:50.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.279+0000 7fd77c0c2640 1 -- 172.21.15.12:0/1444238154 >> 172.21.15.12:0/1444238154 conn(0x7fd7740719e0 msgr2=0x7fd77409a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:50.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.279+0000 7fd77c0c2640 1 -- 172.21.15.12:0/1444238154 shutdown_connections 2024-09-11T23:05:50.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.279+0000 7fd77c0c2640 1 -- 172.21.15.12:0/1444238154 wait complete. 2024-09-11T23:05:50.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.283+0000 7fd77c0c2640 1 Processor -- start 2024-09-11T23:05:50.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.283+0000 7fd77c0c2640 1 -- start start 2024-09-11T23:05:50.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.283+0000 7fd77c0c2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd77409dd10 0x7fd7741238f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:50.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.283+0000 7fd77c0c2640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd774142430 con 0x7fd77409dd10 2024-09-11T23:05:50.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.283+0000 7fd779e5e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd77409dd10 0x7fd7741238f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:50.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.283+0000 7fd779e5e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd77409dd10 0x7fd7741238f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43124/0 (socket says 172.21.15.12:43124) 2024-09-11T23:05:50.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.283+0000 7fd779e5e640 1 -- 172.21.15.12:0/2937481623 learned_addr learned my addr 172.21.15.12:0/2937481623 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:50.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.283+0000 7fd779e5e640 1 -- 172.21.15.12:0/2937481623 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd774123e30 con 0x7fd77409dd10 2024-09-11T23:05:50.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.283+0000 7fd779e5e640 1 --2- 172.21.15.12:0/2937481623 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd77409dd10 0x7fd7741238f0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fd770019fc0 tx=0x7fd77001abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:50.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.283+0000 7fd76a7fc640 1 -- 172.21.15.12:0/2937481623 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7700b0050 con 0x7fd77409dd10 2024-09-11T23:05:50.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.283+0000 7fd76a7fc640 1 -- 172.21.15.12:0/2937481623 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7700b1040 con 0x7fd77409dd10 2024-09-11T23:05:50.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.283+0000 7fd76a7fc640 1 -- 172.21.15.12:0/2937481623 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7700b5740 con 0x7fd77409dd10 2024-09-11T23:05:50.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.283+0000 7fd77c0c2640 1 -- 172.21.15.12:0/2937481623 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7740a99b0 con 0x7fd77409dd10 2024-09-11T23:05:50.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.283+0000 7fd77c0c2640 1 -- 172.21.15.12:0/2937481623 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7740a9c20 con 0x7fd77409dd10 2024-09-11T23:05:50.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.283+0000 7fd76a7fc640 1 -- 172.21.15.12:0/2937481623 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 44053+0+0 (secure 0 0 0) 0x7fd7700be030 con 0x7fd77409dd10 2024-09-11T23:05:50.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.283+0000 7fd76a7fc640 1 --2- 172.21.15.12:0/2937481623 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fd758035db0 0x7fd758038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:50.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.283+0000 7fd76a7fc640 1 -- 172.21.15.12:0/2937481623 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 2957+0+0 (secure 0 0 0) 0x7fd7700bc070 con 0x7fd77409dd10 2024-09-11T23:05:50.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.283+0000 7fd77965d640 1 --2- 172.21.15.12:0/2937481623 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fd758035db0 0x7fd758038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:50.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.283+0000 7fd77c0c2640 1 -- 172.21.15.12:0/2937481623 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd774121f20 con 0x7fd77409dd10 2024-09-11T23:05:50.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.283+0000 7fd77965d640 1 --2- 172.21.15.12:0/2937481623 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fd758035db0 0x7fd758038270 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd77409e160 tx=0x7fd764007ad0 comp rx=0 tx=0).ready entity=mgr.4708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:50.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.291+0000 7fd76a7fc640 1 -- 172.21.15.12:0/2937481623 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd7700c5020 con 0x7fd77409dd10 2024-09-11T23:05:50.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:50.455+0000 7fd77c0c2640 1 -- 172.21.15.12:0/2937481623 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fd77409e230 con 0x7fd77409dd10 2024-09-11T23:05:51.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.115+0000 7fd76a7fc640 1 -- 172.21.15.12:0/2937481623 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v52) ==== 170+0+0 (secure 0 0 0) 0x7fd774123e30 con 0x7fd77409dd10 2024-09-11T23:05:51.119 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' created 2024-09-11T23:05:51.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.119+0000 7fd77c0c2640 1 -- 172.21.15.12:0/2937481623 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fd758035db0 msgr2=0x7fd758038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:51.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.119+0000 7fd77c0c2640 1 --2- 172.21.15.12:0/2937481623 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fd758035db0 0x7fd758038270 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd77409e160 tx=0x7fd764007ad0 comp rx=0 tx=0).stop 2024-09-11T23:05:51.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.119+0000 7fd77c0c2640 1 -- 172.21.15.12:0/2937481623 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd77409dd10 msgr2=0x7fd7741238f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:51.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.119+0000 7fd77c0c2640 1 --2- 172.21.15.12:0/2937481623 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd77409dd10 0x7fd7741238f0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fd770019fc0 tx=0x7fd77001abd0 comp rx=0 tx=0).stop 2024-09-11T23:05:51.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.119+0000 7fd77c0c2640 1 -- 172.21.15.12:0/2937481623 shutdown_connections 2024-09-11T23:05:51.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.119+0000 7fd77c0c2640 1 --2- 172.21.15.12:0/2937481623 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fd758035db0 0x7fd758038270 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:51.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.119+0000 7fd77c0c2640 1 --2- 172.21.15.12:0/2937481623 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd77409dd10 0x7fd7741238f0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:51.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.119+0000 7fd77c0c2640 1 -- 172.21.15.12:0/2937481623 >> 172.21.15.12:0/2937481623 conn(0x7fd7740719e0 msgr2=0x7fd77409ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:51.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.119+0000 7fd77c0c2640 1 -- 172.21.15.12:0/2937481623 shutdown_connections 2024-09-11T23:05:51.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.119+0000 7fd77c0c2640 1 -- 172.21.15.12:0/2937481623 wait complete. 2024-09-11T23:05:51.153 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T23:05:51.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.279+0000 7fd102ded640 1 Processor -- start 2024-09-11T23:05:51.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.279+0000 7fd102ded640 1 -- start start 2024-09-11T23:05:51.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.279+0000 7fd102ded640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd0fc13a200 0x7fd0fc13a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:51.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.279+0000 7fd102ded640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0fc0a1c00 con 0x7fd0fc09fc40 2024-09-11T23:05:51.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.279+0000 7fd102ded640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fd0fc0a0e40 con 0x7fd0fc13a200 2024-09-11T23:05:51.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.279+0000 7fd100b89640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd0fc13a200 0x7fd0fc13a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:51.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.279+0000 7fd0fbfff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd0fc09fc40 0x7fd0fc09d9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55654/0 (socket says 172.21.15.12:55654) 2024-09-11T23:05:51.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.279+0000 7fd0fbfff640 1 -- 172.21.15.12:0/284155172 learned_addr learned my addr 172.21.15.12:0/284155172 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:51.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.279+0000 7fd100b89640 1 -- 172.21.15.12:0/284155172 >> v1:172.21.15.12:6789/0 conn(0x7fd0fc09fc40 legacy=0x7fd0fc09d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:51.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.279+0000 7fd0fb7fe640 1 -- 172.21.15.12:0/284155172 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3770242230 0 0) 0x7fd0fc0a1c00 con 0x7fd0fc09fc40 2024-09-11T23:05:51.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.279+0000 7fd100b89640 1 -- 172.21.15.12:0/284155172 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0fc13ab20 con 0x7fd0fc13a200 2024-09-11T23:05:51.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.283+0000 7fd100b89640 1 --2- 172.21.15.12:0/284155172 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0fc13a200 0x7fd0fc13a5e0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec009740 tx=0x7fd0ec01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91ba81eb90677199 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:51.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.283+0000 7fd0fb7fe640 1 -- 172.21.15.12:0/284155172 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0ec0b0070 con 0x7fd0fc13a200 2024-09-11T23:05:51.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.283+0000 7fd0fb7fe640 1 -- 172.21.15.12:0/284155172 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0ec0ab530 con 0x7fd0fc13a200 2024-09-11T23:05:51.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.283+0000 7fd0fb7fe640 1 -- 172.21.15.12:0/284155172 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0ec0ab830 con 0x7fd0fc13a200 2024-09-11T23:05:51.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.283+0000 7fd102ded640 1 -- 172.21.15.12:0/284155172 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0fc13a200 msgr2=0x7fd0fc13a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:51.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.283+0000 7fd102ded640 1 --2- 172.21.15.12:0/284155172 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0fc13a200 0x7fd0fc13a5e0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec009740 tx=0x7fd0ec01c390 comp rx=0 tx=0).stop 2024-09-11T23:05:51.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.283+0000 7fd102ded640 1 -- 172.21.15.12:0/284155172 shutdown_connections 2024-09-11T23:05:51.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.283+0000 7fd102ded640 1 --2- 172.21.15.12:0/284155172 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0fc13a200 0x7fd0fc13a5e0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:51.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.283+0000 7fd102ded640 1 -- 172.21.15.12:0/284155172 >> 172.21.15.12:0/284155172 conn(0x7fd0fc06da30 msgr2=0x7fd0fc06de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:51.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.283+0000 7fd102ded640 1 -- 172.21.15.12:0/284155172 shutdown_connections 2024-09-11T23:05:51.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.283+0000 7fd102ded640 1 -- 172.21.15.12:0/284155172 wait complete. 2024-09-11T23:05:51.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.283+0000 7fd102ded640 1 Processor -- start 2024-09-11T23:05:51.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.283+0000 7fd102ded640 1 -- start start 2024-09-11T23:05:51.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.287+0000 7fd102ded640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0fc13a200 0x7fd0fc0a31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:51.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.287+0000 7fd102ded640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd0fc0a17c0 con 0x7fd0fc13a200 2024-09-11T23:05:51.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.287+0000 7fd100b89640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0fc13a200 0x7fd0fc0a31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:51.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.287+0000 7fd100b89640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0fc13a200 0x7fd0fc0a31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43136/0 (socket says 172.21.15.12:43136) 2024-09-11T23:05:51.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.287+0000 7fd100b89640 1 -- 172.21.15.12:0/1969855207 learned_addr learned my addr 172.21.15.12:0/1969855207 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:51.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.287+0000 7fd100b89640 1 -- 172.21.15.12:0/1969855207 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0fc0a4b30 con 0x7fd0fc13a200 2024-09-11T23:05:51.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.287+0000 7fd100b89640 1 --2- 172.21.15.12:0/1969855207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0fc13a200 0x7fd0fc0a31b0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec019fc0 tx=0x7fd0ec01abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:51.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.287+0000 7fd0f97fa640 1 -- 172.21.15.12:0/1969855207 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0ec0bb070 con 0x7fd0fc13a200 2024-09-11T23:05:51.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.287+0000 7fd0f97fa640 1 -- 172.21.15.12:0/1969855207 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0ec0abe40 con 0x7fd0fc13a200 2024-09-11T23:05:51.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.287+0000 7fd102ded640 1 -- 172.21.15.12:0/1969855207 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0fc0a6de0 con 0x7fd0fc13a200 2024-09-11T23:05:51.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.287+0000 7fd0f97fa640 1 -- 172.21.15.12:0/1969855207 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0ec0b0040 con 0x7fd0fc13a200 2024-09-11T23:05:51.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.287+0000 7fd102ded640 1 -- 172.21.15.12:0/1969855207 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0fc0a4850 con 0x7fd0fc13a200 2024-09-11T23:05:51.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.287+0000 7fd0f97fa640 1 -- 172.21.15.12:0/1969855207 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 44053+0+0 (secure 0 0 0) 0x7fd0ec004150 con 0x7fd0fc13a200 2024-09-11T23:05:51.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.287+0000 7fd102ded640 1 -- 172.21.15.12:0/1969855207 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0fc0a0530 con 0x7fd0fc13a200 2024-09-11T23:05:51.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.287+0000 7fd0f97fa640 1 --2- 172.21.15.12:0/1969855207 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fd0e8035db0 0x7fd0e8038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:51.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.287+0000 7fd0f97fa640 1 -- 172.21.15.12:0/1969855207 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 3339+0+0 (secure 0 0 0) 0x7fd0ec0e2d70 con 0x7fd0fc13a200 2024-09-11T23:05:51.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.287+0000 7fd0fbfff640 1 --2- 172.21.15.12:0/1969855207 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fd0e8035db0 0x7fd0e8038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:51.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.287+0000 7fd0fbfff640 1 --2- 172.21.15.12:0/1969855207 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fd0e8035db0 0x7fd0e8038270 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd0f0007fd0 tx=0x7fd0f0007920 comp rx=0 tx=0).ready entity=mgr.4708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:51.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.291+0000 7fd0f97fa640 1 -- 172.21.15.12:0/1969855207 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd0ec016010 con 0x7fd0fc13a200 2024-09-11T23:05:51.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:51.491+0000 7fd102ded640 1 -- 172.21.15.12:0/1969855207 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fd0fc13a660 con 0x7fd0fc13a200 2024-09-11T23:05:52.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.119+0000 7fd0f97fa640 1 -- 172.21.15.12:0/1969855207 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v36) ==== 174+0+0 (secure 0 0 0) 0x7fd0ec0b7420 con 0x7fd0fc13a200 2024-09-11T23:05:52.121 INFO:teuthology.orchestra.run.smithi012.stderr:new fs with metadata pool 10 and data pool 11 2024-09-11T23:05:52.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.123+0000 7fd102ded640 1 -- 172.21.15.12:0/1969855207 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fd0e8035db0 msgr2=0x7fd0e8038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:52.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.123+0000 7fd102ded640 1 --2- 172.21.15.12:0/1969855207 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fd0e8035db0 0x7fd0e8038270 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd0f0007fd0 tx=0x7fd0f0007920 comp rx=0 tx=0).stop 2024-09-11T23:05:52.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.123+0000 7fd102ded640 1 -- 172.21.15.12:0/1969855207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0fc13a200 msgr2=0x7fd0fc0a31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:52.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.123+0000 7fd102ded640 1 --2- 172.21.15.12:0/1969855207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0fc13a200 0x7fd0fc0a31b0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec019fc0 tx=0x7fd0ec01abd0 comp rx=0 tx=0).stop 2024-09-11T23:05:52.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.123+0000 7fd102ded640 1 -- 172.21.15.12:0/1969855207 shutdown_connections 2024-09-11T23:05:52.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.123+0000 7fd102ded640 1 --2- 172.21.15.12:0/1969855207 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fd0e8035db0 0x7fd0e8038270 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:52.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.123+0000 7fd102ded640 1 --2- 172.21.15.12:0/1969855207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0fc13a200 0x7fd0fc0a31b0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:52.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.123+0000 7fd102ded640 1 -- 172.21.15.12:0/1969855207 >> 172.21.15.12:0/1969855207 conn(0x7fd0fc06da30 msgr2=0x7fd0fc09c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:52.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.127+0000 7fd102ded640 1 -- 172.21.15.12:0/1969855207 shutdown_connections 2024-09-11T23:05:52.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.139+0000 7fd102ded640 1 -- 172.21.15.12:0/1969855207 wait complete. 2024-09-11T23:05:52.186 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:05:52.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.299+0000 7f9f7d3cd640 1 Processor -- start 2024-09-11T23:05:52.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.299+0000 7f9f7d3cd640 1 -- start start 2024-09-11T23:05:52.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.303+0000 7f9f7d3cd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9f7809f6e0 0x7f9f7813cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:52.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.303+0000 7f9f7d3cd640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f7809e930 con 0x7f9f78137e60 2024-09-11T23:05:52.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.303+0000 7f9f7d3cd640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f9f781379e0 con 0x7f9f7809f6e0 2024-09-11T23:05:52.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.303+0000 7f9f767fc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9f7809f6e0 0x7f9f7813cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:52.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.303+0000 7f9f76ffd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f9f78137e60 0x7f9f78138240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55656/0 (socket says 172.21.15.12:55656) 2024-09-11T23:05:52.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.303+0000 7f9f76ffd640 1 -- 172.21.15.12:0/1372847687 learned_addr learned my addr 172.21.15.12:0/1372847687 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:52.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.303+0000 7f9f767fc640 1 -- 172.21.15.12:0/1372847687 >> v1:172.21.15.12:6789/0 conn(0x7f9f78137e60 legacy=0x7f9f78138240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:52.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.303+0000 7f9f75ffb640 1 -- 172.21.15.12:0/1372847687 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 714852108 0 0) 0x7f9f7809e930 con 0x7f9f78137e60 2024-09-11T23:05:52.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.303+0000 7f9f767fc640 1 -- 172.21.15.12:0/1372847687 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f7809d910 con 0x7f9f7809f6e0 2024-09-11T23:05:52.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.303+0000 7f9f767fc640 1 --2- 172.21.15.12:0/1372847687 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f7809f6e0 0x7f9f7813cc60 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f9f68009740 tx=0x7f9f6801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20c40029c4bded67 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:52.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.303+0000 7f9f75ffb640 1 -- 172.21.15.12:0/1372847687 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f680ab570 con 0x7f9f7809f6e0 2024-09-11T23:05:52.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.303+0000 7f9f75ffb640 1 -- 172.21.15.12:0/1372847687 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f680b0070 con 0x7f9f7809f6e0 2024-09-11T23:05:52.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.303+0000 7f9f75ffb640 1 -- 172.21.15.12:0/1372847687 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f680ab860 con 0x7f9f7809f6e0 2024-09-11T23:05:52.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.307+0000 7f9f7d3cd640 1 -- 172.21.15.12:0/1372847687 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f7809f6e0 msgr2=0x7f9f7813cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:52.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.307+0000 7f9f7d3cd640 1 --2- 172.21.15.12:0/1372847687 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f7809f6e0 0x7f9f7813cc60 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f9f68009740 tx=0x7f9f6801c420 comp rx=0 tx=0).stop 2024-09-11T23:05:52.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.307+0000 7f9f7d3cd640 1 -- 172.21.15.12:0/1372847687 shutdown_connections 2024-09-11T23:05:52.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.307+0000 7f9f7d3cd640 1 --2- 172.21.15.12:0/1372847687 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f7809f6e0 0x7f9f7813cc60 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:52.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.307+0000 7f9f7d3cd640 1 -- 172.21.15.12:0/1372847687 >> 172.21.15.12:0/1372847687 conn(0x7f9f780a8450 msgr2=0x7f9f780a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:52.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.307+0000 7f9f7d3cd640 1 -- 172.21.15.12:0/1372847687 shutdown_connections 2024-09-11T23:05:52.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.307+0000 7f9f7d3cd640 1 -- 172.21.15.12:0/1372847687 wait complete. 2024-09-11T23:05:52.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.307+0000 7f9f7d3cd640 1 Processor -- start 2024-09-11T23:05:52.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.307+0000 7f9f7d3cd640 1 -- start start 2024-09-11T23:05:52.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.307+0000 7f9f7d3cd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f7809f6e0 0x7f9f78072270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:52.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.307+0000 7f9f7d3cd640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9f7813fd50 con 0x7f9f7809f6e0 2024-09-11T23:05:52.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.307+0000 7f9f76ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f7809f6e0 0x7f9f78072270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:52.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.307+0000 7f9f76ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f7809f6e0 0x7f9f78072270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43152/0 (socket says 172.21.15.12:43152) 2024-09-11T23:05:52.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.307+0000 7f9f76ffd640 1 -- 172.21.15.12:0/605303960 learned_addr learned my addr 172.21.15.12:0/605303960 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:52.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.307+0000 7f9f76ffd640 1 -- 172.21.15.12:0/605303960 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f780710c0 con 0x7f9f7809f6e0 2024-09-11T23:05:52.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.307+0000 7f9f76ffd640 1 --2- 172.21.15.12:0/605303960 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f7809f6e0 0x7f9f78072270 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f9f6000cb80 tx=0x7f9f6000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:52.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.307+0000 7f9f6f7fe640 1 -- 172.21.15.12:0/605303960 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f6000ac90 con 0x7f9f7809f6e0 2024-09-11T23:05:52.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.307+0000 7f9f7d3cd640 1 -- 172.21.15.12:0/605303960 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f78071d80 con 0x7f9f7809f6e0 2024-09-11T23:05:52.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.307+0000 7f9f7d3cd640 1 -- 172.21.15.12:0/605303960 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f78071380 con 0x7f9f7809f6e0 2024-09-11T23:05:52.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.307+0000 7f9f6f7fe640 1 -- 172.21.15.12:0/605303960 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f6000ae30 con 0x7f9f7809f6e0 2024-09-11T23:05:52.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.307+0000 7f9f6f7fe640 1 -- 172.21.15.12:0/605303960 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f6001b530 con 0x7f9f7809f6e0 2024-09-11T23:05:52.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.307+0000 7f9f7d3cd640 1 -- 172.21.15.12:0/605303960 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f5c0052a0 con 0x7f9f7809f6e0 2024-09-11T23:05:52.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.307+0000 7f9f6f7fe640 1 -- 172.21.15.12:0/605303960 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 44053+0+0 (secure 0 0 0) 0x7f9f6001b6d0 con 0x7f9f7809f6e0 2024-09-11T23:05:52.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.311+0000 7f9f6f7fe640 1 --2- 172.21.15.12:0/605303960 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f9f58035d60 0x7f9f58038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:52.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.311+0000 7f9f6f7fe640 1 -- 172.21.15.12:0/605303960 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 3439+0+0 (secure 0 0 0) 0x7f9f60048d00 con 0x7f9f7809f6e0 2024-09-11T23:05:52.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.311+0000 7f9f767fc640 1 --2- 172.21.15.12:0/605303960 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f9f58035d60 0x7f9f58038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:52.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.311+0000 7f9f767fc640 1 --2- 172.21.15.12:0/605303960 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f9f58035d60 0x7f9f58038220 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9f680af000 tx=0x7f9f680a7000 comp rx=0 tx=0).ready entity=mgr.4708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:52.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.315+0000 7f9f6f7fe640 1 -- 172.21.15.12:0/605303960 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9f6004c030 con 0x7f9f7809f6e0 2024-09-11T23:05:52.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.479+0000 7f9f7d3cd640 1 -- 172.21.15.12:0/605303960 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9f5c005590 con 0x7f9f7809f6e0 2024-09-11T23:05:52.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.479+0000 7f9f6f7fe640 1 -- 172.21.15.12:0/605303960 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) ==== 74+0+10691 (secure 0 0 0) 0x7f9f6001b9c0 con 0x7f9f7809f6e0 2024-09-11T23:05:52.483 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:05:52.483 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":53,"fsid":"8be14356-3340-4500-91a2-4cbc6b511f65","created":"2024-09-11T23:03:10.620234+0000","modified":"2024-09-11T23:05:51.496491+0000","last_up_change":"2024-09-11T23:03:22.359028+0000","last_in_change":"2024-09-11T23:03:11.545817+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:03:23.587068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:05:49.161756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0299999713897705,"score_stable":1.0299999713897705,"optimal_score":1,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.0299999713897705,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-11T23:05:50.500965+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"153b72a1-40b1-400d-93ea-333e733f9bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6817","nonce":3680911937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6819","nonce":3680911937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6823","nonce":3680911937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6821","nonce":3680911937}]},"public_addr":"172.21.15.12:6817/3680911937","cluster_addr":"172.21.15.12:6819/3680911937","heartbeat_back_addr":"172.21.15.12:6823/3680911937","heartbeat_front_addr":"172.21.15.12:6821/3680911937","state":["exists","up"]},{"osd":1,"uuid":"94669e49-ee4f-4acf-9e25-e94374dda8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6801","nonce":236825163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6803","nonce":236825163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6807","nonce":236825163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6805","nonce":236825163}]},"public_addr":"172.21.15.12:6801/236825163","cluster_addr":"172.21.15.12:6803/236825163","heartbeat_back_addr":"172.21.15.12:6807/236825163","heartbeat_front_addr":"172.21.15.12:6805/236825163","state":["exists","up"]},{"osd":2,"uuid":"826dae4d-8888-4ec5-8f00-425b3be93814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6809","nonce":3263521655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6811","nonce":3263521655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6815","nonce":3263521655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6813","nonce":3263521655}]},"public_addr":"172.21.15.12:6809/3263521655","cluster_addr":"172.21.15.12:6811/3263521655","heartbeat_back_addr":"172.21.15.12:6815/3263521655","heartbeat_front_addr":"172.21.15.12:6813/3263521655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:19.398518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.761524+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.904997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:05:52.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.483+0000 7f9f7d3cd640 1 -- 172.21.15.12:0/605303960 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f9f58035d60 msgr2=0x7f9f58038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:52.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.483+0000 7f9f7d3cd640 1 --2- 172.21.15.12:0/605303960 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f9f58035d60 0x7f9f58038220 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9f680af000 tx=0x7f9f680a7000 comp rx=0 tx=0).stop 2024-09-11T23:05:52.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.483+0000 7f9f7d3cd640 1 -- 172.21.15.12:0/605303960 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f7809f6e0 msgr2=0x7f9f78072270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:52.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.483+0000 7f9f7d3cd640 1 --2- 172.21.15.12:0/605303960 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f7809f6e0 0x7f9f78072270 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f9f6000cb80 tx=0x7f9f6000a430 comp rx=0 tx=0).stop 2024-09-11T23:05:52.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.483+0000 7f9f7d3cd640 1 -- 172.21.15.12:0/605303960 shutdown_connections 2024-09-11T23:05:52.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.483+0000 7f9f7d3cd640 1 --2- 172.21.15.12:0/605303960 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f9f58035d60 0x7f9f58038220 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:52.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.483+0000 7f9f7d3cd640 1 --2- 172.21.15.12:0/605303960 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f7809f6e0 0x7f9f78072270 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:52.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.483+0000 7f9f7d3cd640 1 -- 172.21.15.12:0/605303960 >> 172.21.15.12:0/605303960 conn(0x7f9f780a8450 msgr2=0x7f9f780a14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:52.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.483+0000 7f9f7d3cd640 1 -- 172.21.15.12:0/605303960 shutdown_connections 2024-09-11T23:05:52.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.483+0000 7f9f7d3cd640 1 -- 172.21.15.12:0/605303960 wait complete. 2024-09-11T23:05:52.502 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:05:52.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.619+0000 7f8e887e7640 1 Processor -- start 2024-09-11T23:05:52.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.623+0000 7f8e887e7640 1 -- start start 2024-09-11T23:05:52.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.623+0000 7f8e887e7640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8e8009f3b0 0x7f8e8013ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:52.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.623+0000 7f8e887e7640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e8009f820 con 0x7f8e800a0380 2024-09-11T23:05:52.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.623+0000 7f8e887e7640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f8e8006e890 con 0x7f8e8009f3b0 2024-09-11T23:05:52.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.623+0000 7f8e86583640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f8e800a0380 0x7f8e800a0760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55660/0 (socket says 172.21.15.12:55660) 2024-09-11T23:05:52.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.623+0000 7f8e86583640 1 -- 172.21.15.12:0/1851184789 learned_addr learned my addr 172.21.15.12:0/1851184789 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:52.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.623+0000 7f8e85d82640 1 --2- 172.21.15.12:0/1851184789 >> v2:172.21.15.12:3300/0 conn(0x7f8e8009f3b0 0x7f8e8013ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:52.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.623+0000 7f8e85581640 1 -- 172.21.15.12:0/1851184789 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 962214079 0 0) 0x7f8e7c001120 con 0x7f8e800a0380 2024-09-11T23:05:52.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.623+0000 7f8e85581640 1 -- 172.21.15.12:0/1851184789 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e6c003530 con 0x7f8e800a0380 2024-09-11T23:05:52.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.623+0000 7f8e85d82640 1 -- 172.21.15.12:0/1851184789 >> v1:172.21.15.12:6789/0 conn(0x7f8e800a0380 legacy=0x7f8e800a0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:52.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.623+0000 7f8e85d82640 1 -- 172.21.15.12:0/1851184789 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e8006ed80 con 0x7f8e8009f3b0 2024-09-11T23:05:52.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.623+0000 7f8e85d82640 1 --2- 172.21.15.12:0/1851184789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e8009f3b0 0x7f8e8013ee90 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f8e70009720 tx=0x7f8e7001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc69b1414c453403 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:52.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.623+0000 7f8e85581640 1 -- 172.21.15.12:0/1851184789 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e700b0070 con 0x7f8e8009f3b0 2024-09-11T23:05:52.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.623+0000 7f8e85581640 1 -- 172.21.15.12:0/1851184789 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e700ab530 con 0x7f8e8009f3b0 2024-09-11T23:05:52.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.623+0000 7f8e85581640 1 -- 172.21.15.12:0/1851184789 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e700ab830 con 0x7f8e8009f3b0 2024-09-11T23:05:52.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.627+0000 7f8e887e7640 1 -- 172.21.15.12:0/1851184789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e8009f3b0 msgr2=0x7f8e8013ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:52.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.627+0000 7f8e887e7640 1 --2- 172.21.15.12:0/1851184789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e8009f3b0 0x7f8e8013ee90 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f8e70009720 tx=0x7f8e7001c370 comp rx=0 tx=0).stop 2024-09-11T23:05:52.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.627+0000 7f8e887e7640 1 -- 172.21.15.12:0/1851184789 shutdown_connections 2024-09-11T23:05:52.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.627+0000 7f8e887e7640 1 --2- 172.21.15.12:0/1851184789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e8009f3b0 0x7f8e8013ee90 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:52.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.627+0000 7f8e887e7640 1 -- 172.21.15.12:0/1851184789 >> 172.21.15.12:0/1851184789 conn(0x7f8e800aa2c0 msgr2=0x7f8e800aa6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:52.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.627+0000 7f8e887e7640 1 -- 172.21.15.12:0/1851184789 shutdown_connections 2024-09-11T23:05:52.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.627+0000 7f8e887e7640 1 -- 172.21.15.12:0/1851184789 wait complete. 2024-09-11T23:05:52.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.627+0000 7f8e887e7640 1 Processor -- start 2024-09-11T23:05:52.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.627+0000 7f8e887e7640 1 -- start start 2024-09-11T23:05:52.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.627+0000 7f8e887e7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e8009f3b0 0x7f8e801d1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:52.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.627+0000 7f8e887e7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8e80141f80 con 0x7f8e8009f3b0 2024-09-11T23:05:52.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.627+0000 7f8e86583640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e8009f3b0 0x7f8e801d1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:52.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.627+0000 7f8e86583640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e8009f3b0 0x7f8e801d1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43180/0 (socket says 172.21.15.12:43180) 2024-09-11T23:05:52.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.627+0000 7f8e86583640 1 -- 172.21.15.12:0/813544939 learned_addr learned my addr 172.21.15.12:0/813544939 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:52.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.627+0000 7f8e86583640 1 -- 172.21.15.12:0/813544939 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e8013e970 con 0x7f8e8009f3b0 2024-09-11T23:05:52.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.627+0000 7f8e86583640 1 --2- 172.21.15.12:0/813544939 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e8009f3b0 0x7f8e801d1ba0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c00c6b0 tx=0x7f8e7c00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:52.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.627+0000 7f8e76ffd640 1 -- 172.21.15.12:0/813544939 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e7c017070 con 0x7f8e8009f3b0 2024-09-11T23:05:52.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.627+0000 7f8e76ffd640 1 -- 172.21.15.12:0/813544939 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e7c0058c0 con 0x7f8e8009f3b0 2024-09-11T23:05:52.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.627+0000 7f8e887e7640 1 -- 172.21.15.12:0/813544939 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e8013d6f0 con 0x7f8e8009f3b0 2024-09-11T23:05:52.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.627+0000 7f8e76ffd640 1 -- 172.21.15.12:0/813544939 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e7c005be0 con 0x7f8e8009f3b0 2024-09-11T23:05:52.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.627+0000 7f8e887e7640 1 -- 172.21.15.12:0/813544939 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e8013db90 con 0x7f8e8009f3b0 2024-09-11T23:05:52.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.627+0000 7f8e76ffd640 1 -- 172.21.15.12:0/813544939 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 44053+0+0 (secure 0 0 0) 0x7f8e7c01a070 con 0x7f8e8009f3b0 2024-09-11T23:05:52.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.627+0000 7f8e887e7640 1 -- 172.21.15.12:0/813544939 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e801d19c0 con 0x7f8e8009f3b0 2024-09-11T23:05:52.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.627+0000 7f8e76ffd640 1 --2- 172.21.15.12:0/813544939 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f8e64035db0 0x7f8e64038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:52.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.627+0000 7f8e76ffd640 1 -- 172.21.15.12:0/813544939 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 3439+0+0 (secure 0 0 0) 0x7f8e7c047a00 con 0x7f8e8009f3b0 2024-09-11T23:05:52.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.627+0000 7f8e85d82640 1 --2- 172.21.15.12:0/813544939 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f8e64035db0 0x7f8e64038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:52.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.631+0000 7f8e85d82640 1 --2- 172.21.15.12:0/813544939 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f8e64035db0 0x7f8e64038270 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8e700ad000 tx=0x7f8e70008040 comp rx=0 tx=0).ready entity=mgr.4708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:52.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.635+0000 7f8e76ffd640 1 -- 172.21.15.12:0/813544939 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8e801d19c0 con 0x7f8e8009f3b0 2024-09-11T23:05:52.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.791+0000 7f8e887e7640 1 -- 172.21.15.12:0/813544939 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8e800739f0 con 0x7f8e8009f3b0 2024-09-11T23:05:52.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.791+0000 7f8e76ffd640 1 -- 172.21.15.12:0/813544939 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) ==== 74+0+10691 (secure 0 0 0) 0x7f8e8009f820 con 0x7f8e8009f3b0 2024-09-11T23:05:52.794 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:05:52.794 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":53,"fsid":"8be14356-3340-4500-91a2-4cbc6b511f65","created":"2024-09-11T23:03:10.620234+0000","modified":"2024-09-11T23:05:51.496491+0000","last_up_change":"2024-09-11T23:03:22.359028+0000","last_in_change":"2024-09-11T23:03:11.545817+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:03:23.587068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:05:49.161756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0299999713897705,"score_stable":1.0299999713897705,"optimal_score":1,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.0299999713897705,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-11T23:05:50.500965+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"153b72a1-40b1-400d-93ea-333e733f9bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6817","nonce":3680911937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6819","nonce":3680911937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6823","nonce":3680911937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6821","nonce":3680911937}]},"public_addr":"172.21.15.12:6817/3680911937","cluster_addr":"172.21.15.12:6819/3680911937","heartbeat_back_addr":"172.21.15.12:6823/3680911937","heartbeat_front_addr":"172.21.15.12:6821/3680911937","state":["exists","up"]},{"osd":1,"uuid":"94669e49-ee4f-4acf-9e25-e94374dda8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6801","nonce":236825163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6803","nonce":236825163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6807","nonce":236825163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6805","nonce":236825163}]},"public_addr":"172.21.15.12:6801/236825163","cluster_addr":"172.21.15.12:6803/236825163","heartbeat_back_addr":"172.21.15.12:6807/236825163","heartbeat_front_addr":"172.21.15.12:6805/236825163","state":["exists","up"]},{"osd":2,"uuid":"826dae4d-8888-4ec5-8f00-425b3be93814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6809","nonce":3263521655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6811","nonce":3263521655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6815","nonce":3263521655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6813","nonce":3263521655}]},"public_addr":"172.21.15.12:6809/3263521655","cluster_addr":"172.21.15.12:6811/3263521655","heartbeat_back_addr":"172.21.15.12:6815/3263521655","heartbeat_front_addr":"172.21.15.12:6813/3263521655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:19.398518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.761524+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.904997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:05:52.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.795+0000 7f8e887e7640 1 -- 172.21.15.12:0/813544939 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f8e64035db0 msgr2=0x7f8e64038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:52.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.795+0000 7f8e887e7640 1 --2- 172.21.15.12:0/813544939 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f8e64035db0 0x7f8e64038270 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8e700ad000 tx=0x7f8e70008040 comp rx=0 tx=0).stop 2024-09-11T23:05:52.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.795+0000 7f8e887e7640 1 -- 172.21.15.12:0/813544939 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e8009f3b0 msgr2=0x7f8e801d1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:52.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.795+0000 7f8e887e7640 1 --2- 172.21.15.12:0/813544939 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e8009f3b0 0x7f8e801d1ba0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c00c6b0 tx=0x7f8e7c00cb70 comp rx=0 tx=0).stop 2024-09-11T23:05:52.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.795+0000 7f8e887e7640 1 -- 172.21.15.12:0/813544939 shutdown_connections 2024-09-11T23:05:52.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.795+0000 7f8e887e7640 1 --2- 172.21.15.12:0/813544939 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f8e64035db0 0x7f8e64038270 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:52.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.795+0000 7f8e887e7640 1 --2- 172.21.15.12:0/813544939 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e8009f3b0 0x7f8e801d1ba0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:52.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.795+0000 7f8e887e7640 1 -- 172.21.15.12:0/813544939 >> 172.21.15.12:0/813544939 conn(0x7f8e800aa2c0 msgr2=0x7f8e800a9760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:52.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.795+0000 7f8e887e7640 1 -- 172.21.15.12:0/813544939 shutdown_connections 2024-09-11T23:05:52.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.795+0000 7f8e887e7640 1 -- 172.21.15.12:0/813544939 wait complete. 2024-09-11T23:05:52.813 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-11T23:05:52.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.931+0000 7f4a2c41b640 1 Processor -- start 2024-09-11T23:05:52.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.931+0000 7f4a2c41b640 1 -- start start 2024-09-11T23:05:52.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.935+0000 7f4a2c41b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4a24136da0 0x7f4a24137180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:52.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.935+0000 7f4a2c41b640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a240a1e90 con 0x7f4a2409ac20 2024-09-11T23:05:52.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.935+0000 7f4a2c41b640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f4a241376c0 con 0x7f4a24136da0 2024-09-11T23:05:52.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.935+0000 7f4a299b6640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f4a2409ac20 0x7f4a240a36a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55670/0 (socket says 172.21.15.12:55670) 2024-09-11T23:05:52.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.935+0000 7f4a2a1b7640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4a24136da0 0x7f4a24137180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:52.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.935+0000 7f4a299b6640 1 -- 172.21.15.12:0/3438025084 learned_addr learned my addr 172.21.15.12:0/3438025084 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:52.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.935+0000 7f4a291b5640 1 -- 172.21.15.12:0/3438025084 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 647661865 0 0) 0x7f4a240a1e90 con 0x7f4a2409ac20 2024-09-11T23:05:52.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.935+0000 7f4a291b5640 1 -- 172.21.15.12:0/3438025084 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a10003530 con 0x7f4a2409ac20 2024-09-11T23:05:52.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.935+0000 7f4a2a1b7640 1 -- 172.21.15.12:0/3438025084 >> v1:172.21.15.12:6789/0 conn(0x7f4a2409ac20 legacy=0x7f4a240a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:52.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.935+0000 7f4a2a1b7640 1 -- 172.21.15.12:0/3438025084 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a240a0650 con 0x7f4a24136da0 2024-09-11T23:05:52.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.935+0000 7f4a2a1b7640 1 --2- 172.21.15.12:0/3438025084 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a24136da0 0x7f4a24137180 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f4a20009740 tx=0x7f4a2001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eddb064a558bb727 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:52.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.935+0000 7f4a291b5640 1 -- 172.21.15.12:0/3438025084 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a200b0070 con 0x7f4a24136da0 2024-09-11T23:05:52.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.935+0000 7f4a291b5640 1 -- 172.21.15.12:0/3438025084 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a200ab530 con 0x7f4a24136da0 2024-09-11T23:05:52.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.935+0000 7f4a291b5640 1 -- 172.21.15.12:0/3438025084 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a200ab810 con 0x7f4a24136da0 2024-09-11T23:05:52.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.935+0000 7f4a2c41b640 1 -- 172.21.15.12:0/3438025084 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a24136da0 msgr2=0x7f4a24137180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:52.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.935+0000 7f4a2c41b640 1 --2- 172.21.15.12:0/3438025084 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a24136da0 0x7f4a24137180 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f4a20009740 tx=0x7f4a2001c420 comp rx=0 tx=0).stop 2024-09-11T23:05:52.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.939+0000 7f4a2c41b640 1 -- 172.21.15.12:0/3438025084 shutdown_connections 2024-09-11T23:05:52.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.939+0000 7f4a2c41b640 1 --2- 172.21.15.12:0/3438025084 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a24136da0 0x7f4a24137180 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:52.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.939+0000 7f4a2c41b640 1 -- 172.21.15.12:0/3438025084 >> 172.21.15.12:0/3438025084 conn(0x7f4a240a82f0 msgr2=0x7f4a240a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:52.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.939+0000 7f4a2c41b640 1 -- 172.21.15.12:0/3438025084 shutdown_connections 2024-09-11T23:05:52.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.939+0000 7f4a2c41b640 1 -- 172.21.15.12:0/3438025084 wait complete. 2024-09-11T23:05:52.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.939+0000 7f4a2c41b640 1 Processor -- start 2024-09-11T23:05:52.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.939+0000 7f4a2c41b640 1 -- start start 2024-09-11T23:05:52.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.939+0000 7f4a2c41b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a2409ac20 0x7f4a24071d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:52.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.939+0000 7f4a2c41b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4a2413ee20 con 0x7f4a2409ac20 2024-09-11T23:05:52.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.939+0000 7f4a2a1b7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a2409ac20 0x7f4a24071d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:52.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.939+0000 7f4a2a1b7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a2409ac20 0x7f4a24071d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43202/0 (socket says 172.21.15.12:43202) 2024-09-11T23:05:52.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.939+0000 7f4a2a1b7640 1 -- 172.21.15.12:0/2192986513 learned_addr learned my addr 172.21.15.12:0/2192986513 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:52.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.939+0000 7f4a2a1b7640 1 -- 172.21.15.12:0/2192986513 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a2409fbd0 con 0x7f4a2409ac20 2024-09-11T23:05:52.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.939+0000 7f4a2a1b7640 1 --2- 172.21.15.12:0/2192986513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a2409ac20 0x7f4a24071d80 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f4a200ae040 tx=0x7f4a200191c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:52.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.939+0000 7f4a1affd640 1 -- 172.21.15.12:0/2192986513 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a200b8020 con 0x7f4a2409ac20 2024-09-11T23:05:52.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.939+0000 7f4a1affd640 1 -- 172.21.15.12:0/2192986513 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a200abdb0 con 0x7f4a2409ac20 2024-09-11T23:05:52.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.939+0000 7f4a2c41b640 1 -- 172.21.15.12:0/2192986513 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a24120a00 con 0x7f4a2409ac20 2024-09-11T23:05:52.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.939+0000 7f4a1affd640 1 -- 172.21.15.12:0/2192986513 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a200b0040 con 0x7f4a2409ac20 2024-09-11T23:05:52.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.939+0000 7f4a2c41b640 1 -- 172.21.15.12:0/2192986513 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a2411e650 con 0x7f4a2409ac20 2024-09-11T23:05:52.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.939+0000 7f4a2c41b640 1 -- 172.21.15.12:0/2192986513 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a241210e0 con 0x7f4a2409ac20 2024-09-11T23:05:52.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.939+0000 7f4a1affd640 1 -- 172.21.15.12:0/2192986513 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 44053+0+0 (secure 0 0 0) 0x7f4a200bb020 con 0x7f4a2409ac20 2024-09-11T23:05:52.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.939+0000 7f4a1affd640 1 --2- 172.21.15.12:0/2192986513 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f4a08035db0 0x7f4a08038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:52.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.939+0000 7f4a1affd640 1 -- 172.21.15.12:0/2192986513 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 3439+0+0 (secure 0 0 0) 0x7f4a200e21e0 con 0x7f4a2409ac20 2024-09-11T23:05:52.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.939+0000 7f4a299b6640 1 --2- 172.21.15.12:0/2192986513 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f4a08035db0 0x7f4a08038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:52.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.943+0000 7f4a299b6640 1 --2- 172.21.15.12:0/2192986513 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f4a08035db0 0x7f4a08038270 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4a14007fd0 tx=0x7f4a14007980 comp rx=0 tx=0).ready entity=mgr.4708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:52.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:52.947+0000 7f4a1affd640 1 -- 172.21.15.12:0/2192986513 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4a200c2030 con 0x7f4a2409ac20 2024-09-11T23:05:53.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:53.143+0000 7f4a2c41b640 1 -- 172.21.15.12:0/2192986513 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f4a2406bc60 con 0x7f4a2409ac20 2024-09-11T23:05:54.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.139+0000 7f4a1affd640 1 -- 172.21.15.12:0/2192986513 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v39) ==== 118+0+0 (secure 0 0 0) 0x7f4a20016010 con 0x7f4a2409ac20 2024-09-11T23:05:54.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.143+0000 7f4a2c41b640 1 -- 172.21.15.12:0/2192986513 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f4a08035db0 msgr2=0x7f4a08038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:54.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.143+0000 7f4a2c41b640 1 --2- 172.21.15.12:0/2192986513 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f4a08035db0 0x7f4a08038270 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4a14007fd0 tx=0x7f4a14007980 comp rx=0 tx=0).stop 2024-09-11T23:05:54.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.143+0000 7f4a2c41b640 1 -- 172.21.15.12:0/2192986513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a2409ac20 msgr2=0x7f4a24071d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:54.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.143+0000 7f4a2c41b640 1 --2- 172.21.15.12:0/2192986513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a2409ac20 0x7f4a24071d80 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f4a200ae040 tx=0x7f4a200191c0 comp rx=0 tx=0).stop 2024-09-11T23:05:54.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.143+0000 7f4a2c41b640 1 -- 172.21.15.12:0/2192986513 shutdown_connections 2024-09-11T23:05:54.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.143+0000 7f4a2c41b640 1 --2- 172.21.15.12:0/2192986513 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f4a08035db0 0x7f4a08038270 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:54.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.143+0000 7f4a2c41b640 1 --2- 172.21.15.12:0/2192986513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a2409ac20 0x7f4a24071d80 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:54.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.143+0000 7f4a2c41b640 1 -- 172.21.15.12:0/2192986513 >> 172.21.15.12:0/2192986513 conn(0x7f4a240a82f0 msgr2=0x7f4a240a6720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:54.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.143+0000 7f4a2c41b640 1 -- 172.21.15.12:0/2192986513 shutdown_connections 2024-09-11T23:05:54.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.143+0000 7f4a2c41b640 1 -- 172.21.15.12:0/2192986513 wait complete. 2024-09-11T23:05:54.165 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-11T23:05:54.166 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-11T23:05:54.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.291+0000 7fce1d37f640 1 Processor -- start 2024-09-11T23:05:54.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.291+0000 7fce1d37f640 1 -- start start 2024-09-11T23:05:54.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.291+0000 7fce1d37f640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fce1809fc40 0x7fce1813ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:54.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.291+0000 7fce1d37f640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce180a1c00 con 0x7fce1813a200 2024-09-11T23:05:54.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.291+0000 7fce1d37f640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fce180a0e40 con 0x7fce1809fc40 2024-09-11T23:05:54.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.291+0000 7fce16ffd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fce1813a200 0x7fce1813a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:50006/0 (socket says 172.21.15.12:50006) 2024-09-11T23:05:54.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.291+0000 7fce16ffd640 1 -- 172.21.15.12:0/1826565203 learned_addr learned my addr 172.21.15.12:0/1826565203 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:54.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.291+0000 7fce167fc640 1 --2- 172.21.15.12:0/1826565203 >> v2:172.21.15.12:3300/0 conn(0x7fce1809fc40 0x7fce1813ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:54.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.291+0000 7fce15ffb640 1 -- 172.21.15.12:0/1826565203 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2580831994 0 0) 0x7fce180a1c00 con 0x7fce1813a200 2024-09-11T23:05:54.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.291+0000 7fce15ffb640 1 -- 172.21.15.12:0/1826565203 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce00003530 con 0x7fce1813a200 2024-09-11T23:05:54.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.291+0000 7fce167fc640 1 -- 172.21.15.12:0/1826565203 >> v1:172.21.15.12:6789/0 conn(0x7fce1813a200 legacy=0x7fce1813a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:54.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.291+0000 7fce167fc640 1 -- 172.21.15.12:0/1826565203 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce1809f350 con 0x7fce1809fc40 2024-09-11T23:05:54.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.295+0000 7fce167fc640 1 --2- 172.21.15.12:0/1826565203 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce1809fc40 0x7fce1813ef80 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fce0c009740 tx=0x7fce0c01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86a98f063135bf68 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:54.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.295+0000 7fce15ffb640 1 -- 172.21.15.12:0/1826565203 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce0c0b0070 con 0x7fce1809fc40 2024-09-11T23:05:54.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.295+0000 7fce15ffb640 1 -- 172.21.15.12:0/1826565203 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce0c0ab530 con 0x7fce1809fc40 2024-09-11T23:05:54.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.295+0000 7fce15ffb640 1 -- 172.21.15.12:0/1826565203 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce0c0ab810 con 0x7fce1809fc40 2024-09-11T23:05:54.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.295+0000 7fce1d37f640 1 -- 172.21.15.12:0/1826565203 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce1809fc40 msgr2=0x7fce1813ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:54.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.295+0000 7fce1d37f640 1 --2- 172.21.15.12:0/1826565203 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce1809fc40 0x7fce1813ef80 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fce0c009740 tx=0x7fce0c01c390 comp rx=0 tx=0).stop 2024-09-11T23:05:54.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.295+0000 7fce1d37f640 1 -- 172.21.15.12:0/1826565203 shutdown_connections 2024-09-11T23:05:54.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.295+0000 7fce1d37f640 1 --2- 172.21.15.12:0/1826565203 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce1809fc40 0x7fce1813ef80 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:54.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.295+0000 7fce1d37f640 1 -- 172.21.15.12:0/1826565203 >> 172.21.15.12:0/1826565203 conn(0x7fce1806da30 msgr2=0x7fce1806de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:54.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.295+0000 7fce1d37f640 1 -- 172.21.15.12:0/1826565203 shutdown_connections 2024-09-11T23:05:54.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.295+0000 7fce1d37f640 1 -- 172.21.15.12:0/1826565203 wait complete. 2024-09-11T23:05:54.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.295+0000 7fce1d37f640 1 Processor -- start 2024-09-11T23:05:54.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.295+0000 7fce1d37f640 1 -- start start 2024-09-11T23:05:54.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.295+0000 7fce1d37f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce1813a200 0x7fce180a31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:54.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.295+0000 7fce1d37f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fce18141ce0 con 0x7fce1813a200 2024-09-11T23:05:54.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.295+0000 7fce16ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce1813a200 0x7fce180a31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:54.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.295+0000 7fce16ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce1813a200 0x7fce180a31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48520/0 (socket says 172.21.15.12:48520) 2024-09-11T23:05:54.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.295+0000 7fce16ffd640 1 -- 172.21.15.12:0/352186262 learned_addr learned my addr 172.21.15.12:0/352186262 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:54.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.295+0000 7fce16ffd640 1 -- 172.21.15.12:0/352186262 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce180ac0f0 con 0x7fce1813a200 2024-09-11T23:05:54.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.295+0000 7fce16ffd640 1 --2- 172.21.15.12:0/352186262 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce1813a200 0x7fce180a31b0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fce0800c450 tx=0x7fce0800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:54.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.295+0000 7fcdff7fe640 1 -- 172.21.15.12:0/352186262 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce08017070 con 0x7fce1813a200 2024-09-11T23:05:54.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.295+0000 7fcdff7fe640 1 -- 172.21.15.12:0/352186262 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce08005c20 con 0x7fce1813a200 2024-09-11T23:05:54.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.295+0000 7fce1d37f640 1 -- 172.21.15.12:0/352186262 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce180a45d0 con 0x7fce1813a200 2024-09-11T23:05:54.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.295+0000 7fcdff7fe640 1 -- 172.21.15.12:0/352186262 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce08007070 con 0x7fce1813a200 2024-09-11T23:05:54.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.295+0000 7fce1d37f640 1 -- 172.21.15.12:0/352186262 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce180a6880 con 0x7fce1813a200 2024-09-11T23:05:54.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.299+0000 7fcdff7fe640 1 -- 172.21.15.12:0/352186262 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 44053+0+0 (secure 0 0 0) 0x7fce0801a070 con 0x7fce1813a200 2024-09-11T23:05:54.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.299+0000 7fce1d37f640 1 -- 172.21.15.12:0/352186262 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce1813a660 con 0x7fce1813a200 2024-09-11T23:05:54.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.299+0000 7fcdff7fe640 1 --2- 172.21.15.12:0/352186262 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fce04035de0 0x7fce040382a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:54.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.299+0000 7fcdff7fe640 1 -- 172.21.15.12:0/352186262 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 3439+0+0 (secure 0 0 0) 0x7fce080478f0 con 0x7fce1813a200 2024-09-11T23:05:54.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.299+0000 7fce167fc640 1 --2- 172.21.15.12:0/352186262 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fce04035de0 0x7fce040382a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:54.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.299+0000 7fce167fc640 1 --2- 172.21.15.12:0/352186262 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fce04035de0 0x7fce040382a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fce0c0ad000 tx=0x7fce0c008040 comp rx=0 tx=0).ready entity=mgr.4708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:54.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.303+0000 7fcdff7fe640 1 -- 172.21.15.12:0/352186262 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fce08012400 con 0x7fce1813a200 2024-09-11T23:05:54.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:54.499+0000 7fce1d37f640 1 -- 172.21.15.12:0/352186262 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fce180a7080 con 0x7fce1813a200 2024-09-11T23:05:54.696 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:05:55.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.143+0000 7fcdff7fe640 1 -- 172.21.15.12:0/352186262 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v40) ==== 122+0+0 (secure 0 0 0) 0x7fce0801ac10 con 0x7fce1813a200 2024-09-11T23:05:55.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.147+0000 7fce1d37f640 1 -- 172.21.15.12:0/352186262 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fce04035de0 msgr2=0x7fce040382a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:55.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.147+0000 7fce1d37f640 1 --2- 172.21.15.12:0/352186262 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fce04035de0 0x7fce040382a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fce0c0ad000 tx=0x7fce0c008040 comp rx=0 tx=0).stop 2024-09-11T23:05:55.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.147+0000 7fce1d37f640 1 -- 172.21.15.12:0/352186262 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce1813a200 msgr2=0x7fce180a31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:55.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.147+0000 7fce1d37f640 1 --2- 172.21.15.12:0/352186262 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce1813a200 0x7fce180a31b0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fce0800c450 tx=0x7fce0800c910 comp rx=0 tx=0).stop 2024-09-11T23:05:55.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.147+0000 7fce1d37f640 1 -- 172.21.15.12:0/352186262 shutdown_connections 2024-09-11T23:05:55.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.147+0000 7fce1d37f640 1 --2- 172.21.15.12:0/352186262 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fce04035de0 0x7fce040382a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:55.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.147+0000 7fce1d37f640 1 --2- 172.21.15.12:0/352186262 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce1813a200 0x7fce180a31b0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:55.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.147+0000 7fce1d37f640 1 -- 172.21.15.12:0/352186262 >> 172.21.15.12:0/352186262 conn(0x7fce1806da30 msgr2=0x7fce1809c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:55.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.147+0000 7fce1d37f640 1 -- 172.21.15.12:0/352186262 shutdown_connections 2024-09-11T23:05:55.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.151+0000 7fce1d37f640 1 -- 172.21.15.12:0/352186262 wait complete. 2024-09-11T23:05:55.176 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-11T23:05:55.176 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:05:55.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.303+0000 7f5cf138e640 1 Processor -- start 2024-09-11T23:05:55.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.303+0000 7f5cf138e640 1 -- start start 2024-09-11T23:05:55.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.303+0000 7f5cf138e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5cec09f6e0 0x7f5cec13cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:55.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.307+0000 7f5cf138e640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cec09e930 con 0x7f5cec137e60 2024-09-11T23:05:55.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.307+0000 7f5cf138e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f5cec1379e0 con 0x7f5cec09f6e0 2024-09-11T23:05:55.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.307+0000 7f5ceaffd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f5cec137e60 0x7f5cec138240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:50008/0 (socket says 172.21.15.12:50008) 2024-09-11T23:05:55.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.307+0000 7f5ceaffd640 1 -- 172.21.15.12:0/345371615 learned_addr learned my addr 172.21.15.12:0/345371615 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:55.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.307+0000 7f5cea7fc640 1 --2- 172.21.15.12:0/345371615 >> v2:172.21.15.12:3300/0 conn(0x7f5cec09f6e0 0x7f5cec13cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:55.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.307+0000 7f5ce9ffb640 1 -- 172.21.15.12:0/345371615 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2932964477 0 0) 0x7f5cec09e930 con 0x7f5cec137e60 2024-09-11T23:05:55.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.307+0000 7f5ce9ffb640 1 -- 172.21.15.12:0/345371615 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5cd8003530 con 0x7f5cec137e60 2024-09-11T23:05:55.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.307+0000 7f5cea7fc640 1 -- 172.21.15.12:0/345371615 >> v1:172.21.15.12:6789/0 conn(0x7f5cec137e60 legacy=0x7f5cec138240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:55.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.307+0000 7f5cea7fc640 1 -- 172.21.15.12:0/345371615 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cec09d910 con 0x7f5cec09f6e0 2024-09-11T23:05:55.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.307+0000 7f5cea7fc640 1 --2- 172.21.15.12:0/345371615 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5cec09f6e0 0x7f5cec13cc60 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f5cd4009740 tx=0x7f5cd401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d95d817bae72c20 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:55.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.307+0000 7f5ce9ffb640 1 -- 172.21.15.12:0/345371615 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cd40ab570 con 0x7f5cec09f6e0 2024-09-11T23:05:55.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.307+0000 7f5ce9ffb640 1 -- 172.21.15.12:0/345371615 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cd40b0070 con 0x7f5cec09f6e0 2024-09-11T23:05:55.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.307+0000 7f5ce9ffb640 1 -- 172.21.15.12:0/345371615 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cd40ab840 con 0x7f5cec09f6e0 2024-09-11T23:05:55.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.307+0000 7f5cf138e640 1 -- 172.21.15.12:0/345371615 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5cec09f6e0 msgr2=0x7f5cec13cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:55.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.307+0000 7f5cf138e640 1 --2- 172.21.15.12:0/345371615 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5cec09f6e0 0x7f5cec13cc60 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f5cd4009740 tx=0x7f5cd401c420 comp rx=0 tx=0).stop 2024-09-11T23:05:55.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.307+0000 7f5cf138e640 1 -- 172.21.15.12:0/345371615 shutdown_connections 2024-09-11T23:05:55.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.307+0000 7f5cf138e640 1 --2- 172.21.15.12:0/345371615 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5cec09f6e0 0x7f5cec13cc60 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:55.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.307+0000 7f5cf138e640 1 -- 172.21.15.12:0/345371615 >> 172.21.15.12:0/345371615 conn(0x7f5cec0a8450 msgr2=0x7f5cec0a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:55.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.307+0000 7f5cf138e640 1 -- 172.21.15.12:0/345371615 shutdown_connections 2024-09-11T23:05:55.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.307+0000 7f5cf138e640 1 -- 172.21.15.12:0/345371615 wait complete. 2024-09-11T23:05:55.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.311+0000 7f5cf138e640 1 Processor -- start 2024-09-11T23:05:55.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.311+0000 7f5cf138e640 1 -- start start 2024-09-11T23:05:55.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.311+0000 7f5cf138e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5cec137e60 0x7f5cec06fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:55.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.311+0000 7f5cf138e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5cec13fd50 con 0x7f5cec137e60 2024-09-11T23:05:55.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.311+0000 7f5ceaffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5cec137e60 0x7f5cec06fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:55.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.311+0000 7f5ceaffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5cec137e60 0x7f5cec06fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48532/0 (socket says 172.21.15.12:48532) 2024-09-11T23:05:55.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.311+0000 7f5ceaffd640 1 -- 172.21.15.12:0/3497490807 learned_addr learned my addr 172.21.15.12:0/3497490807 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:55.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.311+0000 7f5ceaffd640 1 -- 172.21.15.12:0/3497490807 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cec13c8c0 con 0x7f5cec137e60 2024-09-11T23:05:55.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.311+0000 7f5ceaffd640 1 --2- 172.21.15.12:0/3497490807 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5cec137e60 0x7f5cec06fdf0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f5ce400cb40 tx=0x7f5ce40021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:55.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.311+0000 7f5ce37fe640 1 -- 172.21.15.12:0/3497490807 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ce4017070 con 0x7f5cec137e60 2024-09-11T23:05:55.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.311+0000 7f5ce37fe640 1 -- 172.21.15.12:0/3497490807 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ce400ab80 con 0x7f5cec137e60 2024-09-11T23:05:55.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.311+0000 7f5cf138e640 1 -- 172.21.15.12:0/3497490807 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cec06f3b0 con 0x7f5cec137e60 2024-09-11T23:05:55.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.311+0000 7f5ce37fe640 1 -- 172.21.15.12:0/3497490807 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ce4012400 con 0x7f5cec137e60 2024-09-11T23:05:55.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.311+0000 7f5cf138e640 1 -- 172.21.15.12:0/3497490807 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cec13ba40 con 0x7f5cec137e60 2024-09-11T23:05:55.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.311+0000 7f5cf138e640 1 -- 172.21.15.12:0/3497490807 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cec138240 con 0x7f5cec137e60 2024-09-11T23:05:55.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.311+0000 7f5ce37fe640 1 -- 172.21.15.12:0/3497490807 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 44053+0+0 (secure 0 0 0) 0x7f5ce401a070 con 0x7f5cec137e60 2024-09-11T23:05:55.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.311+0000 7f5ce37fe640 1 --2- 172.21.15.12:0/3497490807 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f5ccc035db0 0x7f5ccc038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:55.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.311+0000 7f5ce37fe640 1 -- 172.21.15.12:0/3497490807 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 3439+0+0 (secure 0 0 0) 0x7f5ce4048420 con 0x7f5cec137e60 2024-09-11T23:05:55.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.311+0000 7f5cea7fc640 1 --2- 172.21.15.12:0/3497490807 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f5ccc035db0 0x7f5ccc038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:55.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.315+0000 7f5cea7fc640 1 --2- 172.21.15.12:0/3497490807 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f5ccc035db0 0x7f5ccc038270 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5cd40af000 tx=0x7f5cd40a7000 comp rx=0 tx=0).ready entity=mgr.4708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:55.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.319+0000 7f5ce37fe640 1 -- 172.21.15.12:0/3497490807 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5ce401b3b0 con 0x7f5cec137e60 2024-09-11T23:05:55.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.515+0000 7f5cf138e640 1 -- 172.21.15.12:0/3497490807 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5cec06e760 con 0x7f5cec137e60 2024-09-11T23:05:55.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.515+0000 7f5ce37fe640 1 -- 172.21.15.12:0/3497490807 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+3575 (secure 0 0 0) 0x7f5ce4010300 con 0x7f5cec137e60 2024-09-11T23:05:55.517 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:05:55.517 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":40,"btime":"2024-09-11T23:05:55:143736+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4812,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6827/1404954527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":1404954527},{"type":"v1","addr":"172.21.15.12:6827","nonce":1404954527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:05:51.497188+0000","modified":"2024-09-11T23:05:54.502889+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4813},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4813":{"gid":4813,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6829/2605601020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":2605601020},{"type":"v1","addr":"172.21.15.12:6829","nonce":2605601020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4813,"qdb_cluster":[4813]},"id":5}]} 2024-09-11T23:05:55.518 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 40 2024-09-11T23:05:55.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.515+0000 7f5cf138e640 1 -- 172.21.15.12:0/3497490807 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f5ccc035db0 msgr2=0x7f5ccc038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:55.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.515+0000 7f5cf138e640 1 --2- 172.21.15.12:0/3497490807 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f5ccc035db0 0x7f5ccc038270 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5cd40af000 tx=0x7f5cd40a7000 comp rx=0 tx=0).stop 2024-09-11T23:05:55.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.515+0000 7f5cf138e640 1 -- 172.21.15.12:0/3497490807 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5cec137e60 msgr2=0x7f5cec06fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:55.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.515+0000 7f5cf138e640 1 --2- 172.21.15.12:0/3497490807 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5cec137e60 0x7f5cec06fdf0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f5ce400cb40 tx=0x7f5ce40021f0 comp rx=0 tx=0).stop 2024-09-11T23:05:55.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.515+0000 7f5cf138e640 1 -- 172.21.15.12:0/3497490807 shutdown_connections 2024-09-11T23:05:55.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.515+0000 7f5cf138e640 1 --2- 172.21.15.12:0/3497490807 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f5ccc035db0 0x7f5ccc038270 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:55.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.515+0000 7f5cf138e640 1 --2- 172.21.15.12:0/3497490807 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5cec137e60 0x7f5cec06fdf0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:55.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.515+0000 7f5cf138e640 1 -- 172.21.15.12:0/3497490807 >> 172.21.15.12:0/3497490807 conn(0x7f5cec0a8450 msgr2=0x7f5cec134970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:55.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.515+0000 7f5cf138e640 1 -- 172.21.15.12:0/3497490807 shutdown_connections 2024-09-11T23:05:55.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.515+0000 7f5cf138e640 1 -- 172.21.15.12:0/3497490807 wait complete. 2024-09-11T23:05:55.535 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:05:55.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.647+0000 7fa0b4119640 1 Processor -- start 2024-09-11T23:05:55.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.647+0000 7fa0b4119640 1 -- start start 2024-09-11T23:05:55.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.647+0000 7fa0b4119640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa0ac09f190 0x7fa0ac09f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:55.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.647+0000 7fa0b4119640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0ac0a14c0 con 0x7fa0ac09fab0 2024-09-11T23:05:55.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.647+0000 7fa0b4119640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fa0ac0a1760 con 0x7fa0ac09f190 2024-09-11T23:05:55.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.647+0000 7fa0b16b4640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa0ac09fab0 0x7fa0ac1364d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:50012/0 (socket says 172.21.15.12:50012) 2024-09-11T23:05:55.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.647+0000 7fa0b16b4640 1 -- 172.21.15.12:0/312619762 learned_addr learned my addr 172.21.15.12:0/312619762 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:55.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.647+0000 7fa0b1eb5640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa0ac09f190 0x7fa0ac09f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:55.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.647+0000 7fa0b0eb3640 1 -- 172.21.15.12:0/312619762 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2459659151 0 0) 0x7fa0ac0a14c0 con 0x7fa0ac09fab0 2024-09-11T23:05:55.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.647+0000 7fa0b0eb3640 1 -- 172.21.15.12:0/312619762 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa098003530 con 0x7fa0ac09fab0 2024-09-11T23:05:55.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.647+0000 7fa0b1eb5640 1 -- 172.21.15.12:0/312619762 >> v1:172.21.15.12:6789/0 conn(0x7fa0ac09fab0 legacy=0x7fa0ac1364d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:55.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.647+0000 7fa0b1eb5640 1 -- 172.21.15.12:0/312619762 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0ac0a0d30 con 0x7fa0ac09f190 2024-09-11T23:05:55.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.651+0000 7fa0b1eb5640 1 --2- 172.21.15.12:0/312619762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0ac09f190 0x7fa0ac09f570 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fa09c009740 tx=0x7fa09c01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb5c1b284a886095 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:55.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.651+0000 7fa0b0eb3640 1 -- 172.21.15.12:0/312619762 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa09c0b0070 con 0x7fa0ac09f190 2024-09-11T23:05:55.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.651+0000 7fa0b0eb3640 1 -- 172.21.15.12:0/312619762 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa09c0ab530 con 0x7fa0ac09f190 2024-09-11T23:05:55.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.651+0000 7fa0b0eb3640 1 -- 172.21.15.12:0/312619762 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa09c0ab810 con 0x7fa0ac09f190 2024-09-11T23:05:55.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.655+0000 7fa0b4119640 1 -- 172.21.15.12:0/312619762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0ac09f190 msgr2=0x7fa0ac09f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:55.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.655+0000 7fa0b4119640 1 --2- 172.21.15.12:0/312619762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0ac09f190 0x7fa0ac09f570 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fa09c009740 tx=0x7fa09c01c390 comp rx=0 tx=0).stop 2024-09-11T23:05:55.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.655+0000 7fa0b4119640 1 -- 172.21.15.12:0/312619762 shutdown_connections 2024-09-11T23:05:55.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.655+0000 7fa0b4119640 1 --2- 172.21.15.12:0/312619762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0ac09f190 0x7fa0ac09f570 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:55.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.655+0000 7fa0b4119640 1 -- 172.21.15.12:0/312619762 >> 172.21.15.12:0/312619762 conn(0x7fa0ac0a8450 msgr2=0x7fa0ac0a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:55.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.655+0000 7fa0b4119640 1 -- 172.21.15.12:0/312619762 shutdown_connections 2024-09-11T23:05:55.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.655+0000 7fa0b4119640 1 -- 172.21.15.12:0/312619762 wait complete. 2024-09-11T23:05:55.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.655+0000 7fa0b4119640 1 Processor -- start 2024-09-11T23:05:55.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.655+0000 7fa0b4119640 1 -- start start 2024-09-11T23:05:55.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.655+0000 7fa0b4119640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0ac09f190 0x7fa0ac13d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:55.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.655+0000 7fa0b4119640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa0ac0a0520 con 0x7fa0ac09f190 2024-09-11T23:05:55.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.655+0000 7fa0b1eb5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0ac09f190 0x7fa0ac13d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:55.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.655+0000 7fa0b1eb5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0ac09f190 0x7fa0ac13d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48550/0 (socket says 172.21.15.12:48550) 2024-09-11T23:05:55.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.655+0000 7fa0b1eb5640 1 -- 172.21.15.12:0/981212505 learned_addr learned my addr 172.21.15.12:0/981212505 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:55.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.655+0000 7fa0b1eb5640 1 -- 172.21.15.12:0/981212505 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0ac120d70 con 0x7fa0ac09f190 2024-09-11T23:05:55.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.655+0000 7fa0b1eb5640 1 --2- 172.21.15.12:0/981212505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0ac09f190 0x7fa0ac13d7a0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fa09c019fc0 tx=0x7fa09c01abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:55.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.655+0000 7fa0a27fc640 1 -- 172.21.15.12:0/981212505 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa09c0b0050 con 0x7fa0ac09f190 2024-09-11T23:05:55.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.655+0000 7fa0a27fc640 1 -- 172.21.15.12:0/981212505 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa09c0b1040 con 0x7fa0ac09f190 2024-09-11T23:05:55.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.655+0000 7fa0a27fc640 1 -- 172.21.15.12:0/981212505 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa09c0b76b0 con 0x7fa0ac09f190 2024-09-11T23:05:55.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.655+0000 7fa0b4119640 1 -- 172.21.15.12:0/981212505 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0ac1c55d0 con 0x7fa0ac09f190 2024-09-11T23:05:55.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.655+0000 7fa0b4119640 1 -- 172.21.15.12:0/981212505 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0ac1266a0 con 0x7fa0ac09f190 2024-09-11T23:05:55.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.659+0000 7fa0b4119640 1 -- 172.21.15.12:0/981212505 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0ac09f570 con 0x7fa0ac09f190 2024-09-11T23:05:55.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.659+0000 7fa0a27fc640 1 -- 172.21.15.12:0/981212505 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 44053+0+0 (secure 0 0 0) 0x7fa09c0be030 con 0x7fa0ac09f190 2024-09-11T23:05:55.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.659+0000 7fa0a27fc640 1 --2- 172.21.15.12:0/981212505 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fa090035db0 0x7fa090038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:55.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.659+0000 7fa0a27fc640 1 -- 172.21.15.12:0/981212505 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 3439+0+0 (secure 0 0 0) 0x7fa09c0bc070 con 0x7fa0ac09f190 2024-09-11T23:05:55.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.659+0000 7fa0b16b4640 1 --2- 172.21.15.12:0/981212505 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fa090035db0 0x7fa090038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:55.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.659+0000 7fa0b16b4640 1 --2- 172.21.15.12:0/981212505 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fa090035db0 0x7fa090038270 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8007fd0 tx=0x7fa0a8007980 comp rx=0 tx=0).ready entity=mgr.4708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:55.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.663+0000 7fa0a27fc640 1 -- 172.21.15.12:0/981212505 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa09c0c5020 con 0x7fa0ac09f190 2024-09-11T23:05:55.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.819+0000 7fa0b4119640 1 -- 172.21.15.12:0/981212505 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa0ac09ee70 con 0x7fa0ac09f190 2024-09-11T23:05:55.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.819+0000 7fa0a27fc640 1 -- 172.21.15.12:0/981212505 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) ==== 74+0+10678 (secure 0 0 0) 0x7fa09c016010 con 0x7fa0ac09f190 2024-09-11T23:05:55.823 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:05:55.823 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":54,"fsid":"8be14356-3340-4500-91a2-4cbc6b511f65","created":"2024-09-11T23:03:10.620234+0000","modified":"2024-09-11T23:05:53.132240+0000","last_up_change":"2024-09-11T23:03:22.359028+0000","last_in_change":"2024-09-11T23:03:11.545817+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:03:23.587068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:05:49.161756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0299999713897705,"score_stable":1.0299999713897705,"optimal_score":1,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.0299999713897705,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-11T23:05:50.500965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"153b72a1-40b1-400d-93ea-333e733f9bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6817","nonce":3680911937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6819","nonce":3680911937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6823","nonce":3680911937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6821","nonce":3680911937}]},"public_addr":"172.21.15.12:6817/3680911937","cluster_addr":"172.21.15.12:6819/3680911937","heartbeat_back_addr":"172.21.15.12:6823/3680911937","heartbeat_front_addr":"172.21.15.12:6821/3680911937","state":["exists","up"]},{"osd":1,"uuid":"94669e49-ee4f-4acf-9e25-e94374dda8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6801","nonce":236825163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6803","nonce":236825163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6807","nonce":236825163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6805","nonce":236825163}]},"public_addr":"172.21.15.12:6801/236825163","cluster_addr":"172.21.15.12:6803/236825163","heartbeat_back_addr":"172.21.15.12:6807/236825163","heartbeat_front_addr":"172.21.15.12:6805/236825163","state":["exists","up"]},{"osd":2,"uuid":"826dae4d-8888-4ec5-8f00-425b3be93814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6809","nonce":3263521655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6811","nonce":3263521655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6815","nonce":3263521655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6813","nonce":3263521655}]},"public_addr":"172.21.15.12:6809/3263521655","cluster_addr":"172.21.15.12:6811/3263521655","heartbeat_back_addr":"172.21.15.12:6815/3263521655","heartbeat_front_addr":"172.21.15.12:6813/3263521655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:19.398518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.761524+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.904997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:05:55.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.823+0000 7fa0b4119640 1 -- 172.21.15.12:0/981212505 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fa090035db0 msgr2=0x7fa090038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:55.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.823+0000 7fa0b4119640 1 --2- 172.21.15.12:0/981212505 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fa090035db0 0x7fa090038270 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8007fd0 tx=0x7fa0a8007980 comp rx=0 tx=0).stop 2024-09-11T23:05:55.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.823+0000 7fa0b4119640 1 -- 172.21.15.12:0/981212505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0ac09f190 msgr2=0x7fa0ac13d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:55.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.823+0000 7fa0b4119640 1 --2- 172.21.15.12:0/981212505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0ac09f190 0x7fa0ac13d7a0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fa09c019fc0 tx=0x7fa09c01abd0 comp rx=0 tx=0).stop 2024-09-11T23:05:55.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.823+0000 7fa0b4119640 1 -- 172.21.15.12:0/981212505 shutdown_connections 2024-09-11T23:05:55.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.823+0000 7fa0b4119640 1 --2- 172.21.15.12:0/981212505 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fa090035db0 0x7fa090038270 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:55.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.823+0000 7fa0b4119640 1 --2- 172.21.15.12:0/981212505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0ac09f190 0x7fa0ac13d7a0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:55.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.823+0000 7fa0b4119640 1 -- 172.21.15.12:0/981212505 >> 172.21.15.12:0/981212505 conn(0x7fa0ac0a8450 msgr2=0x7fa0ac09bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:55.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.823+0000 7fa0b4119640 1 -- 172.21.15.12:0/981212505 shutdown_connections 2024-09-11T23:05:55.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.823+0000 7fa0b4119640 1 -- 172.21.15.12:0/981212505 wait complete. 2024-09-11T23:05:55.841 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T23:05:55.841 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:05:55.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.951+0000 7f4caa17a640 1 Processor -- start 2024-09-11T23:05:55.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.951+0000 7f4caa17a640 1 -- start start 2024-09-11T23:05:55.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.955+0000 7f4caa17a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4ca40a4b80 0x7f4ca40a7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:55.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.955+0000 7f4caa17a640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ca40a82a0 con 0x7f4ca413a410 2024-09-11T23:05:55.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.955+0000 7f4caa17a640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f4ca40a3cb0 con 0x7f4ca40a4b80 2024-09-11T23:05:55.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.955+0000 7f4ca2ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4ca40a4b80 0x7f4ca40a7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:55.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.955+0000 7f4ca37fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f4ca413a410 0x7f4ca40a6af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:50018/0 (socket says 172.21.15.12:50018) 2024-09-11T23:05:55.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.955+0000 7f4ca37fe640 1 -- 172.21.15.12:0/21655382 learned_addr learned my addr 172.21.15.12:0/21655382 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:55.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.955+0000 7f4ca2ffd640 1 -- 172.21.15.12:0/21655382 >> v1:172.21.15.12:6789/0 conn(0x7f4ca413a410 legacy=0x7f4ca40a6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:55.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.955+0000 7f4ca2ffd640 1 -- 172.21.15.12:0/21655382 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ca4139fe0 con 0x7f4ca40a4b80 2024-09-11T23:05:55.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.955+0000 7f4ca2ffd640 1 --2- 172.21.15.12:0/21655382 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ca40a4b80 0x7f4ca40a7200 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c009d90 tx=0x7f4c8c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3028b6d0c17d951 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:55.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.955+0000 7f4ca27fc640 1 -- 172.21.15.12:0/21655382 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c8c0b2070 con 0x7f4ca40a4b80 2024-09-11T23:05:55.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.955+0000 7f4ca27fc640 1 -- 172.21.15.12:0/21655382 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c8c0a5760 con 0x7f4ca40a4b80 2024-09-11T23:05:55.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.955+0000 7f4ca27fc640 1 -- 172.21.15.12:0/21655382 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c8c0a5a60 con 0x7f4ca40a4b80 2024-09-11T23:05:55.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.955+0000 7f4caa17a640 1 -- 172.21.15.12:0/21655382 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ca40a4b80 msgr2=0x7f4ca40a7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:55.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.955+0000 7f4caa17a640 1 --2- 172.21.15.12:0/21655382 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ca40a4b80 0x7f4ca40a7200 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c009d90 tx=0x7f4c8c01c8e0 comp rx=0 tx=0).stop 2024-09-11T23:05:55.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.955+0000 7f4caa17a640 1 -- 172.21.15.12:0/21655382 shutdown_connections 2024-09-11T23:05:55.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.955+0000 7f4caa17a640 1 --2- 172.21.15.12:0/21655382 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ca40a4b80 0x7f4ca40a7200 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:55.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.955+0000 7f4caa17a640 1 -- 172.21.15.12:0/21655382 >> 172.21.15.12:0/21655382 conn(0x7f4ca40ac2c0 msgr2=0x7f4ca40ac6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:55.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.955+0000 7f4caa17a640 1 -- 172.21.15.12:0/21655382 shutdown_connections 2024-09-11T23:05:55.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.955+0000 7f4caa17a640 1 -- 172.21.15.12:0/21655382 wait complete. 2024-09-11T23:05:55.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.959+0000 7f4caa17a640 1 Processor -- start 2024-09-11T23:05:55.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.959+0000 7f4caa17a640 1 -- start start 2024-09-11T23:05:55.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.959+0000 7f4caa17a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ca40a4b80 0x7f4ca40a0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:55.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.959+0000 7f4caa17a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca40a7740 con 0x7f4ca40a4b80 2024-09-11T23:05:55.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.959+0000 7f4ca37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ca40a4b80 0x7f4ca40a0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:55.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.959+0000 7f4ca37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ca40a4b80 0x7f4ca40a0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48568/0 (socket says 172.21.15.12:48568) 2024-09-11T23:05:55.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.959+0000 7f4ca37fe640 1 -- 172.21.15.12:0/1345507084 learned_addr learned my addr 172.21.15.12:0/1345507084 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:55.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.959+0000 7f4ca37fe640 1 -- 172.21.15.12:0/1345507084 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ca40a1710 con 0x7f4ca40a4b80 2024-09-11T23:05:55.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.959+0000 7f4ca37fe640 1 --2- 172.21.15.12:0/1345507084 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ca40a4b80 0x7f4ca40a0fd0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f4c9400c480 tx=0x7f4c9400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:55.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.959+0000 7f4c9bfff640 1 -- 172.21.15.12:0/1345507084 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c94017070 con 0x7f4ca40a4b80 2024-09-11T23:05:55.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.959+0000 7f4c9bfff640 1 -- 172.21.15.12:0/1345507084 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c94005c20 con 0x7f4ca40a4b80 2024-09-11T23:05:55.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.959+0000 7f4c9bfff640 1 -- 172.21.15.12:0/1345507084 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c94007070 con 0x7f4ca40a4b80 2024-09-11T23:05:55.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.959+0000 7f4caa17a640 1 -- 172.21.15.12:0/1345507084 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ca40a1a30 con 0x7f4ca40a4b80 2024-09-11T23:05:55.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.959+0000 7f4caa17a640 1 -- 172.21.15.12:0/1345507084 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ca409f590 con 0x7f4ca40a4b80 2024-09-11T23:05:55.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.959+0000 7f4c9bfff640 1 -- 172.21.15.12:0/1345507084 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 44053+0+0 (secure 0 0 0) 0x7f4c9401a070 con 0x7f4ca40a4b80 2024-09-11T23:05:55.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.959+0000 7f4caa17a640 1 -- 172.21.15.12:0/1345507084 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ca40a1510 con 0x7f4ca40a4b80 2024-09-11T23:05:55.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.959+0000 7f4c9bfff640 1 --2- 172.21.15.12:0/1345507084 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f4c84035db0 0x7f4c84038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:55.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.959+0000 7f4c9bfff640 1 -- 172.21.15.12:0/1345507084 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 3439+0+0 (secure 0 0 0) 0x7f4c94047920 con 0x7f4ca40a4b80 2024-09-11T23:05:55.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.959+0000 7f4ca2ffd640 1 --2- 172.21.15.12:0/1345507084 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f4c84035db0 0x7f4c84038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:55.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.963+0000 7f4ca2ffd640 1 --2- 172.21.15.12:0/1345507084 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f4c84035db0 0x7f4c84038270 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c0af000 tx=0x7f4c8c0a7070 comp rx=0 tx=0).ready entity=mgr.4708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:55.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:55.967+0000 7f4c9bfff640 1 -- 172.21.15.12:0/1345507084 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4c94007210 con 0x7f4ca40a4b80 2024-09-11T23:05:56.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.127+0000 7f4caa17a640 1 -- 172.21.15.12:0/1345507084 --> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4ca40a0aa0 con 0x7f4c84035db0 2024-09-11T23:05:56.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.135+0000 7f4c9bfff640 1 -- 172.21.15.12:0/1345507084 <== mgr.4708 v2:172.21.15.12:6824/1925124150 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+235320 (secure 0 0 0) 0x7f4c8c0a57b0 con 0x7f4c84035db0 2024-09-11T23:05:56.141 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:05:56.142 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-11T23:05:56.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.139+0000 7f4caa17a640 1 -- 172.21.15.12:0/1345507084 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f4c84035db0 msgr2=0x7f4c84038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:56.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.139+0000 7f4caa17a640 1 --2- 172.21.15.12:0/1345507084 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f4c84035db0 0x7f4c84038270 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c0af000 tx=0x7f4c8c0a7070 comp rx=0 tx=0).stop 2024-09-11T23:05:56.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.139+0000 7f4caa17a640 1 -- 172.21.15.12:0/1345507084 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ca40a4b80 msgr2=0x7f4ca40a0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:56.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.139+0000 7f4caa17a640 1 --2- 172.21.15.12:0/1345507084 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ca40a4b80 0x7f4ca40a0fd0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f4c9400c480 tx=0x7f4c9400c940 comp rx=0 tx=0).stop 2024-09-11T23:05:56.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.139+0000 7f4caa17a640 1 -- 172.21.15.12:0/1345507084 shutdown_connections 2024-09-11T23:05:56.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.139+0000 7f4caa17a640 1 --2- 172.21.15.12:0/1345507084 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f4c84035db0 0x7f4c84038270 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:56.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.139+0000 7f4caa17a640 1 --2- 172.21.15.12:0/1345507084 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ca40a4b80 0x7f4ca40a0fd0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:56.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.139+0000 7f4caa17a640 1 -- 172.21.15.12:0/1345507084 >> 172.21.15.12:0/1345507084 conn(0x7f4ca40ac2c0 msgr2=0x7f4ca40aa560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:56.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.139+0000 7f4caa17a640 1 -- 172.21.15.12:0/1345507084 shutdown_connections 2024-09-11T23:05:56.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.139+0000 7f4caa17a640 1 -- 172.21.15.12:0/1345507084 wait complete. 2024-09-11T23:05:56.159 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-11T23:05:54.270706+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":490,"num_read_kb":915,"num_write":217,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":92000,"kb_used_data":2584,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283023520,"statfs":{"total":289910292480,"available":289816084480,"internally_reserved":0,"allocated":2646016,"data_stored":1739586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.155837"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-11T23:05:50.121882+0000","last_change":"2024-09-11T23:05:50.121882+0000","last_active":"2024-09-11T23:05:50.107392+0000","last_peered":"2024-09-11T23:05:50.107392+0000","last_clean":"2024-09-11T23:05:50.107392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:50.121882+0000","last_undegraded":"2024-09-11T23:05:50.121882+0000","last_fullsized":"2024-09-11T23:05:50.121882+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-11T23:05:50.134064+0000","last_change":"2024-09-11T23:05:50.134064+0000","last_active":"2024-09-11T23:05:50.107392+0000","last_peered":"2024-09-11T23:05:50.107392+0000","last_clean":"2024-09-11T23:05:50.107392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:50.134064+0000","last_undegraded":"2024-09-11T23:05:50.134064+0000","last_fullsized":"2024-09-11T23:05:50.134064+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-11T23:05:50.121898+0000","last_change":"2024-09-11T23:05:50.121898+0000","last_active":"2024-09-11T23:05:50.107392+0000","last_peered":"2024-09-11T23:05:50.107392+0000","last_clean":"2024-09-11T23:05:50.107392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:50.121898+0000","last_undegraded":"2024-09-11T23:05:50.121898+0000","last_fullsized":"2024-09-11T23:05:50.121898+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-11T23:05:50.121038+0000","last_change":"2024-09-11T23:05:50.121038+0000","last_active":"2024-09-11T23:05:50.107392+0000","last_peered":"2024-09-11T23:05:50.107392+0000","last_clean":"2024-09-11T23:05:50.107392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:50.121038+0000","last_undegraded":"2024-09-11T23:05:50.121038+0000","last_fullsized":"2024-09-11T23:05:50.121038+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-11T23:05:50.121041+0000","last_change":"2024-09-11T23:05:50.121041+0000","last_active":"2024-09-11T23:05:50.107392+0000","last_peered":"2024-09-11T23:05:50.107392+0000","last_clean":"2024-09-11T23:05:50.107392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:50.121041+0000","last_undegraded":"2024-09-11T23:05:50.121041+0000","last_fullsized":"2024-09-11T23:05:50.121041+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-11T23:05:50.124621+0000","last_change":"2024-09-11T23:05:50.124621+0000","last_active":"2024-09-11T23:05:50.107392+0000","last_peered":"2024-09-11T23:05:50.107392+0000","last_clean":"2024-09-11T23:05:50.107392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:50.124621+0000","last_undegraded":"2024-09-11T23:05:50.124621+0000","last_fullsized":"2024-09-11T23:05:50.124621+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-11T23:05:50.130285+0000","last_change":"2024-09-11T23:05:50.130285+0000","last_active":"2024-09-11T23:05:50.107392+0000","last_peered":"2024-09-11T23:05:50.107392+0000","last_clean":"2024-09-11T23:05:50.107392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:50.130285+0000","last_undegraded":"2024-09-11T23:05:50.130285+0000","last_fullsized":"2024-09-11T23:05:50.130285+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-11T23:05:50.121140+0000","last_change":"2024-09-11T23:05:50.121140+0000","last_active":"2024-09-11T23:05:50.107392+0000","last_peered":"2024-09-11T23:05:50.107392+0000","last_clean":"2024-09-11T23:05:50.107392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:50.121140+0000","last_undegraded":"2024-09-11T23:05:50.121140+0000","last_fullsized":"2024-09-11T23:05:50.121140+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-11T23:05:50.124984+0000","last_change":"2024-09-11T23:05:50.124984+0000","last_active":"2024-09-11T23:05:50.107392+0000","last_peered":"2024-09-11T23:05:50.107392+0000","last_clean":"2024-09-11T23:05:50.107392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:50.124984+0000","last_undegraded":"2024-09-11T23:05:50.124984+0000","last_fullsized":"2024-09-11T23:05:50.124984+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-11T23:05:50.129740+0000","last_change":"2024-09-11T23:05:50.129740+0000","last_active":"2024-09-11T23:05:50.107392+0000","last_peered":"2024-09-11T23:05:50.107392+0000","last_clean":"2024-09-11T23:05:50.107392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:50.129740+0000","last_undegraded":"2024-09-11T23:05:50.129740+0000","last_fullsized":"2024-09-11T23:05:50.129740+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-11T23:05:50.130035+0000","last_change":"2024-09-11T23:05:50.130035+0000","last_active":"2024-09-11T23:05:50.107392+0000","last_peered":"2024-09-11T23:05:50.107392+0000","last_clean":"2024-09-11T23:05:50.107392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:50.130035+0000","last_undegraded":"2024-09-11T23:05:50.130035+0000","last_fullsized":"2024-09-11T23:05:50.130035+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-11T23:05:50.126395+0000","last_change":"2024-09-11T23:05:50.126395+0000","last_active":"2024-09-11T23:05:50.107392+0000","last_peered":"2024-09-11T23:05:50.107392+0000","last_clean":"2024-09-11T23:05:50.107392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:50.126395+0000","last_undegraded":"2024-09-11T23:05:50.126395+0000","last_fullsized":"2024-09-11T23:05:50.126395+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-11T23:05:50.124600+0000","last_change":"2024-09-11T23:05:50.124600+0000","last_active":"2024-09-11T23:05:50.107392+0000","last_peered":"2024-09-11T23:05:50.107392+0000","last_clean":"2024-09-11T23:05:50.107392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:50.124600+0000","last_undegraded":"2024-09-11T23:05:50.124600+0000","last_fullsized":"2024-09-11T23:05:50.124600+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-11T23:05:50.124095+0000","last_change":"2024-09-11T23:05:50.124095+0000","last_active":"2024-09-11T23:05:50.107392+0000","last_peered":"2024-09-11T23:05:50.107392+0000","last_clean":"2024-09-11T23:05:50.107392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:50.124095+0000","last_undegraded":"2024-09-11T23:05:50.124095+0000","last_fullsized":"2024-09-11T23:05:50.124095+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-11T23:05:50.126402+0000","last_change":"2024-09-11T23:05:50.126402+0000","last_active":"2024-09-11T23:05:50.107392+0000","last_peered":"2024-09-11T23:05:50.107392+0000","last_clean":"2024-09-11T23:05:50.107392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:50.126402+0000","last_undegraded":"2024-09-11T23:05:50.126402+0000","last_fullsized":"2024-09-11T23:05:50.126402+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-11T23:05:50.123065+0000","last_change":"2024-09-11T23:05:50.123065+0000","last_active":"2024-09-11T23:05:50.107392+0000","last_peered":"2024-09-11T23:05:50.107392+0000","last_clean":"2024-09-11T23:05:50.107392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:50.123065+0000","last_undegraded":"2024-09-11T23:05:50.123065+0000","last_fullsized":"2024-09-11T23:05:50.123065+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-11T23:05:50.126930+0000","last_change":"2024-09-11T23:05:50.126930+0000","last_active":"2024-09-11T23:05:50.107392+0000","last_peered":"2024-09-11T23:05:50.107392+0000","last_clean":"2024-09-11T23:05:50.107392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:50.126930+0000","last_undegraded":"2024-09-11T23:05:50.126930+0000","last_fullsized":"2024-09-11T23:05:50.126930+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-11T23:05:50.124556+0000","last_change":"2024-09-11T23:05:50.124556+0000","last_active":"2024-09-11T23:05:50.107392+0000","last_peered":"2024-09-11T23:05:50.107392+0000","last_clean":"2024-09-11T23:05:50.107392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:50.124556+0000","last_undegraded":"2024-09-11T23:05:50.124556+0000","last_fullsized":"2024-09-11T23:05:50.124556+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-11T23:05:50.124854+0000","last_change":"2024-09-11T23:05:50.124854+0000","last_active":"2024-09-11T23:05:50.107392+0000","last_peered":"2024-09-11T23:05:50.107392+0000","last_clean":"2024-09-11T23:05:50.107392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:50.124854+0000","last_undegraded":"2024-09-11T23:05:50.124854+0000","last_fullsized":"2024-09-11T23:05:50.124854+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-11T23:05:50.119940+0000","last_change":"2024-09-11T23:05:50.119940+0000","last_active":"2024-09-11T23:05:50.107392+0000","last_peered":"2024-09-11T23:05:50.107392+0000","last_clean":"2024-09-11T23:05:50.107392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:50.119940+0000","last_undegraded":"2024-09-11T23:05:50.119940+0000","last_fullsized":"2024-09-11T23:05:50.119940+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-11T23:05:50.119592+0000","last_change":"2024-09-11T23:05:50.119592+0000","last_active":"2024-09-11T23:05:50.107392+0000","last_peered":"2024-09-11T23:05:50.107392+0000","last_clean":"2024-09-11T23:05:50.107392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:50.119592+0000","last_undegraded":"2024-09-11T23:05:50.119592+0000","last_fullsized":"2024-09-11T23:05:50.119592+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-11T23:05:50.129369+0000","last_change":"2024-09-11T23:05:50.129369+0000","last_active":"2024-09-11T23:05:50.107392+0000","last_peered":"2024-09-11T23:05:50.107392+0000","last_clean":"2024-09-11T23:05:50.107392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:50.129369+0000","last_undegraded":"2024-09-11T23:05:50.129369+0000","last_fullsized":"2024-09-11T23:05:50.129369+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-11T23:05:50.125073+0000","last_change":"2024-09-11T23:05:50.125073+0000","last_active":"2024-09-11T23:05:50.107392+0000","last_peered":"2024-09-11T23:05:50.107392+0000","last_clean":"2024-09-11T23:05:50.107392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:50.125073+0000","last_undegraded":"2024-09-11T23:05:50.125073+0000","last_fullsized":"2024-09-11T23:05:50.125073+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-11T23:05:50.124089+0000","last_change":"2024-09-11T23:05:50.124089+0000","last_active":"2024-09-11T23:05:50.107392+0000","last_peered":"2024-09-11T23:05:50.107392+0000","last_clean":"2024-09-11T23:05:50.107392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:50.124089+0000","last_undegraded":"2024-09-11T23:05:50.124089+0000","last_fullsized":"2024-09-11T23:05:50.124089+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-11T23:05:50.124271+0000","last_change":"2024-09-11T23:05:50.124271+0000","last_active":"2024-09-11T23:05:50.107392+0000","last_peered":"2024-09-11T23:05:50.107392+0000","last_clean":"2024-09-11T23:05:50.107392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:50.124271+0000","last_undegraded":"2024-09-11T23:05:50.124271+0000","last_fullsized":"2024-09-11T23:05:50.124271+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-11T23:05:50.120466+0000","last_change":"2024-09-11T23:05:50.120466+0000","last_active":"2024-09-11T23:05:50.107392+0000","last_peered":"2024-09-11T23:05:50.107392+0000","last_clean":"2024-09-11T23:05:50.107392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:50.120466+0000","last_undegraded":"2024-09-11T23:05:50.120466+0000","last_fullsized":"2024-09-11T23:05:50.120466+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-11T23:05:50.129204+0000","last_change":"2024-09-11T23:05:50.129204+0000","last_active":"2024-09-11T23:05:50.107392+0000","last_peered":"2024-09-11T23:05:50.107392+0000","last_clean":"2024-09-11T23:05:50.107392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:50.129204+0000","last_undegraded":"2024-09-11T23:05:50.129204+0000","last_fullsized":"2024-09-11T23:05:50.129204+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-11T23:05:50.119523+0000","last_change":"2024-09-11T23:05:50.119523+0000","last_active":"2024-09-11T23:05:50.107392+0000","last_peered":"2024-09-11T23:05:50.107392+0000","last_clean":"2024-09-11T23:05:50.107392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:50.119523+0000","last_undegraded":"2024-09-11T23:05:50.119523+0000","last_fullsized":"2024-09-11T23:05:50.119523+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-11T23:05:50.123443+0000","last_change":"2024-09-11T23:05:50.123443+0000","last_active":"2024-09-11T23:05:50.107392+0000","last_peered":"2024-09-11T23:05:50.107392+0000","last_clean":"2024-09-11T23:05:50.107392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:50.123443+0000","last_undegraded":"2024-09-11T23:05:50.123443+0000","last_fullsized":"2024-09-11T23:05:50.123443+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-11T23:05:50.123989+0000","last_change":"2024-09-11T23:05:50.123989+0000","last_active":"2024-09-11T23:05:50.107392+0000","last_peered":"2024-09-11T23:05:50.107392+0000","last_clean":"2024-09-11T23:05:50.107392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:50.123989+0000","last_undegraded":"2024-09-11T23:05:50.123989+0000","last_fullsized":"2024-09-11T23:05:50.123989+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-11T23:05:50.119543+0000","last_change":"2024-09-11T23:05:50.119543+0000","last_active":"2024-09-11T23:05:50.107392+0000","last_peered":"2024-09-11T23:05:50.107392+0000","last_clean":"2024-09-11T23:05:50.107392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:50.119543+0000","last_undegraded":"2024-09-11T23:05:50.119543+0000","last_fullsized":"2024-09-11T23:05:50.119543+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:05:51.112539+0000","last_change":"2024-09-11T23:05:51.112539+0000","last_active":"2024-09-11T23:05:51.112539+0000","last_peered":"2024-09-11T23:05:51.112539+0000","last_clean":"2024-09-11T23:05:51.112539+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:51.112539+0000","last_undegraded":"2024-09-11T23:05:51.112539+0000","last_fullsized":"2024-09-11T23:05:51.112539+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-11T23:05:50.123530+0000","last_change":"2024-09-11T23:05:50.123530+0000","last_active":"2024-09-11T23:05:50.107392+0000","last_peered":"2024-09-11T23:05:50.107392+0000","last_clean":"2024-09-11T23:05:50.107392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:05:50.123530+0000","last_undegraded":"2024-09-11T23:05:50.123530+0000","last_fullsized":"2024-09-11T23:05:50.123530+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"42'141","reported_seq":369,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-11T23:05:50.133939+0000","last_change":"2024-09-11T23:03:26.382905+0000","last_active":"2024-09-11T23:05:50.133939+0000","last_peered":"2024-09-11T23:05:50.133939+0000","last_clean":"2024-09-11T23:05:50.133939+0000","last_became_active":"2024-09-11T23:03:26.380590+0000","last_became_peered":"2024-09-11T23:03:26.380590+0000","last_unstale":"2024-09-11T23:05:50.133939+0000","last_undegraded":"2024-09-11T23:05:50.133939+0000","last_fullsized":"2024-09-11T23:05:50.133939+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:24.361793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:24.361793+0000","last_clean_scrub_stamp":"2024-09-11T23:03:24.361793+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:46.577063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":490,"num_read_kb":915,"num_write":217,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":490,"num_read_kb":915,"num_write":217,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738399,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":483328,"data_stored":185101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738399,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32248,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":1085440,"data_stored":779016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738399,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32248,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":1077248,"data_stored":775469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:05:56.163 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:05:56.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.323+0000 7f035df42640 1 Processor -- start 2024-09-11T23:05:56.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.323+0000 7f035df42640 1 -- start start 2024-09-11T23:05:56.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.323+0000 7f035df42640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0358137e60 0x7f0358138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:56.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.323+0000 7f035df42640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f035809e930 con 0x7f035809f6e0 2024-09-11T23:05:56.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.323+0000 7f035df42640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f03581379e0 con 0x7f0358137e60 2024-09-11T23:05:56.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.323+0000 7f03577fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0358137e60 0x7f0358138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:56.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.323+0000 7f0356ffd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f035809f6e0 0x7f03580a36a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:50030/0 (socket says 172.21.15.12:50030) 2024-09-11T23:05:56.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.323+0000 7f03577fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0358137e60 0x7f0358138240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48570/0 (socket says 172.21.15.12:48570) 2024-09-11T23:05:56.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.323+0000 7f0356ffd640 1 -- 172.21.15.12:0/3117963497 learned_addr learned my addr 172.21.15.12:0/3117963497 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:56.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.323+0000 7f03577fe640 1 -- 172.21.15.12:0/3117963497 >> v1:172.21.15.12:6789/0 conn(0x7f035809f6e0 legacy=0x7f03580a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:56.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.323+0000 7f03577fe640 1 -- 172.21.15.12:0/3117963497 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f035809d910 con 0x7f0358137e60 2024-09-11T23:05:56.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.323+0000 7f03577fe640 1 --2- 172.21.15.12:0/3117963497 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0358137e60 0x7f0358138240 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f0348009740 tx=0x7f034801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7392bd6aff5a40b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:56.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.323+0000 7f03567fc640 1 -- 172.21.15.12:0/3117963497 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03480ab570 con 0x7f0358137e60 2024-09-11T23:05:56.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.327+0000 7f03567fc640 1 -- 172.21.15.12:0/3117963497 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03480b0070 con 0x7f0358137e60 2024-09-11T23:05:56.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.327+0000 7f03567fc640 1 -- 172.21.15.12:0/3117963497 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03480ab860 con 0x7f0358137e60 2024-09-11T23:05:56.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.327+0000 7f035df42640 1 -- 172.21.15.12:0/3117963497 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0358137e60 msgr2=0x7f0358138240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:56.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.327+0000 7f035df42640 1 --2- 172.21.15.12:0/3117963497 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0358137e60 0x7f0358138240 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f0348009740 tx=0x7f034801c420 comp rx=0 tx=0).stop 2024-09-11T23:05:56.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.327+0000 7f035df42640 1 -- 172.21.15.12:0/3117963497 shutdown_connections 2024-09-11T23:05:56.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.327+0000 7f035df42640 1 --2- 172.21.15.12:0/3117963497 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0358137e60 0x7f0358138240 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:56.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.327+0000 7f035df42640 1 -- 172.21.15.12:0/3117963497 >> 172.21.15.12:0/3117963497 conn(0x7f03580a8450 msgr2=0x7f03580a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:56.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.327+0000 7f035df42640 1 -- 172.21.15.12:0/3117963497 shutdown_connections 2024-09-11T23:05:56.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.327+0000 7f035df42640 1 -- 172.21.15.12:0/3117963497 wait complete. 2024-09-11T23:05:56.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.327+0000 7f035df42640 1 Processor -- start 2024-09-11T23:05:56.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.327+0000 7f035df42640 1 -- start start 2024-09-11T23:05:56.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.327+0000 7f035df42640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f035809f6e0 0x7f03581cf920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:56.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.327+0000 7f035df42640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f035813fe00 con 0x7f035809f6e0 2024-09-11T23:05:56.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.327+0000 7f03577fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f035809f6e0 0x7f03581cf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:56.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.327+0000 7f03577fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f035809f6e0 0x7f03581cf920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48576/0 (socket says 172.21.15.12:48576) 2024-09-11T23:05:56.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.327+0000 7f03577fe640 1 -- 172.21.15.12:0/2977568705 learned_addr learned my addr 172.21.15.12:0/2977568705 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:56.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.327+0000 7f03577fe640 1 -- 172.21.15.12:0/2977568705 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03581389f0 con 0x7f035809f6e0 2024-09-11T23:05:56.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.327+0000 7f03577fe640 1 --2- 172.21.15.12:0/2977568705 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f035809f6e0 0x7f03581cf920 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f0348019030 tx=0x7f034801ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:56.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.327+0000 7f033ffff640 1 -- 172.21.15.12:0/2977568705 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03480bf410 con 0x7f035809f6e0 2024-09-11T23:05:56.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.327+0000 7f033ffff640 1 -- 172.21.15.12:0/2977568705 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03480bf5d0 con 0x7f035809f6e0 2024-09-11T23:05:56.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.327+0000 7f033ffff640 1 -- 172.21.15.12:0/2977568705 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03480bf8f0 con 0x7f035809f6e0 2024-09-11T23:05:56.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.327+0000 7f035df42640 1 -- 172.21.15.12:0/2977568705 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0358138c30 con 0x7f035809f6e0 2024-09-11T23:05:56.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.327+0000 7f035df42640 1 -- 172.21.15.12:0/2977568705 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f035813a520 con 0x7f035809f6e0 2024-09-11T23:05:56.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.327+0000 7f033ffff640 1 -- 172.21.15.12:0/2977568705 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 44053+0+0 (secure 0 0 0) 0x7f03480bd020 con 0x7f035809f6e0 2024-09-11T23:05:56.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.327+0000 7f035df42640 1 -- 172.21.15.12:0/2977568705 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03580008e0 con 0x7f035809f6e0 2024-09-11T23:05:56.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.331+0000 7f033ffff640 1 --2- 172.21.15.12:0/2977568705 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f0344035db0 0x7f0344038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:56.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.331+0000 7f033ffff640 1 -- 172.21.15.12:0/2977568705 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 3439+0+0 (secure 0 0 0) 0x7f03480e2d60 con 0x7f035809f6e0 2024-09-11T23:05:56.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.331+0000 7f0356ffd640 1 --2- 172.21.15.12:0/2977568705 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f0344035db0 0x7f0344038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:56.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.331+0000 7f0356ffd640 1 --2- 172.21.15.12:0/2977568705 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f0344035db0 0x7f0344038270 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f034c001610 tx=0x7f034c007ad0 comp rx=0 tx=0).ready entity=mgr.4708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:56.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.335+0000 7f033ffff640 1 -- 172.21.15.12:0/2977568705 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0348016010 con 0x7f035809f6e0 2024-09-11T23:05:56.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.495+0000 7f035df42640 1 -- 172.21.15.12:0/2977568705 --> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f03580726f0 con 0x7f0344035db0 2024-09-11T23:05:56.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.511+0000 7f033ffff640 1 -- 172.21.15.12:0/2977568705 <== mgr.4708 v2:172.21.15.12:6824/1925124150 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246083 (secure 0 0 0) 0x7f03580726f0 con 0x7f0344035db0 2024-09-11T23:05:56.516 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:05:56.517 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-11T23:05:56.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.515+0000 7f035df42640 1 -- 172.21.15.12:0/2977568705 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f0344035db0 msgr2=0x7f0344038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:56.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.515+0000 7f035df42640 1 --2- 172.21.15.12:0/2977568705 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f0344035db0 0x7f0344038270 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f034c001610 tx=0x7f034c007ad0 comp rx=0 tx=0).stop 2024-09-11T23:05:56.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.515+0000 7f035df42640 1 -- 172.21.15.12:0/2977568705 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f035809f6e0 msgr2=0x7f03581cf920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:56.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.515+0000 7f035df42640 1 --2- 172.21.15.12:0/2977568705 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f035809f6e0 0x7f03581cf920 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f0348019030 tx=0x7f034801ac60 comp rx=0 tx=0).stop 2024-09-11T23:05:56.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.515+0000 7f035df42640 1 -- 172.21.15.12:0/2977568705 shutdown_connections 2024-09-11T23:05:56.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.515+0000 7f035df42640 1 --2- 172.21.15.12:0/2977568705 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f0344035db0 0x7f0344038270 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:56.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.515+0000 7f035df42640 1 --2- 172.21.15.12:0/2977568705 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f035809f6e0 0x7f03581cf920 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:56.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.515+0000 7f035df42640 1 -- 172.21.15.12:0/2977568705 >> 172.21.15.12:0/2977568705 conn(0x7f03580a8450 msgr2=0x7f0358134b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:56.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.515+0000 7f035df42640 1 -- 172.21.15.12:0/2977568705 shutdown_connections 2024-09-11T23:05:56.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.515+0000 7f035df42640 1 -- 172.21.15.12:0/2977568705 wait complete. 2024-09-11T23:05:56.534 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-09-11T23:05:56.271273+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":490,"num_read_kb":915,"num_write":262,"num_write_kb":1908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":180,"ondisk_log_size":180,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":121,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":96312,"kb_used_data":2736,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":283019208,"statfs":{"total":289910292480,"available":289811668992,"internally_reserved":0,"allocated":2801664,"data_stored":1788880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001390"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.356376+0000","last_change":"2024-09-11T23:05:52.181115+0000","last_active":"2024-09-11T23:05:53.356376+0000","last_peered":"2024-09-11T23:05:53.356376+0000","last_clean":"2024-09-11T23:05:53.356376+0000","last_became_active":"2024-09-11T23:05:52.180849+0000","last_became_peered":"2024-09-11T23:05:52.180849+0000","last_unstale":"2024-09-11T23:05:53.356376+0000","last_undegraded":"2024-09-11T23:05:53.356376+0000","last_fullsized":"2024-09-11T23:05:53.356376+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:52.688931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.355262+0000","last_change":"2024-09-11T23:05:52.153636+0000","last_active":"2024-09-11T23:05:53.355262+0000","last_peered":"2024-09-11T23:05:53.355262+0000","last_clean":"2024-09-11T23:05:53.355262+0000","last_became_active":"2024-09-11T23:05:52.153262+0000","last_became_peered":"2024-09-11T23:05:52.153262+0000","last_unstale":"2024-09-11T23:05:53.355262+0000","last_undegraded":"2024-09-11T23:05:53.355262+0000","last_fullsized":"2024-09-11T23:05:53.355262+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:39.575524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.140584+0000","last_change":"2024-09-11T23:05:52.171547+0000","last_active":"2024-09-11T23:05:53.140584+0000","last_peered":"2024-09-11T23:05:53.140584+0000","last_clean":"2024-09-11T23:05:53.140584+0000","last_became_active":"2024-09-11T23:05:52.171242+0000","last_became_peered":"2024-09-11T23:05:52.171242+0000","last_unstale":"2024-09-11T23:05:53.140584+0000","last_undegraded":"2024-09-11T23:05:53.140584+0000","last_fullsized":"2024-09-11T23:05:53.140584+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:22.955881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.351958+0000","last_change":"2024-09-11T23:05:52.181112+0000","last_active":"2024-09-11T23:05:53.351958+0000","last_peered":"2024-09-11T23:05:53.351958+0000","last_clean":"2024-09-11T23:05:53.351958+0000","last_became_active":"2024-09-11T23:05:52.180819+0000","last_became_peered":"2024-09-11T23:05:52.180819+0000","last_unstale":"2024-09-11T23:05:53.351958+0000","last_undegraded":"2024-09-11T23:05:53.351958+0000","last_fullsized":"2024-09-11T23:05:53.351958+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:12.311665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.139349+0000","last_change":"2024-09-11T23:05:52.164937+0000","last_active":"2024-09-11T23:05:53.139349+0000","last_peered":"2024-09-11T23:05:53.139349+0000","last_clean":"2024-09-11T23:05:53.139349+0000","last_became_active":"2024-09-11T23:05:52.163201+0000","last_became_peered":"2024-09-11T23:05:52.163201+0000","last_unstale":"2024-09-11T23:05:53.139349+0000","last_undegraded":"2024-09-11T23:05:53.139349+0000","last_fullsized":"2024-09-11T23:05:53.139349+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:52.688931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.138983+0000","last_change":"2024-09-11T23:05:52.163306+0000","last_active":"2024-09-11T23:05:53.138983+0000","last_peered":"2024-09-11T23:05:53.138983+0000","last_clean":"2024-09-11T23:05:53.138983+0000","last_became_active":"2024-09-11T23:05:52.163009+0000","last_became_peered":"2024-09-11T23:05:52.163009+0000","last_unstale":"2024-09-11T23:05:53.138983+0000","last_undegraded":"2024-09-11T23:05:53.138983+0000","last_fullsized":"2024-09-11T23:05:53.138983+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:11.454342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.353309+0000","last_change":"2024-09-11T23:05:52.169818+0000","last_active":"2024-09-11T23:05:53.353309+0000","last_peered":"2024-09-11T23:05:53.353309+0000","last_clean":"2024-09-11T23:05:53.353309+0000","last_became_active":"2024-09-11T23:05:52.169535+0000","last_became_peered":"2024-09-11T23:05:52.169535+0000","last_unstale":"2024-09-11T23:05:53.353309+0000","last_undegraded":"2024-09-11T23:05:53.353309+0000","last_fullsized":"2024-09-11T23:05:53.353309+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:03.139498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.350685+0000","last_change":"2024-09-11T23:05:52.158771+0000","last_active":"2024-09-11T23:05:53.350685+0000","last_peered":"2024-09-11T23:05:53.350685+0000","last_clean":"2024-09-11T23:05:53.350685+0000","last_became_active":"2024-09-11T23:05:52.156562+0000","last_became_peered":"2024-09-11T23:05:52.156562+0000","last_unstale":"2024-09-11T23:05:53.350685+0000","last_undegraded":"2024-09-11T23:05:53.350685+0000","last_fullsized":"2024-09-11T23:05:53.350685+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:25.350191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.140967+0000","last_change":"2024-09-11T23:05:52.168553+0000","last_active":"2024-09-11T23:05:53.140967+0000","last_peered":"2024-09-11T23:05:53.140967+0000","last_clean":"2024-09-11T23:05:53.140967+0000","last_became_active":"2024-09-11T23:05:52.168171+0000","last_became_peered":"2024-09-11T23:05:52.168171+0000","last_unstale":"2024-09-11T23:05:53.140967+0000","last_undegraded":"2024-09-11T23:05:53.140967+0000","last_fullsized":"2024-09-11T23:05:53.140967+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:48.473050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.354406+0000","last_change":"2024-09-11T23:05:52.178905+0000","last_active":"2024-09-11T23:05:53.354406+0000","last_peered":"2024-09-11T23:05:53.354406+0000","last_clean":"2024-09-11T23:05:53.354406+0000","last_became_active":"2024-09-11T23:05:52.178162+0000","last_became_peered":"2024-09-11T23:05:52.178162+0000","last_unstale":"2024-09-11T23:05:53.354406+0000","last_undegraded":"2024-09-11T23:05:53.354406+0000","last_fullsized":"2024-09-11T23:05:53.354406+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:55:36.396911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.354816+0000","last_change":"2024-09-11T23:05:52.173314+0000","last_active":"2024-09-11T23:05:53.354816+0000","last_peered":"2024-09-11T23:05:53.354816+0000","last_clean":"2024-09-11T23:05:53.354816+0000","last_became_active":"2024-09-11T23:05:52.172547+0000","last_became_peered":"2024-09-11T23:05:52.172547+0000","last_unstale":"2024-09-11T23:05:53.354816+0000","last_undegraded":"2024-09-11T23:05:53.354816+0000","last_fullsized":"2024-09-11T23:05:53.354816+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:58:12.583209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.352369+0000","last_change":"2024-09-11T23:05:52.170072+0000","last_active":"2024-09-11T23:05:53.352369+0000","last_peered":"2024-09-11T23:05:53.352369+0000","last_clean":"2024-09-11T23:05:53.352369+0000","last_became_active":"2024-09-11T23:05:52.169806+0000","last_became_peered":"2024-09-11T23:05:52.169806+0000","last_unstale":"2024-09-11T23:05:53.352369+0000","last_undegraded":"2024-09-11T23:05:53.352369+0000","last_fullsized":"2024-09-11T23:05:53.352369+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:19.471180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.353422+0000","last_change":"2024-09-11T23:05:52.161273+0000","last_active":"2024-09-11T23:05:53.353422+0000","last_peered":"2024-09-11T23:05:53.353422+0000","last_clean":"2024-09-11T23:05:53.353422+0000","last_became_active":"2024-09-11T23:05:52.160991+0000","last_became_peered":"2024-09-11T23:05:52.160991+0000","last_unstale":"2024-09-11T23:05:53.353422+0000","last_undegraded":"2024-09-11T23:05:53.353422+0000","last_fullsized":"2024-09-11T23:05:53.353422+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:03.939345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.138975+0000","last_change":"2024-09-11T23:05:52.184787+0000","last_active":"2024-09-11T23:05:53.138975+0000","last_peered":"2024-09-11T23:05:53.138975+0000","last_clean":"2024-09-11T23:05:53.138975+0000","last_became_active":"2024-09-11T23:05:52.184444+0000","last_became_peered":"2024-09-11T23:05:52.184444+0000","last_unstale":"2024-09-11T23:05:53.138975+0000","last_undegraded":"2024-09-11T23:05:53.138975+0000","last_fullsized":"2024-09-11T23:05:53.138975+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:19.738248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.351227+0000","last_change":"2024-09-11T23:05:52.172821+0000","last_active":"2024-09-11T23:05:53.351227+0000","last_peered":"2024-09-11T23:05:53.351227+0000","last_clean":"2024-09-11T23:05:53.351227+0000","last_became_active":"2024-09-11T23:05:52.172206+0000","last_became_peered":"2024-09-11T23:05:52.172206+0000","last_unstale":"2024-09-11T23:05:53.351227+0000","last_undegraded":"2024-09-11T23:05:53.351227+0000","last_fullsized":"2024-09-11T23:05:53.351227+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:30.088563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.138652+0000","last_change":"2024-09-11T23:05:52.168268+0000","last_active":"2024-09-11T23:05:53.138652+0000","last_peered":"2024-09-11T23:05:53.138652+0000","last_clean":"2024-09-11T23:05:53.138652+0000","last_became_active":"2024-09-11T23:05:52.166105+0000","last_became_peered":"2024-09-11T23:05:52.166105+0000","last_unstale":"2024-09-11T23:05:53.138652+0000","last_undegraded":"2024-09-11T23:05:53.138652+0000","last_fullsized":"2024-09-11T23:05:53.138652+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:55:36.396911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.141083+0000","last_change":"2024-09-11T23:05:52.182647+0000","last_active":"2024-09-11T23:05:53.141083+0000","last_peered":"2024-09-11T23:05:53.141083+0000","last_clean":"2024-09-11T23:05:53.141083+0000","last_became_active":"2024-09-11T23:05:52.182345+0000","last_became_peered":"2024-09-11T23:05:52.182345+0000","last_unstale":"2024-09-11T23:05:53.141083+0000","last_undegraded":"2024-09-11T23:05:53.141083+0000","last_fullsized":"2024-09-11T23:05:53.141083+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:56.907364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.354810+0000","last_change":"2024-09-11T23:05:52.178419+0000","last_active":"2024-09-11T23:05:53.354810+0000","last_peered":"2024-09-11T23:05:53.354810+0000","last_clean":"2024-09-11T23:05:53.354810+0000","last_became_active":"2024-09-11T23:05:52.178056+0000","last_became_peered":"2024-09-11T23:05:52.178056+0000","last_unstale":"2024-09-11T23:05:53.354810+0000","last_undegraded":"2024-09-11T23:05:53.354810+0000","last_fullsized":"2024-09-11T23:05:53.354810+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:03.135212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.139914+0000","last_change":"2024-09-11T23:05:52.182235+0000","last_active":"2024-09-11T23:05:53.139914+0000","last_peered":"2024-09-11T23:05:53.139914+0000","last_clean":"2024-09-11T23:05:53.139914+0000","last_became_active":"2024-09-11T23:05:52.181737+0000","last_became_peered":"2024-09-11T23:05:52.181737+0000","last_unstale":"2024-09-11T23:05:53.139914+0000","last_undegraded":"2024-09-11T23:05:53.139914+0000","last_fullsized":"2024-09-11T23:05:53.139914+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:23.681973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.351689+0000","last_change":"2024-09-11T23:05:52.178551+0000","last_active":"2024-09-11T23:05:53.351689+0000","last_peered":"2024-09-11T23:05:53.351689+0000","last_clean":"2024-09-11T23:05:53.351689+0000","last_became_active":"2024-09-11T23:05:52.177866+0000","last_became_peered":"2024-09-11T23:05:52.177866+0000","last_unstale":"2024-09-11T23:05:53.351689+0000","last_undegraded":"2024-09-11T23:05:53.351689+0000","last_fullsized":"2024-09-11T23:05:53.351689+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:04.242009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.353836+0000","last_change":"2024-09-11T23:05:52.177388+0000","last_active":"2024-09-11T23:05:53.353836+0000","last_peered":"2024-09-11T23:05:53.353836+0000","last_clean":"2024-09-11T23:05:53.353836+0000","last_became_active":"2024-09-11T23:05:52.176961+0000","last_became_peered":"2024-09-11T23:05:52.176961+0000","last_unstale":"2024-09-11T23:05:53.353836+0000","last_undegraded":"2024-09-11T23:05:53.353836+0000","last_fullsized":"2024-09-11T23:05:53.353836+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:34.977512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.140310+0000","last_change":"2024-09-11T23:05:52.183091+0000","last_active":"2024-09-11T23:05:53.140310+0000","last_peered":"2024-09-11T23:05:53.140310+0000","last_clean":"2024-09-11T23:05:53.140310+0000","last_became_active":"2024-09-11T23:05:52.182540+0000","last_became_peered":"2024-09-11T23:05:52.182540+0000","last_unstale":"2024-09-11T23:05:53.140310+0000","last_undegraded":"2024-09-11T23:05:53.140310+0000","last_fullsized":"2024-09-11T23:05:53.140310+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:17.565874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.353700+0000","last_change":"2024-09-11T23:05:52.150467+0000","last_active":"2024-09-11T23:05:53.353700+0000","last_peered":"2024-09-11T23:05:53.353700+0000","last_clean":"2024-09-11T23:05:53.353700+0000","last_became_active":"2024-09-11T23:05:52.149172+0000","last_became_peered":"2024-09-11T23:05:52.149172+0000","last_unstale":"2024-09-11T23:05:53.353700+0000","last_undegraded":"2024-09-11T23:05:53.353700+0000","last_fullsized":"2024-09-11T23:05:53.353700+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:41.608163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.351066+0000","last_change":"2024-09-11T23:05:52.173000+0000","last_active":"2024-09-11T23:05:53.351066+0000","last_peered":"2024-09-11T23:05:53.351066+0000","last_clean":"2024-09-11T23:05:53.351066+0000","last_became_active":"2024-09-11T23:05:52.172234+0000","last_became_peered":"2024-09-11T23:05:52.172234+0000","last_unstale":"2024-09-11T23:05:53.351066+0000","last_undegraded":"2024-09-11T23:05:53.351066+0000","last_fullsized":"2024-09-11T23:05:53.351066+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:39.329630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.355855+0000","last_change":"2024-09-11T23:05:52.149068+0000","last_active":"2024-09-11T23:05:53.355855+0000","last_peered":"2024-09-11T23:05:53.355855+0000","last_clean":"2024-09-11T23:05:53.355855+0000","last_became_active":"2024-09-11T23:05:52.148562+0000","last_became_peered":"2024-09-11T23:05:52.148562+0000","last_unstale":"2024-09-11T23:05:53.355855+0000","last_undegraded":"2024-09-11T23:05:53.355855+0000","last_fullsized":"2024-09-11T23:05:53.355855+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:19.738248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.355181+0000","last_change":"2024-09-11T23:05:52.179478+0000","last_active":"2024-09-11T23:05:53.355181+0000","last_peered":"2024-09-11T23:05:53.355181+0000","last_clean":"2024-09-11T23:05:53.355181+0000","last_became_active":"2024-09-11T23:05:52.178545+0000","last_became_peered":"2024-09-11T23:05:52.178545+0000","last_unstale":"2024-09-11T23:05:53.355181+0000","last_undegraded":"2024-09-11T23:05:53.355181+0000","last_fullsized":"2024-09-11T23:05:53.355181+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:21:27.064634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.355198+0000","last_change":"2024-09-11T23:05:52.153458+0000","last_active":"2024-09-11T23:05:53.355198+0000","last_peered":"2024-09-11T23:05:53.355198+0000","last_clean":"2024-09-11T23:05:53.355198+0000","last_became_active":"2024-09-11T23:05:52.153184+0000","last_became_peered":"2024-09-11T23:05:52.153184+0000","last_unstale":"2024-09-11T23:05:53.355198+0000","last_undegraded":"2024-09-11T23:05:53.355198+0000","last_fullsized":"2024-09-11T23:05:53.355198+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:08.409695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.352100+0000","last_change":"2024-09-11T23:05:52.178248+0000","last_active":"2024-09-11T23:05:53.352100+0000","last_peered":"2024-09-11T23:05:53.352100+0000","last_clean":"2024-09-11T23:05:53.352100+0000","last_became_active":"2024-09-11T23:05:52.177441+0000","last_became_peered":"2024-09-11T23:05:52.177441+0000","last_unstale":"2024-09-11T23:05:53.352100+0000","last_undegraded":"2024-09-11T23:05:53.352100+0000","last_fullsized":"2024-09-11T23:05:53.352100+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:50.422394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.354256+0000","last_change":"2024-09-11T23:05:52.174922+0000","last_active":"2024-09-11T23:05:53.354256+0000","last_peered":"2024-09-11T23:05:53.354256+0000","last_clean":"2024-09-11T23:05:53.354256+0000","last_became_active":"2024-09-11T23:05:52.174702+0000","last_became_peered":"2024-09-11T23:05:52.174702+0000","last_unstale":"2024-09-11T23:05:53.354256+0000","last_undegraded":"2024-09-11T23:05:53.354256+0000","last_fullsized":"2024-09-11T23:05:53.354256+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:53.937400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.351310+0000","last_change":"2024-09-11T23:05:52.145322+0000","last_active":"2024-09-11T23:05:53.351310+0000","last_peered":"2024-09-11T23:05:53.351310+0000","last_clean":"2024-09-11T23:05:53.351310+0000","last_became_active":"2024-09-11T23:05:52.143063+0000","last_became_peered":"2024-09-11T23:05:52.143063+0000","last_unstale":"2024-09-11T23:05:53.351310+0000","last_undegraded":"2024-09-11T23:05:53.351310+0000","last_fullsized":"2024-09-11T23:05:53.351310+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:25.064002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.351592+0000","last_change":"2024-09-11T23:05:52.172486+0000","last_active":"2024-09-11T23:05:53.351592+0000","last_peered":"2024-09-11T23:05:53.351592+0000","last_clean":"2024-09-11T23:05:53.351592+0000","last_became_active":"2024-09-11T23:05:52.171829+0000","last_became_peered":"2024-09-11T23:05:52.171829+0000","last_unstale":"2024-09-11T23:05:53.351592+0000","last_undegraded":"2024-09-11T23:05:53.351592+0000","last_fullsized":"2024-09-11T23:05:53.351592+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:11:56.724686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.351443+0000","last_change":"2024-09-11T23:05:52.177648+0000","last_active":"2024-09-11T23:05:53.351443+0000","last_peered":"2024-09-11T23:05:53.351443+0000","last_clean":"2024-09-11T23:05:53.351443+0000","last_became_active":"2024-09-11T23:05:52.177231+0000","last_became_peered":"2024-09-11T23:05:52.177231+0000","last_unstale":"2024-09-11T23:05:53.351443+0000","last_undegraded":"2024-09-11T23:05:53.351443+0000","last_fullsized":"2024-09-11T23:05:53.351443+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:20.294528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.141027+0000","last_change":"2024-09-11T23:05:52.168061+0000","last_active":"2024-09-11T23:05:53.141027+0000","last_peered":"2024-09-11T23:05:53.141027+0000","last_clean":"2024-09-11T23:05:53.141027+0000","last_became_active":"2024-09-11T23:05:52.166274+0000","last_became_peered":"2024-09-11T23:05:52.166274+0000","last_unstale":"2024-09-11T23:05:53.141027+0000","last_undegraded":"2024-09-11T23:05:53.141027+0000","last_fullsized":"2024-09-11T23:05:53.141027+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:47.308468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1f","version":"53'4","reported_seq":18,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.141156+0000","last_change":"2024-09-11T23:05:51.166812+0000","last_active":"2024-09-11T23:05:53.141156+0000","last_peered":"2024-09-11T23:05:53.141156+0000","last_clean":"2024-09-11T23:05:53.141156+0000","last_became_active":"2024-09-11T23:05:51.166248+0000","last_became_peered":"2024-09-11T23:05:51.166248+0000","last_unstale":"2024-09-11T23:05:53.141156+0000","last_undegraded":"2024-09-11T23:05:53.141156+0000","last_fullsized":"2024-09-11T23:05:53.141156+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:11.634441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.141298+0000","last_change":"2024-09-11T23:05:52.183146+0000","last_active":"2024-09-11T23:05:53.141298+0000","last_peered":"2024-09-11T23:05:53.141298+0000","last_clean":"2024-09-11T23:05:53.141298+0000","last_became_active":"2024-09-11T23:05:52.182832+0000","last_became_peered":"2024-09-11T23:05:52.182832+0000","last_unstale":"2024-09-11T23:05:53.141298+0000","last_undegraded":"2024-09-11T23:05:53.141298+0000","last_fullsized":"2024-09-11T23:05:53.141298+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:46.056855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.355887+0000","last_change":"2024-09-11T23:05:51.153850+0000","last_active":"2024-09-11T23:05:53.355887+0000","last_peered":"2024-09-11T23:05:53.355887+0000","last_clean":"2024-09-11T23:05:53.355887+0000","last_became_active":"2024-09-11T23:05:51.153043+0000","last_became_peered":"2024-09-11T23:05:51.153043+0000","last_unstale":"2024-09-11T23:05:53.355887+0000","last_undegraded":"2024-09-11T23:05:53.355887+0000","last_fullsized":"2024-09-11T23:05:53.355887+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:32.021786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.139671+0000","last_change":"2024-09-11T23:05:52.173151+0000","last_active":"2024-09-11T23:05:53.139671+0000","last_peered":"2024-09-11T23:05:53.139671+0000","last_clean":"2024-09-11T23:05:53.139671+0000","last_became_active":"2024-09-11T23:05:52.172644+0000","last_became_peered":"2024-09-11T23:05:52.172644+0000","last_unstale":"2024-09-11T23:05:53.139671+0000","last_undegraded":"2024-09-11T23:05:53.139671+0000","last_fullsized":"2024-09-11T23:05:53.139671+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:35:18.203820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1d","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.140440+0000","last_change":"2024-09-11T23:05:51.164984+0000","last_active":"2024-09-11T23:05:53.140440+0000","last_peered":"2024-09-11T23:05:53.140440+0000","last_clean":"2024-09-11T23:05:53.140440+0000","last_became_active":"2024-09-11T23:05:51.164024+0000","last_became_peered":"2024-09-11T23:05:51.164024+0000","last_unstale":"2024-09-11T23:05:53.140440+0000","last_undegraded":"2024-09-11T23:05:53.140440+0000","last_fullsized":"2024-09-11T23:05:53.140440+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:23.364825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.354908+0000","last_change":"2024-09-11T23:05:52.148711+0000","last_active":"2024-09-11T23:05:53.354908+0000","last_peered":"2024-09-11T23:05:53.354908+0000","last_clean":"2024-09-11T23:05:53.354908+0000","last_became_active":"2024-09-11T23:05:52.148317+0000","last_became_peered":"2024-09-11T23:05:52.148317+0000","last_unstale":"2024-09-11T23:05:53.354908+0000","last_undegraded":"2024-09-11T23:05:53.354908+0000","last_fullsized":"2024-09-11T23:05:53.354908+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:26:46.934313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.139529+0000","last_change":"2024-09-11T23:05:51.170122+0000","last_active":"2024-09-11T23:05:53.139529+0000","last_peered":"2024-09-11T23:05:53.139529+0000","last_clean":"2024-09-11T23:05:53.139529+0000","last_became_active":"2024-09-11T23:05:51.167953+0000","last_became_peered":"2024-09-11T23:05:51.167953+0000","last_unstale":"2024-09-11T23:05:53.139529+0000","last_undegraded":"2024-09-11T23:05:53.139529+0000","last_fullsized":"2024-09-11T23:05:53.139529+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:43.104325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.139305+0000","last_change":"2024-09-11T23:05:52.165261+0000","last_active":"2024-09-11T23:05:53.139305+0000","last_peered":"2024-09-11T23:05:53.139305+0000","last_clean":"2024-09-11T23:05:53.139305+0000","last_became_active":"2024-09-11T23:05:52.164950+0000","last_became_peered":"2024-09-11T23:05:52.164950+0000","last_unstale":"2024-09-11T23:05:53.139305+0000","last_undegraded":"2024-09-11T23:05:53.139305+0000","last_fullsized":"2024-09-11T23:05:53.139305+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:34.433389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1b","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.140045+0000","last_change":"2024-09-11T23:05:51.161012+0000","last_active":"2024-09-11T23:05:53.140045+0000","last_peered":"2024-09-11T23:05:53.140045+0000","last_clean":"2024-09-11T23:05:53.140045+0000","last_became_active":"2024-09-11T23:05:51.160380+0000","last_became_peered":"2024-09-11T23:05:51.160380+0000","last_unstale":"2024-09-11T23:05:53.140045+0000","last_undegraded":"2024-09-11T23:05:53.140045+0000","last_fullsized":"2024-09-11T23:05:53.140045+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:22.911307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.139577+0000","last_change":"2024-09-11T23:05:52.183084+0000","last_active":"2024-09-11T23:05:53.139577+0000","last_peered":"2024-09-11T23:05:53.139577+0000","last_clean":"2024-09-11T23:05:53.139577+0000","last_became_active":"2024-09-11T23:05:52.182736+0000","last_became_peered":"2024-09-11T23:05:52.182736+0000","last_unstale":"2024-09-11T23:05:53.139577+0000","last_undegraded":"2024-09-11T23:05:53.139577+0000","last_fullsized":"2024-09-11T23:05:53.139577+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:11.324570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1a","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.351814+0000","last_change":"2024-09-11T23:05:51.173204+0000","last_active":"2024-09-11T23:05:53.351814+0000","last_peered":"2024-09-11T23:05:53.351814+0000","last_clean":"2024-09-11T23:05:53.351814+0000","last_became_active":"2024-09-11T23:05:51.172757+0000","last_became_peered":"2024-09-11T23:05:51.172757+0000","last_unstale":"2024-09-11T23:05:53.351814+0000","last_undegraded":"2024-09-11T23:05:53.351814+0000","last_fullsized":"2024-09-11T23:05:53.351814+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:13:02.780362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.138705+0000","last_change":"2024-09-11T23:05:52.187086+0000","last_active":"2024-09-11T23:05:53.138705+0000","last_peered":"2024-09-11T23:05:53.138705+0000","last_clean":"2024-09-11T23:05:53.138705+0000","last_became_active":"2024-09-11T23:05:52.182383+0000","last_became_peered":"2024-09-11T23:05:52.182383+0000","last_unstale":"2024-09-11T23:05:53.138705+0000","last_undegraded":"2024-09-11T23:05:53.138705+0000","last_fullsized":"2024-09-11T23:05:53.138705+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:03.135212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.353839+0000","last_change":"2024-09-11T23:05:51.168069+0000","last_active":"2024-09-11T23:05:53.353839+0000","last_peered":"2024-09-11T23:05:53.353839+0000","last_clean":"2024-09-11T23:05:53.353839+0000","last_became_active":"2024-09-11T23:05:51.166163+0000","last_became_peered":"2024-09-11T23:05:51.166163+0000","last_unstale":"2024-09-11T23:05:53.353839+0000","last_undegraded":"2024-09-11T23:05:53.353839+0000","last_fullsized":"2024-09-11T23:05:53.353839+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:23:16.784041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.351954+0000","last_change":"2024-09-11T23:05:52.157196+0000","last_active":"2024-09-11T23:05:53.351954+0000","last_peered":"2024-09-11T23:05:53.351954+0000","last_clean":"2024-09-11T23:05:53.351954+0000","last_became_active":"2024-09-11T23:05:52.156827+0000","last_became_peered":"2024-09-11T23:05:52.156827+0000","last_unstale":"2024-09-11T23:05:53.351954+0000","last_undegraded":"2024-09-11T23:05:53.351954+0000","last_fullsized":"2024-09-11T23:05:53.351954+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:22:38.639080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.138776+0000","last_change":"2024-09-11T23:05:51.161095+0000","last_active":"2024-09-11T23:05:53.138776+0000","last_peered":"2024-09-11T23:05:53.138776+0000","last_clean":"2024-09-11T23:05:53.138776+0000","last_became_active":"2024-09-11T23:05:51.159971+0000","last_became_peered":"2024-09-11T23:05:51.159971+0000","last_unstale":"2024-09-11T23:05:53.138776+0000","last_undegraded":"2024-09-11T23:05:53.138776+0000","last_fullsized":"2024-09-11T23:05:53.138776+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:33.775730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.355951+0000","last_change":"2024-09-11T23:05:52.150416+0000","last_active":"2024-09-11T23:05:53.355951+0000","last_peered":"2024-09-11T23:05:53.355951+0000","last_clean":"2024-09-11T23:05:53.355951+0000","last_became_active":"2024-09-11T23:05:52.148894+0000","last_became_peered":"2024-09-11T23:05:52.148894+0000","last_unstale":"2024-09-11T23:05:53.355951+0000","last_undegraded":"2024-09-11T23:05:53.355951+0000","last_fullsized":"2024-09-11T23:05:53.355951+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:11.454342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.353332+0000","last_change":"2024-09-11T23:05:51.176393+0000","last_active":"2024-09-11T23:05:53.353332+0000","last_peered":"2024-09-11T23:05:53.353332+0000","last_clean":"2024-09-11T23:05:53.353332+0000","last_became_active":"2024-09-11T23:05:51.175783+0000","last_became_peered":"2024-09-11T23:05:51.175783+0000","last_unstale":"2024-09-11T23:05:53.353332+0000","last_undegraded":"2024-09-11T23:05:53.353332+0000","last_fullsized":"2024-09-11T23:05:53.353332+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:55.308504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.352792+0000","last_change":"2024-09-11T23:05:52.157507+0000","last_active":"2024-09-11T23:05:53.352792+0000","last_peered":"2024-09-11T23:05:53.352792+0000","last_clean":"2024-09-11T23:05:53.352792+0000","last_became_active":"2024-09-11T23:05:52.156911+0000","last_became_peered":"2024-09-11T23:05:52.156911+0000","last_unstale":"2024-09-11T23:05:53.352792+0000","last_undegraded":"2024-09-11T23:05:53.352792+0000","last_fullsized":"2024-09-11T23:05:53.352792+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:23.378315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.355888+0000","last_change":"2024-09-11T23:05:51.153984+0000","last_active":"2024-09-11T23:05:53.355888+0000","last_peered":"2024-09-11T23:05:53.355888+0000","last_clean":"2024-09-11T23:05:53.355888+0000","last_became_active":"2024-09-11T23:05:51.153729+0000","last_became_peered":"2024-09-11T23:05:51.153729+0000","last_unstale":"2024-09-11T23:05:53.355888+0000","last_undegraded":"2024-09-11T23:05:53.355888+0000","last_fullsized":"2024-09-11T23:05:53.355888+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:34.846627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.352520+0000","last_change":"2024-09-11T23:05:52.157389+0000","last_active":"2024-09-11T23:05:53.352520+0000","last_peered":"2024-09-11T23:05:53.352520+0000","last_clean":"2024-09-11T23:05:53.352520+0000","last_became_active":"2024-09-11T23:05:52.157029+0000","last_became_peered":"2024-09-11T23:05:52.157029+0000","last_unstale":"2024-09-11T23:05:53.352520+0000","last_undegraded":"2024-09-11T23:05:53.352520+0000","last_fullsized":"2024-09-11T23:05:53.352520+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:21.192356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.15","version":"53'3","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.355460+0000","last_change":"2024-09-11T23:05:51.164734+0000","last_active":"2024-09-11T23:05:53.355460+0000","last_peered":"2024-09-11T23:05:53.355460+0000","last_clean":"2024-09-11T23:05:53.355460+0000","last_became_active":"2024-09-11T23:05:51.163923+0000","last_became_peered":"2024-09-11T23:05:51.163923+0000","last_unstale":"2024-09-11T23:05:53.355460+0000","last_undegraded":"2024-09-11T23:05:53.355460+0000","last_fullsized":"2024-09-11T23:05:53.355460+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:46.303321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.140127+0000","last_change":"2024-09-11T23:05:52.185138+0000","last_active":"2024-09-11T23:05:53.140127+0000","last_peered":"2024-09-11T23:05:53.140127+0000","last_clean":"2024-09-11T23:05:53.140127+0000","last_became_active":"2024-09-11T23:05:52.184425+0000","last_became_peered":"2024-09-11T23:05:52.184425+0000","last_unstale":"2024-09-11T23:05:53.140127+0000","last_undegraded":"2024-09-11T23:05:53.140127+0000","last_fullsized":"2024-09-11T23:05:53.140127+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:23.276292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"53'6","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.353318+0000","last_change":"2024-09-11T23:05:51.168708+0000","last_active":"2024-09-11T23:05:53.353318+0000","last_peered":"2024-09-11T23:05:53.353318+0000","last_clean":"2024-09-11T23:05:53.353318+0000","last_became_active":"2024-09-11T23:05:51.168229+0000","last_became_peered":"2024-09-11T23:05:51.168229+0000","last_unstale":"2024-09-11T23:05:53.353318+0000","last_undegraded":"2024-09-11T23:05:53.353318+0000","last_fullsized":"2024-09-11T23:05:53.353318+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:26:28.412915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.139610+0000","last_change":"2024-09-11T23:05:52.165422+0000","last_active":"2024-09-11T23:05:53.139610+0000","last_peered":"2024-09-11T23:05:53.139610+0000","last_clean":"2024-09-11T23:05:53.139610+0000","last_became_active":"2024-09-11T23:05:52.164978+0000","last_became_peered":"2024-09-11T23:05:52.164978+0000","last_unstale":"2024-09-11T23:05:53.139610+0000","last_undegraded":"2024-09-11T23:05:53.139610+0000","last_fullsized":"2024-09-11T23:05:53.139610+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:37.290244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.13","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.353918+0000","last_change":"2024-09-11T23:05:51.168736+0000","last_active":"2024-09-11T23:05:53.353918+0000","last_peered":"2024-09-11T23:05:53.353918+0000","last_clean":"2024-09-11T23:05:53.353918+0000","last_became_active":"2024-09-11T23:05:51.168282+0000","last_became_peered":"2024-09-11T23:05:51.168282+0000","last_unstale":"2024-09-11T23:05:53.353918+0000","last_undegraded":"2024-09-11T23:05:53.353918+0000","last_fullsized":"2024-09-11T23:05:53.353918+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:44.514550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.353253+0000","last_change":"2024-09-11T23:05:52.148846+0000","last_active":"2024-09-11T23:05:53.353253+0000","last_peered":"2024-09-11T23:05:53.353253+0000","last_clean":"2024-09-11T23:05:53.353253+0000","last_became_active":"2024-09-11T23:05:52.148292+0000","last_became_peered":"2024-09-11T23:05:52.148292+0000","last_unstale":"2024-09-11T23:05:53.353253+0000","last_undegraded":"2024-09-11T23:05:53.353253+0000","last_fullsized":"2024-09-11T23:05:53.353253+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:15.631857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.352064+0000","last_change":"2024-09-11T23:05:51.172346+0000","last_active":"2024-09-11T23:05:53.352064+0000","last_peered":"2024-09-11T23:05:53.352064+0000","last_clean":"2024-09-11T23:05:53.352064+0000","last_became_active":"2024-09-11T23:05:51.169415+0000","last_became_peered":"2024-09-11T23:05:51.169415+0000","last_unstale":"2024-09-11T23:05:53.352064+0000","last_undegraded":"2024-09-11T23:05:53.352064+0000","last_fullsized":"2024-09-11T23:05:53.352064+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:53.427583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.351809+0000","last_change":"2024-09-11T23:05:52.172286+0000","last_active":"2024-09-11T23:05:53.351809+0000","last_peered":"2024-09-11T23:05:53.351809+0000","last_clean":"2024-09-11T23:05:53.351809+0000","last_became_active":"2024-09-11T23:05:52.171991+0000","last_became_peered":"2024-09-11T23:05:52.171991+0000","last_unstale":"2024-09-11T23:05:53.351809+0000","last_undegraded":"2024-09-11T23:05:53.351809+0000","last_fullsized":"2024-09-11T23:05:53.351809+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:25.495640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.354094+0000","last_change":"2024-09-11T23:05:51.163269+0000","last_active":"2024-09-11T23:05:53.354094+0000","last_peered":"2024-09-11T23:05:53.354094+0000","last_clean":"2024-09-11T23:05:53.354094+0000","last_became_active":"2024-09-11T23:05:51.163000+0000","last_became_peered":"2024-09-11T23:05:51.163000+0000","last_unstale":"2024-09-11T23:05:53.354094+0000","last_undegraded":"2024-09-11T23:05:53.354094+0000","last_fullsized":"2024-09-11T23:05:53.354094+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:13.550902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.138785+0000","last_change":"2024-09-11T23:05:52.163365+0000","last_active":"2024-09-11T23:05:53.138785+0000","last_peered":"2024-09-11T23:05:53.138785+0000","last_clean":"2024-09-11T23:05:53.138785+0000","last_became_active":"2024-09-11T23:05:52.162924+0000","last_became_peered":"2024-09-11T23:05:52.162924+0000","last_unstale":"2024-09-11T23:05:53.138785+0000","last_undegraded":"2024-09-11T23:05:53.138785+0000","last_fullsized":"2024-09-11T23:05:53.138785+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:26:46.934313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"53'8","reported_seq":22,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.351368+0000","last_change":"2024-09-11T23:05:51.168294+0000","last_active":"2024-09-11T23:05:53.351368+0000","last_peered":"2024-09-11T23:05:53.351368+0000","last_clean":"2024-09-11T23:05:53.351368+0000","last_became_active":"2024-09-11T23:05:51.166257+0000","last_became_peered":"2024-09-11T23:05:51.166257+0000","last_unstale":"2024-09-11T23:05:53.351368+0000","last_undegraded":"2024-09-11T23:05:53.351368+0000","last_fullsized":"2024-09-11T23:05:53.351368+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:11:24.379246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.355718+0000","last_change":"2024-09-11T23:05:52.145644+0000","last_active":"2024-09-11T23:05:53.355718+0000","last_peered":"2024-09-11T23:05:53.355718+0000","last_clean":"2024-09-11T23:05:53.355718+0000","last_became_active":"2024-09-11T23:05:52.144048+0000","last_became_peered":"2024-09-11T23:05:52.144048+0000","last_unstale":"2024-09-11T23:05:53.355718+0000","last_undegraded":"2024-09-11T23:05:53.355718+0000","last_fullsized":"2024-09-11T23:05:53.355718+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:23.889156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.356218+0000","last_change":"2024-09-11T23:05:51.175176+0000","last_active":"2024-09-11T23:05:53.356218+0000","last_peered":"2024-09-11T23:05:53.356218+0000","last_clean":"2024-09-11T23:05:53.356218+0000","last_became_active":"2024-09-11T23:05:51.172340+0000","last_became_peered":"2024-09-11T23:05:51.172340+0000","last_unstale":"2024-09-11T23:05:53.356218+0000","last_undegraded":"2024-09-11T23:05:53.356218+0000","last_fullsized":"2024-09-11T23:05:53.356218+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:11.634441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.353192+0000","last_change":"2024-09-11T23:05:52.157618+0000","last_active":"2024-09-11T23:05:53.353192+0000","last_peered":"2024-09-11T23:05:53.353192+0000","last_clean":"2024-09-11T23:05:53.353192+0000","last_became_active":"2024-09-11T23:05:52.157254+0000","last_became_peered":"2024-09-11T23:05:52.157254+0000","last_unstale":"2024-09-11T23:05:53.353192+0000","last_undegraded":"2024-09-11T23:05:53.353192+0000","last_fullsized":"2024-09-11T23:05:53.353192+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:28.911725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.356104+0000","last_change":"2024-09-11T23:05:51.171530+0000","last_active":"2024-09-11T23:05:53.356104+0000","last_peered":"2024-09-11T23:05:53.356104+0000","last_clean":"2024-09-11T23:05:53.356104+0000","last_became_active":"2024-09-11T23:05:51.170868+0000","last_became_peered":"2024-09-11T23:05:51.170868+0000","last_unstale":"2024-09-11T23:05:53.356104+0000","last_undegraded":"2024-09-11T23:05:53.356104+0000","last_fullsized":"2024-09-11T23:05:53.356104+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:36.287797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.352782+0000","last_change":"2024-09-11T23:05:52.174543+0000","last_active":"2024-09-11T23:05:53.352782+0000","last_peered":"2024-09-11T23:05:53.352782+0000","last_clean":"2024-09-11T23:05:53.352782+0000","last_became_active":"2024-09-11T23:05:52.169995+0000","last_became_peered":"2024-09-11T23:05:52.169995+0000","last_unstale":"2024-09-11T23:05:53.352782+0000","last_undegraded":"2024-09-11T23:05:53.352782+0000","last_fullsized":"2024-09-11T23:05:53.352782+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:01.369314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.355439+0000","last_change":"2024-09-11T23:05:51.165142+0000","last_active":"2024-09-11T23:05:53.355439+0000","last_peered":"2024-09-11T23:05:53.355439+0000","last_clean":"2024-09-11T23:05:53.355439+0000","last_became_active":"2024-09-11T23:05:51.164284+0000","last_became_peered":"2024-09-11T23:05:51.164284+0000","last_unstale":"2024-09-11T23:05:53.355439+0000","last_undegraded":"2024-09-11T23:05:53.355439+0000","last_fullsized":"2024-09-11T23:05:53.355439+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:55.902217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.140325+0000","last_change":"2024-09-11T23:05:52.185606+0000","last_active":"2024-09-11T23:05:53.140325+0000","last_peered":"2024-09-11T23:05:53.140325+0000","last_clean":"2024-09-11T23:05:53.140325+0000","last_became_active":"2024-09-11T23:05:52.184793+0000","last_became_peered":"2024-09-11T23:05:52.184793+0000","last_unstale":"2024-09-11T23:05:53.140325+0000","last_undegraded":"2024-09-11T23:05:53.140325+0000","last_fullsized":"2024-09-11T23:05:53.140325+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:49.552851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.139635+0000","last_change":"2024-09-11T23:05:51.168596+0000","last_active":"2024-09-11T23:05:53.139635+0000","last_peered":"2024-09-11T23:05:53.139635+0000","last_clean":"2024-09-11T23:05:53.139635+0000","last_became_active":"2024-09-11T23:05:51.167138+0000","last_became_peered":"2024-09-11T23:05:51.167138+0000","last_unstale":"2024-09-11T23:05:53.139635+0000","last_undegraded":"2024-09-11T23:05:53.139635+0000","last_fullsized":"2024-09-11T23:05:53.139635+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:14.036814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.139786+0000","last_change":"2024-09-11T23:05:52.183358+0000","last_active":"2024-09-11T23:05:53.139786+0000","last_peered":"2024-09-11T23:05:53.139786+0000","last_clean":"2024-09-11T23:05:53.139786+0000","last_became_active":"2024-09-11T23:05:52.182713+0000","last_became_peered":"2024-09-11T23:05:52.182713+0000","last_unstale":"2024-09-11T23:05:53.139786+0000","last_undegraded":"2024-09-11T23:05:53.139786+0000","last_fullsized":"2024-09-11T23:05:53.139786+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:50.257086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.139999+0000","last_change":"2024-09-11T23:05:51.146547+0000","last_active":"2024-09-11T23:05:53.139999+0000","last_peered":"2024-09-11T23:05:53.139999+0000","last_clean":"2024-09-11T23:05:53.139999+0000","last_became_active":"2024-09-11T23:05:51.146265+0000","last_became_peered":"2024-09-11T23:05:51.146265+0000","last_unstale":"2024-09-11T23:05:53.139999+0000","last_undegraded":"2024-09-11T23:05:53.139999+0000","last_fullsized":"2024-09-11T23:05:53.139999+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:26:28.412915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.138905+0000","last_change":"2024-09-11T23:05:52.184415+0000","last_active":"2024-09-11T23:05:53.138905+0000","last_peered":"2024-09-11T23:05:53.138905+0000","last_clean":"2024-09-11T23:05:53.138905+0000","last_became_active":"2024-09-11T23:05:52.183411+0000","last_became_peered":"2024-09-11T23:05:52.183411+0000","last_unstale":"2024-09-11T23:05:53.138905+0000","last_undegraded":"2024-09-11T23:05:53.138905+0000","last_fullsized":"2024-09-11T23:05:53.138905+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:32.738161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.353348+0000","last_change":"2024-09-11T23:05:51.152927+0000","last_active":"2024-09-11T23:05:53.353348+0000","last_peered":"2024-09-11T23:05:53.353348+0000","last_clean":"2024-09-11T23:05:53.353348+0000","last_became_active":"2024-09-11T23:05:51.152465+0000","last_became_peered":"2024-09-11T23:05:51.152465+0000","last_unstale":"2024-09-11T23:05:53.353348+0000","last_undegraded":"2024-09-11T23:05:53.353348+0000","last_fullsized":"2024-09-11T23:05:53.353348+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:47.467903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.138955+0000","last_change":"2024-09-11T23:05:52.181922+0000","last_active":"2024-09-11T23:05:53.138955+0000","last_peered":"2024-09-11T23:05:53.138955+0000","last_clean":"2024-09-11T23:05:53.138955+0000","last_became_active":"2024-09-11T23:05:52.181512+0000","last_became_peered":"2024-09-11T23:05:52.181512+0000","last_unstale":"2024-09-11T23:05:53.138955+0000","last_undegraded":"2024-09-11T23:05:53.138955+0000","last_fullsized":"2024-09-11T23:05:53.138955+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:21:27.064634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.351945+0000","last_change":"2024-09-11T23:05:51.153601+0000","last_active":"2024-09-11T23:05:53.351945+0000","last_peered":"2024-09-11T23:05:53.351945+0000","last_clean":"2024-09-11T23:05:53.351945+0000","last_became_active":"2024-09-11T23:05:51.153064+0000","last_became_peered":"2024-09-11T23:05:51.153064+0000","last_unstale":"2024-09-11T23:05:53.351945+0000","last_undegraded":"2024-09-11T23:05:53.351945+0000","last_fullsized":"2024-09-11T23:05:53.351945+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:07.502468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.355731+0000","last_change":"2024-09-11T23:05:52.173317+0000","last_active":"2024-09-11T23:05:53.355731+0000","last_peered":"2024-09-11T23:05:53.355731+0000","last_clean":"2024-09-11T23:05:53.355731+0000","last_became_active":"2024-09-11T23:05:52.172687+0000","last_became_peered":"2024-09-11T23:05:52.172687+0000","last_unstale":"2024-09-11T23:05:53.355731+0000","last_undegraded":"2024-09-11T23:05:53.355731+0000","last_fullsized":"2024-09-11T23:05:53.355731+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:02.053890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.353580+0000","last_change":"2024-09-11T23:05:51.175968+0000","last_active":"2024-09-11T23:05:53.353580+0000","last_peered":"2024-09-11T23:05:53.353580+0000","last_clean":"2024-09-11T23:05:53.353580+0000","last_became_active":"2024-09-11T23:05:51.175691+0000","last_became_peered":"2024-09-11T23:05:51.175691+0000","last_unstale":"2024-09-11T23:05:53.353580+0000","last_undegraded":"2024-09-11T23:05:53.353580+0000","last_fullsized":"2024-09-11T23:05:53.353580+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:24.260838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.356069+0000","last_change":"2024-09-11T23:05:52.150680+0000","last_active":"2024-09-11T23:05:53.356069+0000","last_peered":"2024-09-11T23:05:53.356069+0000","last_clean":"2024-09-11T23:05:53.356069+0000","last_became_active":"2024-09-11T23:05:52.149202+0000","last_became_peered":"2024-09-11T23:05:52.149202+0000","last_unstale":"2024-09-11T23:05:53.356069+0000","last_undegraded":"2024-09-11T23:05:53.356069+0000","last_fullsized":"2024-09-11T23:05:53.356069+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:34.433389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.6","version":"54'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.355935+0000","last_change":"2024-09-11T23:05:51.172181+0000","last_active":"2024-09-11T23:05:53.355935+0000","last_peered":"2024-09-11T23:05:53.355935+0000","last_clean":"2024-09-11T23:05:53.355935+0000","last_became_active":"2024-09-11T23:05:51.168164+0000","last_became_peered":"2024-09-11T23:05:51.168164+0000","last_unstale":"2024-09-11T23:05:53.355935+0000","last_undegraded":"2024-09-11T23:05:53.355935+0000","last_fullsized":"2024-09-11T23:05:53.355935+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:23.364825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.352925+0000","last_change":"2024-09-11T23:05:52.179061+0000","last_active":"2024-09-11T23:05:53.352925+0000","last_peered":"2024-09-11T23:05:53.352925+0000","last_clean":"2024-09-11T23:05:53.352925+0000","last_became_active":"2024-09-11T23:05:52.178802+0000","last_became_peered":"2024-09-11T23:05:52.178802+0000","last_unstale":"2024-09-11T23:05:53.352925+0000","last_undegraded":"2024-09-11T23:05:53.352925+0000","last_fullsized":"2024-09-11T23:05:53.352925+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:21.887152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.140618+0000","last_change":"2024-09-11T23:05:51.147012+0000","last_active":"2024-09-11T23:05:53.140618+0000","last_peered":"2024-09-11T23:05:53.140618+0000","last_clean":"2024-09-11T23:05:53.140618+0000","last_became_active":"2024-09-11T23:05:51.146742+0000","last_became_peered":"2024-09-11T23:05:51.146742+0000","last_unstale":"2024-09-11T23:05:53.140618+0000","last_undegraded":"2024-09-11T23:05:53.140618+0000","last_fullsized":"2024-09-11T23:05:53.140618+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:28.823553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.355017+0000","last_change":"2024-09-11T23:05:52.174454+0000","last_active":"2024-09-11T23:05:53.355017+0000","last_peered":"2024-09-11T23:05:53.355017+0000","last_clean":"2024-09-11T23:05:53.355017+0000","last_became_active":"2024-09-11T23:05:52.169783+0000","last_became_peered":"2024-09-11T23:05:52.169783+0000","last_unstale":"2024-09-11T23:05:53.355017+0000","last_undegraded":"2024-09-11T23:05:53.355017+0000","last_fullsized":"2024-09-11T23:05:53.355017+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:32.738161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.353061+0000","last_change":"2024-09-11T23:05:51.169471+0000","last_active":"2024-09-11T23:05:53.353061+0000","last_peered":"2024-09-11T23:05:53.353061+0000","last_clean":"2024-09-11T23:05:53.353061+0000","last_became_active":"2024-09-11T23:05:51.168801+0000","last_became_peered":"2024-09-11T23:05:51.168801+0000","last_unstale":"2024-09-11T23:05:53.353061+0000","last_undegraded":"2024-09-11T23:05:53.353061+0000","last_fullsized":"2024-09-11T23:05:53.353061+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:21.950734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.139902+0000","last_change":"2024-09-11T23:05:52.168480+0000","last_active":"2024-09-11T23:05:53.139902+0000","last_peered":"2024-09-11T23:05:53.139902+0000","last_clean":"2024-09-11T23:05:53.139902+0000","last_became_active":"2024-09-11T23:05:52.168113+0000","last_became_peered":"2024-09-11T23:05:52.168113+0000","last_unstale":"2024-09-11T23:05:53.139902+0000","last_undegraded":"2024-09-11T23:05:53.139902+0000","last_fullsized":"2024-09-11T23:05:53.139902+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:07.116640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.140086+0000","last_change":"2024-09-11T23:05:51.158456+0000","last_active":"2024-09-11T23:05:53.140086+0000","last_peered":"2024-09-11T23:05:53.140086+0000","last_clean":"2024-09-11T23:05:53.140086+0000","last_became_active":"2024-09-11T23:05:51.158194+0000","last_became_peered":"2024-09-11T23:05:51.158194+0000","last_unstale":"2024-09-11T23:05:53.140086+0000","last_undegraded":"2024-09-11T23:05:53.140086+0000","last_fullsized":"2024-09-11T23:05:53.140086+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:46.448642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.139985+0000","last_change":"2024-09-11T23:05:52.173034+0000","last_active":"2024-09-11T23:05:53.139985+0000","last_peered":"2024-09-11T23:05:53.139985+0000","last_clean":"2024-09-11T23:05:53.139985+0000","last_became_active":"2024-09-11T23:05:52.170979+0000","last_became_peered":"2024-09-11T23:05:52.170979+0000","last_unstale":"2024-09-11T23:05:53.139985+0000","last_undegraded":"2024-09-11T23:05:53.139985+0000","last_fullsized":"2024-09-11T23:05:53.139985+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:51.904667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.352289+0000","last_change":"2024-09-11T23:05:51.172405+0000","last_active":"2024-09-11T23:05:53.352289+0000","last_peered":"2024-09-11T23:05:53.352289+0000","last_clean":"2024-09-11T23:05:53.352289+0000","last_became_active":"2024-09-11T23:05:51.169080+0000","last_became_peered":"2024-09-11T23:05:51.169080+0000","last_unstale":"2024-09-11T23:05:53.352289+0000","last_undegraded":"2024-09-11T23:05:53.352289+0000","last_fullsized":"2024-09-11T23:05:53.352289+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:33.775730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.350926+0000","last_change":"2024-09-11T23:05:52.148761+0000","last_active":"2024-09-11T23:05:53.350926+0000","last_peered":"2024-09-11T23:05:53.350926+0000","last_clean":"2024-09-11T23:05:53.350926+0000","last_became_active":"2024-09-11T23:05:52.148400+0000","last_became_peered":"2024-09-11T23:05:52.148400+0000","last_unstale":"2024-09-11T23:05:53.350926+0000","last_undegraded":"2024-09-11T23:05:53.350926+0000","last_fullsized":"2024-09-11T23:05:53.350926+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:10:48.868156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.353590+0000","last_change":"2024-09-11T23:05:51.153278+0000","last_active":"2024-09-11T23:05:53.353590+0000","last_peered":"2024-09-11T23:05:53.353590+0000","last_clean":"2024-09-11T23:05:53.353590+0000","last_became_active":"2024-09-11T23:05:51.152836+0000","last_became_peered":"2024-09-11T23:05:51.152836+0000","last_unstale":"2024-09-11T23:05:53.353590+0000","last_undegraded":"2024-09-11T23:05:53.353590+0000","last_fullsized":"2024-09-11T23:05:53.353590+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:45.051708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.355192+0000","last_change":"2024-09-11T23:05:52.153535+0000","last_active":"2024-09-11T23:05:53.355192+0000","last_peered":"2024-09-11T23:05:53.355192+0000","last_clean":"2024-09-11T23:05:53.355192+0000","last_became_active":"2024-09-11T23:05:52.153278+0000","last_became_peered":"2024-09-11T23:05:52.153278+0000","last_unstale":"2024-09-11T23:05:53.355192+0000","last_undegraded":"2024-09-11T23:05:53.355192+0000","last_fullsized":"2024-09-11T23:05:53.355192+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:13.126064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.138903+0000","last_change":"2024-09-11T23:05:51.164578+0000","last_active":"2024-09-11T23:05:53.138903+0000","last_peered":"2024-09-11T23:05:53.138903+0000","last_clean":"2024-09-11T23:05:53.138903+0000","last_became_active":"2024-09-11T23:05:51.163936+0000","last_became_peered":"2024-09-11T23:05:51.163936+0000","last_unstale":"2024-09-11T23:05:53.138903+0000","last_undegraded":"2024-09-11T23:05:53.138903+0000","last_fullsized":"2024-09-11T23:05:53.138903+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:30.346220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.351678+0000","last_change":"2024-09-11T23:05:52.175657+0000","last_active":"2024-09-11T23:05:53.351678+0000","last_peered":"2024-09-11T23:05:53.351678+0000","last_clean":"2024-09-11T23:05:53.351678+0000","last_became_active":"2024-09-11T23:05:52.174532+0000","last_became_peered":"2024-09-11T23:05:52.174532+0000","last_unstale":"2024-09-11T23:05:53.351678+0000","last_undegraded":"2024-09-11T23:05:53.351678+0000","last_fullsized":"2024-09-11T23:05:53.351678+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:51.112539+0000","last_clean_scrub_stamp":"2024-09-11T23:05:51.112539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:48.696344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.354189+0000","last_change":"2024-09-11T23:05:51.164091+0000","last_active":"2024-09-11T23:05:53.354189+0000","last_peered":"2024-09-11T23:05:53.354189+0000","last_clean":"2024-09-11T23:05:53.354189+0000","last_became_active":"2024-09-11T23:05:51.163344+0000","last_became_peered":"2024-09-11T23:05:51.163344+0000","last_unstale":"2024-09-11T23:05:53.354189+0000","last_undegraded":"2024-09-11T23:05:53.354189+0000","last_fullsized":"2024-09-11T23:05:53.354189+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:05:50.107392+0000","last_clean_scrub_stamp":"2024-09-11T23:05:50.107392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:30.346220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"42'141","reported_seq":375,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-11T23:05:53.351641+0000","last_change":"2024-09-11T23:03:26.382905+0000","last_active":"2024-09-11T23:05:53.351641+0000","last_peered":"2024-09-11T23:05:53.351641+0000","last_clean":"2024-09-11T23:05:53.351641+0000","last_became_active":"2024-09-11T23:03:26.380590+0000","last_became_peered":"2024-09-11T23:03:26.380590+0000","last_unstale":"2024-09-11T23:05:53.351641+0000","last_undegraded":"2024-09-11T23:05:53.351641+0000","last_fullsized":"2024-09-11T23:05:53.351641+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:24.361793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:24.361793+0000","last_clean_scrub_stamp":"2024-09-11T23:03:24.361793+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:46.577063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":490,"num_read_kb":915,"num_write":217,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":490,"num_read_kb":915,"num_write":217,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738400,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31732,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340108,"statfs":{"total":96636764160,"available":96604270592,"internally_reserved":0,"allocated":548864,"data_stored":203518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738400,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":1134592,"data_stored":793726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738400,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1118208,"data_stored":791636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:05:56.537 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T23:05:56.538 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-11T23:05:56.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.711+0000 7f9848cd4640 1 Processor -- start 2024-09-11T23:05:56.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.711+0000 7f9848cd4640 1 -- start start 2024-09-11T23:05:56.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.711+0000 7f9848cd4640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f984409f060 0x7f984413cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:56.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.711+0000 7f9848cd4640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9844134500 con 0x7f9844134720 2024-09-11T23:05:56.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.711+0000 7f9848cd4640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f9844135210 con 0x7f984409f060 2024-09-11T23:05:56.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.711+0000 7f9841d9b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f984409f060 0x7f984413cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:56.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.711+0000 7f984259c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f9844134720 0x7f9844134b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:50032/0 (socket says 172.21.15.12:50032) 2024-09-11T23:05:56.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.711+0000 7f984259c640 1 -- 172.21.15.12:0/1197321395 learned_addr learned my addr 172.21.15.12:0/1197321395 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:56.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.711+0000 7f9841d9b640 1 -- 172.21.15.12:0/1197321395 >> v1:172.21.15.12:6789/0 conn(0x7f9844134720 legacy=0x7f9844134b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:56.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.711+0000 7f9841d9b640 1 -- 172.21.15.12:0/1197321395 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98441341f0 con 0x7f984409f060 2024-09-11T23:05:56.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.711+0000 7f984159a640 1 -- 172.21.15.12:0/1197321395 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 416798296 0 0) 0x7f9844134500 con 0x7f9844134720 2024-09-11T23:05:56.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.715+0000 7f9841d9b640 1 --2- 172.21.15.12:0/1197321395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f984409f060 0x7f984413cb60 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f982c009740 tx=0x7f982c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1906621e800e53a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:56.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.715+0000 7f984159a640 1 -- 172.21.15.12:0/1197321395 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f982c0b0070 con 0x7f984409f060 2024-09-11T23:05:56.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.715+0000 7f984159a640 1 -- 172.21.15.12:0/1197321395 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f982c0ab530 con 0x7f984409f060 2024-09-11T23:05:56.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.715+0000 7f984159a640 1 -- 172.21.15.12:0/1197321395 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f982c0ab830 con 0x7f984409f060 2024-09-11T23:05:56.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.715+0000 7f9848cd4640 1 -- 172.21.15.12:0/1197321395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f984409f060 msgr2=0x7f984413cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:56.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.715+0000 7f9848cd4640 1 --2- 172.21.15.12:0/1197321395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f984409f060 0x7f984413cb60 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f982c009740 tx=0x7f982c01c420 comp rx=0 tx=0).stop 2024-09-11T23:05:56.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.715+0000 7f9848cd4640 1 -- 172.21.15.12:0/1197321395 shutdown_connections 2024-09-11T23:05:56.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.715+0000 7f9848cd4640 1 --2- 172.21.15.12:0/1197321395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f984409f060 0x7f984413cb60 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:56.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.715+0000 7f9848cd4640 1 -- 172.21.15.12:0/1197321395 >> 172.21.15.12:0/1197321395 conn(0x7f984409a9d0 msgr2=0x7f984409cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:56.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.715+0000 7f9848cd4640 1 -- 172.21.15.12:0/1197321395 shutdown_connections 2024-09-11T23:05:56.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.715+0000 7f9848cd4640 1 -- 172.21.15.12:0/1197321395 wait complete. 2024-09-11T23:05:56.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.715+0000 7f9848cd4640 1 Processor -- start 2024-09-11T23:05:56.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.715+0000 7f9848cd4640 1 -- start start 2024-09-11T23:05:56.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.719+0000 7f9848cd4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f984409f060 0x7f98440a7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:56.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.719+0000 7f9848cd4640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f984413f8c0 con 0x7f984409f060 2024-09-11T23:05:56.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.719+0000 7f984259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f984409f060 0x7f98440a7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:56.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.719+0000 7f984259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f984409f060 0x7f98440a7fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48606/0 (socket says 172.21.15.12:48606) 2024-09-11T23:05:56.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.719+0000 7f984259c640 1 -- 172.21.15.12:0/1994520551 learned_addr learned my addr 172.21.15.12:0/1994520551 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:56.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.719+0000 7f984259c640 1 -- 172.21.15.12:0/1994520551 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98440a8940 con 0x7f984409f060 2024-09-11T23:05:56.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.719+0000 7f984259c640 1 --2- 172.21.15.12:0/1994520551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f984409f060 0x7f98440a7fa0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f983c00c840 tx=0x7f983c00cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:56.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.719+0000 7f983affd640 1 -- 172.21.15.12:0/1994520551 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f983c018070 con 0x7f984409f060 2024-09-11T23:05:56.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.719+0000 7f983affd640 1 -- 172.21.15.12:0/1994520551 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f983c00a660 con 0x7f984409f060 2024-09-11T23:05:56.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.719+0000 7f9848cd4640 1 -- 172.21.15.12:0/1994520551 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98440a5a00 con 0x7f984409f060 2024-09-11T23:05:56.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.719+0000 7f983affd640 1 -- 172.21.15.12:0/1994520551 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f983c00a850 con 0x7f984409f060 2024-09-11T23:05:56.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.719+0000 7f9848cd4640 1 -- 172.21.15.12:0/1994520551 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98440a5720 con 0x7f984409f060 2024-09-11T23:05:56.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.719+0000 7f983affd640 1 -- 172.21.15.12:0/1994520551 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 44053+0+0 (secure 0 0 0) 0x7f983c01b070 con 0x7f984409f060 2024-09-11T23:05:56.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.719+0000 7f9848cd4640 1 -- 172.21.15.12:0/1994520551 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9844073360 con 0x7f984409f060 2024-09-11T23:05:56.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.719+0000 7f983affd640 1 --2- 172.21.15.12:0/1994520551 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f9824035db0 0x7f9824038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:56.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.719+0000 7f983affd640 1 -- 172.21.15.12:0/1994520551 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 3439+0+0 (secure 0 0 0) 0x7f983c047d50 con 0x7f984409f060 2024-09-11T23:05:56.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.719+0000 7f9841d9b640 1 --2- 172.21.15.12:0/1994520551 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f9824035db0 0x7f9824038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:56.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.719+0000 7f9841d9b640 1 --2- 172.21.15.12:0/1994520551 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f9824035db0 0x7f9824038270 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f982c0ad000 tx=0x7f982c0a6000 comp rx=0 tx=0).ready entity=mgr.4708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:56.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.723+0000 7f983affd640 1 -- 172.21.15.12:0/1994520551 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f983c011360 con 0x7f984409f060 2024-09-11T23:05:56.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.951+0000 7f9848cd4640 1 -- 172.21.15.12:0/1994520551 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f984406be50 con 0x7f984409f060 2024-09-11T23:05:56.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.955+0000 7f983affd640 1 -- 172.21.15.12:0/1994520551 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) ==== 190+0+147 (secure 0 0 0) 0x7f983c01cda0 con 0x7f984409f060 2024-09-11T23:05:56.956 INFO:teuthology.orchestra.run.smithi012.stdout:[client.0] 2024-09-11T23:05:56.956 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCgIeJmTz6nGhAAveLcJxI+RD0GsD9nnR2S/w== 2024-09-11T23:05:56.956 INFO:teuthology.orchestra.run.smithi012.stdout: caps mds = "allow" 2024-09-11T23:05:56.956 INFO:teuthology.orchestra.run.smithi012.stdout: caps mon = "allow r" 2024-09-11T23:05:56.957 INFO:teuthology.orchestra.run.smithi012.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-11T23:05:56.957 INFO:teuthology.orchestra.run.smithi012.stderr:updated caps for client.0 2024-09-11T23:05:56.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.955+0000 7f9848cd4640 1 -- 172.21.15.12:0/1994520551 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f9824035db0 msgr2=0x7f9824038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:56.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.955+0000 7f9848cd4640 1 --2- 172.21.15.12:0/1994520551 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f9824035db0 0x7f9824038270 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f982c0ad000 tx=0x7f982c0a6000 comp rx=0 tx=0).stop 2024-09-11T23:05:56.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.955+0000 7f9848cd4640 1 -- 172.21.15.12:0/1994520551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f984409f060 msgr2=0x7f98440a7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:56.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.955+0000 7f9848cd4640 1 --2- 172.21.15.12:0/1994520551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f984409f060 0x7f98440a7fa0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f983c00c840 tx=0x7f983c00cd00 comp rx=0 tx=0).stop 2024-09-11T23:05:56.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.955+0000 7f9848cd4640 1 -- 172.21.15.12:0/1994520551 shutdown_connections 2024-09-11T23:05:56.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.955+0000 7f9848cd4640 1 --2- 172.21.15.12:0/1994520551 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f9824035db0 0x7f9824038270 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:56.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.955+0000 7f9848cd4640 1 --2- 172.21.15.12:0/1994520551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f984409f060 0x7f98440a7fa0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:56.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.955+0000 7f9848cd4640 1 -- 172.21.15.12:0/1994520551 >> 172.21.15.12:0/1994520551 conn(0x7f984409a9d0 msgr2=0x7f98440715b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:56.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.955+0000 7f9848cd4640 1 -- 172.21.15.12:0/1994520551 shutdown_connections 2024-09-11T23:05:56.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:56.955+0000 7f9848cd4640 1 -- 172.21.15.12:0/1994520551 wait complete. 2024-09-11T23:05:56.975 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:05:57.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.099+0000 7f55c15fc640 1 Processor -- start 2024-09-11T23:05:57.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.099+0000 7f55c15fc640 1 -- start start 2024-09-11T23:05:57.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.099+0000 7f55c15fc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f55bc137080 0x7f55bc13bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:57.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.099+0000 7f55c15fc640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55bc0a1ff0 con 0x7f55bc136ca0 2024-09-11T23:05:57.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.099+0000 7f55c15fc640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f55bc09b4a0 con 0x7f55bc137080 2024-09-11T23:05:57.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.099+0000 7f55ba7fc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f55bc137080 0x7f55bc13bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:57.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.099+0000 7f55baffd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f55bc136ca0 0x7f55bc09ad90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:50046/0 (socket says 172.21.15.12:50046) 2024-09-11T23:05:57.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.099+0000 7f55baffd640 1 -- 172.21.15.12:0/538318999 learned_addr learned my addr 172.21.15.12:0/538318999 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:57.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.099+0000 7f55ba7fc640 1 -- 172.21.15.12:0/538318999 >> v1:172.21.15.12:6789/0 conn(0x7f55bc136ca0 legacy=0x7f55bc09ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:57.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.099+0000 7f55ba7fc640 1 -- 172.21.15.12:0/538318999 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55bc0a0eb0 con 0x7f55bc137080 2024-09-11T23:05:57.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.103+0000 7f55ba7fc640 1 --2- 172.21.15.12:0/538318999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55bc137080 0x7f55bc13bb70 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f55b0009740 tx=0x7f55b001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b66b2e9d93ec995 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:57.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.103+0000 7f55b9ffb640 1 -- 172.21.15.12:0/538318999 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55b00b0070 con 0x7f55bc137080 2024-09-11T23:05:57.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.103+0000 7f55b9ffb640 1 -- 172.21.15.12:0/538318999 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55b00ab530 con 0x7f55bc137080 2024-09-11T23:05:57.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.103+0000 7f55b9ffb640 1 -- 172.21.15.12:0/538318999 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55b00ab830 con 0x7f55bc137080 2024-09-11T23:05:57.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.103+0000 7f55c15fc640 1 -- 172.21.15.12:0/538318999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55bc137080 msgr2=0x7f55bc13bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:57.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.103+0000 7f55c15fc640 1 --2- 172.21.15.12:0/538318999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55bc137080 0x7f55bc13bb70 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f55b0009740 tx=0x7f55b001c420 comp rx=0 tx=0).stop 2024-09-11T23:05:57.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.103+0000 7f55c15fc640 1 -- 172.21.15.12:0/538318999 shutdown_connections 2024-09-11T23:05:57.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.103+0000 7f55c15fc640 1 --2- 172.21.15.12:0/538318999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55bc137080 0x7f55bc13bb70 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:57.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.103+0000 7f55c15fc640 1 -- 172.21.15.12:0/538318999 >> 172.21.15.12:0/538318999 conn(0x7f55bc0a8450 msgr2=0x7f55bc0a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:57.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.103+0000 7f55c15fc640 1 -- 172.21.15.12:0/538318999 shutdown_connections 2024-09-11T23:05:57.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.103+0000 7f55c15fc640 1 -- 172.21.15.12:0/538318999 wait complete. 2024-09-11T23:05:57.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.103+0000 7f55c15fc640 1 Processor -- start 2024-09-11T23:05:57.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.103+0000 7f55c15fc640 1 -- start start 2024-09-11T23:05:57.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.103+0000 7f55c15fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55bc136ca0 0x7f55bc0728f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:57.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.103+0000 7f55c15fc640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f55bc09f520 con 0x7f55bc136ca0 2024-09-11T23:05:57.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.103+0000 7f55baffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55bc136ca0 0x7f55bc0728f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:57.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.103+0000 7f55baffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55bc136ca0 0x7f55bc0728f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48630/0 (socket says 172.21.15.12:48630) 2024-09-11T23:05:57.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.103+0000 7f55baffd640 1 -- 172.21.15.12:0/1847337562 learned_addr learned my addr 172.21.15.12:0/1847337562 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:57.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.107+0000 7f55baffd640 1 -- 172.21.15.12:0/1847337562 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55bc073480 con 0x7f55bc136ca0 2024-09-11T23:05:57.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.107+0000 7f55baffd640 1 --2- 172.21.15.12:0/1847337562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55bc136ca0 0x7f55bc0728f0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f55ac00c480 tx=0x7f55ac00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:57.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.107+0000 7f55a37fe640 1 -- 172.21.15.12:0/1847337562 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55ac017070 con 0x7f55bc136ca0 2024-09-11T23:05:57.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.107+0000 7f55a37fe640 1 -- 172.21.15.12:0/1847337562 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55ac005c20 con 0x7f55bc136ca0 2024-09-11T23:05:57.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.107+0000 7f55c15fc640 1 -- 172.21.15.12:0/1847337562 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55bc071eb0 con 0x7f55bc136ca0 2024-09-11T23:05:57.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.107+0000 7f55a37fe640 1 -- 172.21.15.12:0/1847337562 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55ac007070 con 0x7f55bc136ca0 2024-09-11T23:05:57.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.107+0000 7f55c15fc640 1 -- 172.21.15.12:0/1847337562 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55bc1359c0 con 0x7f55bc136ca0 2024-09-11T23:05:57.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.107+0000 7f55c15fc640 1 -- 172.21.15.12:0/1847337562 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55bc070370 con 0x7f55bc136ca0 2024-09-11T23:05:57.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.107+0000 7f55a37fe640 1 -- 172.21.15.12:0/1847337562 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 44053+0+0 (secure 0 0 0) 0x7f55ac01a070 con 0x7f55bc136ca0 2024-09-11T23:05:57.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.107+0000 7f55a37fe640 1 --2- 172.21.15.12:0/1847337562 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f55a8035db0 0x7f55a8038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:57.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.107+0000 7f55a37fe640 1 -- 172.21.15.12:0/1847337562 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 3439+0+0 (secure 0 0 0) 0x7f55ac047920 con 0x7f55bc136ca0 2024-09-11T23:05:57.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.107+0000 7f55ba7fc640 1 --2- 172.21.15.12:0/1847337562 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f55a8035db0 0x7f55a8038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:57.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.107+0000 7f55ba7fc640 1 --2- 172.21.15.12:0/1847337562 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f55a8035db0 0x7f55a8038270 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f55b00ad000 tx=0x7f55b00a6000 comp rx=0 tx=0).ready entity=mgr.4708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:57.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.111+0000 7f55a37fe640 1 -- 172.21.15.12:0/1847337562 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f55ac007210 con 0x7f55bc136ca0 2024-09-11T23:05:57.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.303+0000 7f55c15fc640 1 -- 172.21.15.12:0/1847337562 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f55bc09ad90 con 0x7f55bc136ca0 2024-09-11T23:05:57.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.303+0000 7f55a37fe640 1 -- 172.21.15.12:0/1847337562 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+3575 (secure 0 0 0) 0x7f55ac01b400 con 0x7f55bc136ca0 2024-09-11T23:05:57.307 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:05:57.307 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":40,"btime":"2024-09-11T23:05:55:143736+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4812,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6827/1404954527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":1404954527},{"type":"v1","addr":"172.21.15.12:6827","nonce":1404954527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:05:51.497188+0000","modified":"2024-09-11T23:05:54.502889+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4813},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4813":{"gid":4813,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6829/2605601020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":2605601020},{"type":"v1","addr":"172.21.15.12:6829","nonce":2605601020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4813,"qdb_cluster":[4813]},"id":5}]} 2024-09-11T23:05:57.308 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 40 2024-09-11T23:05:57.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.307+0000 7f55c15fc640 1 -- 172.21.15.12:0/1847337562 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f55a8035db0 msgr2=0x7f55a8038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:57.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.307+0000 7f55c15fc640 1 --2- 172.21.15.12:0/1847337562 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f55a8035db0 0x7f55a8038270 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f55b00ad000 tx=0x7f55b00a6000 comp rx=0 tx=0).stop 2024-09-11T23:05:57.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.307+0000 7f55c15fc640 1 -- 172.21.15.12:0/1847337562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55bc136ca0 msgr2=0x7f55bc0728f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:57.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.307+0000 7f55c15fc640 1 --2- 172.21.15.12:0/1847337562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55bc136ca0 0x7f55bc0728f0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f55ac00c480 tx=0x7f55ac00c940 comp rx=0 tx=0).stop 2024-09-11T23:05:57.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.307+0000 7f55c15fc640 1 -- 172.21.15.12:0/1847337562 shutdown_connections 2024-09-11T23:05:57.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.307+0000 7f55c15fc640 1 --2- 172.21.15.12:0/1847337562 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f55a8035db0 0x7f55a8038270 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:57.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.307+0000 7f55c15fc640 1 --2- 172.21.15.12:0/1847337562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55bc136ca0 0x7f55bc0728f0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:57.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.307+0000 7f55c15fc640 1 -- 172.21.15.12:0/1847337562 >> 172.21.15.12:0/1847337562 conn(0x7f55bc0a8450 msgr2=0x7f55bc0a6d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:57.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.307+0000 7f55c15fc640 1 -- 172.21.15.12:0/1847337562 shutdown_connections 2024-09-11T23:05:57.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.307+0000 7f55c15fc640 1 -- 172.21.15.12:0/1847337562 wait complete. 2024-09-11T23:05:57.525 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 40, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T23:05:51.497188+0000', 'modified': '2024-09-11T23:05:54.502889+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4813}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4813': {'gid': 4813, 'name': 'a', 'rank': 0, 'incarnation': 36, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.12:6829/2605601020', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6828', 'nonce': 2605601020}, {'type': 'v1', 'addr': '172.21.15.12:6829', 'nonce': 2605601020}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4813, 'qdb_cluster': [4813]} 2024-09-11T23:05:57.526 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T23:05:57.526 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-11T23:05:57.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.655+0000 7fa753fa5640 1 Processor -- start 2024-09-11T23:05:57.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.655+0000 7fa753fa5640 1 -- start start 2024-09-11T23:05:57.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.655+0000 7fa753fa5640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa74c137e50 0x7fa74c073740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:57.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.655+0000 7fa753fa5640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa74c070cc0 con 0x7fa74c138230 2024-09-11T23:05:57.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.655+0000 7fa753fa5640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fa74c072330 con 0x7fa74c137e50 2024-09-11T23:05:57.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.655+0000 7fa751d41640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa74c137e50 0x7fa74c073740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:57.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.655+0000 7fa751540640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa74c138230 0x7fa74c072af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:50056/0 (socket says 172.21.15.12:50056) 2024-09-11T23:05:57.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.655+0000 7fa751d41640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa74c137e50 0x7fa74c073740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48646/0 (socket says 172.21.15.12:48646) 2024-09-11T23:05:57.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.655+0000 7fa751540640 1 -- 172.21.15.12:0/3699130136 learned_addr learned my addr 172.21.15.12:0/3699130136 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:57.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.655+0000 7fa751d41640 1 -- 172.21.15.12:0/3699130136 >> v1:172.21.15.12:6789/0 conn(0x7fa74c138230 legacy=0x7fa74c072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:57.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.655+0000 7fa751d41640 1 -- 172.21.15.12:0/3699130136 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa74c0a6810 con 0x7fa74c137e50 2024-09-11T23:05:57.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.659+0000 7fa751d41640 1 --2- 172.21.15.12:0/3699130136 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa74c137e50 0x7fa74c073740 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fa744009d90 tx=0x7fa74401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37ba1d2958b966f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:57.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.659+0000 7fa750d3f640 1 -- 172.21.15.12:0/3699130136 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7440b2070 con 0x7fa74c137e50 2024-09-11T23:05:57.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.659+0000 7fa750d3f640 1 -- 172.21.15.12:0/3699130136 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7440a5900 con 0x7fa74c137e50 2024-09-11T23:05:57.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.659+0000 7fa750d3f640 1 -- 172.21.15.12:0/3699130136 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7440a5c00 con 0x7fa74c137e50 2024-09-11T23:05:57.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.659+0000 7fa753fa5640 1 -- 172.21.15.12:0/3699130136 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa74c137e50 msgr2=0x7fa74c073740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:57.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.659+0000 7fa753fa5640 1 --2- 172.21.15.12:0/3699130136 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa74c137e50 0x7fa74c073740 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fa744009d90 tx=0x7fa74401c970 comp rx=0 tx=0).stop 2024-09-11T23:05:57.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.659+0000 7fa753fa5640 1 -- 172.21.15.12:0/3699130136 shutdown_connections 2024-09-11T23:05:57.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.659+0000 7fa753fa5640 1 --2- 172.21.15.12:0/3699130136 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa74c137e50 0x7fa74c073740 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:57.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.659+0000 7fa753fa5640 1 -- 172.21.15.12:0/3699130136 >> 172.21.15.12:0/3699130136 conn(0x7fa74c0aa140 msgr2=0x7fa74c0aa550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:57.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.659+0000 7fa753fa5640 1 -- 172.21.15.12:0/3699130136 shutdown_connections 2024-09-11T23:05:57.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.659+0000 7fa753fa5640 1 -- 172.21.15.12:0/3699130136 wait complete. 2024-09-11T23:05:57.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.659+0000 7fa753fa5640 1 Processor -- start 2024-09-11T23:05:57.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.659+0000 7fa753fa5640 1 -- start start 2024-09-11T23:05:57.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.659+0000 7fa753fa5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa74c137e50 0x7fa74c09f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:57.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.659+0000 7fa753fa5640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa74c13f7d0 con 0x7fa74c137e50 2024-09-11T23:05:57.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.659+0000 7fa751d41640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa74c137e50 0x7fa74c09f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:57.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.659+0000 7fa751d41640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa74c137e50 0x7fa74c09f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48662/0 (socket says 172.21.15.12:48662) 2024-09-11T23:05:57.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.659+0000 7fa751d41640 1 -- 172.21.15.12:0/4218516508 learned_addr learned my addr 172.21.15.12:0/4218516508 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:57.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.659+0000 7fa751d41640 1 -- 172.21.15.12:0/4218516508 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa74c120df0 con 0x7fa74c137e50 2024-09-11T23:05:57.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.659+0000 7fa751d41640 1 --2- 172.21.15.12:0/4218516508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa74c137e50 0x7fa74c09f320 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fa744019580 tx=0x7fa744019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:57.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.659+0000 7fa7427fc640 1 -- 172.21.15.12:0/4218516508 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7440b2050 con 0x7fa74c137e50 2024-09-11T23:05:57.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.659+0000 7fa7427fc640 1 -- 172.21.15.12:0/4218516508 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7440b3040 con 0x7fa74c137e50 2024-09-11T23:05:57.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.659+0000 7fa7427fc640 1 -- 172.21.15.12:0/4218516508 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7440adc00 con 0x7fa74c137e50 2024-09-11T23:05:57.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.659+0000 7fa753fa5640 1 -- 172.21.15.12:0/4218516508 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa74c06cf10 con 0x7fa74c137e50 2024-09-11T23:05:57.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.659+0000 7fa753fa5640 1 -- 172.21.15.12:0/4218516508 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa74c120830 con 0x7fa74c137e50 2024-09-11T23:05:57.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.663+0000 7fa7427fc640 1 -- 172.21.15.12:0/4218516508 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 44053+0+0 (secure 0 0 0) 0x7fa7440c0020 con 0x7fa74c137e50 2024-09-11T23:05:57.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.663+0000 7fa7427fc640 1 --2- 172.21.15.12:0/4218516508 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fa730035db0 0x7fa730038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:57.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.663+0000 7fa7427fc640 1 -- 172.21.15.12:0/4218516508 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 3439+0+0 (secure 0 0 0) 0x7fa7440be020 con 0x7fa74c137e50 2024-09-11T23:05:57.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.663+0000 7fa751540640 1 --2- 172.21.15.12:0/4218516508 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fa730035db0 0x7fa730038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:57.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.663+0000 7fa751540640 1 --2- 172.21.15.12:0/4218516508 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fa730035db0 0x7fa730038270 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa73c001610 tx=0x7fa73c007ad0 comp rx=0 tx=0).ready entity=mgr.4708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:57.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.663+0000 7fa757061000 1 Processor -- start 2024-09-11T23:05:57.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.663+0000 7fa757061000 1 -- start start 2024-09-11T23:05:57.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.663+0000 7fa757061000 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ece2b5dd30 0x55ece2b66b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:57.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.663+0000 7fa757061000 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ece2a48b60 con 0x55ece2b5dd30 2024-09-11T23:05:57.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.663+0000 7fa751d41640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ece2b5dd30 0x55ece2b66b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:57.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.663+0000 7fa751d41640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ece2b5dd30 0x55ece2b66b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48666/0 (socket says 172.21.15.12:48666) 2024-09-11T23:05:57.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.663+0000 7fa751d41640 1 -- 172.21.15.12:0/3876993152 learned_addr learned my addr 172.21.15.12:0/3876993152 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:57.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.663+0000 7fa751d41640 1 -- 172.21.15.12:0/3876993152 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ece2967e50 con 0x55ece2b5dd30 2024-09-11T23:05:57.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.663+0000 7fa751d41640 1 --2- 172.21.15.12:0/3876993152 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ece2b5dd30 0x55ece2b66b40 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fa7440e2380 tx=0x7fa7440b6cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d42db1c2b745200 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:57.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.663+0000 7fa72f7fe640 1 -- 172.21.15.12:0/3876993152 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7440cf020 con 0x55ece2b5dd30 2024-09-11T23:05:57.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.663+0000 7fa72f7fe640 1 -- 172.21.15.12:0/3876993152 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7440c2930 con 0x55ece2b5dd30 2024-09-11T23:05:57.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.663+0000 7fa72f7fe640 1 -- 172.21.15.12:0/3876993152 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7440dd040 con 0x55ece2b5dd30 2024-09-11T23:05:57.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.663+0000 7fa757061000 1 -- 172.21.15.12:0/3876993152 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ece2b5dd30 msgr2=0x55ece2b66b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:57.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.663+0000 7fa757061000 1 --2- 172.21.15.12:0/3876993152 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ece2b5dd30 0x55ece2b66b40 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fa7440e2380 tx=0x7fa7440b6cb0 comp rx=0 tx=0).stop 2024-09-11T23:05:57.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.663+0000 7fa757061000 1 -- 172.21.15.12:0/3876993152 shutdown_connections 2024-09-11T23:05:57.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.663+0000 7fa757061000 1 --2- 172.21.15.12:0/3876993152 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ece2b5dd30 0x55ece2b66b40 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:57.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.663+0000 7fa757061000 1 -- 172.21.15.12:0/3876993152 >> 172.21.15.12:0/3876993152 conn(0x55ece2b58680 msgr2=0x55ece2b5d620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:57.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.663+0000 7fa757061000 1 -- 172.21.15.12:0/3876993152 shutdown_connections 2024-09-11T23:05:57.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.667+0000 7fa757061000 1 -- 172.21.15.12:0/3876993152 wait complete. 2024-09-11T23:05:57.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.667+0000 7fa757061000 1 -- start start 2024-09-11T23:05:57.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.667+0000 7fa757061000 1 Processor -- start 2024-09-11T23:05:57.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.667+0000 7fa757061000 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ece2b5dd30 0x55ece2b665a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:57.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.667+0000 7fa757061000 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ece2955ed0 con 0x55ece2b5dd30 2024-09-11T23:05:57.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.667+0000 7fa757061000 10 client.0 _ll_register_callbacks cb 0x55ece2b4c820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:05:57.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.667+0000 7fa751d41640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ece2b5dd30 0x55ece2b665a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:57.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.667+0000 7fa751d41640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ece2b5dd30 0x55ece2b665a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48672/0 (socket says 172.21.15.12:48672) 2024-09-11T23:05:57.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.667+0000 7fa751d41640 1 -- 172.21.15.12:0/400340180 learned_addr learned my addr 172.21.15.12:0/400340180 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:57.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.667+0000 7fa751d41640 1 -- 172.21.15.12:0/400340180 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ece2956120 con 0x55ece2b5dd30 2024-09-11T23:05:57.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.667+0000 7fa751d41640 1 --2- 172.21.15.12:0/400340180 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ece2b5dd30 0x55ece2b665a0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fa7440e12a0 tx=0x7fa7440c9000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97f5c747b207da3b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:57.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.667+0000 7fa72cff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-11T23:05:57.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.667+0000 7fa72cff9640 1 -- 172.21.15.12:0/400340180 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7440e8060 con 0x55ece2b5dd30 2024-09-11T23:05:57.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.667+0000 7fa72cff9640 1 -- 172.21.15.12:0/400340180 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 3439+0+0 (secure 0 0 0) 0x7fa7440b6490 con 0x55ece2b5dd30 2024-09-11T23:05:57.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.667+0000 7fa757061000 1 -- 172.21.15.12:0/400340180 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7440c2930 con 0x55ece2b5dd30 2024-09-11T23:05:57.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.667+0000 7fa72cff9640 1 -- 172.21.15.12:0/400340180 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fa7440cf040 con 0x55ece2b5dd30 2024-09-11T23:05:57.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.667+0000 7fa757061000 10 client.4866 fetch_fsmap learned FSMap version 40 2024-09-11T23:05:57.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.667+0000 7fa757061000 1 -- 172.21.15.12:0/400340180 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) -- 0x55ece294f450 con 0x55ece2b5dd30 2024-09-11T23:05:57.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.667+0000 7fa72cff9640 1 -- 172.21.15.12:0/400340180 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7440c2930 con 0x55ece2b5dd30 2024-09-11T23:05:57.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.667+0000 7fa72cff9640 1 -- 172.21.15.12:0/400340180 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 40) ==== 2292+0+0 (secure 0 0 0) 0x7fa7440c1c70 con 0x55ece2b5dd30 2024-09-11T23:05:57.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.667+0000 7fa757061000 10 client.4866 fetch_fsmap finished waiting for FSMap version 40 2024-09-11T23:05:57.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.667+0000 7fa757061000 10 client.4866 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-11T23:05:57.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.667+0000 7fa757061000 20 client.4866 populate_metadata read hostname 'smithi012' 2024-09-11T23:05:57.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.667+0000 7fa757061000 1 --2- 172.21.15.12:0/400340180 >> [v2:172.21.15.12:6828/2605601020,v1:172.21.15.12:6829/2605601020] conn(0x55ece2b8b920 0x55ece2b89ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:57.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.667+0000 7fa757061000 4 client.4866 mds_command: new command op to 4813 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:05:57.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.667+0000 7fa757061000 1 -- 172.21.15.12:0/400340180 --> [v2:172.21.15.12:6828/2605601020,v1:172.21.15.12:6829/2605601020] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ece2949c00 con 0x55ece2b8b920 2024-09-11T23:05:57.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.667+0000 7fa751540640 1 --2- 172.21.15.12:0/400340180 >> [v2:172.21.15.12:6828/2605601020,v1:172.21.15.12:6829/2605601020] conn(0x55ece2b8b920 0x55ece2b89ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:57.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.667+0000 7fa751540640 1 --2- 172.21.15.12:0/400340180 >> [v2:172.21.15.12:6828/2605601020,v1:172.21.15.12:6829/2605601020] conn(0x55ece2b8b920 0x55ece2b89ed0 crc :-1 s=READY pgs=6 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a10c23d943dd1a1c server_cookie=e576759ff2729dc2 in_seq=0 out_seq=0 2024-09-11T23:05:57.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.667+0000 7fa72cff9640 10 client.4866 ms_handle_connect on v2:172.21.15.12:6828/2605601020 2024-09-11T23:05:57.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.667+0000 7fa72cff9640 1 -- 172.21.15.12:0/400340180 <== mds.0 v2:172.21.15.12:6828/2605601020 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ece2949c00 con 0x55ece2b8b920 2024-09-11T23:05:57.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.667+0000 7fa72cff9640 10 client.4866 handle_command_reply: tid=0 2024-09-11T23:05:57.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.667+0000 7fa757061000 1 client.4866 shutdown 2024-09-11T23:05:57.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.667+0000 7fa757061000 1 -- 172.21.15.12:0/400340180 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ece2b5dd30 msgr2=0x55ece2b665a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:57.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.667+0000 7fa757061000 1 --2- 172.21.15.12:0/400340180 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ece2b5dd30 0x55ece2b665a0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fa7440e12a0 tx=0x7fa7440c9000 comp rx=0 tx=0).stop 2024-09-11T23:05:57.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.667+0000 7fa757061000 1 -- 172.21.15.12:0/400340180 shutdown_connections 2024-09-11T23:05:57.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.667+0000 7fa757061000 1 --2- 172.21.15.12:0/400340180 >> [v2:172.21.15.12:6828/2605601020,v1:172.21.15.12:6829/2605601020] conn(0x55ece2b8b920 0x55ece2b89ed0 crc :-1 s=READY pgs=6 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:57.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.667+0000 7fa757061000 1 --2- 172.21.15.12:0/400340180 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ece2b5dd30 0x55ece2b665a0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:57.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.667+0000 7fa72cff9640 0 client.4866 ms_handle_reset on v2:172.21.15.12:6828/2605601020 2024-09-11T23:05:57.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.667+0000 7fa757061000 1 -- 172.21.15.12:0/400340180 >> 172.21.15.12:0/400340180 conn(0x55ece2b58680 msgr2=0x55ece2b5d620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:57.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.667+0000 7fa757061000 1 -- 172.21.15.12:0/400340180 shutdown_connections 2024-09-11T23:05:57.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.667+0000 7fa757061000 1 -- 172.21.15.12:0/400340180 wait complete. 2024-09-11T23:05:57.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.667+0000 7fa757061000 20 client.4866 trim_cache size 0 max 16384 2024-09-11T23:05:57.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.687+0000 7fa757061000 1 Processor -- start 2024-09-11T23:05:57.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.687+0000 7fa757061000 1 -- start start 2024-09-11T23:05:57.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.687+0000 7fa757061000 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ece2b5dd30 0x55ece2b99c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:57.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.687+0000 7fa757061000 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa74c1d2190 con 0x55ece2b5dd30 2024-09-11T23:05:57.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.687+0000 7fa751d41640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ece2b5dd30 0x55ece2b99c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:57.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.687+0000 7fa751d41640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ece2b5dd30 0x55ece2b99c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48674/0 (socket says 172.21.15.12:48674) 2024-09-11T23:05:57.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.687+0000 7fa751d41640 1 -- 172.21.15.12:0/1924295032 learned_addr learned my addr 172.21.15.12:0/1924295032 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:57.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.687+0000 7fa751d41640 1 -- 172.21.15.12:0/1924295032 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ece2936fd0 con 0x55ece2b5dd30 2024-09-11T23:05:57.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.687+0000 7fa751d41640 1 --2- 172.21.15.12:0/1924295032 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ece2b5dd30 0x55ece2b99c40 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fa74401c7a0 tx=0x7fa7440d6040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92c4e4d1ae03bb26 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:57.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.687+0000 7fa72effd640 1 -- 172.21.15.12:0/1924295032 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7440f2080 con 0x55ece2b5dd30 2024-09-11T23:05:57.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.687+0000 7fa72effd640 1 -- 172.21.15.12:0/1924295032 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7440c2930 con 0x55ece2b5dd30 2024-09-11T23:05:57.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.687+0000 7fa72effd640 1 -- 172.21.15.12:0/1924295032 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7440c1c70 con 0x55ece2b5dd30 2024-09-11T23:05:57.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.691+0000 7fa757061000 1 -- 172.21.15.12:0/1924295032 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ece2b5dd30 msgr2=0x55ece2b99c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:57.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.691+0000 7fa757061000 1 --2- 172.21.15.12:0/1924295032 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ece2b5dd30 0x55ece2b99c40 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fa74401c7a0 tx=0x7fa7440d6040 comp rx=0 tx=0).stop 2024-09-11T23:05:57.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.691+0000 7fa757061000 1 -- 172.21.15.12:0/1924295032 shutdown_connections 2024-09-11T23:05:57.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.691+0000 7fa757061000 1 --2- 172.21.15.12:0/1924295032 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ece2b5dd30 0x55ece2b99c40 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:57.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.691+0000 7fa757061000 1 -- 172.21.15.12:0/1924295032 >> 172.21.15.12:0/1924295032 conn(0x55ece2b58680 msgr2=0x55ece2b8a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:57.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.691+0000 7fa757061000 1 -- 172.21.15.12:0/1924295032 shutdown_connections 2024-09-11T23:05:57.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.691+0000 7fa757061000 1 -- 172.21.15.12:0/1924295032 wait complete. 2024-09-11T23:05:57.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.691+0000 7fa757061000 1 -- start start 2024-09-11T23:05:57.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.691+0000 7fa757061000 1 Processor -- start 2024-09-11T23:05:57.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.691+0000 7fa757061000 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ece2b5dd30 0x55ece2b988b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:57.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.691+0000 7fa757061000 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ece29afc70 con 0x55ece2b5dd30 2024-09-11T23:05:57.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.691+0000 7fa757061000 10 client.0 _ll_register_callbacks cb 0x7fa7440b6ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:05:57.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.691+0000 7fa751d41640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ece2b5dd30 0x55ece2b988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:57.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.691+0000 7fa751d41640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ece2b5dd30 0x55ece2b988b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48690/0 (socket says 172.21.15.12:48690) 2024-09-11T23:05:57.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.691+0000 7fa751d41640 1 -- 172.21.15.12:0/2354948947 learned_addr learned my addr 172.21.15.12:0/2354948947 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:57.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.691+0000 7fa751d41640 1 -- 172.21.15.12:0/2354948947 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ece2a32750 con 0x55ece2b5dd30 2024-09-11T23:05:57.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.691+0000 7fa751d41640 1 --2- 172.21.15.12:0/2354948947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ece2b5dd30 0x55ece2b988b0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fa7440c2c40 tx=0x7fa744009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f9271cb309079c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:57.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.691+0000 7fa72cff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-11T23:05:57.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.691+0000 7fa72cff9640 1 -- 172.21.15.12:0/2354948947 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa744103060 con 0x55ece2b5dd30 2024-09-11T23:05:57.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.691+0000 7fa72cff9640 1 -- 172.21.15.12:0/2354948947 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 3439+0+0 (secure 0 0 0) 0x7fa7440b6490 con 0x55ece2b5dd30 2024-09-11T23:05:57.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.691+0000 7fa757061000 1 -- 172.21.15.12:0/2354948947 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7440c2930 con 0x55ece2b5dd30 2024-09-11T23:05:57.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.691+0000 7fa72cff9640 1 -- 172.21.15.12:0/2354948947 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fa7440f2040 con 0x55ece2b5dd30 2024-09-11T23:05:57.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.691+0000 7fa757061000 10 client.4868 fetch_fsmap learned FSMap version 40 2024-09-11T23:05:57.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.691+0000 7fa757061000 1 -- 172.21.15.12:0/2354948947 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) -- 0x55ece293da30 con 0x55ece2b5dd30 2024-09-11T23:05:57.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.691+0000 7fa72cff9640 1 -- 172.21.15.12:0/2354948947 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7440c2930 con 0x55ece2b5dd30 2024-09-11T23:05:57.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.691+0000 7fa72cff9640 1 -- 172.21.15.12:0/2354948947 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 40) ==== 2292+0+0 (secure 0 0 0) 0x7fa7440c2070 con 0x55ece2b5dd30 2024-09-11T23:05:57.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.691+0000 7fa757061000 10 client.4868 fetch_fsmap finished waiting for FSMap version 40 2024-09-11T23:05:57.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.691+0000 7fa757061000 10 client.4868 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-11T23:05:57.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.691+0000 7fa757061000 20 client.4868 populate_metadata read hostname 'smithi012' 2024-09-11T23:05:57.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.691+0000 7fa757061000 1 --2- 172.21.15.12:0/2354948947 >> [v2:172.21.15.12:6828/2605601020,v1:172.21.15.12:6829/2605601020] conn(0x55ece2b64ec0 0x55ece2b98df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:57.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.691+0000 7fa757061000 4 client.4868 mds_command: new command op to 4813 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:05:57.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.691+0000 7fa757061000 1 -- 172.21.15.12:0/2354948947 --> [v2:172.21.15.12:6828/2605601020,v1:172.21.15.12:6829/2605601020] -- command(tid 0: {"prefix": "status"}) -- 0x55ece29bd3a0 con 0x55ece2b64ec0 2024-09-11T23:05:57.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.691+0000 7fa751540640 1 --2- 172.21.15.12:0/2354948947 >> [v2:172.21.15.12:6828/2605601020,v1:172.21.15.12:6829/2605601020] conn(0x55ece2b64ec0 0x55ece2b98df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:57.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.691+0000 7fa751540640 1 --2- 172.21.15.12:0/2354948947 >> [v2:172.21.15.12:6828/2605601020,v1:172.21.15.12:6829/2605601020] conn(0x55ece2b64ec0 0x55ece2b98df0 crc :-1 s=READY pgs=7 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47076856d289bbf5 server_cookie=ef2588b7d5d374a1 in_seq=0 out_seq=0 2024-09-11T23:05:57.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.691+0000 7fa72cff9640 10 client.4868 ms_handle_connect on v2:172.21.15.12:6828/2605601020 2024-09-11T23:05:57.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.691+0000 7fa72cff9640 1 -- 172.21.15.12:0/2354948947 <== mds.0 v2:172.21.15.12:6828/2605601020 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55ece29bd3a0 con 0x55ece2b64ec0 2024-09-11T23:05:57.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.691+0000 7fa72cff9640 10 client.4868 handle_command_reply: tid=0 2024-09-11T23:05:57.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.691+0000 7fa757061000 1 client.4868 shutdown 2024-09-11T23:05:57.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.691+0000 7fa757061000 1 -- 172.21.15.12:0/2354948947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ece2b5dd30 msgr2=0x55ece2b988b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:57.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.691+0000 7fa757061000 1 --2- 172.21.15.12:0/2354948947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ece2b5dd30 0x55ece2b988b0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fa7440c2c40 tx=0x7fa744009b90 comp rx=0 tx=0).stop 2024-09-11T23:05:57.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.691+0000 7fa757061000 1 -- 172.21.15.12:0/2354948947 shutdown_connections 2024-09-11T23:05:57.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.691+0000 7fa757061000 1 --2- 172.21.15.12:0/2354948947 >> [v2:172.21.15.12:6828/2605601020,v1:172.21.15.12:6829/2605601020] conn(0x55ece2b64ec0 0x55ece2b98df0 crc :-1 s=READY pgs=7 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:57.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.691+0000 7fa757061000 1 --2- 172.21.15.12:0/2354948947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ece2b5dd30 0x55ece2b988b0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:57.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.691+0000 7fa72cff9640 0 client.4868 ms_handle_reset on v2:172.21.15.12:6828/2605601020 2024-09-11T23:05:57.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.691+0000 7fa757061000 1 -- 172.21.15.12:0/2354948947 >> 172.21.15.12:0/2354948947 conn(0x55ece2b58680 msgr2=0x55ece2b65b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:57.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.691+0000 7fa757061000 1 -- 172.21.15.12:0/2354948947 shutdown_connections 2024-09-11T23:05:57.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.691+0000 7fa757061000 1 -- 172.21.15.12:0/2354948947 wait complete. 2024-09-11T23:05:57.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.691+0000 7fa757061000 20 client.4868 trim_cache size 0 max 16384 2024-09-11T23:05:57.699 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T23:05:57.699 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "8be14356-3340-4500-91a2-4cbc6b511f65", 2024-09-11T23:05:57.699 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 0, 2024-09-11T23:05:57.700 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4813, 2024-09-11T23:05:57.700 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-09-11T23:05:57.700 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-09-11T23:05:57.700 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-09-11T23:05:57.700 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 5.5738015120000002, 2024-09-11T23:05:57.700 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 40, 2024-09-11T23:05:57.700 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 54, 2024-09-11T23:05:57.700 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 54, 2024-09-11T23:05:57.700 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 10.907215925999999 2024-09-11T23:05:57.700 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T23:05:57.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.691+0000 7fa753fa5640 1 -- 172.21.15.12:0/4218516508 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fa730035db0 msgr2=0x7fa730038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:57.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.691+0000 7fa753fa5640 1 --2- 172.21.15.12:0/4218516508 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fa730035db0 0x7fa730038270 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa73c001610 tx=0x7fa73c007ad0 comp rx=0 tx=0).stop 2024-09-11T23:05:57.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.695+0000 7fa753fa5640 1 -- 172.21.15.12:0/4218516508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa74c137e50 msgr2=0x7fa74c09f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:57.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.695+0000 7fa753fa5640 1 --2- 172.21.15.12:0/4218516508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa74c137e50 0x7fa74c09f320 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fa744019580 tx=0x7fa744019710 comp rx=0 tx=0).stop 2024-09-11T23:05:57.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.695+0000 7fa753fa5640 1 -- 172.21.15.12:0/4218516508 shutdown_connections 2024-09-11T23:05:57.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.695+0000 7fa753fa5640 1 --2- 172.21.15.12:0/4218516508 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fa730035db0 0x7fa730038270 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:57.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.695+0000 7fa753fa5640 1 --2- 172.21.15.12:0/4218516508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa74c137e50 0x7fa74c09f320 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:57.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.695+0000 7fa753fa5640 1 -- 172.21.15.12:0/4218516508 >> 172.21.15.12:0/4218516508 conn(0x7fa74c0aa140 msgr2=0x7fa74c0a50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:57.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.695+0000 7fa753fa5640 1 -- 172.21.15.12:0/4218516508 shutdown_connections 2024-09-11T23:05:57.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.695+0000 7fa753fa5640 1 -- 172.21.15.12:0/4218516508 wait complete. 2024-09-11T23:05:57.712 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T23:05:57.783 INFO:tasks.ceph.mds.a.smithi012.stderr:2024-09-11T23:05:57.779+0000 7fc07492b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T23:05:57.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.823+0000 7fad17e3f640 1 Processor -- start 2024-09-11T23:05:57.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.823+0000 7fad17e3f640 1 -- start start 2024-09-11T23:05:57.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.827+0000 7fad17e3f640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fad1009f6e0 0x7fad1013cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:57.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.827+0000 7fad17e3f640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad1009e930 con 0x7fad10137e60 2024-09-11T23:05:57.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.827+0000 7fad17e3f640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fad101379e0 con 0x7fad1009f6e0 2024-09-11T23:05:57.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.827+0000 7fad15bdb640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fad10137e60 0x7fad10138240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:50070/0 (socket says 172.21.15.12:50070) 2024-09-11T23:05:57.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.827+0000 7fad15bdb640 1 -- 172.21.15.12:0/3566554238 learned_addr learned my addr 172.21.15.12:0/3566554238 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:05:57.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.827+0000 7fad153da640 1 --2- 172.21.15.12:0/3566554238 >> v2:172.21.15.12:3300/0 conn(0x7fad1009f6e0 0x7fad1013cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:57.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.827+0000 7fad14bd9640 1 -- 172.21.15.12:0/3566554238 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3404159092 0 0) 0x7fad1009e930 con 0x7fad10137e60 2024-09-11T23:05:57.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.827+0000 7fad14bd9640 1 -- 172.21.15.12:0/3566554238 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7facfc003530 con 0x7fad10137e60 2024-09-11T23:05:57.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.827+0000 7fad153da640 1 -- 172.21.15.12:0/3566554238 >> v1:172.21.15.12:6789/0 conn(0x7fad10137e60 legacy=0x7fad10138240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:57.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.827+0000 7fad153da640 1 -- 172.21.15.12:0/3566554238 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad1009d910 con 0x7fad1009f6e0 2024-09-11T23:05:57.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.827+0000 7fad153da640 1 --2- 172.21.15.12:0/3566554238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad1009f6e0 0x7fad1013cc60 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fad0c009d90 tx=0x7fad0c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6d13050c434e7aa server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:57.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.827+0000 7fad14bd9640 1 -- 172.21.15.12:0/3566554238 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad0c0b2070 con 0x7fad1009f6e0 2024-09-11T23:05:57.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.827+0000 7fad14bd9640 1 -- 172.21.15.12:0/3566554238 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad0c0a5900 con 0x7fad1009f6e0 2024-09-11T23:05:57.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.827+0000 7fad14bd9640 1 -- 172.21.15.12:0/3566554238 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad0c0a5c00 con 0x7fad1009f6e0 2024-09-11T23:05:57.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.827+0000 7fad17e3f640 1 -- 172.21.15.12:0/3566554238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad1009f6e0 msgr2=0x7fad1013cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:57.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.827+0000 7fad17e3f640 1 --2- 172.21.15.12:0/3566554238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad1009f6e0 0x7fad1013cc60 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fad0c009d90 tx=0x7fad0c01c970 comp rx=0 tx=0).stop 2024-09-11T23:05:57.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.831+0000 7fad17e3f640 1 -- 172.21.15.12:0/3566554238 shutdown_connections 2024-09-11T23:05:57.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.831+0000 7fad17e3f640 1 --2- 172.21.15.12:0/3566554238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad1009f6e0 0x7fad1013cc60 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:57.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.831+0000 7fad17e3f640 1 -- 172.21.15.12:0/3566554238 >> 172.21.15.12:0/3566554238 conn(0x7fad100a8450 msgr2=0x7fad100a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:57.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.831+0000 7fad17e3f640 1 -- 172.21.15.12:0/3566554238 shutdown_connections 2024-09-11T23:05:57.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.831+0000 7fad17e3f640 1 -- 172.21.15.12:0/3566554238 wait complete. 2024-09-11T23:05:57.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.831+0000 7fad17e3f640 1 Processor -- start 2024-09-11T23:05:57.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.831+0000 7fad17e3f640 1 -- start start 2024-09-11T23:05:57.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.831+0000 7fad17e3f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad1009f6e0 0x7fad10071c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:57.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.831+0000 7fad17e3f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fad1013fd50 con 0x7fad1009f6e0 2024-09-11T23:05:57.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.831+0000 7fad15bdb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad1009f6e0 0x7fad10071c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:57.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.831+0000 7fad15bdb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad1009f6e0 0x7fad10071c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48716/0 (socket says 172.21.15.12:48716) 2024-09-11T23:05:57.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.831+0000 7fad15bdb640 1 -- 172.21.15.12:0/1805634240 learned_addr learned my addr 172.21.15.12:0/1805634240 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:05:57.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.831+0000 7fad15bdb640 1 -- 172.21.15.12:0/1805634240 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad10071230 con 0x7fad1009f6e0 2024-09-11T23:05:57.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.831+0000 7fad15bdb640 1 --2- 172.21.15.12:0/1805634240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad1009f6e0 0x7fad10071c20 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fad0000c450 tx=0x7fad0000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:57.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.831+0000 7fad067fc640 1 -- 172.21.15.12:0/1805634240 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad00017070 con 0x7fad1009f6e0 2024-09-11T23:05:57.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.831+0000 7fad067fc640 1 -- 172.21.15.12:0/1805634240 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad00005c20 con 0x7fad1009f6e0 2024-09-11T23:05:57.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.831+0000 7fad067fc640 1 -- 172.21.15.12:0/1805634240 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad00007070 con 0x7fad1009f6e0 2024-09-11T23:05:57.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.831+0000 7fad17e3f640 1 -- 172.21.15.12:0/1805634240 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad100723a0 con 0x7fad1009f6e0 2024-09-11T23:05:57.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.831+0000 7fad17e3f640 1 -- 172.21.15.12:0/1805634240 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad1006f970 con 0x7fad1009f6e0 2024-09-11T23:05:57.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.831+0000 7fad17e3f640 1 -- 172.21.15.12:0/1805634240 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad10072160 con 0x7fad1009f6e0 2024-09-11T23:05:57.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.831+0000 7fad067fc640 1 -- 172.21.15.12:0/1805634240 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 44053+0+0 (secure 0 0 0) 0x7fad0001a070 con 0x7fad1009f6e0 2024-09-11T23:05:57.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.831+0000 7fad067fc640 1 --2- 172.21.15.12:0/1805634240 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7facf4035db0 0x7facf4038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:05:57.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.835+0000 7fad067fc640 1 -- 172.21.15.12:0/1805634240 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 3439+0+0 (secure 0 0 0) 0x7fad000478f0 con 0x7fad1009f6e0 2024-09-11T23:05:57.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.835+0000 7fad153da640 1 --2- 172.21.15.12:0/1805634240 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7facf4035db0 0x7facf4038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:05:57.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.835+0000 7fad153da640 1 --2- 172.21.15.12:0/1805634240 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7facf4035db0 0x7facf4038270 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fad0c0af000 tx=0x7fad0c0a7070 comp rx=0 tx=0).ready entity=mgr.4708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:05:57.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:57.839+0000 7fad067fc640 1 -- 172.21.15.12:0/1805634240 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fad00012400 con 0x7fad1009f6e0 2024-09-11T23:05:58.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:58.039+0000 7fad17e3f640 1 -- 172.21.15.12:0/1805634240 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fad1006bc60 con 0x7fad1009f6e0 2024-09-11T23:05:58.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:58.039+0000 7fad067fc640 1 -- 172.21.15.12:0/1805634240 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v40) ==== 53+0+73 (secure 0 0 0) 0x7fad0001ac10 con 0x7fad1009f6e0 2024-09-11T23:05:58.042 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T23:05:58.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:58.043+0000 7fad17e3f640 1 -- 172.21.15.12:0/1805634240 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7facf4035db0 msgr2=0x7facf4038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:58.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:58.043+0000 7fad17e3f640 1 --2- 172.21.15.12:0/1805634240 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7facf4035db0 0x7facf4038270 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fad0c0af000 tx=0x7fad0c0a7070 comp rx=0 tx=0).stop 2024-09-11T23:05:58.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:58.043+0000 7fad17e3f640 1 -- 172.21.15.12:0/1805634240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad1009f6e0 msgr2=0x7fad10071c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:05:58.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:58.043+0000 7fad17e3f640 1 --2- 172.21.15.12:0/1805634240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad1009f6e0 0x7fad10071c20 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fad0000c450 tx=0x7fad0000c910 comp rx=0 tx=0).stop 2024-09-11T23:05:58.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:58.043+0000 7fad17e3f640 1 -- 172.21.15.12:0/1805634240 shutdown_connections 2024-09-11T23:05:58.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:58.043+0000 7fad17e3f640 1 --2- 172.21.15.12:0/1805634240 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7facf4035db0 0x7facf4038270 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:58.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:58.043+0000 7fad17e3f640 1 --2- 172.21.15.12:0/1805634240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad1009f6e0 0x7fad10071c20 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:05:58.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:58.043+0000 7fad17e3f640 1 -- 172.21.15.12:0/1805634240 >> 172.21.15.12:0/1805634240 conn(0x7fad100a8450 msgr2=0x7fad101347e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:05:58.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:58.043+0000 7fad17e3f640 1 -- 172.21.15.12:0/1805634240 shutdown_connections 2024-09-11T23:05:58.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:58.043+0000 7fad17e3f640 1 -- 172.21.15.12:0/1805634240 wait complete. 2024-09-11T23:05:58.062 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-11T23:05:58.062 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:05:58.062 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi012.front.sepia.ceph.com 2024-09-11T23:05:58.062 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T23:05:58.062 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T23:05:58.062 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-11T23:05:58.062 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T23:05:58.062 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:05:58.062 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:05:58.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:05:58.063 DEBUG:teuthology.orchestra.run.smithi012:> ip addr 2024-09-11T23:05:58.069 INFO:teuthology.orchestra.run.smithi012.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:05:58.069 INFO:teuthology.orchestra.run.smithi012.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:05:58.069 INFO:teuthology.orchestra.run.smithi012.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:05:58.069 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:05:58.070 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 ::1/128 scope host 2024-09-11T23:05:58.070 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:05:58.070 INFO:teuthology.orchestra.run.smithi012.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:05:58.070 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a4 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:05:58.070 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f0 2024-09-11T23:05:58.070 INFO:teuthology.orchestra.run.smithi012.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:05:58.070 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a5 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:05:58.070 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f1 2024-09-11T23:05:58.070 INFO:teuthology.orchestra.run.smithi012.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:05:58.070 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:ea brd ff:ff:ff:ff:ff:ff 2024-09-11T23:05:58.070 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f0 2024-09-11T23:05:58.070 INFO:teuthology.orchestra.run.smithi012.stdout: inet 172.21.15.12/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-11T23:05:58.070 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft 42383sec preferred_lft 42383sec 2024-09-11T23:05:58.071 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::ae1f:6bff:fef8:25ea/64 scope link 2024-09-11T23:05:58.071 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:05:58.071 INFO:teuthology.orchestra.run.smithi012.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:05:58.071 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:eb brd ff:ff:ff:ff:ff:ff 2024-09-11T23:05:58.071 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f1 2024-09-11T23:05:58.071 INFO:teuthology.orchestra.run.smithi012.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-11T23:05:58.071 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 02:42:d6:75:63:83 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:05:58.071 INFO:teuthology.orchestra.run.smithi012.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-11T23:05:58.071 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:05:58.071 INFO:teuthology.orchestra.run.smithi012.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:05:58.071 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-11T23:05:58.071 INFO:teuthology.orchestra.run.smithi012.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T23:05:58.071 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:05:58.071 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-11T23:05:58.072 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:05:58.072 INFO:teuthology.orchestra.run.smithi012.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:05:58.072 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:05:58.072 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-11T23:05:58.072 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:05:58.072 INFO:teuthology.orchestra.run.smithi012.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:05:58.072 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:05:58.072 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-11T23:05:58.072 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:05:58.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:05:58.073 DEBUG:teuthology.orchestra.run.smithi012:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:05:58.123 INFO:teuthology.orchestra.run.smithi012.stdout:1 2024-09-11T23:05:58.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:05:58.124 DEBUG:teuthology.orchestra.run.smithi012:> route 2024-09-11T23:05:58.174 INFO:teuthology.orchestra.run.smithi012.stdout:Kernel IP routing table 2024-09-11T23:05:58.174 INFO:teuthology.orchestra.run.smithi012.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:05:58.174 INFO:teuthology.orchestra.run.smithi012.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-11T23:05:58.174 INFO:teuthology.orchestra.run.smithi012.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-11T23:05:58.174 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-11T23:05:58.174 INFO:teuthology.orchestra.run.smithi012.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:05:58.175 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:05:58.175 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-09-11T23:05:58.175 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-11T23:05:58.175 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-11T23:05:58.175 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-11T23:05:58.175 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-09-11T23:05:58.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:05:58.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:05:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:05:58.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:05:58.299 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2024-09-11T23:05:58.304 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 1) 2024-09-11T23:05:58.304 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T23:05:58.304 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:05:58.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:05:58.304 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set brx.0 up 2024-09-11T23:05:58.360 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-11T23:05:58.360 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:05:58.360 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T23:05:58.408 INFO:teuthology.orchestra.run.smithi012.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:05:58.409 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:05:58.409 DEBUG:teuthology.orchestra.run.smithi012:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:05:58.456 DEBUG:teuthology.orchestra.run.smithi012:> sudo modprobe fuse 2024-09-11T23:05:58.514 DEBUG:teuthology.orchestra.run.smithi012:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:05:58.562 INFO:teuthology.orchestra.run.smithi012.stdout:/sys 2024-09-11T23:05:58.562 INFO:teuthology.orchestra.run.smithi012.stdout:/proc 2024-09-11T23:05:58.562 INFO:teuthology.orchestra.run.smithi012.stdout:/dev 2024-09-11T23:05:58.562 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/pts 2024-09-11T23:05:58.562 INFO:teuthology.orchestra.run.smithi012.stdout:/run 2024-09-11T23:05:58.562 INFO:teuthology.orchestra.run.smithi012.stdout:/ 2024-09-11T23:05:58.562 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/security 2024-09-11T23:05:58.562 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/shm 2024-09-11T23:05:58.562 INFO:teuthology.orchestra.run.smithi012.stdout:/run/lock 2024-09-11T23:05:58.562 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup 2024-09-11T23:05:58.562 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/pstore 2024-09-11T23:05:58.563 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/bpf 2024-09-11T23:05:58.563 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:05:58.563 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/hugepages 2024-09-11T23:05:58.563 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/mqueue 2024-09-11T23:05:58.563 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/debug 2024-09-11T23:05:58.563 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/tracing 2024-09-11T23:05:58.563 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/fs/nfsd 2024-09-11T23:05:58.563 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/fuse/connections 2024-09-11T23:05:58.563 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/config 2024-09-11T23:05:58.563 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:05:58.563 INFO:teuthology.orchestra.run.smithi012.stdout:/run/rpc_pipefs 2024-09-11T23:05:58.563 INFO:teuthology.orchestra.run.smithi012.stdout:/run/user/1000 2024-09-11T23:05:58.563 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph 2024-09-11T23:05:58.563 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:05:58.564 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:05:58.564 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:05:58.564 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns 2024-09-11T23:05:58.564 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:05:58.564 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:05:58.564 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:05:58.564 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:05:58.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:05:58.565 DEBUG:teuthology.orchestra.run.smithi012:> ls /sys/fs/fuse/connections 2024-09-11T23:05:58.613 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-11T23:05:58.613 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-11T23:05:58.657 DEBUG:teuthology.orchestra.run.smithi012:> sudo modprobe fuse 2024-09-11T23:05:58.673 DEBUG:teuthology.orchestra.run.smithi012:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:05:58.721 INFO:teuthology.orchestra.run.smithi012.stdout:/sys 2024-09-11T23:05:58.721 INFO:teuthology.orchestra.run.smithi012.stdout:/proc 2024-09-11T23:05:58.721 INFO:teuthology.orchestra.run.smithi012.stdout:/dev 2024-09-11T23:05:58.721 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/pts 2024-09-11T23:05:58.721 INFO:teuthology.orchestra.run.smithi012.stdout:/run 2024-09-11T23:05:58.721 INFO:teuthology.orchestra.run.smithi012.stdout:/ 2024-09-11T23:05:58.722 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/security 2024-09-11T23:05:58.722 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/shm 2024-09-11T23:05:58.722 INFO:teuthology.orchestra.run.smithi012.stdout:/run/lock 2024-09-11T23:05:58.722 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup 2024-09-11T23:05:58.722 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/pstore 2024-09-11T23:05:58.722 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/bpf 2024-09-11T23:05:58.722 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:05:58.722 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/hugepages 2024-09-11T23:05:58.722 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/mqueue 2024-09-11T23:05:58.722 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/debug 2024-09-11T23:05:58.722 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/tracing 2024-09-11T23:05:58.722 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/fs/nfsd 2024-09-11T23:05:58.723 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/fuse/connections 2024-09-11T23:05:58.723 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/config 2024-09-11T23:05:58.723 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:05:58.723 INFO:teuthology.orchestra.run.smithi012.stdout:/run/rpc_pipefs 2024-09-11T23:05:58.723 INFO:teuthology.orchestra.run.smithi012.stdout:/run/user/1000 2024-09-11T23:05:58.723 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph 2024-09-11T23:05:58.723 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:05:58.723 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:05:58.723 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:05:58.723 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns 2024-09-11T23:05:58.723 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:05:58.723 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:05:58.723 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:05:58.723 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:05:58.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:05:58.724 DEBUG:teuthology.orchestra.run.smithi012:> ls /sys/fs/fuse/connections 2024-09-11T23:05:58.736 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi012.stderr:2024-09-11T23:05:58.735+0000 7fcbdb343580 -1 init, newargv = 0x55e6313c1540 newargc=15 2024-09-11T23:05:58.736 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi012.stderr:ceph-fuse[39481]: starting ceph client 2024-09-11T23:05:58.741 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi012.stderr:ceph-fuse[39481]: starting fuse 2024-09-11T23:05:59.842 DEBUG:teuthology.orchestra.run.smithi012:> sudo modprobe fuse 2024-09-11T23:05:59.858 DEBUG:teuthology.orchestra.run.smithi012:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:05:59.907 INFO:teuthology.orchestra.run.smithi012.stdout:/sys 2024-09-11T23:05:59.907 INFO:teuthology.orchestra.run.smithi012.stdout:/proc 2024-09-11T23:05:59.907 INFO:teuthology.orchestra.run.smithi012.stdout:/dev 2024-09-11T23:05:59.908 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/pts 2024-09-11T23:05:59.908 INFO:teuthology.orchestra.run.smithi012.stdout:/run 2024-09-11T23:05:59.908 INFO:teuthology.orchestra.run.smithi012.stdout:/ 2024-09-11T23:05:59.908 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/security 2024-09-11T23:05:59.908 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/shm 2024-09-11T23:05:59.908 INFO:teuthology.orchestra.run.smithi012.stdout:/run/lock 2024-09-11T23:05:59.908 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup 2024-09-11T23:05:59.908 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/pstore 2024-09-11T23:05:59.908 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/bpf 2024-09-11T23:05:59.908 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:05:59.908 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/hugepages 2024-09-11T23:05:59.908 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/mqueue 2024-09-11T23:05:59.908 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/debug 2024-09-11T23:05:59.909 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/tracing 2024-09-11T23:05:59.909 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/fs/nfsd 2024-09-11T23:05:59.909 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/fuse/connections 2024-09-11T23:05:59.909 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/config 2024-09-11T23:05:59.909 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:05:59.909 INFO:teuthology.orchestra.run.smithi012.stdout:/run/rpc_pipefs 2024-09-11T23:05:59.909 INFO:teuthology.orchestra.run.smithi012.stdout:/run/user/1000 2024-09-11T23:05:59.909 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph 2024-09-11T23:05:59.909 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:05:59.909 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:05:59.909 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:05:59.909 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns 2024-09-11T23:05:59.909 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:05:59.910 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:05:59.910 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:05:59.910 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:05:59.910 INFO:teuthology.orchestra.run.smithi012.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-11T23:05:59.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:05:59.911 DEBUG:teuthology.orchestra.run.smithi012:> ls /sys/fs/fuse/connections 2024-09-11T23:05:59.957 INFO:teuthology.orchestra.run.smithi012.stdout:45 2024-09-11T23:05:59.957 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-11T23:05:59.957 DEBUG:teuthology.orchestra.run.smithi012:> sudo stdin-killer -- python3 -c ' 2024-09-11T23:05:59.957 DEBUG:teuthology.orchestra.run.smithi012:> import glob 2024-09-11T23:05:59.957 DEBUG:teuthology.orchestra.run.smithi012:> import re 2024-09-11T23:05:59.957 DEBUG:teuthology.orchestra.run.smithi012:> import os 2024-09-11T23:05:59.957 DEBUG:teuthology.orchestra.run.smithi012:> import subprocess 2024-09-11T23:05:59.958 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:05:59.958 DEBUG:teuthology.orchestra.run.smithi012:> def _find_admin_socket(client_name): 2024-09-11T23:05:59.958 DEBUG:teuthology.orchestra.run.smithi012:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-11T23:05:59.958 DEBUG:teuthology.orchestra.run.smithi012:> files = glob.glob(asok_path) 2024-09-11T23:05:59.958 DEBUG:teuthology.orchestra.run.smithi012:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-11T23:05:59.958 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:05:59.958 DEBUG:teuthology.orchestra.run.smithi012:> # Given a non-glob path, it better be there 2024-09-11T23:05:59.958 DEBUG:teuthology.orchestra.run.smithi012:> if "*" not in asok_path: 2024-09-11T23:05:59.958 DEBUG:teuthology.orchestra.run.smithi012:> assert(len(files) == 1) 2024-09-11T23:05:59.958 DEBUG:teuthology.orchestra.run.smithi012:> return files[0] 2024-09-11T23:05:59.958 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:05:59.958 DEBUG:teuthology.orchestra.run.smithi012:> for f in files: 2024-09-11T23:05:59.958 DEBUG:teuthology.orchestra.run.smithi012:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T23:05:59.958 DEBUG:teuthology.orchestra.run.smithi012:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T23:05:59.958 DEBUG:teuthology.orchestra.run.smithi012:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T23:05:59.959 DEBUG:teuthology.orchestra.run.smithi012:> contents = proc_f.read() 2024-09-11T23:05:59.959 DEBUG:teuthology.orchestra.run.smithi012:> if mountpoint in contents: 2024-09-11T23:05:59.959 DEBUG:teuthology.orchestra.run.smithi012:> return f 2024-09-11T23:05:59.959 DEBUG:teuthology.orchestra.run.smithi012:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T23:05:59.959 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:05:59.959 DEBUG:teuthology.orchestra.run.smithi012:> print(_find_admin_socket("client.0")) 2024-09-11T23:05:59.959 DEBUG:teuthology.orchestra.run.smithi012:> ' 2024-09-11T23:06:00.085 INFO:teuthology.orchestra.run.smithi012.stdout:/var/run/ceph/ceph-client.0.39481.asok 2024-09-11T23:06:00.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:06:00.097 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.39481.asok 2024-09-11T23:06:00.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:06:00.097 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.39481.asok status 2024-09-11T23:06:00.254 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T23:06:00.254 INFO:teuthology.orchestra.run.smithi012.stdout: "metadata": { 2024-09-11T23:06:00.255 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-11T23:06:00.255 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T23:06:00.255 INFO:teuthology.orchestra.run.smithi012.stdout: "entity_id": "0", 2024-09-11T23:06:00.255 INFO:teuthology.orchestra.run.smithi012.stdout: "hostname": "smithi012", 2024-09-11T23:06:00.255 INFO:teuthology.orchestra.run.smithi012.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-11T23:06:00.255 INFO:teuthology.orchestra.run.smithi012.stdout: "pid": "39481", 2024-09-11T23:06:00.255 INFO:teuthology.orchestra.run.smithi012.stdout: "root": "/" 2024-09-11T23:06:00.255 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:06:00.255 INFO:teuthology.orchestra.run.smithi012.stdout: "dentry_count": 0, 2024-09-11T23:06:00.255 INFO:teuthology.orchestra.run.smithi012.stdout: "dentry_pinned_count": 0, 2024-09-11T23:06:00.255 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4874, 2024-09-11T23:06:00.255 INFO:teuthology.orchestra.run.smithi012.stdout: "inst": { 2024-09-11T23:06:00.255 INFO:teuthology.orchestra.run.smithi012.stdout: "name": { 2024-09-11T23:06:00.255 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "client", 2024-09-11T23:06:00.255 INFO:teuthology.orchestra.run.smithi012.stdout: "num": 4874 2024-09-11T23:06:00.256 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:06:00.256 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": { 2024-09-11T23:06:00.256 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T23:06:00.256 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "192.168.0.1:0", 2024-09-11T23:06:00.256 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 23229456 2024-09-11T23:06:00.256 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:06:00.256 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:06:00.256 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": { 2024-09-11T23:06:00.256 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T23:06:00.256 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "192.168.0.1:0", 2024-09-11T23:06:00.256 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 23229456 2024-09-11T23:06:00.256 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:06:00.256 INFO:teuthology.orchestra.run.smithi012.stdout: "inst_str": "client.4874 192.168.0.1:0/23229456", 2024-09-11T23:06:00.257 INFO:teuthology.orchestra.run.smithi012.stdout: "addr_str": "192.168.0.1:0/23229456", 2024-09-11T23:06:00.257 INFO:teuthology.orchestra.run.smithi012.stdout: "inode_count": 1, 2024-09-11T23:06:00.257 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_epoch": 40, 2024-09-11T23:06:00.257 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_epoch": 54, 2024-09-11T23:06:00.257 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_epoch_barrier": 0, 2024-09-11T23:06:00.257 INFO:teuthology.orchestra.run.smithi012.stdout: "blocklisted": false, 2024-09-11T23:06:00.257 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs" 2024-09-11T23:06:00.257 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T23:06:00.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:06:00.269 DEBUG:teuthology.orchestra.run.smithi012:> stat --file-system '--printf=%T 2024-09-11T23:06:00.269 DEBUG:teuthology.orchestra.run.smithi012:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-11T23:06:00.274 INFO:teuthology.orchestra.run.smithi012.stdout:fuseblk 2024-09-11T23:06:00.275 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-11T23:06:00.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:06:00.275 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:06:00.333 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T23:06:00.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.499+0000 7fe32e916640 1 Processor -- start 2024-09-11T23:06:00.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.499+0000 7fe32e916640 1 -- start start 2024-09-11T23:06:00.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.503+0000 7fe32e916640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe328137e60 0x7fe328138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:00.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.503+0000 7fe32e916640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe32809e930 con 0x7fe32809f6e0 2024-09-11T23:06:00.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.503+0000 7fe32e916640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fe3281379e0 con 0x7fe328137e60 2024-09-11T23:06:00.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.503+0000 7fe327fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe328137e60 0x7fe328138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:00.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.503+0000 7fe327fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe328137e60 0x7fe328138240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48724/0 (socket says 172.21.15.12:48724) 2024-09-11T23:06:00.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.503+0000 7fe327fff640 1 -- 172.21.15.12:0/1400525791 learned_addr learned my addr 172.21.15.12:0/1400525791 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:00.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.503+0000 7fe327fff640 1 -- 172.21.15.12:0/1400525791 >> v1:172.21.15.12:6789/0 conn(0x7fe32809f6e0 legacy=0x7fe3280a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:00.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.503+0000 7fe327fff640 1 -- 172.21.15.12:0/1400525791 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe32809d910 con 0x7fe328137e60 2024-09-11T23:06:00.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.503+0000 7fe326ffd640 1 -- 172.21.15.12:0/1400525791 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2303394645 0 0) 0x7fe32809e930 con 0x7fe32809f6e0 2024-09-11T23:06:00.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.503+0000 7fe327fff640 1 --2- 172.21.15.12:0/1400525791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe328137e60 0x7fe328138240 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fe3180097f0 tx=0x7fe31801c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f437fa053d22e2bc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:00.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.503+0000 7fe326ffd640 1 -- 172.21.15.12:0/1400525791 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3180aa590 con 0x7fe328137e60 2024-09-11T23:06:00.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.503+0000 7fe326ffd640 1 -- 172.21.15.12:0/1400525791 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3180af070 con 0x7fe328137e60 2024-09-11T23:06:00.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.503+0000 7fe326ffd640 1 -- 172.21.15.12:0/1400525791 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3180aa880 con 0x7fe328137e60 2024-09-11T23:06:00.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.503+0000 7fe32e916640 1 -- 172.21.15.12:0/1400525791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe328137e60 msgr2=0x7fe328138240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:00.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.503+0000 7fe32e916640 1 --2- 172.21.15.12:0/1400525791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe328137e60 0x7fe328138240 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fe3180097f0 tx=0x7fe31801c4e0 comp rx=0 tx=0).stop 2024-09-11T23:06:00.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.503+0000 7fe32e916640 1 -- 172.21.15.12:0/1400525791 shutdown_connections 2024-09-11T23:06:00.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.503+0000 7fe32e916640 1 --2- 172.21.15.12:0/1400525791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe328137e60 0x7fe328138240 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:00.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.503+0000 7fe32e916640 1 -- 172.21.15.12:0/1400525791 >> 172.21.15.12:0/1400525791 conn(0x7fe3280a8450 msgr2=0x7fe3280a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:00.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.503+0000 7fe32e916640 1 -- 172.21.15.12:0/1400525791 shutdown_connections 2024-09-11T23:06:00.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.503+0000 7fe32e916640 1 -- 172.21.15.12:0/1400525791 wait complete. 2024-09-11T23:06:00.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.507+0000 7fe32e916640 1 Processor -- start 2024-09-11T23:06:00.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.507+0000 7fe32e916640 1 -- start start 2024-09-11T23:06:00.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.507+0000 7fe32e916640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe32809f6e0 0x7fe328133760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:00.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.507+0000 7fe32e916640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe32813fe00 con 0x7fe32809f6e0 2024-09-11T23:06:00.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.507+0000 7fe327fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe32809f6e0 0x7fe328133760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:00.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.507+0000 7fe327fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe32809f6e0 0x7fe328133760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48734/0 (socket says 172.21.15.12:48734) 2024-09-11T23:06:00.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.507+0000 7fe327fff640 1 -- 172.21.15.12:0/514000696 learned_addr learned my addr 172.21.15.12:0/514000696 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:00.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.507+0000 7fe327fff640 1 -- 172.21.15.12:0/514000696 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe32811fd30 con 0x7fe32809f6e0 2024-09-11T23:06:00.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.507+0000 7fe327fff640 1 --2- 172.21.15.12:0/514000696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe32809f6e0 0x7fe328133760 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fe3180190f0 tx=0x7fe31801ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:00.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.507+0000 7fe324ff9640 1 -- 172.21.15.12:0/514000696 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3180bd3f0 con 0x7fe32809f6e0 2024-09-11T23:06:00.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.507+0000 7fe324ff9640 1 -- 172.21.15.12:0/514000696 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3180bd5b0 con 0x7fe32809f6e0 2024-09-11T23:06:00.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.507+0000 7fe324ff9640 1 -- 172.21.15.12:0/514000696 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3180bd8d0 con 0x7fe32809f6e0 2024-09-11T23:06:00.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.507+0000 7fe32e916640 1 -- 172.21.15.12:0/514000696 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe32809c5a0 con 0x7fe32809f6e0 2024-09-11T23:06:00.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.507+0000 7fe32e916640 1 -- 172.21.15.12:0/514000696 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe32813d140 con 0x7fe32809f6e0 2024-09-11T23:06:00.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.507+0000 7fe32e916640 1 -- 172.21.15.12:0/514000696 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3280008e0 con 0x7fe32809f6e0 2024-09-11T23:06:00.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.507+0000 7fe324ff9640 1 -- 172.21.15.12:0/514000696 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 44053+0+0 (secure 0 0 0) 0x7fe3180c6440 con 0x7fe32809f6e0 2024-09-11T23:06:00.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.507+0000 7fe324ff9640 1 --2- 172.21.15.12:0/514000696 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fe314035db0 0x7fe314038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:00.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.507+0000 7fe324ff9640 1 -- 172.21.15.12:0/514000696 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 3439+0+0 (secure 0 0 0) 0x7fe3180e30a0 con 0x7fe32809f6e0 2024-09-11T23:06:00.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.507+0000 7fe3277fe640 1 --2- 172.21.15.12:0/514000696 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fe314035db0 0x7fe314038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:00.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.511+0000 7fe3277fe640 1 --2- 172.21.15.12:0/514000696 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fe314035db0 0x7fe314038270 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe31c007fd0 tx=0x7fe31c007940 comp rx=0 tx=0).ready entity=mgr.4708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:00.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.515+0000 7fe324ff9640 1 -- 172.21.15.12:0/514000696 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe3180160d0 con 0x7fe32809f6e0 2024-09-11T23:06:00.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.715+0000 7fe32e916640 1 -- 172.21.15.12:0/514000696 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe32809c840 con 0x7fe32809f6e0 2024-09-11T23:06:00.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.715+0000 7fe324ff9640 1 -- 172.21.15.12:0/514000696 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v40) ==== 53+0+73 (secure 0 0 0) 0x7fe3180b33f0 con 0x7fe32809f6e0 2024-09-11T23:06:00.718 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T23:06:00.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.715+0000 7fe32e916640 1 -- 172.21.15.12:0/514000696 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fe314035db0 msgr2=0x7fe314038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:00.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.715+0000 7fe32e916640 1 --2- 172.21.15.12:0/514000696 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fe314035db0 0x7fe314038270 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe31c007fd0 tx=0x7fe31c007940 comp rx=0 tx=0).stop 2024-09-11T23:06:00.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.715+0000 7fe32e916640 1 -- 172.21.15.12:0/514000696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe32809f6e0 msgr2=0x7fe328133760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:00.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.715+0000 7fe32e916640 1 --2- 172.21.15.12:0/514000696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe32809f6e0 0x7fe328133760 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fe3180190f0 tx=0x7fe31801ad20 comp rx=0 tx=0).stop 2024-09-11T23:06:00.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.719+0000 7fe32e916640 1 -- 172.21.15.12:0/514000696 shutdown_connections 2024-09-11T23:06:00.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.719+0000 7fe32e916640 1 --2- 172.21.15.12:0/514000696 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7fe314035db0 0x7fe314038270 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:00.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.719+0000 7fe32e916640 1 --2- 172.21.15.12:0/514000696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe32809f6e0 0x7fe328133760 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:00.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.719+0000 7fe32e916640 1 -- 172.21.15.12:0/514000696 >> 172.21.15.12:0/514000696 conn(0x7fe3280a8450 msgr2=0x7fe328134650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:00.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.719+0000 7fe32e916640 1 -- 172.21.15.12:0/514000696 shutdown_connections 2024-09-11T23:06:00.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00.719+0000 7fe32e916640 1 -- 172.21.15.12:0/514000696 wait complete. 2024-09-11T23:06:00.736 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-11T23:06:00.736 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:06:00.737 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi012.front.sepia.ceph.com 2024-09-11T23:06:00.737 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-11T23:06:00.737 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-11T23:06:00.737 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-11T23:06:00.737 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T23:06:00.737 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:06:00.737 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:06:00.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:06:00.737 DEBUG:teuthology.orchestra.run.smithi012:> ip addr 2024-09-11T23:06:00.743 INFO:teuthology.orchestra.run.smithi012.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:06:00.744 INFO:teuthology.orchestra.run.smithi012.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:06:00.744 INFO:teuthology.orchestra.run.smithi012.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:06:00.744 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:06:00.744 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 ::1/128 scope host 2024-09-11T23:06:00.744 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:06:00.744 INFO:teuthology.orchestra.run.smithi012.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:06:00.744 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a4 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:06:00.744 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f0 2024-09-11T23:06:00.744 INFO:teuthology.orchestra.run.smithi012.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:06:00.744 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a5 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:06:00.744 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f1 2024-09-11T23:06:00.744 INFO:teuthology.orchestra.run.smithi012.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:06:00.745 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:ea brd ff:ff:ff:ff:ff:ff 2024-09-11T23:06:00.745 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f0 2024-09-11T23:06:00.745 INFO:teuthology.orchestra.run.smithi012.stdout: inet 172.21.15.12/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-11T23:06:00.745 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft 42380sec preferred_lft 42380sec 2024-09-11T23:06:00.745 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::ae1f:6bff:fef8:25ea/64 scope link 2024-09-11T23:06:00.745 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:06:00.745 INFO:teuthology.orchestra.run.smithi012.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:06:00.745 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:eb brd ff:ff:ff:ff:ff:ff 2024-09-11T23:06:00.745 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f1 2024-09-11T23:06:00.745 INFO:teuthology.orchestra.run.smithi012.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-11T23:06:00.745 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 02:42:d6:75:63:83 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:06:00.745 INFO:teuthology.orchestra.run.smithi012.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-11T23:06:00.745 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:06:00.746 INFO:teuthology.orchestra.run.smithi012.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:06:00.746 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-11T23:06:00.746 INFO:teuthology.orchestra.run.smithi012.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T23:06:00.746 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:06:00.746 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-11T23:06:00.746 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:06:00.746 INFO:teuthology.orchestra.run.smithi012.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:06:00.746 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:06:00.746 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-11T23:06:00.746 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:06:00.746 INFO:teuthology.orchestra.run.smithi012.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:06:00.746 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:06:00.746 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-11T23:06:00.747 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:06:00.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:06:00.747 DEBUG:teuthology.orchestra.run.smithi012:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:06:00.800 INFO:teuthology.orchestra.run.smithi012.stdout:1 2024-09-11T23:06:00.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:06:00.801 DEBUG:teuthology.orchestra.run.smithi012:> route 2024-09-11T23:06:00.854 INFO:teuthology.orchestra.run.smithi012.stdout:Kernel IP routing table 2024-09-11T23:06:00.854 INFO:teuthology.orchestra.run.smithi012.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:06:00.854 INFO:teuthology.orchestra.run.smithi012.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-11T23:06:00.854 INFO:teuthology.orchestra.run.smithi012.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-11T23:06:00.854 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-11T23:06:00.854 INFO:teuthology.orchestra.run.smithi012.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:06:00.855 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:06:00.855 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-09-11T23:06:00.855 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-11T23:06:00.855 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-11T23:06:00.855 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-11T23:06:00.855 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-09-11T23:06:00.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:06:00.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:06:00.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:06:00.981 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2024-09-11T23:06:00.987 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 1) 2024-09-11T23:06:00.987 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T23:06:00.987 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:06:00.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:06:00.988 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set brx.1 up 2024-09-11T23:06:01.045 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-11T23:06:01.045 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:06:01.046 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-11T23:06:01.092 INFO:teuthology.orchestra.run.smithi012.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:06:01.093 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:06:01.093 DEBUG:teuthology.orchestra.run.smithi012:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-11T23:06:01.141 DEBUG:teuthology.orchestra.run.smithi012:> sudo modprobe fuse 2024-09-11T23:06:01.198 DEBUG:teuthology.orchestra.run.smithi012:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:06:01.246 INFO:teuthology.orchestra.run.smithi012.stdout:/sys 2024-09-11T23:06:01.246 INFO:teuthology.orchestra.run.smithi012.stdout:/proc 2024-09-11T23:06:01.246 INFO:teuthology.orchestra.run.smithi012.stdout:/dev 2024-09-11T23:06:01.246 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/pts 2024-09-11T23:06:01.246 INFO:teuthology.orchestra.run.smithi012.stdout:/run 2024-09-11T23:06:01.246 INFO:teuthology.orchestra.run.smithi012.stdout:/ 2024-09-11T23:06:01.246 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/security 2024-09-11T23:06:01.246 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/shm 2024-09-11T23:06:01.246 INFO:teuthology.orchestra.run.smithi012.stdout:/run/lock 2024-09-11T23:06:01.247 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup 2024-09-11T23:06:01.247 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/pstore 2024-09-11T23:06:01.247 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/bpf 2024-09-11T23:06:01.247 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:06:01.247 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/hugepages 2024-09-11T23:06:01.247 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/mqueue 2024-09-11T23:06:01.247 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/debug 2024-09-11T23:06:01.247 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/tracing 2024-09-11T23:06:01.247 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/fs/nfsd 2024-09-11T23:06:01.247 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/fuse/connections 2024-09-11T23:06:01.247 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/config 2024-09-11T23:06:01.247 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:06:01.248 INFO:teuthology.orchestra.run.smithi012.stdout:/run/rpc_pipefs 2024-09-11T23:06:01.248 INFO:teuthology.orchestra.run.smithi012.stdout:/run/user/1000 2024-09-11T23:06:01.248 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph 2024-09-11T23:06:01.248 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:06:01.248 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:06:01.248 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:06:01.248 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns 2024-09-11T23:06:01.248 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:06:01.248 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:06:01.248 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:06:01.248 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:06:01.248 INFO:teuthology.orchestra.run.smithi012.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-11T23:06:01.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:06:01.249 DEBUG:teuthology.orchestra.run.smithi012:> ls /sys/fs/fuse/connections 2024-09-11T23:06:01.297 INFO:teuthology.orchestra.run.smithi012.stdout:45 2024-09-11T23:06:01.297 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [45] 2024-09-11T23:06:01.297 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-11T23:06:01.345 DEBUG:teuthology.orchestra.run.smithi012:> sudo modprobe fuse 2024-09-11T23:06:01.360 DEBUG:teuthology.orchestra.run.smithi012:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:06:01.409 INFO:teuthology.orchestra.run.smithi012.stdout:/sys 2024-09-11T23:06:01.409 INFO:teuthology.orchestra.run.smithi012.stdout:/proc 2024-09-11T23:06:01.409 INFO:teuthology.orchestra.run.smithi012.stdout:/dev 2024-09-11T23:06:01.409 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/pts 2024-09-11T23:06:01.409 INFO:teuthology.orchestra.run.smithi012.stdout:/run 2024-09-11T23:06:01.410 INFO:teuthology.orchestra.run.smithi012.stdout:/ 2024-09-11T23:06:01.410 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/security 2024-09-11T23:06:01.410 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/shm 2024-09-11T23:06:01.410 INFO:teuthology.orchestra.run.smithi012.stdout:/run/lock 2024-09-11T23:06:01.410 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup 2024-09-11T23:06:01.410 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/pstore 2024-09-11T23:06:01.410 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/bpf 2024-09-11T23:06:01.410 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:06:01.410 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/hugepages 2024-09-11T23:06:01.410 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/mqueue 2024-09-11T23:06:01.410 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/debug 2024-09-11T23:06:01.410 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/tracing 2024-09-11T23:06:01.410 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/fs/nfsd 2024-09-11T23:06:01.411 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/fuse/connections 2024-09-11T23:06:01.411 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/config 2024-09-11T23:06:01.411 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:06:01.411 INFO:teuthology.orchestra.run.smithi012.stdout:/run/rpc_pipefs 2024-09-11T23:06:01.411 INFO:teuthology.orchestra.run.smithi012.stdout:/run/user/1000 2024-09-11T23:06:01.411 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph 2024-09-11T23:06:01.411 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:06:01.411 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:06:01.411 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:06:01.411 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns 2024-09-11T23:06:01.411 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:06:01.411 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:06:01.411 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:06:01.411 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:06:01.412 INFO:teuthology.orchestra.run.smithi012.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-11T23:06:01.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:06:01.412 DEBUG:teuthology.orchestra.run.smithi012:> ls /sys/fs/fuse/connections 2024-09-11T23:06:01.429 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi012.stderr:2024-09-11T23:06:01.427+0000 7f34721af580 -1 init, newargv = 0x556af3fd8a70 newargc=15 2024-09-11T23:06:01.429 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi012.stderr:ceph-fuse[39591]: starting ceph client 2024-09-11T23:06:01.434 INFO:teuthology.orchestra.run.smithi012.stdout:45 2024-09-11T23:06:01.435 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi012.stderr:ceph-fuse[39591]: starting fuse 2024-09-11T23:06:02.536 DEBUG:teuthology.orchestra.run.smithi012:> sudo modprobe fuse 2024-09-11T23:06:02.553 DEBUG:teuthology.orchestra.run.smithi012:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:06:02.603 INFO:teuthology.orchestra.run.smithi012.stdout:/sys 2024-09-11T23:06:02.603 INFO:teuthology.orchestra.run.smithi012.stdout:/proc 2024-09-11T23:06:02.603 INFO:teuthology.orchestra.run.smithi012.stdout:/dev 2024-09-11T23:06:02.603 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/pts 2024-09-11T23:06:02.603 INFO:teuthology.orchestra.run.smithi012.stdout:/run 2024-09-11T23:06:02.604 INFO:teuthology.orchestra.run.smithi012.stdout:/ 2024-09-11T23:06:02.604 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/security 2024-09-11T23:06:02.604 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/shm 2024-09-11T23:06:02.604 INFO:teuthology.orchestra.run.smithi012.stdout:/run/lock 2024-09-11T23:06:02.604 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup 2024-09-11T23:06:02.604 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/pstore 2024-09-11T23:06:02.604 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/bpf 2024-09-11T23:06:02.604 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:06:02.604 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/hugepages 2024-09-11T23:06:02.604 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/mqueue 2024-09-11T23:06:02.604 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/debug 2024-09-11T23:06:02.604 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/tracing 2024-09-11T23:06:02.604 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/fs/nfsd 2024-09-11T23:06:02.604 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/fuse/connections 2024-09-11T23:06:02.605 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/config 2024-09-11T23:06:02.605 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:06:02.605 INFO:teuthology.orchestra.run.smithi012.stdout:/run/rpc_pipefs 2024-09-11T23:06:02.605 INFO:teuthology.orchestra.run.smithi012.stdout:/run/user/1000 2024-09-11T23:06:02.605 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph 2024-09-11T23:06:02.605 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:06:02.605 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:06:02.605 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:06:02.605 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns 2024-09-11T23:06:02.605 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:06:02.605 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:06:02.605 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:06:02.606 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:06:02.606 INFO:teuthology.orchestra.run.smithi012.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-11T23:06:02.606 INFO:teuthology.orchestra.run.smithi012.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-11T23:06:02.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:06:02.607 DEBUG:teuthology.orchestra.run.smithi012:> ls /sys/fs/fuse/connections 2024-09-11T23:06:02.653 INFO:teuthology.orchestra.run.smithi012.stdout:45 2024-09-11T23:06:02.653 INFO:teuthology.orchestra.run.smithi012.stdout:46 2024-09-11T23:06:02.653 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45, 46] 2024-09-11T23:06:02.654 DEBUG:teuthology.orchestra.run.smithi012:> sudo stdin-killer -- python3 -c ' 2024-09-11T23:06:02.654 DEBUG:teuthology.orchestra.run.smithi012:> import glob 2024-09-11T23:06:02.654 DEBUG:teuthology.orchestra.run.smithi012:> import re 2024-09-11T23:06:02.654 DEBUG:teuthology.orchestra.run.smithi012:> import os 2024-09-11T23:06:02.654 DEBUG:teuthology.orchestra.run.smithi012:> import subprocess 2024-09-11T23:06:02.654 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:06:02.654 DEBUG:teuthology.orchestra.run.smithi012:> def _find_admin_socket(client_name): 2024-09-11T23:06:02.654 DEBUG:teuthology.orchestra.run.smithi012:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-11T23:06:02.654 DEBUG:teuthology.orchestra.run.smithi012:> files = glob.glob(asok_path) 2024-09-11T23:06:02.654 DEBUG:teuthology.orchestra.run.smithi012:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-11T23:06:02.654 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:06:02.654 DEBUG:teuthology.orchestra.run.smithi012:> # Given a non-glob path, it better be there 2024-09-11T23:06:02.655 DEBUG:teuthology.orchestra.run.smithi012:> if "*" not in asok_path: 2024-09-11T23:06:02.655 DEBUG:teuthology.orchestra.run.smithi012:> assert(len(files) == 1) 2024-09-11T23:06:02.655 DEBUG:teuthology.orchestra.run.smithi012:> return files[0] 2024-09-11T23:06:02.655 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:06:02.655 DEBUG:teuthology.orchestra.run.smithi012:> for f in files: 2024-09-11T23:06:02.655 DEBUG:teuthology.orchestra.run.smithi012:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T23:06:02.655 DEBUG:teuthology.orchestra.run.smithi012:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T23:06:02.655 DEBUG:teuthology.orchestra.run.smithi012:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T23:06:02.655 DEBUG:teuthology.orchestra.run.smithi012:> contents = proc_f.read() 2024-09-11T23:06:02.656 DEBUG:teuthology.orchestra.run.smithi012:> if mountpoint in contents: 2024-09-11T23:06:02.656 DEBUG:teuthology.orchestra.run.smithi012:> return f 2024-09-11T23:06:02.656 DEBUG:teuthology.orchestra.run.smithi012:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T23:06:02.656 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:06:02.656 DEBUG:teuthology.orchestra.run.smithi012:> print(_find_admin_socket("client.1")) 2024-09-11T23:06:02.656 DEBUG:teuthology.orchestra.run.smithi012:> ' 2024-09-11T23:06:02.780 INFO:teuthology.orchestra.run.smithi012.stdout:/var/run/ceph/ceph-client.1.39591.asok 2024-09-11T23:06:02.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:06:02.794 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.39591.asok 2024-09-11T23:06:02.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:06:02.795 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.39591.asok status 2024-09-11T23:06:02.953 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T23:06:02.954 INFO:teuthology.orchestra.run.smithi012.stdout: "metadata": { 2024-09-11T23:06:02.954 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-11T23:06:02.954 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T23:06:02.954 INFO:teuthology.orchestra.run.smithi012.stdout: "entity_id": "1", 2024-09-11T23:06:02.954 INFO:teuthology.orchestra.run.smithi012.stdout: "hostname": "smithi012", 2024-09-11T23:06:02.954 INFO:teuthology.orchestra.run.smithi012.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-11T23:06:02.954 INFO:teuthology.orchestra.run.smithi012.stdout: "pid": "39591", 2024-09-11T23:06:02.954 INFO:teuthology.orchestra.run.smithi012.stdout: "root": "/" 2024-09-11T23:06:02.954 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:06:02.954 INFO:teuthology.orchestra.run.smithi012.stdout: "dentry_count": 0, 2024-09-11T23:06:02.954 INFO:teuthology.orchestra.run.smithi012.stdout: "dentry_pinned_count": 0, 2024-09-11T23:06:02.955 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4880, 2024-09-11T23:06:02.955 INFO:teuthology.orchestra.run.smithi012.stdout: "inst": { 2024-09-11T23:06:02.955 INFO:teuthology.orchestra.run.smithi012.stdout: "name": { 2024-09-11T23:06:02.955 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "client", 2024-09-11T23:06:02.955 INFO:teuthology.orchestra.run.smithi012.stdout: "num": 4880 2024-09-11T23:06:02.955 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:06:02.955 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": { 2024-09-11T23:06:02.955 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T23:06:02.955 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "192.168.0.2:0", 2024-09-11T23:06:02.955 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2582698335 2024-09-11T23:06:02.955 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:06:02.955 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:06:02.956 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": { 2024-09-11T23:06:02.956 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T23:06:02.956 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "192.168.0.2:0", 2024-09-11T23:06:02.956 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2582698335 2024-09-11T23:06:02.956 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:06:02.956 INFO:teuthology.orchestra.run.smithi012.stdout: "inst_str": "client.4880 192.168.0.2:0/2582698335", 2024-09-11T23:06:02.956 INFO:teuthology.orchestra.run.smithi012.stdout: "addr_str": "192.168.0.2:0/2582698335", 2024-09-11T23:06:02.956 INFO:teuthology.orchestra.run.smithi012.stdout: "inode_count": 1, 2024-09-11T23:06:02.956 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_epoch": 40, 2024-09-11T23:06:02.956 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_epoch": 54, 2024-09-11T23:06:02.956 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_epoch_barrier": 0, 2024-09-11T23:06:02.956 INFO:teuthology.orchestra.run.smithi012.stdout: "blocklisted": false, 2024-09-11T23:06:02.956 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs" 2024-09-11T23:06:02.957 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T23:06:02.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:06:02.968 DEBUG:teuthology.orchestra.run.smithi012:> stat --file-system '--printf=%T 2024-09-11T23:06:02.968 DEBUG:teuthology.orchestra.run.smithi012:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-11T23:06:02.974 INFO:teuthology.orchestra.run.smithi012.stdout:fuseblk 2024-09-11T23:06:02.974 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-11T23:06:02.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:06:02.975 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-11T23:06:03.026 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable stats 2024-09-11T23:06:03.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:03.195+0000 7f3b6bf10640 1 Processor -- start 2024-09-11T23:06:03.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:03.195+0000 7f3b6bf10640 1 -- start start 2024-09-11T23:06:03.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:03.195+0000 7f3b6bf10640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3b641381c0 0x7f3b6413cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:03.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:03.195+0000 7f3b6bf10640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b6409d690 con 0x7f3b64137de0 2024-09-11T23:06:03.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:03.195+0000 7f3b6bf10640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f3b6409ea90 con 0x7f3b641381c0 2024-09-11T23:06:03.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:03.195+0000 7f3b694ab640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3b641381c0 0x7f3b6413cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:03.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:03.195+0000 7f3b69cac640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f3b64137de0 0x7f3b6409f190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:50078/0 (socket says 172.21.15.12:50078) 2024-09-11T23:06:03.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:03.195+0000 7f3b69cac640 1 -- 172.21.15.12:0/1662398204 learned_addr learned my addr 172.21.15.12:0/1662398204 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:03.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:03.199+0000 7f3b694ab640 1 -- 172.21.15.12:0/1662398204 >> v1:172.21.15.12:6789/0 conn(0x7f3b64137de0 legacy=0x7f3b6409f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:03.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:03.199+0000 7f3b694ab640 1 -- 172.21.15.12:0/1662398204 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b6409cf00 con 0x7f3b641381c0 2024-09-11T23:06:03.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:03.199+0000 7f3b68caa640 1 -- 172.21.15.12:0/1662398204 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2146930681 0 0) 0x7f3b6409d690 con 0x7f3b64137de0 2024-09-11T23:06:03.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:03.199+0000 7f3b694ab640 1 --2- 172.21.15.12:0/1662398204 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b641381c0 0x7f3b6413cbc0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f3b60009d90 tx=0x7f3b6001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c82491ba9127ed32 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:03.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:03.199+0000 7f3b68caa640 1 -- 172.21.15.12:0/1662398204 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b600b2070 con 0x7f3b641381c0 2024-09-11T23:06:03.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:03.199+0000 7f3b68caa640 1 -- 172.21.15.12:0/1662398204 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b600a5760 con 0x7f3b641381c0 2024-09-11T23:06:03.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:03.199+0000 7f3b68caa640 1 -- 172.21.15.12:0/1662398204 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b600a5a60 con 0x7f3b641381c0 2024-09-11T23:06:03.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:03.199+0000 7f3b6bf10640 1 -- 172.21.15.12:0/1662398204 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b641381c0 msgr2=0x7f3b6413cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:03.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:03.199+0000 7f3b6bf10640 1 --2- 172.21.15.12:0/1662398204 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b641381c0 0x7f3b6413cbc0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f3b60009d90 tx=0x7f3b6001c8e0 comp rx=0 tx=0).stop 2024-09-11T23:06:03.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:03.199+0000 7f3b6bf10640 1 -- 172.21.15.12:0/1662398204 shutdown_connections 2024-09-11T23:06:03.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:03.199+0000 7f3b6bf10640 1 --2- 172.21.15.12:0/1662398204 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b641381c0 0x7f3b6413cbc0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:03.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:03.199+0000 7f3b6bf10640 1 -- 172.21.15.12:0/1662398204 >> 172.21.15.12:0/1662398204 conn(0x7f3b640a82f0 msgr2=0x7f3b640a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:03.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:03.199+0000 7f3b6bf10640 1 -- 172.21.15.12:0/1662398204 shutdown_connections 2024-09-11T23:06:03.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:03.199+0000 7f3b6bf10640 1 -- 172.21.15.12:0/1662398204 wait complete. 2024-09-11T23:06:03.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:03.203+0000 7f3b6bf10640 1 Processor -- start 2024-09-11T23:06:03.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:03.203+0000 7f3b6bf10640 1 -- start start 2024-09-11T23:06:03.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:03.203+0000 7f3b6bf10640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b64137de0 0x7f3b641cc340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:03.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:03.203+0000 7f3b6bf10640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3b64137860 con 0x7f3b64137de0 2024-09-11T23:06:03.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:03.203+0000 7f3b69cac640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b64137de0 0x7f3b641cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:03.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:03.203+0000 7f3b69cac640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b64137de0 0x7f3b641cc340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48746/0 (socket says 172.21.15.12:48746) 2024-09-11T23:06:03.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:03.203+0000 7f3b69cac640 1 -- 172.21.15.12:0/4233527927 learned_addr learned my addr 172.21.15.12:0/4233527927 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:03.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:03.203+0000 7f3b69cac640 1 -- 172.21.15.12:0/4233527927 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b641cbc70 con 0x7f3b64137de0 2024-09-11T23:06:03.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:03.203+0000 7f3b69cac640 1 --2- 172.21.15.12:0/4233527927 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b64137de0 0x7f3b641cc340 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f3b5800c390 tx=0x7f3b5800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:03.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:03.203+0000 7f3b567fc640 1 -- 172.21.15.12:0/4233527927 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b58007410 con 0x7f3b64137de0 2024-09-11T23:06:03.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:03.203+0000 7f3b567fc640 1 -- 172.21.15.12:0/4233527927 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b580075d0 con 0x7f3b64137de0 2024-09-11T23:06:03.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:03.203+0000 7f3b567fc640 1 -- 172.21.15.12:0/4233527927 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b58004960 con 0x7f3b64137de0 2024-09-11T23:06:03.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:03.203+0000 7f3b6bf10640 1 -- 172.21.15.12:0/4233527927 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b64073430 con 0x7f3b64137de0 2024-09-11T23:06:03.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:03.203+0000 7f3b6bf10640 1 -- 172.21.15.12:0/4233527927 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b640718d0 con 0x7f3b64137de0 2024-09-11T23:06:03.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:03.203+0000 7f3b567fc640 1 -- 172.21.15.12:0/4233527927 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 44053+0+0 (secure 0 0 0) 0x7f3b58011070 con 0x7f3b64137de0 2024-09-11T23:06:03.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:03.203+0000 7f3b6bf10640 1 -- 172.21.15.12:0/4233527927 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b640721b0 con 0x7f3b64137de0 2024-09-11T23:06:03.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:03.203+0000 7f3b567fc640 1 --2- 172.21.15.12:0/4233527927 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f3b48035db0 0x7f3b48038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:03.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:03.203+0000 7f3b567fc640 1 -- 172.21.15.12:0/4233527927 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 3439+0+0 (secure 0 0 0) 0x7f3b580481e0 con 0x7f3b64137de0 2024-09-11T23:06:03.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:03.203+0000 7f3b694ab640 1 --2- 172.21.15.12:0/4233527927 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f3b48035db0 0x7f3b48038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:03.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:03.207+0000 7f3b694ab640 1 --2- 172.21.15.12:0/4233527927 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f3b48035db0 0x7f3b48038270 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3b600af000 tx=0x7f3b600a7070 comp rx=0 tx=0).ready entity=mgr.4708 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:03.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:03.211+0000 7f3b567fc640 1 -- 172.21.15.12:0/4233527927 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3b58004d90 con 0x7f3b64137de0 2024-09-11T23:06:03.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:03.415+0000 7f3b6bf10640 1 -- 172.21.15.12:0/4233527927 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "stats"} v 0) -- 0x7f3b6409f190 con 0x7f3b64137de0 2024-09-11T23:06:04.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:04.331+0000 7f3b567fc640 1 -- 172.21.15.12:0/4233527927 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "stats"}]=0 v26) ==== 84+0+0 (secure 0 0 0) 0x7f3b580138e0 con 0x7f3b64137de0 2024-09-11T23:06:04.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:04.335+0000 7f3b567fc640 1 -- 172.21.15.12:0/4233527927 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mgrmap(e 26) ==== 44062+0+0 (secure 0 0 0) 0x7f3b580133c0 con 0x7f3b64137de0 2024-09-11T23:06:04.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:04.335+0000 7f3b6bf10640 1 -- 172.21.15.12:0/4233527927 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f3b48035db0 msgr2=0x7f3b48038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:04.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:04.335+0000 7f3b6bf10640 1 --2- 172.21.15.12:0/4233527927 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f3b48035db0 0x7f3b48038270 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3b600af000 tx=0x7f3b600a7070 comp rx=0 tx=0).stop 2024-09-11T23:06:04.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:04.335+0000 7f3b6bf10640 1 -- 172.21.15.12:0/4233527927 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b64137de0 msgr2=0x7f3b641cc340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:04.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:04.335+0000 7f3b6bf10640 1 --2- 172.21.15.12:0/4233527927 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b64137de0 0x7f3b641cc340 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f3b5800c390 tx=0x7f3b5800c850 comp rx=0 tx=0).stop 2024-09-11T23:06:04.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:04.335+0000 7f3b6bf10640 1 -- 172.21.15.12:0/4233527927 shutdown_connections 2024-09-11T23:06:04.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:04.335+0000 7f3b6bf10640 1 --2- 172.21.15.12:0/4233527927 >> [v2:172.21.15.12:6824/1925124150,v1:172.21.15.12:6825/1925124150] conn(0x7f3b48035db0 0x7f3b48038270 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:04.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:04.335+0000 7f3b6bf10640 1 --2- 172.21.15.12:0/4233527927 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b64137de0 0x7f3b641cc340 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:04.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:04.335+0000 7f3b6bf10640 1 -- 172.21.15.12:0/4233527927 >> 172.21.15.12:0/4233527927 conn(0x7f3b640a82f0 msgr2=0x7f3b640a1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:04.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:04.335+0000 7f3b6bf10640 1 -- 172.21.15.12:0/4233527927 shutdown_connections 2024-09-11T23:06:04.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:04.335+0000 7f3b6bf10640 1 -- 172.21.15.12:0/4233527927 wait complete. 2024-09-11T23:06:04.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:06:04.360 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec cephfs-top --id=admin --selftest) 2024-09-11T23:06:04.470 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:04.467+0000 7f7bc3680180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T23:06:04.853 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:04.851+0000 7f7bc3680180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T23:06:04.990 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:04.987+0000 7f7bc3680180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T23:06:05.429 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:05.427+0000 7f7bc3680180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T23:06:05.482 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:05.479+0000 7f7bc3680180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T23:06:05.533 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:05.531+0000 7f7bc3680180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T23:06:05.611 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:05.607+0000 7f7bc3680180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T23:06:05.663 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:05.659+0000 7f7bc3680180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T23:06:05.739 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:05.735+0000 7f7bc3680180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T23:06:05.793 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:05.791+0000 7f7bc3680180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T23:06:05.938 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:05.935+0000 7f7bc3680180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T23:06:05.992 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:05.987+0000 7f7bc3680180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T23:06:06.216 INFO:tasks.ceph.mgr.x.smithi012.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-11T23:06:06.217 INFO:tasks.ceph.mgr.x.smithi012.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-11T23:06:06.217 INFO:tasks.ceph.mgr.x.smithi012.stderr: from numpy import show_config as show_numpy_config 2024-09-11T23:06:06.224 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:06.223+0000 7f7bc3680180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T23:06:06.364 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:06.359+0000 7f7bc3680180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:06:06.478 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:06.475+0000 7f7bc3680180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T23:06:06.542 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:06.539+0000 7f7bc3680180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T23:06:06.681 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:06.679+0000 7f7bc3680180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:06:07.185 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:07.183+0000 7f7bc3680180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T23:06:07.261 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:07.259+0000 7f7bc3680180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T23:06:07.414 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:07.411+0000 7f7bc3680180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T23:06:07.490 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:07.487+0000 7f7bc3680180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T23:06:07.790 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:07.787+0000 7f7bc3680180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T23:06:07.847 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:07.843+0000 7f7bc3680180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T23:06:07.939 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:07.935+0000 7f7b4c97d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:06:07.939 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:07.935+0000 7f7b4c97d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:06:07.939 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:07.935+0000 7f7b4c97d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:06:07.939 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:07.935+0000 7f7b4c97d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:06:07.939 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:07.935+0000 7f7b4c97d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:06:07.939 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:07.935+0000 7f7b49977640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:06:07.939 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:07.935+0000 7f7b49977640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:06:07.940 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:07.935+0000 7f7b49977640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:06:07.940 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:07.935+0000 7f7b49977640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:06:07.940 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:07.935+0000 7f7b49977640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:06:08.889 INFO:teuthology.orchestra.run.smithi012.stdout:selftest ok 2024-09-11T23:06:08.901 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable stats 2024-09-11T23:06:09.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.031+0000 7f765e6f9640 1 Processor -- start 2024-09-11T23:06:09.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.031+0000 7f765e6f9640 1 -- start start 2024-09-11T23:06:09.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.031+0000 7f765e6f9640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f76580a1ba0 0x7f765813ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:09.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.031+0000 7f765e6f9640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76580a55a0 con 0x7f7658136b50 2024-09-11T23:06:09.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.031+0000 7f765e6f9640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f76580a0f10 con 0x7f76580a1ba0 2024-09-11T23:06:09.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.035+0000 7f76577fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f76580a1ba0 0x7f765813ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:09.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.035+0000 7f76577fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f76580a1ba0 0x7f765813ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40208/0 (socket says 172.21.15.12:40208) 2024-09-11T23:06:09.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.035+0000 7f76577fe640 1 -- 172.21.15.12:0/2502230651 learned_addr learned my addr 172.21.15.12:0/2502230651 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:09.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.035+0000 7f76577fe640 1 -- 172.21.15.12:0/2502230651 >> v1:172.21.15.12:6789/0 conn(0x7f7658136b50 legacy=0x7f7658136f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:09.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.035+0000 7f76577fe640 1 -- 172.21.15.12:0/2502230651 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f765806ca30 con 0x7f76580a1ba0 2024-09-11T23:06:09.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.035+0000 7f76577fe640 1 --2- 172.21.15.12:0/2502230651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76580a1ba0 0x7f765813ed80 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f764c0097f0 tx=0x7f764c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=654d2f5ec78ebcf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:09.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.035+0000 7f7656ffd640 1 -- 172.21.15.12:0/2502230651 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f764c0b0070 con 0x7f76580a1ba0 2024-09-11T23:06:09.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.035+0000 7f7656ffd640 1 -- 172.21.15.12:0/2502230651 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f764c0ab530 con 0x7f76580a1ba0 2024-09-11T23:06:09.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.035+0000 7f7656ffd640 1 -- 172.21.15.12:0/2502230651 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f764c0ab830 con 0x7f76580a1ba0 2024-09-11T23:06:09.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.035+0000 7f765e6f9640 1 -- 172.21.15.12:0/2502230651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76580a1ba0 msgr2=0x7f765813ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:09.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.035+0000 7f765e6f9640 1 --2- 172.21.15.12:0/2502230651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76580a1ba0 0x7f765813ed80 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f764c0097f0 tx=0x7f764c01c450 comp rx=0 tx=0).stop 2024-09-11T23:06:09.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.035+0000 7f765e6f9640 1 -- 172.21.15.12:0/2502230651 shutdown_connections 2024-09-11T23:06:09.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.035+0000 7f765e6f9640 1 --2- 172.21.15.12:0/2502230651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76580a1ba0 0x7f765813ed80 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:09.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.035+0000 7f765e6f9640 1 -- 172.21.15.12:0/2502230651 >> 172.21.15.12:0/2502230651 conn(0x7f76580a91a0 msgr2=0x7f76580a95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:09.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.035+0000 7f765e6f9640 1 -- 172.21.15.12:0/2502230651 shutdown_connections 2024-09-11T23:06:09.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.035+0000 7f765e6f9640 1 -- 172.21.15.12:0/2502230651 wait complete. 2024-09-11T23:06:09.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.039+0000 7f765e6f9640 1 Processor -- start 2024-09-11T23:06:09.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.039+0000 7f765e6f9640 1 -- start start 2024-09-11T23:06:09.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.039+0000 7f765e6f9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76580a1ba0 0x7f765809ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:09.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.039+0000 7f765e6f9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7658141c60 con 0x7f76580a1ba0 2024-09-11T23:06:09.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.039+0000 7f7657fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76580a1ba0 0x7f765809ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:09.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.039+0000 7f7657fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76580a1ba0 0x7f765809ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40216/0 (socket says 172.21.15.12:40216) 2024-09-11T23:06:09.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.039+0000 7f7657fff640 1 -- 172.21.15.12:0/355317469 learned_addr learned my addr 172.21.15.12:0/355317469 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:09.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.039+0000 7f7657fff640 1 -- 172.21.15.12:0/355317469 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f765809e4d0 con 0x7f76580a1ba0 2024-09-11T23:06:09.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.039+0000 7f7657fff640 1 --2- 172.21.15.12:0/355317469 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76580a1ba0 0x7f765809ac40 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f765000c7f0 tx=0x7f765000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:09.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.039+0000 7f7654ff9640 1 -- 172.21.15.12:0/355317469 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7650016020 con 0x7f76580a1ba0 2024-09-11T23:06:09.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.039+0000 7f7654ff9640 1 -- 172.21.15.12:0/355317469 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7650006cb0 con 0x7f76580a1ba0 2024-09-11T23:06:09.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.039+0000 7f7654ff9640 1 -- 172.21.15.12:0/355317469 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f765000a7f0 con 0x7f76580a1ba0 2024-09-11T23:06:09.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.039+0000 7f765e6f9640 1 -- 172.21.15.12:0/355317469 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f765809ded0 con 0x7f76580a1ba0 2024-09-11T23:06:09.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.039+0000 7f765e6f9640 1 -- 172.21.15.12:0/355317469 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f765809c6b0 con 0x7f76580a1ba0 2024-09-11T23:06:09.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.039+0000 7f765e6f9640 1 -- 172.21.15.12:0/355317469 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f765809c990 con 0x7f76580a1ba0 2024-09-11T23:06:09.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.039+0000 7f7654ff9640 1 -- 172.21.15.12:0/355317469 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 28) ==== 43900+0+0 (secure 0 0 0) 0x7f765000a990 con 0x7f76580a1ba0 2024-09-11T23:06:09.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.039+0000 7f7654ff9640 1 --2- 172.21.15.12:0/355317469 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f7644035c50 0x7f7644038110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:09.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.039+0000 7f7654ff9640 1 -- 172.21.15.12:0/355317469 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 3697+0+0 (secure 0 0 0) 0x7f7650047fe0 con 0x7f76580a1ba0 2024-09-11T23:06:09.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.039+0000 7f76577fe640 1 --2- 172.21.15.12:0/355317469 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f7644035c50 0x7f7644038110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:09.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.039+0000 7f76577fe640 1 --2- 172.21.15.12:0/355317469 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f7644035c50 0x7f7644038110 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f764c0ad000 tx=0x7f764c008040 comp rx=0 tx=0).ready entity=mgr.4885 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:09.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.043+0000 7f7654ff9640 1 -- 172.21.15.12:0/355317469 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7650020060 con 0x7f76580a1ba0 2024-09-11T23:06:09.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.251+0000 7f765e6f9640 1 -- 172.21.15.12:0/355317469 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "stats"} v 0) -- 0x7f76580a31f0 con 0x7f76580a1ba0 2024-09-11T23:06:09.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.923+0000 7f7654ff9640 1 -- 172.21.15.12:0/355317469 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "stats"}]=0 v29) ==== 85+0+0 (secure 0 0 0) 0x7f765001a570 con 0x7f76580a1ba0 2024-09-11T23:06:09.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.927+0000 7f765e6f9640 1 -- 172.21.15.12:0/355317469 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f7644035c50 msgr2=0x7f7644038110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:09.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.927+0000 7f765e6f9640 1 --2- 172.21.15.12:0/355317469 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f7644035c50 0x7f7644038110 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f764c0ad000 tx=0x7f764c008040 comp rx=0 tx=0).stop 2024-09-11T23:06:09.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.927+0000 7f765e6f9640 1 -- 172.21.15.12:0/355317469 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76580a1ba0 msgr2=0x7f765809ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:09.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.927+0000 7f765e6f9640 1 --2- 172.21.15.12:0/355317469 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76580a1ba0 0x7f765809ac40 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f765000c7f0 tx=0x7f765000ccb0 comp rx=0 tx=0).stop 2024-09-11T23:06:09.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.927+0000 7f765e6f9640 1 -- 172.21.15.12:0/355317469 shutdown_connections 2024-09-11T23:06:09.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.927+0000 7f765e6f9640 1 --2- 172.21.15.12:0/355317469 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f7644035c50 0x7f7644038110 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:09.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.927+0000 7f765e6f9640 1 --2- 172.21.15.12:0/355317469 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76580a1ba0 0x7f765809ac40 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:09.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.927+0000 7f765e6f9640 1 -- 172.21.15.12:0/355317469 >> 172.21.15.12:0/355317469 conn(0x7f76580a91a0 msgr2=0x7f7658139170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:09.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.927+0000 7f765e6f9640 1 -- 172.21.15.12:0/355317469 shutdown_connections 2024-09-11T23:06:09.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:09.927+0000 7f765e6f9640 1 -- 172.21.15.12:0/355317469 wait complete. 2024-09-11T23:06:09.951 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T23:06:09.951 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:06:09.986 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T23:06:09.986 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:06:09.986 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T23:06:09.986 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:06:10.037 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:06:10.058 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:10.055+0000 7f0303827180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T23:06:10.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.171+0000 7f5d89029640 1 Processor -- start 2024-09-11T23:06:10.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.171+0000 7f5d89029640 1 -- start start 2024-09-11T23:06:10.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.175+0000 7f5d89029640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5d840a9c60 0x7f5d8409e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:10.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.175+0000 7f5d89029640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d8409d8c0 con 0x7f5d8409bfc0 2024-09-11T23:06:10.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.175+0000 7f5d89029640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f5d8409d170 con 0x7f5d840a9c60 2024-09-11T23:06:10.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.175+0000 7f5d82d9d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5d840a9c60 0x7f5d8409e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:10.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.175+0000 7f5d8259c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f5d8409bfc0 0x7f5d8409a9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39882/0 (socket says 172.21.15.12:39882) 2024-09-11T23:06:10.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.175+0000 7f5d82d9d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5d840a9c60 0x7f5d8409e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40248/0 (socket says 172.21.15.12:40248) 2024-09-11T23:06:10.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.175+0000 7f5d8259c640 1 -- 172.21.15.12:0/98239702 learned_addr learned my addr 172.21.15.12:0/98239702 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:10.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.175+0000 7f5d82d9d640 1 -- 172.21.15.12:0/98239702 >> v1:172.21.15.12:6789/0 conn(0x7f5d8409bfc0 legacy=0x7f5d8409a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:10.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.175+0000 7f5d81d9b640 1 -- 172.21.15.12:0/98239702 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2631186992 0 0) 0x7f5d78001120 con 0x7f5d8409bfc0 2024-09-11T23:06:10.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.175+0000 7f5d82d9d640 1 -- 172.21.15.12:0/98239702 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d8409d430 con 0x7f5d840a9c60 2024-09-11T23:06:10.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.175+0000 7f5d82d9d640 1 --2- 172.21.15.12:0/98239702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d840a9c60 0x7f5d8409e320 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f5d74009740 tx=0x7f5d7401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8faa222b96ac81fb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:10.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.175+0000 7f5d81d9b640 1 -- 172.21.15.12:0/98239702 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d740b0070 con 0x7f5d840a9c60 2024-09-11T23:06:10.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.175+0000 7f5d81d9b640 1 -- 172.21.15.12:0/98239702 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d740ab530 con 0x7f5d840a9c60 2024-09-11T23:06:10.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.175+0000 7f5d81d9b640 1 -- 172.21.15.12:0/98239702 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d740ab830 con 0x7f5d840a9c60 2024-09-11T23:06:10.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.179+0000 7f5d89029640 1 -- 172.21.15.12:0/98239702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d840a9c60 msgr2=0x7f5d8409e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:10.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.179+0000 7f5d89029640 1 --2- 172.21.15.12:0/98239702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d840a9c60 0x7f5d8409e320 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f5d74009740 tx=0x7f5d7401c390 comp rx=0 tx=0).stop 2024-09-11T23:06:10.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.179+0000 7f5d89029640 1 -- 172.21.15.12:0/98239702 shutdown_connections 2024-09-11T23:06:10.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.179+0000 7f5d89029640 1 --2- 172.21.15.12:0/98239702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d840a9c60 0x7f5d8409e320 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:10.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.179+0000 7f5d89029640 1 -- 172.21.15.12:0/98239702 >> 172.21.15.12:0/98239702 conn(0x7f5d8406fba0 msgr2=0x7f5d84071fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:10.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.179+0000 7f5d89029640 1 -- 172.21.15.12:0/98239702 shutdown_connections 2024-09-11T23:06:10.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.179+0000 7f5d89029640 1 -- 172.21.15.12:0/98239702 wait complete. 2024-09-11T23:06:10.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.179+0000 7f5d89029640 1 Processor -- start 2024-09-11T23:06:10.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.179+0000 7f5d89029640 1 -- start start 2024-09-11T23:06:10.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.179+0000 7f5d89029640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d8409bfc0 0x7f5d841380c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:10.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.179+0000 7f5d89029640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5d84141e30 con 0x7f5d8409bfc0 2024-09-11T23:06:10.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.179+0000 7f5d82d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d8409bfc0 0x7f5d841380c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:10.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.179+0000 7f5d82d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d8409bfc0 0x7f5d841380c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40264/0 (socket says 172.21.15.12:40264) 2024-09-11T23:06:10.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.179+0000 7f5d82d9d640 1 -- 172.21.15.12:0/2466217731 learned_addr learned my addr 172.21.15.12:0/2466217731 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:10.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.179+0000 7f5d82d9d640 1 -- 172.21.15.12:0/2466217731 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d84120770 con 0x7f5d8409bfc0 2024-09-11T23:06:10.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.179+0000 7f5d82d9d640 1 --2- 172.21.15.12:0/2466217731 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d8409bfc0 0x7f5d841380c0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f5d74019fc0 tx=0x7f5d7401abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:10.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.179+0000 7f5d6b7fe640 1 -- 172.21.15.12:0/2466217731 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d740bb070 con 0x7f5d8409bfc0 2024-09-11T23:06:10.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.179+0000 7f5d6b7fe640 1 -- 172.21.15.12:0/2466217731 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d74004020 con 0x7f5d8409bfc0 2024-09-11T23:06:10.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.179+0000 7f5d89029640 1 -- 172.21.15.12:0/2466217731 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d8413a000 con 0x7f5d8409bfc0 2024-09-11T23:06:10.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.179+0000 7f5d6b7fe640 1 -- 172.21.15.12:0/2466217731 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d740b0040 con 0x7f5d8409bfc0 2024-09-11T23:06:10.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.179+0000 7f5d89029640 1 -- 172.21.15.12:0/2466217731 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d84139d20 con 0x7f5d8409bfc0 2024-09-11T23:06:10.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.179+0000 7f5d89029640 1 -- 172.21.15.12:0/2466217731 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d8409e320 con 0x7f5d8409bfc0 2024-09-11T23:06:10.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.183+0000 7f5d6b7fe640 1 -- 172.21.15.12:0/2466217731 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 29) ==== 44099+0+0 (secure 0 0 0) 0x7f5d74004320 con 0x7f5d8409bfc0 2024-09-11T23:06:10.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.183+0000 7f5d6b7fe640 1 --2- 172.21.15.12:0/2466217731 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f5d70035e40 0x7f5d70038300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:10.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.183+0000 7f5d6b7fe640 1 -- 172.21.15.12:0/2466217731 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 3697+0+0 (secure 0 0 0) 0x7f5d740e3a40 con 0x7f5d8409bfc0 2024-09-11T23:06:10.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.183+0000 7f5d8259c640 1 -- 172.21.15.12:0/2466217731 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f5d70035e40 msgr2=0x7f5d70038300 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6824/378652896 2024-09-11T23:06:10.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.183+0000 7f5d8259c640 1 --2- 172.21.15.12:0/2466217731 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f5d70035e40 0x7f5d70038300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:06:10.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.187+0000 7f5d6b7fe640 1 -- 172.21.15.12:0/2466217731 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5d74016010 con 0x7f5d8409bfc0 2024-09-11T23:06:10.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.363+0000 7f5d89029640 1 -- 172.21.15.12:0/2466217731 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5d8413e030 con 0x7f5d8409bfc0 2024-09-11T23:06:10.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.363+0000 7f5d6b7fe640 1 -- 172.21.15.12:0/2466217731 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 6 entries v55) ==== 80+0+353 (secure 0 0 0) 0x7f5d740ca430 con 0x7f5d8409bfc0 2024-09-11T23:06:10.367 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/1044732542 2024-09-12T23:06:07.866565+0000 2024-09-11T23:06:10.367 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/1734477438 2024-09-12T23:06:07.866565+0000 2024-09-11T23:06:10.367 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/462043258 2024-09-12T23:06:07.866565+0000 2024-09-11T23:06:10.367 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/3818284364 2024-09-12T23:06:07.866565+0000 2024-09-11T23:06:10.367 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:6825/1925124150 2024-09-12T23:06:07.866565+0000 2024-09-11T23:06:10.367 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:6824/1925124150 2024-09-12T23:06:07.866565+0000 2024-09-11T23:06:10.367 INFO:teuthology.orchestra.run.smithi012.stderr:listed 6 entries 2024-09-11T23:06:10.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.367+0000 7f5d89029640 1 -- 172.21.15.12:0/2466217731 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f5d70035e40 msgr2=0x7f5d70038300 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:06:10.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.367+0000 7f5d89029640 1 --2- 172.21.15.12:0/2466217731 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f5d70035e40 0x7f5d70038300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:10.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.367+0000 7f5d89029640 1 -- 172.21.15.12:0/2466217731 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d8409bfc0 msgr2=0x7f5d841380c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:10.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.367+0000 7f5d89029640 1 --2- 172.21.15.12:0/2466217731 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d8409bfc0 0x7f5d841380c0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f5d74019fc0 tx=0x7f5d7401abd0 comp rx=0 tx=0).stop 2024-09-11T23:06:10.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.367+0000 7f5d89029640 1 -- 172.21.15.12:0/2466217731 shutdown_connections 2024-09-11T23:06:10.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.367+0000 7f5d89029640 1 --2- 172.21.15.12:0/2466217731 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f5d70035e40 0x7f5d70038300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:10.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.367+0000 7f5d89029640 1 --2- 172.21.15.12:0/2466217731 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d8409bfc0 0x7f5d841380c0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:10.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.367+0000 7f5d89029640 1 -- 172.21.15.12:0/2466217731 >> 172.21.15.12:0/2466217731 conn(0x7f5d8406fba0 msgr2=0x7f5d840725d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:10.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.367+0000 7f5d89029640 1 -- 172.21.15.12:0/2466217731 shutdown_connections 2024-09-11T23:06:10.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.367+0000 7f5d89029640 1 -- 172.21.15.12:0/2466217731 wait complete. 2024-09-11T23:06:10.385 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi012.front.sepia.ceph.com... 2024-09-11T23:06:10.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:06:10.385 DEBUG:teuthology.orchestra.run.smithi012:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-11T23:06:10.396 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi012.stderr:ceph-fuse[39481]: fuse finished with error 0 and tester_r 0 2024-09-11T23:06:10.397 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi012.front.sepia.ceph.com 2024-09-11T23:06:10.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:06:10.397 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-11T23:06:10.458 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:10.455+0000 7f0303827180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T23:06:10.543 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:06:10.543 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T23:06:10.543 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:06:10.589 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:06:10.596 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:10.595+0000 7f0303827180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T23:06:10.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.715+0000 7f525a483640 1 Processor -- start 2024-09-11T23:06:10.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.715+0000 7f525a483640 1 -- start start 2024-09-11T23:06:10.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.715+0000 7f525a483640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5254137aa0 0x7f5254137e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:10.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.715+0000 7f525a483640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f525409e5b0 con 0x7f52541383c0 2024-09-11T23:06:10.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.715+0000 7f525a483640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f525409f2d0 con 0x7f5254137aa0 2024-09-11T23:06:10.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.715+0000 7f5253fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5254137aa0 0x7f5254137e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:10.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.715+0000 7f5253fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5254137aa0 0x7f5254137e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40272/0 (socket says 172.21.15.12:40272) 2024-09-11T23:06:10.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.715+0000 7f5253fff640 1 -- 172.21.15.12:0/4106998129 learned_addr learned my addr 172.21.15.12:0/4106998129 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:10.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.715+0000 7f5253fff640 1 -- 172.21.15.12:0/4106998129 >> v1:172.21.15.12:6789/0 conn(0x7f52541383c0 legacy=0x7f5254136a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:10.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.715+0000 7f5253fff640 1 -- 172.21.15.12:0/4106998129 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52540aa830 con 0x7f5254137aa0 2024-09-11T23:06:10.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.719+0000 7f5253fff640 1 --2- 172.21.15.12:0/4106998129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5254137aa0 0x7f5254137e80 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f52440097f0 tx=0x7f524401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a4b8e5a43b1df79 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:10.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.719+0000 7f5252ffd640 1 -- 172.21.15.12:0/4106998129 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52440b0070 con 0x7f5254137aa0 2024-09-11T23:06:10.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.719+0000 7f5252ffd640 1 -- 172.21.15.12:0/4106998129 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52440ab530 con 0x7f5254137aa0 2024-09-11T23:06:10.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.719+0000 7f5252ffd640 1 -- 172.21.15.12:0/4106998129 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52440ab830 con 0x7f5254137aa0 2024-09-11T23:06:10.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.719+0000 7f525a483640 1 -- 172.21.15.12:0/4106998129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5254137aa0 msgr2=0x7f5254137e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:10.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.719+0000 7f525a483640 1 --2- 172.21.15.12:0/4106998129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5254137aa0 0x7f5254137e80 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f52440097f0 tx=0x7f524401c450 comp rx=0 tx=0).stop 2024-09-11T23:06:10.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.719+0000 7f525a483640 1 -- 172.21.15.12:0/4106998129 shutdown_connections 2024-09-11T23:06:10.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.719+0000 7f525a483640 1 --2- 172.21.15.12:0/4106998129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5254137aa0 0x7f5254137e80 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:10.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.719+0000 7f525a483640 1 -- 172.21.15.12:0/4106998129 >> 172.21.15.12:0/4106998129 conn(0x7f5254070df0 msgr2=0x7f5254073210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:10.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.719+0000 7f525a483640 1 -- 172.21.15.12:0/4106998129 shutdown_connections 2024-09-11T23:06:10.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.719+0000 7f525a483640 1 -- 172.21.15.12:0/4106998129 wait complete. 2024-09-11T23:06:10.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.719+0000 7f525a483640 1 Processor -- start 2024-09-11T23:06:10.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.719+0000 7f525a483640 1 -- start start 2024-09-11T23:06:10.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.719+0000 7f525a483640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5254137aa0 0x7f525406cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:10.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.719+0000 7f525a483640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f52541387a0 con 0x7f5254137aa0 2024-09-11T23:06:10.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.719+0000 7f5253fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5254137aa0 0x7f525406cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:10.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.719+0000 7f5253fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5254137aa0 0x7f525406cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40286/0 (socket says 172.21.15.12:40286) 2024-09-11T23:06:10.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.719+0000 7f5253fff640 1 -- 172.21.15.12:0/1827660945 learned_addr learned my addr 172.21.15.12:0/1827660945 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:10.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.719+0000 7f5253fff640 1 -- 172.21.15.12:0/1827660945 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5254122ab0 con 0x7f5254137aa0 2024-09-11T23:06:10.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.719+0000 7f5253fff640 1 --2- 172.21.15.12:0/1827660945 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5254137aa0 0x7f525406cd70 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f524401a080 tx=0x7f524401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:10.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.719+0000 7f5250ff9640 1 -- 172.21.15.12:0/1827660945 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52440ba020 con 0x7f5254137aa0 2024-09-11T23:06:10.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.719+0000 7f5250ff9640 1 -- 172.21.15.12:0/1827660945 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52440b6420 con 0x7f5254137aa0 2024-09-11T23:06:10.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.719+0000 7f525a483640 1 -- 172.21.15.12:0/1827660945 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52540731a0 con 0x7f5254137aa0 2024-09-11T23:06:10.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.719+0000 7f5250ff9640 1 -- 172.21.15.12:0/1827660945 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52440b0040 con 0x7f5254137aa0 2024-09-11T23:06:10.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.719+0000 7f525a483640 1 -- 172.21.15.12:0/1827660945 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52541223a0 con 0x7f5254137aa0 2024-09-11T23:06:10.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.719+0000 7f5250ff9640 1 -- 172.21.15.12:0/1827660945 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 29) ==== 44099+0+0 (secure 0 0 0) 0x7f52440bd020 con 0x7f5254137aa0 2024-09-11T23:06:10.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.723+0000 7f525a483640 1 -- 172.21.15.12:0/1827660945 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52540a04c0 con 0x7f5254137aa0 2024-09-11T23:06:10.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.723+0000 7f5250ff9640 1 --2- 172.21.15.12:0/1827660945 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f5240035e40 0x7f5240038300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:10.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.723+0000 7f5250ff9640 1 -- 172.21.15.12:0/1827660945 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 3697+0+0 (secure 0 0 0) 0x7f52440a4e00 con 0x7f5254137aa0 2024-09-11T23:06:10.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.723+0000 7f52537fe640 1 -- 172.21.15.12:0/1827660945 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f5240035e40 msgr2=0x7f5240038300 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6824/378652896 2024-09-11T23:06:10.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.723+0000 7f52537fe640 1 --2- 172.21.15.12:0/1827660945 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f5240035e40 0x7f5240038300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:06:10.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.727+0000 7f5250ff9640 1 -- 172.21.15.12:0/1827660945 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f52440c4030 con 0x7f5254137aa0 2024-09-11T23:06:10.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.899+0000 7f525a483640 1 -- 172.21.15.12:0/1827660945 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f525409fe30 con 0x7f5254137aa0 2024-09-11T23:06:10.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.899+0000 7f5250ff9640 1 -- 172.21.15.12:0/1827660945 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 6 entries v55) ==== 80+0+353 (secure 0 0 0) 0x7f52440160d0 con 0x7f5254137aa0 2024-09-11T23:06:10.903 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/1044732542 2024-09-12T23:06:07.866565+0000 2024-09-11T23:06:10.904 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/1734477438 2024-09-12T23:06:07.866565+0000 2024-09-11T23:06:10.904 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/462043258 2024-09-12T23:06:07.866565+0000 2024-09-11T23:06:10.904 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/3818284364 2024-09-12T23:06:07.866565+0000 2024-09-11T23:06:10.904 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:6825/1925124150 2024-09-12T23:06:07.866565+0000 2024-09-11T23:06:10.904 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:6824/1925124150 2024-09-12T23:06:07.866565+0000 2024-09-11T23:06:10.904 INFO:teuthology.orchestra.run.smithi012.stderr:listed 6 entries 2024-09-11T23:06:10.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.903+0000 7f525a483640 1 -- 172.21.15.12:0/1827660945 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f5240035e40 msgr2=0x7f5240038300 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:06:10.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.903+0000 7f525a483640 1 --2- 172.21.15.12:0/1827660945 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f5240035e40 0x7f5240038300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:10.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.903+0000 7f525a483640 1 -- 172.21.15.12:0/1827660945 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5254137aa0 msgr2=0x7f525406cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:10.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.903+0000 7f525a483640 1 --2- 172.21.15.12:0/1827660945 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5254137aa0 0x7f525406cd70 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f524401a080 tx=0x7f524401ac90 comp rx=0 tx=0).stop 2024-09-11T23:06:10.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.903+0000 7f525a483640 1 -- 172.21.15.12:0/1827660945 shutdown_connections 2024-09-11T23:06:10.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.903+0000 7f525a483640 1 --2- 172.21.15.12:0/1827660945 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f5240035e40 0x7f5240038300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:10.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.903+0000 7f525a483640 1 --2- 172.21.15.12:0/1827660945 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5254137aa0 0x7f525406cd70 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:10.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.903+0000 7f525a483640 1 -- 172.21.15.12:0/1827660945 >> 172.21.15.12:0/1827660945 conn(0x7f5254070df0 msgr2=0x7f52540711d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:10.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.903+0000 7f525a483640 1 -- 172.21.15.12:0/1827660945 shutdown_connections 2024-09-11T23:06:10.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:10.903+0000 7f525a483640 1 -- 172.21.15.12:0/1827660945 wait complete. 2024-09-11T23:06:10.922 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi012.front.sepia.ceph.com... 2024-09-11T23:06:10.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:06:10.922 DEBUG:teuthology.orchestra.run.smithi012:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-11T23:06:10.933 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi012.stderr:ceph-fuse[39591]: fuse finished with error 0 and tester_r 0 2024-09-11T23:06:10.934 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi012.front.sepia.ceph.com 2024-09-11T23:06:10.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:06:10.935 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-11T23:06:11.029 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:06:11.047 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:11.043+0000 7f0303827180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T23:06:11.102 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:11.099+0000 7f0303827180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T23:06:11.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.147+0000 7f2e6e7af640 1 Processor -- start 2024-09-11T23:06:11.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.147+0000 7f2e6e7af640 1 -- start start 2024-09-11T23:06:11.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.147+0000 7f2e6e7af640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2e680703d0 0x7f2e6813cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:11.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.147+0000 7f2e6e7af640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e6806cb80 con 0x7f2e68134900 2024-09-11T23:06:11.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.147+0000 7f2e6e7af640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f2e6806bf00 con 0x7f2e680703d0 2024-09-11T23:06:11.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.147+0000 7f2e67fff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f2e68134900 0x7f2e68134ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39896/0 (socket says 172.21.15.12:39896) 2024-09-11T23:06:11.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.147+0000 7f2e67fff640 1 -- 172.21.15.12:0/2845335785 learned_addr learned my addr 172.21.15.12:0/2845335785 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:11.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.147+0000 7f2e677fe640 1 --2- 172.21.15.12:0/2845335785 >> v2:172.21.15.12:3300/0 conn(0x7f2e680703d0 0x7f2e6813cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:11.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.147+0000 7f2e66ffd640 1 -- 172.21.15.12:0/2845335785 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1938180965 0 0) 0x7f2e6806cb80 con 0x7f2e68134900 2024-09-11T23:06:11.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.147+0000 7f2e66ffd640 1 -- 172.21.15.12:0/2845335785 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e50003530 con 0x7f2e68134900 2024-09-11T23:06:11.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.147+0000 7f2e677fe640 1 -- 172.21.15.12:0/2845335785 >> v1:172.21.15.12:6789/0 conn(0x7f2e68134900 legacy=0x7f2e68134ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:11.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.147+0000 7f2e677fe640 1 -- 172.21.15.12:0/2845335785 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e6806bc60 con 0x7f2e680703d0 2024-09-11T23:06:11.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.147+0000 7f2e677fe640 1 --2- 172.21.15.12:0/2845335785 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e680703d0 0x7f2e6813cd60 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c009720 tx=0x7f2e5c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2dd216e9c0a9e39 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:11.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.147+0000 7f2e66ffd640 1 -- 172.21.15.12:0/2845335785 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e5c0b0070 con 0x7f2e680703d0 2024-09-11T23:06:11.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.147+0000 7f2e66ffd640 1 -- 172.21.15.12:0/2845335785 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e5c0ab530 con 0x7f2e680703d0 2024-09-11T23:06:11.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.147+0000 7f2e66ffd640 1 -- 172.21.15.12:0/2845335785 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e5c0ab830 con 0x7f2e680703d0 2024-09-11T23:06:11.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.151+0000 7f2e6e7af640 1 -- 172.21.15.12:0/2845335785 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e680703d0 msgr2=0x7f2e6813cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:11.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.151+0000 7f2e6e7af640 1 --2- 172.21.15.12:0/2845335785 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e680703d0 0x7f2e6813cd60 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c009720 tx=0x7f2e5c01c370 comp rx=0 tx=0).stop 2024-09-11T23:06:11.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.151+0000 7f2e6e7af640 1 -- 172.21.15.12:0/2845335785 shutdown_connections 2024-09-11T23:06:11.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.151+0000 7f2e6e7af640 1 --2- 172.21.15.12:0/2845335785 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e680703d0 0x7f2e6813cd60 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:11.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.151+0000 7f2e6e7af640 1 -- 172.21.15.12:0/2845335785 >> 172.21.15.12:0/2845335785 conn(0x7f2e68068000 msgr2=0x7f2e680a5910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:11.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.151+0000 7f2e6e7af640 1 -- 172.21.15.12:0/2845335785 shutdown_connections 2024-09-11T23:06:11.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.151+0000 7f2e6e7af640 1 -- 172.21.15.12:0/2845335785 wait complete. 2024-09-11T23:06:11.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.151+0000 7f2e6e7af640 1 Processor -- start 2024-09-11T23:06:11.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.151+0000 7f2e6e7af640 1 -- start start 2024-09-11T23:06:11.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.151+0000 7f2e6e7af640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e680703d0 0x7f2e6813bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:11.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.151+0000 7f2e6e7af640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2e680a6400 con 0x7f2e680703d0 2024-09-11T23:06:11.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.151+0000 7f2e67fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e680703d0 0x7f2e6813bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:11.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.151+0000 7f2e67fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e680703d0 0x7f2e6813bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40310/0 (socket says 172.21.15.12:40310) 2024-09-11T23:06:11.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.151+0000 7f2e67fff640 1 -- 172.21.15.12:0/571926970 learned_addr learned my addr 172.21.15.12:0/571926970 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:11.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.151+0000 7f2e67fff640 1 -- 172.21.15.12:0/571926970 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e6813ba30 con 0x7f2e680703d0 2024-09-11T23:06:11.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.151+0000 7f2e67fff640 1 --2- 172.21.15.12:0/571926970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e680703d0 0x7f2e6813bef0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f2e5800c470 tx=0x7f2e5800c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:11.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.151+0000 7f2e64ff9640 1 -- 172.21.15.12:0/571926970 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e58017070 con 0x7f2e680703d0 2024-09-11T23:06:11.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.151+0000 7f2e64ff9640 1 -- 172.21.15.12:0/571926970 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e58005c20 con 0x7f2e680703d0 2024-09-11T23:06:11.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.151+0000 7f2e64ff9640 1 -- 172.21.15.12:0/571926970 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e58007070 con 0x7f2e680703d0 2024-09-11T23:06:11.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.151+0000 7f2e6e7af640 1 -- 172.21.15.12:0/571926970 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e6813a4d0 con 0x7f2e680703d0 2024-09-11T23:06:11.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.151+0000 7f2e6e7af640 1 -- 172.21.15.12:0/571926970 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e6813b680 con 0x7f2e680703d0 2024-09-11T23:06:11.157 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:11.155+0000 7f0303827180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T23:06:11.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.155+0000 7f2e64ff9640 1 -- 172.21.15.12:0/571926970 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 29) ==== 44099+0+0 (secure 0 0 0) 0x7f2e5801a070 con 0x7f2e680703d0 2024-09-11T23:06:11.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.155+0000 7f2e6e7af640 1 -- 172.21.15.12:0/571926970 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e680008e0 con 0x7f2e680703d0 2024-09-11T23:06:11.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.155+0000 7f2e64ff9640 1 --2- 172.21.15.12:0/571926970 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f2e54035e40 0x7f2e54038300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:11.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.155+0000 7f2e64ff9640 1 -- 172.21.15.12:0/571926970 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 3697+0+0 (secure 0 0 0) 0x7f2e58047b10 con 0x7f2e680703d0 2024-09-11T23:06:11.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.155+0000 7f2e677fe640 1 -- 172.21.15.12:0/571926970 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f2e54035e40 msgr2=0x7f2e54038300 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6824/378652896 2024-09-11T23:06:11.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.155+0000 7f2e677fe640 1 --2- 172.21.15.12:0/571926970 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f2e54035e40 0x7f2e54038300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:06:11.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.159+0000 7f2e64ff9640 1 -- 172.21.15.12:0/571926970 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2e5801a930 con 0x7f2e680703d0 2024-09-11T23:06:11.236 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:11.231+0000 7f0303827180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T23:06:11.287 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:11.283+0000 7f0303827180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T23:06:11.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.355+0000 7f2e6e7af640 1 -- 172.21.15.12:0/571926970 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2e6813a1c0 con 0x7f2e680703d0 2024-09-11T23:06:11.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.355+0000 7f2e64ff9640 1 -- 172.21.15.12:0/571926970 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+3575 (secure 0 0 0) 0x7f2e5801b730 con 0x7f2e680703d0 2024-09-11T23:06:11.360 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:06:11.360 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":40,"btime":"2024-09-11T23:05:55:143736+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4812,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6827/1404954527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":1404954527},{"type":"v1","addr":"172.21.15.12:6827","nonce":1404954527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:05:51.497188+0000","modified":"2024-09-11T23:05:54.502889+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4813},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4813":{"gid":4813,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6829/2605601020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":2605601020},{"type":"v1","addr":"172.21.15.12:6829","nonce":2605601020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4813,"qdb_cluster":[4813]},"id":5}]} 2024-09-11T23:06:11.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.359+0000 7f2e677fe640 1 -- 172.21.15.12:0/571926970 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f2e54035e40 msgr2=0x7f2e54038300 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6824/378652896 2024-09-11T23:06:11.361 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 40 2024-09-11T23:06:11.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.359+0000 7f2e677fe640 1 --2- 172.21.15.12:0/571926970 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f2e54035e40 0x7f2e54038300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T23:06:11.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.359+0000 7f2e6e7af640 1 -- 172.21.15.12:0/571926970 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f2e54035e40 msgr2=0x7f2e54038300 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:06:11.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.359+0000 7f2e6e7af640 1 --2- 172.21.15.12:0/571926970 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f2e54035e40 0x7f2e54038300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:11.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.359+0000 7f2e6e7af640 1 -- 172.21.15.12:0/571926970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e680703d0 msgr2=0x7f2e6813bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:11.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.359+0000 7f2e6e7af640 1 --2- 172.21.15.12:0/571926970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e680703d0 0x7f2e6813bef0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f2e5800c470 tx=0x7f2e5800c930 comp rx=0 tx=0).stop 2024-09-11T23:06:11.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.359+0000 7f2e6e7af640 1 -- 172.21.15.12:0/571926970 shutdown_connections 2024-09-11T23:06:11.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.359+0000 7f2e6e7af640 1 --2- 172.21.15.12:0/571926970 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f2e54035e40 0x7f2e54038300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:11.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.359+0000 7f2e6e7af640 1 --2- 172.21.15.12:0/571926970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e680703d0 0x7f2e6813bef0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:11.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.359+0000 7f2e6e7af640 1 -- 172.21.15.12:0/571926970 >> 172.21.15.12:0/571926970 conn(0x7f2e68068000 msgr2=0x7f2e680a30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:11.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.359+0000 7f2e6e7af640 1 -- 172.21.15.12:0/571926970 shutdown_connections 2024-09-11T23:06:11.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.359+0000 7f2e6e7af640 1 -- 172.21.15.12:0/571926970 wait complete. 2024-09-11T23:06:11.366 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:11.363+0000 7f0303827180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T23:06:11.380 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:06:11.420 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:11.415+0000 7f0303827180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T23:06:11.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.535+0000 7f65305f5640 1 Processor -- start 2024-09-11T23:06:11.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.535+0000 7f65305f5640 1 -- start start 2024-09-11T23:06:11.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.539+0000 7f65305f5640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f652813a410 0x7f65280a6af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:11.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.539+0000 7f65305f5640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65280a82a0 con 0x7f65280a4b80 2024-09-11T23:06:11.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.539+0000 7f65305f5640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f65280a3cb0 con 0x7f652813a410 2024-09-11T23:06:11.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.539+0000 7f652e391640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f652813a410 0x7f65280a6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:11.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.539+0000 7f652db90640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f65280a4b80 0x7f65280a7030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39902/0 (socket says 172.21.15.12:39902) 2024-09-11T23:06:11.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.539+0000 7f652db90640 1 -- 172.21.15.12:0/4108887976 learned_addr learned my addr 172.21.15.12:0/4108887976 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:11.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.539+0000 7f652e391640 1 -- 172.21.15.12:0/4108887976 >> v1:172.21.15.12:6789/0 conn(0x7f65280a4b80 legacy=0x7f65280a7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:11.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.539+0000 7f652e391640 1 -- 172.21.15.12:0/4108887976 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6528139fe0 con 0x7f652813a410 2024-09-11T23:06:11.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.539+0000 7f652e391640 1 --2- 172.21.15.12:0/4108887976 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f652813a410 0x7f65280a6af0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f6518009740 tx=0x7f651801c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97105775077c8d51 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:11.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.539+0000 7f652d38f640 1 -- 172.21.15.12:0/4108887976 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65180b0070 con 0x7f652813a410 2024-09-11T23:06:11.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.539+0000 7f652d38f640 1 -- 172.21.15.12:0/4108887976 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65180ab530 con 0x7f652813a410 2024-09-11T23:06:11.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.539+0000 7f652d38f640 1 -- 172.21.15.12:0/4108887976 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65180ab830 con 0x7f652813a410 2024-09-11T23:06:11.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.539+0000 7f65305f5640 1 -- 172.21.15.12:0/4108887976 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f652813a410 msgr2=0x7f65280a6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:11.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.539+0000 7f65305f5640 1 --2- 172.21.15.12:0/4108887976 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f652813a410 0x7f65280a6af0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f6518009740 tx=0x7f651801c390 comp rx=0 tx=0).stop 2024-09-11T23:06:11.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.539+0000 7f65305f5640 1 -- 172.21.15.12:0/4108887976 shutdown_connections 2024-09-11T23:06:11.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.539+0000 7f65305f5640 1 --2- 172.21.15.12:0/4108887976 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f652813a410 0x7f65280a6af0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:11.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.539+0000 7f65305f5640 1 -- 172.21.15.12:0/4108887976 >> 172.21.15.12:0/4108887976 conn(0x7f65280ac2c0 msgr2=0x7f65280ac6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:11.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.539+0000 7f65305f5640 1 -- 172.21.15.12:0/4108887976 shutdown_connections 2024-09-11T23:06:11.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.539+0000 7f65305f5640 1 -- 172.21.15.12:0/4108887976 wait complete. 2024-09-11T23:06:11.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.543+0000 7f65305f5640 1 Processor -- start 2024-09-11T23:06:11.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.543+0000 7f65305f5640 1 -- start start 2024-09-11T23:06:11.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.543+0000 7f65305f5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65280a4b80 0x7f65280a1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:11.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.543+0000 7f65305f5640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f65280a7740 con 0x7f65280a4b80 2024-09-11T23:06:11.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.543+0000 7f652e391640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65280a4b80 0x7f65280a1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:11.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.543+0000 7f652e391640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65280a4b80 0x7f65280a1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40332/0 (socket says 172.21.15.12:40332) 2024-09-11T23:06:11.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.543+0000 7f652e391640 1 -- 172.21.15.12:0/3558636846 learned_addr learned my addr 172.21.15.12:0/3558636846 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:11.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.543+0000 7f652e391640 1 -- 172.21.15.12:0/3558636846 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65280a0700 con 0x7f65280a4b80 2024-09-11T23:06:11.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.543+0000 7f652e391640 1 --2- 172.21.15.12:0/3558636846 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65280a4b80 0x7f65280a1140 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f6518019fc0 tx=0x7f651801abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:11.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.543+0000 7f651effd640 1 -- 172.21.15.12:0/3558636846 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65180b0050 con 0x7f65280a4b80 2024-09-11T23:06:11.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.543+0000 7f651effd640 1 -- 172.21.15.12:0/3558636846 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65180b1040 con 0x7f65280a4b80 2024-09-11T23:06:11.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.543+0000 7f651effd640 1 -- 172.21.15.12:0/3558636846 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65180b5740 con 0x7f65280a4b80 2024-09-11T23:06:11.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.543+0000 7f65305f5640 1 -- 172.21.15.12:0/3558636846 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f652813f070 con 0x7f65280a4b80 2024-09-11T23:06:11.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.543+0000 7f65305f5640 1 -- 172.21.15.12:0/3558636846 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65280a09c0 con 0x7f65280a4b80 2024-09-11T23:06:11.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.543+0000 7f65305f5640 1 -- 172.21.15.12:0/3558636846 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65280a6af0 con 0x7f65280a4b80 2024-09-11T23:06:11.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.547+0000 7f651effd640 1 -- 172.21.15.12:0/3558636846 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 29) ==== 44099+0+0 (secure 0 0 0) 0x7f65180be030 con 0x7f65280a4b80 2024-09-11T23:06:11.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.547+0000 7f651effd640 1 --2- 172.21.15.12:0/3558636846 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f650c035e40 0x7f650c038300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:11.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.547+0000 7f651effd640 1 -- 172.21.15.12:0/3558636846 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 3697+0+0 (secure 0 0 0) 0x7f65180bc070 con 0x7f65280a4b80 2024-09-11T23:06:11.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.547+0000 7f652db90640 1 -- 172.21.15.12:0/3558636846 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f650c035e40 msgr2=0x7f650c038300 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6824/378652896 2024-09-11T23:06:11.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.547+0000 7f652db90640 1 --2- 172.21.15.12:0/3558636846 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f650c035e40 0x7f650c038300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:06:11.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.555+0000 7f651effd640 1 -- 172.21.15.12:0/3558636846 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f65180c5020 con 0x7f65280a4b80 2024-09-11T23:06:11.574 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:11.571+0000 7f0303827180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T23:06:11.628 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:11.627+0000 7f0303827180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T23:06:11.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.743+0000 7f65305f5640 1 -- 172.21.15.12:0/3558636846 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f65280a2eb0 con 0x7f65280a4b80 2024-09-11T23:06:11.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.747+0000 7f651effd640 1 -- 172.21.15.12:0/3558636846 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+3575 (secure 0 0 0) 0x7f6518016010 con 0x7f65280a4b80 2024-09-11T23:06:11.749 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:06:11.749 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":40,"btime":"2024-09-11T23:05:55:143736+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4812,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6827/1404954527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":1404954527},{"type":"v1","addr":"172.21.15.12:6827","nonce":1404954527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:05:51.497188+0000","modified":"2024-09-11T23:05:54.502889+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4813},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4813":{"gid":4813,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6829/2605601020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":2605601020},{"type":"v1","addr":"172.21.15.12:6829","nonce":2605601020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4813,"qdb_cluster":[4813]},"id":5}]} 2024-09-11T23:06:11.749 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 40 2024-09-11T23:06:11.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.751+0000 7f652db90640 1 -- 172.21.15.12:0/3558636846 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f650c035e40 msgr2=0x7f650c038300 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6824/378652896 2024-09-11T23:06:11.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.751+0000 7f652db90640 1 --2- 172.21.15.12:0/3558636846 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f650c035e40 0x7f650c038300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T23:06:11.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.751+0000 7f65305f5640 1 -- 172.21.15.12:0/3558636846 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f650c035e40 msgr2=0x7f650c038300 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:06:11.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.751+0000 7f65305f5640 1 --2- 172.21.15.12:0/3558636846 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f650c035e40 0x7f650c038300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:11.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.751+0000 7f65305f5640 1 -- 172.21.15.12:0/3558636846 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65280a4b80 msgr2=0x7f65280a1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:11.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.751+0000 7f65305f5640 1 --2- 172.21.15.12:0/3558636846 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65280a4b80 0x7f65280a1140 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f6518019fc0 tx=0x7f651801abd0 comp rx=0 tx=0).stop 2024-09-11T23:06:11.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.751+0000 7f65305f5640 1 -- 172.21.15.12:0/3558636846 shutdown_connections 2024-09-11T23:06:11.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.751+0000 7f65305f5640 1 --2- 172.21.15.12:0/3558636846 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f650c035e40 0x7f650c038300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:11.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.751+0000 7f65305f5640 1 --2- 172.21.15.12:0/3558636846 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65280a4b80 0x7f65280a1140 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:11.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.751+0000 7f65305f5640 1 -- 172.21.15.12:0/3558636846 >> 172.21.15.12:0/3558636846 conn(0x7f65280ac2c0 msgr2=0x7f65280ab750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:11.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.751+0000 7f65305f5640 1 -- 172.21.15.12:0/3558636846 shutdown_connections 2024-09-11T23:06:11.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.751+0000 7f65305f5640 1 -- 172.21.15.12:0/3558636846 wait complete. 2024-09-11T23:06:11.781 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:06:11.856 INFO:tasks.ceph.mgr.x.smithi012.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-11T23:06:11.857 INFO:tasks.ceph.mgr.x.smithi012.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-11T23:06:11.857 INFO:tasks.ceph.mgr.x.smithi012.stderr: from numpy import show_config as show_numpy_config 2024-09-11T23:06:11.865 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:11.863+0000 7f0303827180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T23:06:11.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.911+0000 7f6be574a640 1 Processor -- start 2024-09-11T23:06:11.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.911+0000 7f6be574a640 1 -- start start 2024-09-11T23:06:11.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.911+0000 7f6be574a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6be0137970 0x7f6be00a5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:11.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.911+0000 7f6be574a640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6be0070a60 con 0x7f6be0137d50 2024-09-11T23:06:11.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.911+0000 7f6be574a640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f6be00a6000 con 0x7f6be0137970 2024-09-11T23:06:11.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.911+0000 7f6bdeffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6be0137970 0x7f6be00a5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:11.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.911+0000 7f6bde7fc640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f6be0137d50 0x7f6be01381a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39912/0 (socket says 172.21.15.12:39912) 2024-09-11T23:06:11.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.911+0000 7f6bde7fc640 1 -- 172.21.15.12:0/1648995999 learned_addr learned my addr 172.21.15.12:0/1648995999 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:11.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.911+0000 7f6bdeffd640 1 -- 172.21.15.12:0/1648995999 >> v1:172.21.15.12:6789/0 conn(0x7f6be0137d50 legacy=0x7f6be01381a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:11.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.911+0000 7f6bddffb640 1 -- 172.21.15.12:0/1648995999 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 848009687 0 0) 0x7f6be0070a60 con 0x7f6be0137d50 2024-09-11T23:06:11.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.911+0000 7f6bdeffd640 1 -- 172.21.15.12:0/1648995999 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6be00a36b0 con 0x7f6be0137970 2024-09-11T23:06:11.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.915+0000 7f6bdeffd640 1 --2- 172.21.15.12:0/1648995999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6be0137970 0x7f6be00a5940 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f6bd0009740 tx=0x7f6bd001c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4056bceefbc1f108 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:11.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.915+0000 7f6bddffb640 1 -- 172.21.15.12:0/1648995999 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bd00b0070 con 0x7f6be0137970 2024-09-11T23:06:11.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.915+0000 7f6bddffb640 1 -- 172.21.15.12:0/1648995999 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bd00ab530 con 0x7f6be0137970 2024-09-11T23:06:11.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.915+0000 7f6bddffb640 1 -- 172.21.15.12:0/1648995999 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bd00ab830 con 0x7f6be0137970 2024-09-11T23:06:11.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.915+0000 7f6be574a640 1 -- 172.21.15.12:0/1648995999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6be0137970 msgr2=0x7f6be00a5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:11.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.915+0000 7f6be574a640 1 --2- 172.21.15.12:0/1648995999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6be0137970 0x7f6be00a5940 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f6bd0009740 tx=0x7f6bd001c390 comp rx=0 tx=0).stop 2024-09-11T23:06:11.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.915+0000 7f6be574a640 1 -- 172.21.15.12:0/1648995999 shutdown_connections 2024-09-11T23:06:11.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.915+0000 7f6be574a640 1 --2- 172.21.15.12:0/1648995999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6be0137970 0x7f6be00a5940 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:11.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.915+0000 7f6be574a640 1 -- 172.21.15.12:0/1648995999 >> 172.21.15.12:0/1648995999 conn(0x7f6be00a6c00 msgr2=0x7f6be00a7010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:11.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.915+0000 7f6be574a640 1 -- 172.21.15.12:0/1648995999 shutdown_connections 2024-09-11T23:06:11.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.915+0000 7f6be574a640 1 -- 172.21.15.12:0/1648995999 wait complete. 2024-09-11T23:06:11.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.915+0000 7f6be574a640 1 Processor -- start 2024-09-11T23:06:11.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.915+0000 7f6be574a640 1 -- start start 2024-09-11T23:06:11.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.919+0000 7f6be574a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6be0137970 0x7f6be009bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:11.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.919+0000 7f6be574a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6be013f840 con 0x7f6be0137970 2024-09-11T23:06:11.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.919+0000 7f6bdeffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6be0137970 0x7f6be009bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:11.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.919+0000 7f6bdeffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6be0137970 0x7f6be009bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40352/0 (socket says 172.21.15.12:40352) 2024-09-11T23:06:11.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.919+0000 7f6bdeffd640 1 -- 172.21.15.12:0/2775941410 learned_addr learned my addr 172.21.15.12:0/2775941410 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:11.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.919+0000 7f6bdeffd640 1 -- 172.21.15.12:0/2775941410 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6be009b230 con 0x7f6be0137970 2024-09-11T23:06:11.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.919+0000 7f6bdeffd640 1 --2- 172.21.15.12:0/2775941410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6be0137970 0x7f6be009bc90 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f6bd0019fc0 tx=0x7f6bd001abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:11.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.919+0000 7f6bc77fe640 1 -- 172.21.15.12:0/2775941410 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bd00b0050 con 0x7f6be0137970 2024-09-11T23:06:11.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.919+0000 7f6bc77fe640 1 -- 172.21.15.12:0/2775941410 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bd00b1040 con 0x7f6be0137970 2024-09-11T23:06:11.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.919+0000 7f6bc77fe640 1 -- 172.21.15.12:0/2775941410 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bd00b5740 con 0x7f6be0137970 2024-09-11T23:06:11.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.919+0000 7f6be574a640 1 -- 172.21.15.12:0/2775941410 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6be013be60 con 0x7f6be0137970 2024-09-11T23:06:11.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.919+0000 7f6be574a640 1 -- 172.21.15.12:0/2775941410 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6be009b800 con 0x7f6be0137970 2024-09-11T23:06:11.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.919+0000 7f6bc77fe640 1 -- 172.21.15.12:0/2775941410 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 29) ==== 44099+0+0 (secure 0 0 0) 0x7f6bd00be030 con 0x7f6be0137970 2024-09-11T23:06:11.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.919+0000 7f6be574a640 1 -- 172.21.15.12:0/2775941410 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6be00a5940 con 0x7f6be0137970 2024-09-11T23:06:11.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.919+0000 7f6bc77fe640 1 --2- 172.21.15.12:0/2775941410 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f6bcc035df0 0x7f6bcc0382b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:11.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.919+0000 7f6bc77fe640 1 -- 172.21.15.12:0/2775941410 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 3697+0+0 (secure 0 0 0) 0x7f6bd00bc070 con 0x7f6be0137970 2024-09-11T23:06:11.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.919+0000 7f6bde7fc640 1 -- 172.21.15.12:0/2775941410 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f6bcc035df0 msgr2=0x7f6bcc0382b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6824/378652896 2024-09-11T23:06:11.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.919+0000 7f6bde7fc640 1 --2- 172.21.15.12:0/2775941410 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f6bcc035df0 0x7f6bcc0382b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:06:11.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:11.923+0000 7f6bc77fe640 1 -- 172.21.15.12:0/2775941410 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6bd00c5020 con 0x7f6be0137970 2024-09-11T23:06:12.009 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:12.007+0000 7f0303827180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:06:12.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.083+0000 7f6be574a640 1 -- 172.21.15.12:0/2775941410 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6be006bc60 con 0x7f6be0137970 2024-09-11T23:06:12.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.083+0000 7f6bc77fe640 1 -- 172.21.15.12:0/2775941410 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) ==== 74+0+11054 (secure 0 0 0) 0x7f6bd0016010 con 0x7f6be0137970 2024-09-11T23:06:12.087 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:06:12.087 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":55,"fsid":"8be14356-3340-4500-91a2-4cbc6b511f65","created":"2024-09-11T23:03:10.620234+0000","modified":"2024-09-11T23:06:07.866629+0000","last_up_change":"2024-09-11T23:03:22.359028+0000","last_in_change":"2024-09-11T23:03:11.545817+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:03:23.587068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:05:49.161756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0299999713897705,"score_stable":1.0299999713897705,"optimal_score":1,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.0299999713897705,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-11T23:05:50.500965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"153b72a1-40b1-400d-93ea-333e733f9bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6817","nonce":3680911937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6819","nonce":3680911937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6823","nonce":3680911937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6821","nonce":3680911937}]},"public_addr":"172.21.15.12:6817/3680911937","cluster_addr":"172.21.15.12:6819/3680911937","heartbeat_back_addr":"172.21.15.12:6823/3680911937","heartbeat_front_addr":"172.21.15.12:6821/3680911937","state":["exists","up"]},{"osd":1,"uuid":"94669e49-ee4f-4acf-9e25-e94374dda8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6801","nonce":236825163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6803","nonce":236825163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6807","nonce":236825163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6805","nonce":236825163}]},"public_addr":"172.21.15.12:6801/236825163","cluster_addr":"172.21.15.12:6803/236825163","heartbeat_back_addr":"172.21.15.12:6807/236825163","heartbeat_front_addr":"172.21.15.12:6805/236825163","state":["exists","up"]},{"osd":2,"uuid":"826dae4d-8888-4ec5-8f00-425b3be93814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6809","nonce":3263521655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6811","nonce":3263521655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6815","nonce":3263521655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6813","nonce":3263521655}]},"public_addr":"172.21.15.12:6809/3263521655","cluster_addr":"172.21.15.12:6811/3263521655","heartbeat_back_addr":"172.21.15.12:6815/3263521655","heartbeat_front_addr":"172.21.15.12:6813/3263521655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:19.398518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.761524+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.904997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/1044732542":"2024-09-12T23:06:07.866565+0000","172.21.15.12:0/1734477438":"2024-09-12T23:06:07.866565+0000","172.21.15.12:0/462043258":"2024-09-12T23:06:07.866565+0000","172.21.15.12:0/3818284364":"2024-09-12T23:06:07.866565+0000","172.21.15.12:6825/1925124150":"2024-09-12T23:06:07.866565+0000","172.21.15.12:6824/1925124150":"2024-09-12T23:06:07.866565+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:06:12.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.087+0000 7f6be574a640 1 -- 172.21.15.12:0/2775941410 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f6bcc035df0 msgr2=0x7f6bcc0382b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:06:12.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.087+0000 7f6be574a640 1 --2- 172.21.15.12:0/2775941410 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f6bcc035df0 0x7f6bcc0382b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:12.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.087+0000 7f6be574a640 1 -- 172.21.15.12:0/2775941410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6be0137970 msgr2=0x7f6be009bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:12.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.087+0000 7f6be574a640 1 --2- 172.21.15.12:0/2775941410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6be0137970 0x7f6be009bc90 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f6bd0019fc0 tx=0x7f6bd001abd0 comp rx=0 tx=0).stop 2024-09-11T23:06:12.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.087+0000 7f6be574a640 1 -- 172.21.15.12:0/2775941410 shutdown_connections 2024-09-11T23:06:12.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.087+0000 7f6be574a640 1 --2- 172.21.15.12:0/2775941410 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f6bcc035df0 0x7f6bcc0382b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:12.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.087+0000 7f6be574a640 1 --2- 172.21.15.12:0/2775941410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6be0137970 0x7f6be009bc90 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:12.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.087+0000 7f6be574a640 1 -- 172.21.15.12:0/2775941410 >> 172.21.15.12:0/2775941410 conn(0x7f6be00a6c00 msgr2=0x7f6be0135d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:12.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.087+0000 7f6be574a640 1 -- 172.21.15.12:0/2775941410 shutdown_connections 2024-09-11T23:06:12.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.087+0000 7f6be574a640 1 -- 172.21.15.12:0/2775941410 wait complete. 2024-09-11T23:06:12.105 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T23:06:12.105 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:06:12.125 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:12.123+0000 7f0303827180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T23:06:12.190 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:12.187+0000 7f0303827180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T23:06:12.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.223+0000 7f337a4d5640 1 Processor -- start 2024-09-11T23:06:12.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.223+0000 7f337a4d5640 1 -- start start 2024-09-11T23:06:12.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.223+0000 7f337a4d5640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f33740703f0 0x7f337413cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:12.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.223+0000 7f337a4d5640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f337406be20 con 0x7f3374134900 2024-09-11T23:06:12.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.223+0000 7f337a4d5640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f337406cb80 con 0x7f33740703f0 2024-09-11T23:06:12.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.223+0000 7f33737fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f33740703f0 0x7f337413cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:12.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.223+0000 7f3373fff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f3374134900 0x7f3374134ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39914/0 (socket says 172.21.15.12:39914) 2024-09-11T23:06:12.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.223+0000 7f3373fff640 1 -- 172.21.15.12:0/283596866 learned_addr learned my addr 172.21.15.12:0/283596866 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:12.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.223+0000 7f3372ffd640 1 -- 172.21.15.12:0/283596866 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1929813407 0 0) 0x7f337406be20 con 0x7f3374134900 2024-09-11T23:06:12.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.223+0000 7f3372ffd640 1 -- 172.21.15.12:0/283596866 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3360003530 con 0x7f3374134900 2024-09-11T23:06:12.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.223+0000 7f33737fe640 1 -- 172.21.15.12:0/283596866 >> v1:172.21.15.12:6789/0 conn(0x7f3374134900 legacy=0x7f3374134ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:12.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.223+0000 7f33737fe640 1 -- 172.21.15.12:0/283596866 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33740a4af0 con 0x7f33740703f0 2024-09-11T23:06:12.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.227+0000 7f33737fe640 1 --2- 172.21.15.12:0/283596866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33740703f0 0x7f337413cd60 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f335c009720 tx=0x7f335c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48a9ff387ebf00f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:12.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.227+0000 7f3372ffd640 1 -- 172.21.15.12:0/283596866 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f335c0b1070 con 0x7f33740703f0 2024-09-11T23:06:12.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.227+0000 7f3372ffd640 1 -- 172.21.15.12:0/283596866 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f335c0ac520 con 0x7f33740703f0 2024-09-11T23:06:12.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.227+0000 7f3372ffd640 1 -- 172.21.15.12:0/283596866 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f335c0ac800 con 0x7f33740703f0 2024-09-11T23:06:12.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.227+0000 7f337a4d5640 1 -- 172.21.15.12:0/283596866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33740703f0 msgr2=0x7f337413cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:12.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.227+0000 7f337a4d5640 1 --2- 172.21.15.12:0/283596866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33740703f0 0x7f337413cd60 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f335c009720 tx=0x7f335c01c370 comp rx=0 tx=0).stop 2024-09-11T23:06:12.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.227+0000 7f337a4d5640 1 -- 172.21.15.12:0/283596866 shutdown_connections 2024-09-11T23:06:12.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.227+0000 7f337a4d5640 1 --2- 172.21.15.12:0/283596866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33740703f0 0x7f337413cd60 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:12.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.227+0000 7f337a4d5640 1 -- 172.21.15.12:0/283596866 >> 172.21.15.12:0/283596866 conn(0x7f3374068000 msgr2=0x7f33740a5910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:12.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.227+0000 7f337a4d5640 1 -- 172.21.15.12:0/283596866 shutdown_connections 2024-09-11T23:06:12.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.227+0000 7f337a4d5640 1 -- 172.21.15.12:0/283596866 wait complete. 2024-09-11T23:06:12.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.227+0000 7f337a4d5640 1 Processor -- start 2024-09-11T23:06:12.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.227+0000 7f337a4d5640 1 -- start start 2024-09-11T23:06:12.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.227+0000 7f337a4d5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33740703f0 0x7f337409de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:12.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.227+0000 7f337a4d5640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f33740a6400 con 0x7f33740703f0 2024-09-11T23:06:12.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.227+0000 7f3373fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33740703f0 0x7f337409de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:12.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.227+0000 7f3373fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33740703f0 0x7f337409de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40380/0 (socket says 172.21.15.12:40380) 2024-09-11T23:06:12.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.227+0000 7f3373fff640 1 -- 172.21.15.12:0/1136888705 learned_addr learned my addr 172.21.15.12:0/1136888705 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:12.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.227+0000 7f3373fff640 1 -- 172.21.15.12:0/1136888705 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f337409bb90 con 0x7f33740703f0 2024-09-11T23:06:12.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.227+0000 7f3373fff640 1 --2- 172.21.15.12:0/1136888705 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33740703f0 0x7f337409de90 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f336400c3d0 tx=0x7f336400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:12.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.227+0000 7f3370ff9640 1 -- 172.21.15.12:0/1136888705 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3364017070 con 0x7f33740703f0 2024-09-11T23:06:12.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.227+0000 7f3370ff9640 1 -- 172.21.15.12:0/1136888705 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3364005ce0 con 0x7f33740703f0 2024-09-11T23:06:12.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.227+0000 7f3370ff9640 1 -- 172.21.15.12:0/1136888705 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33640070d0 con 0x7f33740703f0 2024-09-11T23:06:12.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.227+0000 7f337a4d5640 1 -- 172.21.15.12:0/1136888705 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f337409e3d0 con 0x7f33740703f0 2024-09-11T23:06:12.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.227+0000 7f337a4d5640 1 -- 172.21.15.12:0/1136888705 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3374133610 con 0x7f33740703f0 2024-09-11T23:06:12.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.231+0000 7f337a4d5640 1 -- 172.21.15.12:0/1136888705 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f337406cd70 con 0x7f33740703f0 2024-09-11T23:06:12.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.231+0000 7f3370ff9640 1 -- 172.21.15.12:0/1136888705 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 29) ==== 44099+0+0 (secure 0 0 0) 0x7f336401a070 con 0x7f33740703f0 2024-09-11T23:06:12.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.231+0000 7f3370ff9640 1 --2- 172.21.15.12:0/1136888705 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f3354035e40 0x7f3354038300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:12.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.231+0000 7f3370ff9640 1 -- 172.21.15.12:0/1136888705 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 3697+0+0 (secure 0 0 0) 0x7f3364047c00 con 0x7f33740703f0 2024-09-11T23:06:12.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.231+0000 7f33737fe640 1 -- 172.21.15.12:0/1136888705 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f3354035e40 msgr2=0x7f3354038300 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6824/378652896 2024-09-11T23:06:12.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.231+0000 7f33737fe640 1 --2- 172.21.15.12:0/1136888705 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f3354035e40 0x7f3354038300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:06:12.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.235+0000 7f3370ff9640 1 -- 172.21.15.12:0/1136888705 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3364019e10 con 0x7f33740703f0 2024-09-11T23:06:12.334 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:12.331+0000 7f0303827180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:06:12.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.431+0000 7f337a4d5640 1 -- 172.21.15.12:0/1136888705 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f337409e600 con 0x7f33740703f0 2024-09-11T23:06:12.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.431+0000 7f3370ff9640 1 -- 172.21.15.12:0/1136888705 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+3575 (secure 0 0 0) 0x7f336401b8d0 con 0x7f33740703f0 2024-09-11T23:06:12.434 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:06:12.434 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":40,"btime":"2024-09-11T23:05:55:143736+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4812,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6827/1404954527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":1404954527},{"type":"v1","addr":"172.21.15.12:6827","nonce":1404954527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:05:51.497188+0000","modified":"2024-09-11T23:05:54.502889+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4813},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4813":{"gid":4813,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6829/2605601020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":2605601020},{"type":"v1","addr":"172.21.15.12:6829","nonce":2605601020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4813,"qdb_cluster":[4813]},"id":5}]} 2024-09-11T23:06:12.434 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 40 2024-09-11T23:06:12.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.435+0000 7f33737fe640 1 -- 172.21.15.12:0/1136888705 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f3354035e40 msgr2=0x7f3354038300 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6824/378652896 2024-09-11T23:06:12.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.435+0000 7f337a4d5640 1 -- 172.21.15.12:0/1136888705 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f3354035e40 msgr2=0x7f3354038300 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T23:06:12.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.435+0000 7f33737fe640 1 --2- 172.21.15.12:0/1136888705 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f3354035e40 0x7f3354038300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T23:06:12.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.435+0000 7f337a4d5640 1 --2- 172.21.15.12:0/1136888705 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f3354035e40 0x7f3354038300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:12.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.435+0000 7f337a4d5640 1 -- 172.21.15.12:0/1136888705 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33740703f0 msgr2=0x7f337409de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:12.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.435+0000 7f337a4d5640 1 --2- 172.21.15.12:0/1136888705 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33740703f0 0x7f337409de90 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f336400c3d0 tx=0x7f336400c890 comp rx=0 tx=0).stop 2024-09-11T23:06:12.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.435+0000 7f337a4d5640 1 -- 172.21.15.12:0/1136888705 shutdown_connections 2024-09-11T23:06:12.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.435+0000 7f337a4d5640 1 --2- 172.21.15.12:0/1136888705 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f3354035e40 0x7f3354038300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:12.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.435+0000 7f337a4d5640 1 --2- 172.21.15.12:0/1136888705 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33740703f0 0x7f337409de90 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:12.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.435+0000 7f337a4d5640 1 -- 172.21.15.12:0/1136888705 >> 172.21.15.12:0/1136888705 conn(0x7f3374068000 msgr2=0x7f33741378d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:12.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.435+0000 7f337a4d5640 1 -- 172.21.15.12:0/1136888705 shutdown_connections 2024-09-11T23:06:12.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.435+0000 7f337a4d5640 1 -- 172.21.15.12:0/1136888705 wait complete. 2024-09-11T23:06:12.452 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:06:12.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.603+0000 7f49f07d7640 1 Processor -- start 2024-09-11T23:06:12.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.603+0000 7f49f07d7640 1 -- start start 2024-09-11T23:06:12.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.603+0000 7f49f07d7640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f49e813cde0 0x7f49e813f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:12.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.603+0000 7f49f07d7640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49e80a0f10 con 0x7f49e8136b20 2024-09-11T23:06:12.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.603+0000 7f49f07d7640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f49e806caf0 con 0x7f49e813cde0 2024-09-11T23:06:12.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.607+0000 7f49edd72640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f49e813cde0 0x7f49e813f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:12.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.607+0000 7f49ee573640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f49e8136b20 0x7f49e8136f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39916/0 (socket says 172.21.15.12:39916) 2024-09-11T23:06:12.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.607+0000 7f49ee573640 1 -- 172.21.15.12:0/2801716910 learned_addr learned my addr 172.21.15.12:0/2801716910 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:12.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.607+0000 7f49edd72640 1 -- 172.21.15.12:0/2801716910 >> v1:172.21.15.12:6789/0 conn(0x7f49e8136b20 legacy=0x7f49e8136f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:12.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.607+0000 7f49ed571640 1 -- 172.21.15.12:0/2801716910 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1348006585 0 0) 0x7f49e80a0f10 con 0x7f49e8136b20 2024-09-11T23:06:12.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.607+0000 7f49edd72640 1 -- 172.21.15.12:0/2801716910 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49e80a1d80 con 0x7f49e813cde0 2024-09-11T23:06:12.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.607+0000 7f49edd72640 1 --2- 172.21.15.12:0/2801716910 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49e813cde0 0x7f49e813f1d0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f49d8009740 tx=0x7f49d801c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d681f8ce83ef7a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:12.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.607+0000 7f49ed571640 1 -- 172.21.15.12:0/2801716910 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49d80b0070 con 0x7f49e813cde0 2024-09-11T23:06:12.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.607+0000 7f49ed571640 1 -- 172.21.15.12:0/2801716910 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49d80ab530 con 0x7f49e813cde0 2024-09-11T23:06:12.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.607+0000 7f49ed571640 1 -- 172.21.15.12:0/2801716910 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49d80ab830 con 0x7f49e813cde0 2024-09-11T23:06:12.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.607+0000 7f49f07d7640 1 -- 172.21.15.12:0/2801716910 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49e813cde0 msgr2=0x7f49e813f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:12.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.607+0000 7f49f07d7640 1 --2- 172.21.15.12:0/2801716910 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49e813cde0 0x7f49e813f1d0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f49d8009740 tx=0x7f49d801c390 comp rx=0 tx=0).stop 2024-09-11T23:06:12.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.607+0000 7f49f07d7640 1 -- 172.21.15.12:0/2801716910 shutdown_connections 2024-09-11T23:06:12.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.607+0000 7f49f07d7640 1 --2- 172.21.15.12:0/2801716910 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49e813cde0 0x7f49e813f1d0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:12.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.607+0000 7f49f07d7640 1 -- 172.21.15.12:0/2801716910 >> 172.21.15.12:0/2801716910 conn(0x7f49e8068000 msgr2=0x7f49e80a5910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:12.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.607+0000 7f49f07d7640 1 -- 172.21.15.12:0/2801716910 shutdown_connections 2024-09-11T23:06:12.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.607+0000 7f49f07d7640 1 -- 172.21.15.12:0/2801716910 wait complete. 2024-09-11T23:06:12.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.611+0000 7f49f07d7640 1 Processor -- start 2024-09-11T23:06:12.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.611+0000 7f49f07d7640 1 -- start start 2024-09-11T23:06:12.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.611+0000 7f49f07d7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49e8136b20 0x7f49e813a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:12.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.611+0000 7f49f07d7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f49e80a0540 con 0x7f49e8136b20 2024-09-11T23:06:12.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.611+0000 7f49ee573640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49e8136b20 0x7f49e813a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:12.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.611+0000 7f49ee573640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49e8136b20 0x7f49e813a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40394/0 (socket says 172.21.15.12:40394) 2024-09-11T23:06:12.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.611+0000 7f49ee573640 1 -- 172.21.15.12:0/457428942 learned_addr learned my addr 172.21.15.12:0/457428942 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:12.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.611+0000 7f49ee573640 1 -- 172.21.15.12:0/457428942 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49e8137c20 con 0x7f49e8136b20 2024-09-11T23:06:12.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.611+0000 7f49ee573640 1 --2- 172.21.15.12:0/457428942 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49e8136b20 0x7f49e813a210 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f49e400c390 tx=0x7f49e400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:12.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.611+0000 7f49deffd640 1 -- 172.21.15.12:0/457428942 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49e4007410 con 0x7f49e8136b20 2024-09-11T23:06:12.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.611+0000 7f49deffd640 1 -- 172.21.15.12:0/457428942 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49e40075d0 con 0x7f49e8136b20 2024-09-11T23:06:12.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.611+0000 7f49f07d7640 1 -- 172.21.15.12:0/457428942 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49e8139b90 con 0x7f49e8136b20 2024-09-11T23:06:12.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.611+0000 7f49deffd640 1 -- 172.21.15.12:0/457428942 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49e4004960 con 0x7f49e8136b20 2024-09-11T23:06:12.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.611+0000 7f49f07d7640 1 -- 172.21.15.12:0/457428942 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49e8137940 con 0x7f49e8136b20 2024-09-11T23:06:12.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.611+0000 7f49f07d7640 1 -- 172.21.15.12:0/457428942 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49e8136f00 con 0x7f49e8136b20 2024-09-11T23:06:12.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.611+0000 7f49deffd640 1 -- 172.21.15.12:0/457428942 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 29) ==== 44099+0+0 (secure 0 0 0) 0x7f49e4011070 con 0x7f49e8136b20 2024-09-11T23:06:12.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.611+0000 7f49deffd640 1 --2- 172.21.15.12:0/457428942 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f49cc035e40 0x7f49cc038300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:12.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.611+0000 7f49edd72640 1 -- 172.21.15.12:0/457428942 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f49cc035e40 msgr2=0x7f49cc038300 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6824/378652896 2024-09-11T23:06:12.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.611+0000 7f49deffd640 1 -- 172.21.15.12:0/457428942 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 3697+0+0 (secure 0 0 0) 0x7f49e4048370 con 0x7f49e8136b20 2024-09-11T23:06:12.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.611+0000 7f49edd72640 1 --2- 172.21.15.12:0/457428942 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f49cc035e40 0x7f49cc038300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:06:12.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.615+0000 7f49deffd640 1 -- 172.21.15.12:0/457428942 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f49e4004d90 con 0x7f49e8136b20 2024-09-11T23:06:12.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.807+0000 7f49f07d7640 1 -- 172.21.15.12:0/457428942 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f49e8138d90 con 0x7f49e8136b20 2024-09-11T23:06:12.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.811+0000 7f49deffd640 1 -- 172.21.15.12:0/457428942 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+3575 (secure 0 0 0) 0x7f49e40138e0 con 0x7f49e8136b20 2024-09-11T23:06:12.813 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:06:12.813 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":40,"btime":"2024-09-11T23:05:55:143736+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4812,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6827/1404954527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":1404954527},{"type":"v1","addr":"172.21.15.12:6827","nonce":1404954527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:05:51.497188+0000","modified":"2024-09-11T23:05:54.502889+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4813},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4813":{"gid":4813,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6829/2605601020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":2605601020},{"type":"v1","addr":"172.21.15.12:6829","nonce":2605601020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4813,"qdb_cluster":[4813]},"id":5}]} 2024-09-11T23:06:12.813 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 40 2024-09-11T23:06:12.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.811+0000 7f49f07d7640 1 -- 172.21.15.12:0/457428942 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f49cc035e40 msgr2=0x7f49cc038300 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:06:12.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.811+0000 7f49f07d7640 1 --2- 172.21.15.12:0/457428942 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f49cc035e40 0x7f49cc038300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:12.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.811+0000 7f49f07d7640 1 -- 172.21.15.12:0/457428942 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49e8136b20 msgr2=0x7f49e813a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:12.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.811+0000 7f49f07d7640 1 --2- 172.21.15.12:0/457428942 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49e8136b20 0x7f49e813a210 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f49e400c390 tx=0x7f49e400c850 comp rx=0 tx=0).stop 2024-09-11T23:06:12.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.811+0000 7f49f07d7640 1 -- 172.21.15.12:0/457428942 shutdown_connections 2024-09-11T23:06:12.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.811+0000 7f49f07d7640 1 --2- 172.21.15.12:0/457428942 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f49cc035e40 0x7f49cc038300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:12.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.811+0000 7f49f07d7640 1 --2- 172.21.15.12:0/457428942 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49e8136b20 0x7f49e813a210 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:12.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.811+0000 7f49f07d7640 1 -- 172.21.15.12:0/457428942 >> 172.21.15.12:0/457428942 conn(0x7f49e8068000 msgr2=0x7f49e8135b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:12.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.811+0000 7f49f07d7640 1 -- 172.21.15.12:0/457428942 shutdown_connections 2024-09-11T23:06:12.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.811+0000 7f49f07d7640 1 -- 172.21.15.12:0/457428942 wait complete. 2024-09-11T23:06:12.830 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:06:12.846 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:12.843+0000 7f0303827180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T23:06:12.925 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:12.923+0000 7f0303827180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T23:06:12.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.955+0000 7f0110db8640 1 Processor -- start 2024-09-11T23:06:12.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.955+0000 7f0110db8640 1 -- start start 2024-09-11T23:06:12.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.955+0000 7f0110db8640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f010c067a00 0x7f010c0a0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:12.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.955+0000 7f0110db8640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f010c0a0e80 con 0x7f010c137f50 2024-09-11T23:06:12.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.955+0000 7f0110db8640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f010c067de0 con 0x7f010c067a00 2024-09-11T23:06:12.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.959+0000 7f010a59c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f010c067a00 0x7f010c0a0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:12.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.959+0000 7f010a59c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f010c067a00 0x7f010c0a0860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40406/0 (socket says 172.21.15.12:40406) 2024-09-11T23:06:12.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.959+0000 7f0109d9b640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f010c137f50 0x7f010c138390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39918/0 (socket says 172.21.15.12:39918) 2024-09-11T23:06:12.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.959+0000 7f010a59c640 1 -- 172.21.15.12:0/3183344481 learned_addr learned my addr 172.21.15.12:0/3183344481 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:12.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.959+0000 7f010a59c640 1 -- 172.21.15.12:0/3183344481 >> v1:172.21.15.12:6789/0 conn(0x7f010c137f50 legacy=0x7f010c138390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:12.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.959+0000 7f010a59c640 1 -- 172.21.15.12:0/3183344481 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f010c137b20 con 0x7f010c067a00 2024-09-11T23:06:12.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.959+0000 7f010a59c640 1 --2- 172.21.15.12:0/3183344481 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f010c067a00 0x7f010c0a0860 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f00fc0097f0 tx=0x7f00fc01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=986afa12cce72f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:12.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.959+0000 7f010959a640 1 -- 172.21.15.12:0/3183344481 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00fc0b0070 con 0x7f010c067a00 2024-09-11T23:06:12.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.959+0000 7f010959a640 1 -- 172.21.15.12:0/3183344481 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00fc0ab530 con 0x7f010c067a00 2024-09-11T23:06:12.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.959+0000 7f010959a640 1 -- 172.21.15.12:0/3183344481 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00fc0ab830 con 0x7f010c067a00 2024-09-11T23:06:12.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.959+0000 7f0110db8640 1 -- 172.21.15.12:0/3183344481 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f010c067a00 msgr2=0x7f010c0a0860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:12.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.959+0000 7f0110db8640 1 --2- 172.21.15.12:0/3183344481 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f010c067a00 0x7f010c0a0860 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f00fc0097f0 tx=0x7f00fc01c450 comp rx=0 tx=0).stop 2024-09-11T23:06:12.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.959+0000 7f0110db8640 1 -- 172.21.15.12:0/3183344481 shutdown_connections 2024-09-11T23:06:12.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.959+0000 7f0110db8640 1 --2- 172.21.15.12:0/3183344481 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f010c067a00 0x7f010c0a0860 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:12.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.959+0000 7f0110db8640 1 -- 172.21.15.12:0/3183344481 >> 172.21.15.12:0/3183344481 conn(0x7f010c09b910 msgr2=0x7f010c09dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:12.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.959+0000 7f0110db8640 1 -- 172.21.15.12:0/3183344481 shutdown_connections 2024-09-11T23:06:12.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.959+0000 7f0110db8640 1 -- 172.21.15.12:0/3183344481 wait complete. 2024-09-11T23:06:12.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.963+0000 7f0110db8640 1 Processor -- start 2024-09-11T23:06:12.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.963+0000 7f0110db8640 1 -- start start 2024-09-11T23:06:12.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.963+0000 7f0110db8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f010c067a00 0x7f010c0a5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:12.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.963+0000 7f0110db8640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f010c13f8e0 con 0x7f010c067a00 2024-09-11T23:06:12.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.963+0000 7f010a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f010c067a00 0x7f010c0a5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:12.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.963+0000 7f010a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f010c067a00 0x7f010c0a5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40414/0 (socket says 172.21.15.12:40414) 2024-09-11T23:06:12.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.963+0000 7f010a59c640 1 -- 172.21.15.12:0/1433944858 learned_addr learned my addr 172.21.15.12:0/1433944858 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:12.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.967+0000 7f010a59c640 1 -- 172.21.15.12:0/1433944858 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f010c09c5b0 con 0x7f010c067a00 2024-09-11T23:06:12.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.967+0000 7f010a59c640 1 --2- 172.21.15.12:0/1433944858 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f010c067a00 0x7f010c0a5db0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f00fc01a080 tx=0x7f00fc01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:12.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.967+0000 7f00faffd640 1 -- 172.21.15.12:0/1433944858 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00fc0ba020 con 0x7f010c067a00 2024-09-11T23:06:12.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.967+0000 7f00faffd640 1 -- 172.21.15.12:0/1433944858 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00fc0b6420 con 0x7f010c067a00 2024-09-11T23:06:12.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.967+0000 7f00faffd640 1 -- 172.21.15.12:0/1433944858 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00fc0b0040 con 0x7f010c067a00 2024-09-11T23:06:12.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.967+0000 7f0110db8640 1 -- 172.21.15.12:0/1433944858 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f010c1353b0 con 0x7f010c067a00 2024-09-11T23:06:12.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.967+0000 7f0110db8640 1 -- 172.21.15.12:0/1433944858 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f010c0a5370 con 0x7f010c067a00 2024-09-11T23:06:12.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.967+0000 7f00faffd640 1 -- 172.21.15.12:0/1433944858 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 29) ==== 44099+0+0 (secure 0 0 0) 0x7f00fc0bd020 con 0x7f010c067a00 2024-09-11T23:06:12.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.967+0000 7f0110db8640 1 -- 172.21.15.12:0/1433944858 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f010c0a3810 con 0x7f010c067a00 2024-09-11T23:06:12.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.967+0000 7f00faffd640 1 --2- 172.21.15.12:0/1433944858 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f00ec035e40 0x7f00ec038300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:12.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.967+0000 7f00faffd640 1 -- 172.21.15.12:0/1433944858 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 3697+0+0 (secure 0 0 0) 0x7f00fc0e2bc0 con 0x7f010c067a00 2024-09-11T23:06:12.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.967+0000 7f0109d9b640 1 -- 172.21.15.12:0/1433944858 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f00ec035e40 msgr2=0x7f00ec038300 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6824/378652896 2024-09-11T23:06:12.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.967+0000 7f0109d9b640 1 --2- 172.21.15.12:0/1433944858 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f00ec035e40 0x7f00ec038300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:06:12.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:12.971+0000 7f00faffd640 1 -- 172.21.15.12:0/1433944858 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f00fc0c4030 con 0x7f010c067a00 2024-09-11T23:06:13.081 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:13.079+0000 7f0303827180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T23:06:13.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.135+0000 7f0110db8640 1 -- 172.21.15.12:0/1433944858 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f010c0a0860 con 0x7f010c067a00 2024-09-11T23:06:13.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.135+0000 7f00faffd640 1 -- 172.21.15.12:0/1433944858 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) ==== 74+0+11054 (secure 0 0 0) 0x7f00fc0160d0 con 0x7f010c067a00 2024-09-11T23:06:13.139 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:06:13.140 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":55,"fsid":"8be14356-3340-4500-91a2-4cbc6b511f65","created":"2024-09-11T23:03:10.620234+0000","modified":"2024-09-11T23:06:07.866629+0000","last_up_change":"2024-09-11T23:03:22.359028+0000","last_in_change":"2024-09-11T23:03:11.545817+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:03:23.587068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:05:49.161756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0299999713897705,"score_stable":1.0299999713897705,"optimal_score":1,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.0299999713897705,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-11T23:05:50.500965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"153b72a1-40b1-400d-93ea-333e733f9bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6817","nonce":3680911937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6819","nonce":3680911937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6823","nonce":3680911937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6821","nonce":3680911937}]},"public_addr":"172.21.15.12:6817/3680911937","cluster_addr":"172.21.15.12:6819/3680911937","heartbeat_back_addr":"172.21.15.12:6823/3680911937","heartbeat_front_addr":"172.21.15.12:6821/3680911937","state":["exists","up"]},{"osd":1,"uuid":"94669e49-ee4f-4acf-9e25-e94374dda8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6801","nonce":236825163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6803","nonce":236825163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6807","nonce":236825163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6805","nonce":236825163}]},"public_addr":"172.21.15.12:6801/236825163","cluster_addr":"172.21.15.12:6803/236825163","heartbeat_back_addr":"172.21.15.12:6807/236825163","heartbeat_front_addr":"172.21.15.12:6805/236825163","state":["exists","up"]},{"osd":2,"uuid":"826dae4d-8888-4ec5-8f00-425b3be93814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6809","nonce":3263521655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6811","nonce":3263521655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6815","nonce":3263521655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6813","nonce":3263521655}]},"public_addr":"172.21.15.12:6809/3263521655","cluster_addr":"172.21.15.12:6811/3263521655","heartbeat_back_addr":"172.21.15.12:6815/3263521655","heartbeat_front_addr":"172.21.15.12:6813/3263521655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:19.398518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.761524+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.904997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/1044732542":"2024-09-12T23:06:07.866565+0000","172.21.15.12:0/1734477438":"2024-09-12T23:06:07.866565+0000","172.21.15.12:0/462043258":"2024-09-12T23:06:07.866565+0000","172.21.15.12:0/3818284364":"2024-09-12T23:06:07.866565+0000","172.21.15.12:6825/1925124150":"2024-09-12T23:06:07.866565+0000","172.21.15.12:6824/1925124150":"2024-09-12T23:06:07.866565+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:06:13.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.139+0000 7f0110db8640 1 -- 172.21.15.12:0/1433944858 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f00ec035e40 msgr2=0x7f00ec038300 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:06:13.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.139+0000 7f0110db8640 1 --2- 172.21.15.12:0/1433944858 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f00ec035e40 0x7f00ec038300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:13.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.139+0000 7f0110db8640 1 -- 172.21.15.12:0/1433944858 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f010c067a00 msgr2=0x7f010c0a5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:13.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.139+0000 7f0110db8640 1 --2- 172.21.15.12:0/1433944858 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f010c067a00 0x7f010c0a5db0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f00fc01a080 tx=0x7f00fc01ac90 comp rx=0 tx=0).stop 2024-09-11T23:06:13.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.139+0000 7f0110db8640 1 -- 172.21.15.12:0/1433944858 shutdown_connections 2024-09-11T23:06:13.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.139+0000 7f0110db8640 1 --2- 172.21.15.12:0/1433944858 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7f00ec035e40 0x7f00ec038300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:13.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.139+0000 7f0110db8640 1 --2- 172.21.15.12:0/1433944858 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f010c067a00 0x7f010c0a5db0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:13.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.139+0000 7f0110db8640 1 -- 172.21.15.12:0/1433944858 >> 172.21.15.12:0/1433944858 conn(0x7f010c09b910 msgr2=0x7f010c134ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:13.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.139+0000 7f0110db8640 1 -- 172.21.15.12:0/1433944858 shutdown_connections 2024-09-11T23:06:13.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.139+0000 7f0110db8640 1 -- 172.21.15.12:0/1433944858 wait complete. 2024-09-11T23:06:13.158 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-11T23:06:13.158 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:13.155+0000 7f0303827180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T23:06:13.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.267+0000 7ff9a6309640 1 Processor -- start 2024-09-11T23:06:13.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.267+0000 7ff9a6309640 1 -- start start 2024-09-11T23:06:13.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.267+0000 7ff9a6309640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff9a009fc40 0x7ff9a013ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:13.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.267+0000 7ff9a6309640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9a00a1c00 con 0x7ff9a013a200 2024-09-11T23:06:13.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.267+0000 7ff9a6309640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7ff9a00a0e40 con 0x7ff9a009fc40 2024-09-11T23:06:13.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.267+0000 7ff997fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff9a009fc40 0x7ff9a013ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:13.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.267+0000 7ff99ffff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff9a013a200 0x7ff9a013a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39922/0 (socket says 172.21.15.12:39922) 2024-09-11T23:06:13.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.267+0000 7ff99ffff640 1 -- 172.21.15.12:0/3655245502 learned_addr learned my addr 172.21.15.12:0/3655245502 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:13.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.267+0000 7ff997fff640 1 -- 172.21.15.12:0/3655245502 >> v1:172.21.15.12:6789/0 conn(0x7ff9a013a200 legacy=0x7ff9a013a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:13.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.267+0000 7ff997fff640 1 -- 172.21.15.12:0/3655245502 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9a009f350 con 0x7ff9a009fc40 2024-09-11T23:06:13.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.271+0000 7ff997fff640 1 --2- 172.21.15.12:0/3655245502 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9a009fc40 0x7ff9a013ef80 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7ff988009740 tx=0x7ff98801c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=385ad154435f7d08 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:13.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.271+0000 7ff99f7fe640 1 -- 172.21.15.12:0/3655245502 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9880b0070 con 0x7ff9a009fc40 2024-09-11T23:06:13.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.271+0000 7ff99f7fe640 1 -- 172.21.15.12:0/3655245502 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9880ab530 con 0x7ff9a009fc40 2024-09-11T23:06:13.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.271+0000 7ff99f7fe640 1 -- 172.21.15.12:0/3655245502 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9880ab830 con 0x7ff9a009fc40 2024-09-11T23:06:13.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.271+0000 7ff9a6309640 1 -- 172.21.15.12:0/3655245502 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9a009fc40 msgr2=0x7ff9a013ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:13.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.271+0000 7ff9a6309640 1 --2- 172.21.15.12:0/3655245502 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9a009fc40 0x7ff9a013ef80 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7ff988009740 tx=0x7ff98801c390 comp rx=0 tx=0).stop 2024-09-11T23:06:13.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.271+0000 7ff9a6309640 1 -- 172.21.15.12:0/3655245502 shutdown_connections 2024-09-11T23:06:13.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.271+0000 7ff9a6309640 1 --2- 172.21.15.12:0/3655245502 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9a009fc40 0x7ff9a013ef80 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:13.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.271+0000 7ff9a6309640 1 -- 172.21.15.12:0/3655245502 >> 172.21.15.12:0/3655245502 conn(0x7ff9a006da30 msgr2=0x7ff9a006de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:13.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.271+0000 7ff9a6309640 1 -- 172.21.15.12:0/3655245502 shutdown_connections 2024-09-11T23:06:13.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.271+0000 7ff9a6309640 1 -- 172.21.15.12:0/3655245502 wait complete. 2024-09-11T23:06:13.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.271+0000 7ff9a6309640 1 Processor -- start 2024-09-11T23:06:13.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.271+0000 7ff9a6309640 1 -- start start 2024-09-11T23:06:13.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.271+0000 7ff9a6309640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9a013a200 0x7ff9a00aafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:13.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.271+0000 7ff9a6309640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a0141ce0 con 0x7ff9a013a200 2024-09-11T23:06:13.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.275+0000 7ff99ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9a013a200 0x7ff9a00aafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:13.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.275+0000 7ff99ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9a013a200 0x7ff9a00aafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40436/0 (socket says 172.21.15.12:40436) 2024-09-11T23:06:13.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.275+0000 7ff99ffff640 1 -- 172.21.15.12:0/2519840366 learned_addr learned my addr 172.21.15.12:0/2519840366 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:13.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.275+0000 7ff99ffff640 1 -- 172.21.15.12:0/2519840366 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9a00aa560 con 0x7ff9a013a200 2024-09-11T23:06:13.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.275+0000 7ff99ffff640 1 --2- 172.21.15.12:0/2519840366 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9a013a200 0x7ff9a00aafa0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7ff99000c480 tx=0x7ff99000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:13.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.275+0000 7ff99d7fa640 1 -- 172.21.15.12:0/2519840366 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff990017070 con 0x7ff9a013a200 2024-09-11T23:06:13.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.275+0000 7ff99d7fa640 1 -- 172.21.15.12:0/2519840366 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff990005c20 con 0x7ff9a013a200 2024-09-11T23:06:13.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.275+0000 7ff9a6309640 1 -- 172.21.15.12:0/2519840366 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9a00abd10 con 0x7ff9a013a200 2024-09-11T23:06:13.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.275+0000 7ff99d7fa640 1 -- 172.21.15.12:0/2519840366 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff990007070 con 0x7ff9a013a200 2024-09-11T23:06:13.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.275+0000 7ff9a6309640 1 -- 172.21.15.12:0/2519840366 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9a00abfc0 con 0x7ff9a013a200 2024-09-11T23:06:13.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.275+0000 7ff9a6309640 1 -- 172.21.15.12:0/2519840366 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9a013a660 con 0x7ff9a013a200 2024-09-11T23:06:13.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.275+0000 7ff99d7fa640 1 -- 172.21.15.12:0/2519840366 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 29) ==== 44099+0+0 (secure 0 0 0) 0x7ff99001a070 con 0x7ff9a013a200 2024-09-11T23:06:13.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.275+0000 7ff99d7fa640 1 --2- 172.21.15.12:0/2519840366 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7ff980035e40 0x7ff980038300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:13.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.275+0000 7ff99d7fa640 1 -- 172.21.15.12:0/2519840366 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 3697+0+0 (secure 0 0 0) 0x7ff990047ab0 con 0x7ff9a013a200 2024-09-11T23:06:13.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.275+0000 7ff997fff640 1 -- 172.21.15.12:0/2519840366 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7ff980035e40 msgr2=0x7ff980038300 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6824/378652896 2024-09-11T23:06:13.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.275+0000 7ff997fff640 1 --2- 172.21.15.12:0/2519840366 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7ff980035e40 0x7ff980038300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:06:13.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.279+0000 7ff99d7fa640 1 -- 172.21.15.12:0/2519840366 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff990007210 con 0x7ff9a013a200 2024-09-11T23:06:13.463 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:13.459+0000 7f0303827180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T23:06:13.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.471+0000 7ff9a6309640 1 -- 172.21.15.12:0/2519840366 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7ff9a0073580 con 0x7ff9a013a200 2024-09-11T23:06:13.473 INFO:tasks.ceph.mon.a.smithi012.stderr:2024-09-11T23:06:13.471+0000 7fd71c996640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T23:06:13.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.471+0000 7ff99d7fa640 1 -- 172.21.15.12:0/2519840366 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v41) ==== 161+0+0 (secure 0 0 0) 0x7ff99001b400 con 0x7ff9a013a200 2024-09-11T23:06:13.474 INFO:teuthology.orchestra.run.smithi012.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T23:06:13.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.475+0000 7ff9a6309640 1 -- 172.21.15.12:0/2519840366 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7ff980035e40 msgr2=0x7ff980038300 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:06:13.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.475+0000 7ff9a6309640 1 --2- 172.21.15.12:0/2519840366 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7ff980035e40 0x7ff980038300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:13.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.475+0000 7ff9a6309640 1 -- 172.21.15.12:0/2519840366 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9a013a200 msgr2=0x7ff9a00aafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:13.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.475+0000 7ff9a6309640 1 --2- 172.21.15.12:0/2519840366 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9a013a200 0x7ff9a00aafa0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7ff99000c480 tx=0x7ff99000c940 comp rx=0 tx=0).stop 2024-09-11T23:06:13.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.475+0000 7ff9a6309640 1 -- 172.21.15.12:0/2519840366 shutdown_connections 2024-09-11T23:06:13.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.475+0000 7ff9a6309640 1 --2- 172.21.15.12:0/2519840366 >> [v2:172.21.15.12:6824/378652896,v1:172.21.15.12:6825/378652896] conn(0x7ff980035e40 0x7ff980038300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:13.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.475+0000 7ff9a6309640 1 --2- 172.21.15.12:0/2519840366 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9a013a200 0x7ff9a00aafa0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:13.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.475+0000 7ff9a6309640 1 -- 172.21.15.12:0/2519840366 >> 172.21.15.12:0/2519840366 conn(0x7ff9a006da30 msgr2=0x7ff9a009ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:13.479 INFO:tasks.ceph.mds.a.smithi012.stderr: -1769> 2024-09-11T23:05:57.779+0000 7fc07492b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T23:06:13.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.479+0000 7ff9a6309640 1 -- 172.21.15.12:0/2519840366 shutdown_connections 2024-09-11T23:06:13.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.479+0000 7ff9a6309640 1 -- 172.21.15.12:0/2519840366 wait complete. 2024-09-11T23:06:13.498 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-11T23:06:13.517 INFO:tasks.ceph.mds.a.smithi012.stdout:starting mds.a at 2024-09-11T23:06:13.526 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:13.523+0000 7f0303827180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T23:06:13.595 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:13.591+0000 7f028e428640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:06:13.595 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:13.591+0000 7f028e428640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:06:13.595 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:13.591+0000 7f028e428640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:06:13.596 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:13.591+0000 7f028e428640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:06:13.596 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:13.591+0000 7f028e428640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:06:13.596 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:13.595+0000 7f028b422640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:06:13.596 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:13.595+0000 7f028b422640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:06:13.597 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:13.595+0000 7f028b422640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:06:13.597 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:13.595+0000 7f028b422640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:06:13.597 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:13.595+0000 7f028b422640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:06:13.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.615+0000 7f49a0d0e640 1 Processor -- start 2024-09-11T23:06:13.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.615+0000 7f49a0d0e640 1 -- start start 2024-09-11T23:06:13.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.619+0000 7f49a0d0e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f499c1341a0 0x7f499c134c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:13.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.619+0000 7f49a0d0e640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f499c1346a0 con 0x7f499c1348a0 2024-09-11T23:06:13.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.619+0000 7f49a0d0e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f499c09d420 con 0x7f499c1341a0 2024-09-11T23:06:13.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.619+0000 7f4999d9b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f499c1341a0 0x7f499c134c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:13.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.619+0000 7f499a59c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f499c1348a0 0x7f499c137790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39938/0 (socket says 172.21.15.12:39938) 2024-09-11T23:06:13.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.619+0000 7f499a59c640 1 -- 172.21.15.12:0/529070338 learned_addr learned my addr 172.21.15.12:0/529070338 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:13.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.619+0000 7f4999d9b640 1 -- 172.21.15.12:0/529070338 >> v1:172.21.15.12:6789/0 conn(0x7f499c1348a0 legacy=0x7f499c137790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:13.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.619+0000 7f499959a640 1 -- 172.21.15.12:0/529070338 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4018615012 0 0) 0x7f499c1346a0 con 0x7f499c1348a0 2024-09-11T23:06:13.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.619+0000 7f4999d9b640 1 -- 172.21.15.12:0/529070338 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f499c09ede0 con 0x7f499c1341a0 2024-09-11T23:06:13.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.619+0000 7f4999d9b640 1 --2- 172.21.15.12:0/529070338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f499c1341a0 0x7f499c134c80 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f4990009770 tx=0x7f499001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8c96e2e1d9ec1be server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:13.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.619+0000 7f499959a640 1 -- 172.21.15.12:0/529070338 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49900b0070 con 0x7f499c1341a0 2024-09-11T23:06:13.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.619+0000 7f499959a640 1 -- 172.21.15.12:0/529070338 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49900ab530 con 0x7f499c1341a0 2024-09-11T23:06:13.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.619+0000 7f499959a640 1 -- 172.21.15.12:0/529070338 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49900ab830 con 0x7f499c1341a0 2024-09-11T23:06:13.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.619+0000 7f49a0d0e640 1 -- 172.21.15.12:0/529070338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f499c1341a0 msgr2=0x7f499c134c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:13.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.619+0000 7f49a0d0e640 1 --2- 172.21.15.12:0/529070338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f499c1341a0 0x7f499c134c80 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f4990009770 tx=0x7f499001c420 comp rx=0 tx=0).stop 2024-09-11T23:06:13.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.619+0000 7f49a0d0e640 1 -- 172.21.15.12:0/529070338 shutdown_connections 2024-09-11T23:06:13.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.619+0000 7f49a0d0e640 1 --2- 172.21.15.12:0/529070338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f499c1341a0 0x7f499c134c80 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:13.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.619+0000 7f49a0d0e640 1 -- 172.21.15.12:0/529070338 >> 172.21.15.12:0/529070338 conn(0x7f499c070ba0 msgr2=0x7f499c072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:13.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.619+0000 7f49a0d0e640 1 -- 172.21.15.12:0/529070338 shutdown_connections 2024-09-11T23:06:13.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.619+0000 7f49a0d0e640 1 -- 172.21.15.12:0/529070338 wait complete. 2024-09-11T23:06:13.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.619+0000 7f49a0d0e640 1 Processor -- start 2024-09-11T23:06:13.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.623+0000 7f49a0d0e640 1 -- start start 2024-09-11T23:06:13.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.623+0000 7f49a0d0e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f499c1341a0 0x7f499c12fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:13.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.623+0000 7f49a0d0e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f499c13fcb0 con 0x7f499c1341a0 2024-09-11T23:06:13.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.623+0000 7f499a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f499c1341a0 0x7f499c12fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:13.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.623+0000 7f499a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f499c1341a0 0x7f499c12fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40556/0 (socket says 172.21.15.12:40556) 2024-09-11T23:06:13.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.623+0000 7f499a59c640 1 -- 172.21.15.12:0/1400743270 learned_addr learned my addr 172.21.15.12:0/1400743270 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:13.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.623+0000 7f499a59c640 1 -- 172.21.15.12:0/1400743270 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f499c0a3b70 con 0x7f499c1341a0 2024-09-11T23:06:13.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.623+0000 7f499a59c640 1 --2- 172.21.15.12:0/1400743270 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f499c1341a0 0x7f499c12fd00 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f498c00c450 tx=0x7f498c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:13.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.623+0000 7f498affd640 1 -- 172.21.15.12:0/1400743270 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f498c005c20 con 0x7f499c1341a0 2024-09-11T23:06:13.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.623+0000 7f498affd640 1 -- 172.21.15.12:0/1400743270 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f498c005dc0 con 0x7f499c1341a0 2024-09-11T23:06:13.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.623+0000 7f49a0d0e640 1 -- 172.21.15.12:0/1400743270 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f499c0a2a70 con 0x7f499c1341a0 2024-09-11T23:06:13.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.623+0000 7f498affd640 1 -- 172.21.15.12:0/1400743270 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f498c0071a0 con 0x7f499c1341a0 2024-09-11T23:06:13.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.623+0000 7f49a0d0e640 1 -- 172.21.15.12:0/1400743270 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f499c13d660 con 0x7f499c1341a0 2024-09-11T23:06:13.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.623+0000 7f498affd640 1 -- 172.21.15.12:0/1400743270 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 30) ==== 43764+0+0 (secure 0 0 0) 0x7f498c007400 con 0x7f499c1341a0 2024-09-11T23:06:13.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.623+0000 7f49a0d0e640 1 -- 172.21.15.12:0/1400743270 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f499c0008e0 con 0x7f499c1341a0 2024-09-11T23:06:13.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.623+0000 7f498affd640 1 -- 172.21.15.12:0/1400743270 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 4084+0+0 (secure 0 0 0) 0x7f498c0480c0 con 0x7f499c1341a0 2024-09-11T23:06:13.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.627+0000 7f498affd640 1 -- 172.21.15.12:0/1400743270 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f498c0182b0 con 0x7f499c1341a0 2024-09-11T23:06:13.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:13.823+0000 7f49a0d0e640 1 -- 172.21.15.12:0/1400743270 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f499c13cc80 con 0x7f499c1341a0 2024-09-11T23:06:14.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:14.527+0000 7f498affd640 1 -- 172.21.15.12:0/1400743270 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v42) ==== 104+0+0 (secure 0 0 0) 0x7f498c01b4b0 con 0x7f499c1341a0 2024-09-11T23:06:14.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:14.531+0000 7f49a0d0e640 1 -- 172.21.15.12:0/1400743270 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f499c1341a0 msgr2=0x7f499c12fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:14.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:14.531+0000 7f49a0d0e640 1 --2- 172.21.15.12:0/1400743270 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f499c1341a0 0x7f499c12fd00 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f498c00c450 tx=0x7f498c00c910 comp rx=0 tx=0).stop 2024-09-11T23:06:14.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:14.531+0000 7f49a0d0e640 1 -- 172.21.15.12:0/1400743270 shutdown_connections 2024-09-11T23:06:14.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:14.531+0000 7f49a0d0e640 1 --2- 172.21.15.12:0/1400743270 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f499c1341a0 0x7f499c12fd00 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:14.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:14.531+0000 7f49a0d0e640 1 -- 172.21.15.12:0/1400743270 >> 172.21.15.12:0/1400743270 conn(0x7f499c070ba0 msgr2=0x7f499c130bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:14.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:14.531+0000 7f49a0d0e640 1 -- 172.21.15.12:0/1400743270 shutdown_connections 2024-09-11T23:06:14.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:14.531+0000 7f49a0d0e640 1 -- 172.21.15.12:0/1400743270 wait complete. 2024-09-11T23:06:14.561 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-11T23:06:14.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:14.735+0000 7fccc40a9640 1 Processor -- start 2024-09-11T23:06:14.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:14.735+0000 7fccc40a9640 1 -- start start 2024-09-11T23:06:14.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:14.735+0000 7fccc40a9640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fccbc0a17f0 0x7fccbc13ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:14.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:14.735+0000 7fccc40a9640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccbc0a1e30 con 0x7fccbc13a090 2024-09-11T23:06:14.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:14.735+0000 7fccc40a9640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fccbc0a10a0 con 0x7fccbc0a17f0 2024-09-11T23:06:14.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:14.735+0000 7fccc1644640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fccbc0a17f0 0x7fccbc13ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:14.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:14.735+0000 7fccc1e45640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fccbc13a090 0x7fccbc13a470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38010/0 (socket says 172.21.15.12:38010) 2024-09-11T23:06:14.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:14.735+0000 7fccc1e45640 1 -- 172.21.15.12:0/375531044 learned_addr learned my addr 172.21.15.12:0/375531044 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:14.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:14.739+0000 7fccc0e43640 1 -- 172.21.15.12:0/375531044 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2463224609 0 0) 0x7fccbc0a1e30 con 0x7fccbc13a090 2024-09-11T23:06:14.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:14.739+0000 7fccc0e43640 1 -- 172.21.15.12:0/375531044 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcca8003530 con 0x7fccbc13a090 2024-09-11T23:06:14.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:14.739+0000 7fccc1644640 1 -- 172.21.15.12:0/375531044 >> v1:172.21.15.12:6789/0 conn(0x7fccbc13a090 legacy=0x7fccbc13a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:14.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:14.739+0000 7fccc1644640 1 -- 172.21.15.12:0/375531044 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccbc09f380 con 0x7fccbc0a17f0 2024-09-11T23:06:14.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:14.739+0000 7fccc1644640 1 --2- 172.21.15.12:0/375531044 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fccbc0a17f0 0x7fccbc13ef10 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fccac009740 tx=0x7fccac01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77229562227216c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:14.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:14.739+0000 7fccc0e43640 1 -- 172.21.15.12:0/375531044 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccac0b0070 con 0x7fccbc0a17f0 2024-09-11T23:06:14.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:14.739+0000 7fccc0e43640 1 -- 172.21.15.12:0/375531044 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccac0ab530 con 0x7fccbc0a17f0 2024-09-11T23:06:14.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:14.739+0000 7fccc0e43640 1 -- 172.21.15.12:0/375531044 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccac0ab830 con 0x7fccbc0a17f0 2024-09-11T23:06:14.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:14.739+0000 7fccc40a9640 1 -- 172.21.15.12:0/375531044 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fccbc0a17f0 msgr2=0x7fccbc13ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:14.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:14.739+0000 7fccc40a9640 1 --2- 172.21.15.12:0/375531044 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fccbc0a17f0 0x7fccbc13ef10 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fccac009740 tx=0x7fccac01c390 comp rx=0 tx=0).stop 2024-09-11T23:06:14.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:14.739+0000 7fccc40a9640 1 -- 172.21.15.12:0/375531044 shutdown_connections 2024-09-11T23:06:14.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:14.739+0000 7fccc40a9640 1 --2- 172.21.15.12:0/375531044 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fccbc0a17f0 0x7fccbc13ef10 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:14.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:14.739+0000 7fccc40a9640 1 -- 172.21.15.12:0/375531044 >> 172.21.15.12:0/375531044 conn(0x7fccbc06da30 msgr2=0x7fccbc06de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:14.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:14.739+0000 7fccc40a9640 1 -- 172.21.15.12:0/375531044 shutdown_connections 2024-09-11T23:06:14.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:14.739+0000 7fccc40a9640 1 -- 172.21.15.12:0/375531044 wait complete. 2024-09-11T23:06:14.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:14.739+0000 7fccc40a9640 1 Processor -- start 2024-09-11T23:06:14.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:14.739+0000 7fccc40a9640 1 -- start start 2024-09-11T23:06:14.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:14.743+0000 7fccc40a9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fccbc0a17f0 0x7fccbc0a5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:14.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:14.743+0000 7fccc40a9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fccbc141df0 con 0x7fccbc0a17f0 2024-09-11T23:06:14.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:14.743+0000 7fccc1e45640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fccbc0a17f0 0x7fccbc0a5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:14.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:14.743+0000 7fccc1e45640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fccbc0a17f0 0x7fccbc0a5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34470/0 (socket says 172.21.15.12:34470) 2024-09-11T23:06:14.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:14.743+0000 7fccc1e45640 1 -- 172.21.15.12:0/395563602 learned_addr learned my addr 172.21.15.12:0/395563602 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:14.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:14.743+0000 7fccc1e45640 1 -- 172.21.15.12:0/395563602 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccbc0a5330 con 0x7fccbc0a17f0 2024-09-11T23:06:14.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:14.743+0000 7fccc1e45640 1 --2- 172.21.15.12:0/395563602 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fccbc0a17f0 0x7fccbc0a5cf0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fccb800c450 tx=0x7fccb800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:14.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:14.743+0000 7fccb27fc640 1 -- 172.21.15.12:0/395563602 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccb8017070 con 0x7fccbc0a17f0 2024-09-11T23:06:14.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:14.743+0000 7fccb27fc640 1 -- 172.21.15.12:0/395563602 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccb8005c20 con 0x7fccbc0a17f0 2024-09-11T23:06:14.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:14.743+0000 7fccb27fc640 1 -- 172.21.15.12:0/395563602 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccb8007070 con 0x7fccbc0a17f0 2024-09-11T23:06:14.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:14.743+0000 7fccc40a9640 1 -- 172.21.15.12:0/395563602 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccbc0a6b80 con 0x7fccbc0a17f0 2024-09-11T23:06:14.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:14.743+0000 7fccc40a9640 1 -- 172.21.15.12:0/395563602 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccbc0a7b30 con 0x7fccbc0a17f0 2024-09-11T23:06:14.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:14.743+0000 7fccb27fc640 1 -- 172.21.15.12:0/395563602 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 31) ==== 43891+0+0 (secure 0 0 0) 0x7fccb801a070 con 0x7fccbc0a17f0 2024-09-11T23:06:14.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:14.743+0000 7fccc40a9640 1 -- 172.21.15.12:0/395563602 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccbc0008e0 con 0x7fccbc0a17f0 2024-09-11T23:06:14.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:14.743+0000 7fccb27fc640 1 --2- 172.21.15.12:0/395563602 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fcca0035bb0 0x7fcca0038070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:14.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:14.743+0000 7fccb27fc640 1 -- 172.21.15.12:0/395563602 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 4084+0+0 (secure 0 0 0) 0x7fccb80478a0 con 0x7fccbc0a17f0 2024-09-11T23:06:14.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:14.743+0000 7fccc1644640 1 --2- 172.21.15.12:0/395563602 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fcca0035bb0 0x7fcca0038070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:14.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:14.743+0000 7fccc1644640 1 --2- 172.21.15.12:0/395563602 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fcca0035bb0 0x7fcca0038070 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fccac0ad000 tx=0x7fccac0a6000 comp rx=0 tx=0).ready entity=mgr.4903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:14.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:14.747+0000 7fccb27fc640 1 -- 172.21.15.12:0/395563602 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fccb8007210 con 0x7fccbc0a17f0 2024-09-11T23:06:14.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:14.911+0000 7fccc40a9640 1 -- 172.21.15.12:0/395563602 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fccbc13a090 con 0x7fccbc0a17f0 2024-09-11T23:06:15.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.539+0000 7fccb27fc640 1 -- 172.21.15.12:0/395563602 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v58) ==== 181+0+0 (secure 0 0 0) 0x7fccb8012400 con 0x7fccbc0a17f0 2024-09-11T23:06:15.543 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' removed 2024-09-11T23:06:15.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.543+0000 7fccc40a9640 1 -- 172.21.15.12:0/395563602 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fcca0035bb0 msgr2=0x7fcca0038070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:15.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.543+0000 7fccc40a9640 1 --2- 172.21.15.12:0/395563602 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fcca0035bb0 0x7fcca0038070 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fccac0ad000 tx=0x7fccac0a6000 comp rx=0 tx=0).stop 2024-09-11T23:06:15.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.543+0000 7fccc40a9640 1 -- 172.21.15.12:0/395563602 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fccbc0a17f0 msgr2=0x7fccbc0a5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:15.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.543+0000 7fccc40a9640 1 --2- 172.21.15.12:0/395563602 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fccbc0a17f0 0x7fccbc0a5cf0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fccb800c450 tx=0x7fccb800c910 comp rx=0 tx=0).stop 2024-09-11T23:06:15.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.543+0000 7fccc40a9640 1 -- 172.21.15.12:0/395563602 shutdown_connections 2024-09-11T23:06:15.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.543+0000 7fccc40a9640 1 --2- 172.21.15.12:0/395563602 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fcca0035bb0 0x7fcca0038070 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:15.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.543+0000 7fccc40a9640 1 --2- 172.21.15.12:0/395563602 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fccbc0a17f0 0x7fccbc0a5cf0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:15.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.543+0000 7fccc40a9640 1 -- 172.21.15.12:0/395563602 >> 172.21.15.12:0/395563602 conn(0x7fccbc06da30 msgr2=0x7fccbc09c280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:15.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.543+0000 7fccc40a9640 1 -- 172.21.15.12:0/395563602 shutdown_connections 2024-09-11T23:06:15.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.543+0000 7fccc40a9640 1 -- 172.21.15.12:0/395563602 wait complete. 2024-09-11T23:06:15.576 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-11T23:06:15.579 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:15.575+0000 7f02a2c51640 -1 client.4935: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.4890:b65aeaeb-3f3a-4da2-97b5-6988dece6be2:v1:172.21.15.12:0/2496375865] 2024-09-11T23:06:15.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.711+0000 7f2b4e532640 1 Processor -- start 2024-09-11T23:06:15.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.711+0000 7f2b4e532640 1 -- start start 2024-09-11T23:06:15.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.711+0000 7f2b4e532640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2b4809c0f0 0x7f2b4809c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:15.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.711+0000 7f2b4e532640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b4809f260 con 0x7f2b4809d9f0 2024-09-11T23:06:15.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.711+0000 7f2b4e532640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f2b48073f60 con 0x7f2b4809c0f0 2024-09-11T23:06:15.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.711+0000 7f2b47fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2b4809c0f0 0x7f2b4809c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:15.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.711+0000 7f2b477fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f2b4809d9f0 0x7f2b48137a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38020/0 (socket says 172.21.15.12:38020) 2024-09-11T23:06:15.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.711+0000 7f2b477fe640 1 -- 172.21.15.12:0/3280119233 learned_addr learned my addr 172.21.15.12:0/3280119233 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:15.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.711+0000 7f2b47fff640 1 -- 172.21.15.12:0/3280119233 >> v1:172.21.15.12:6789/0 conn(0x7f2b4809d9f0 legacy=0x7f2b48137a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:15.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.711+0000 7f2b46ffd640 1 -- 172.21.15.12:0/3280119233 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2012660049 0 0) 0x7f2b4809f260 con 0x7f2b4809d9f0 2024-09-11T23:06:15.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.711+0000 7f2b47fff640 1 -- 172.21.15.12:0/3280119233 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b4809e5b0 con 0x7f2b4809c0f0 2024-09-11T23:06:15.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.715+0000 7f2b47fff640 1 --2- 172.21.15.12:0/3280119233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b4809c0f0 0x7f2b4809c4d0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f2b40009740 tx=0x7f2b4001c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75b7e318205eadee server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:15.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.715+0000 7f2b46ffd640 1 -- 172.21.15.12:0/3280119233 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b400b0070 con 0x7f2b4809c0f0 2024-09-11T23:06:15.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.715+0000 7f2b46ffd640 1 -- 172.21.15.12:0/3280119233 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b400ab530 con 0x7f2b4809c0f0 2024-09-11T23:06:15.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.715+0000 7f2b46ffd640 1 -- 172.21.15.12:0/3280119233 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b400ab830 con 0x7f2b4809c0f0 2024-09-11T23:06:15.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.715+0000 7f2b4e532640 1 -- 172.21.15.12:0/3280119233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b4809c0f0 msgr2=0x7f2b4809c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:15.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.715+0000 7f2b4e532640 1 --2- 172.21.15.12:0/3280119233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b4809c0f0 0x7f2b4809c4d0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f2b40009740 tx=0x7f2b4001c390 comp rx=0 tx=0).stop 2024-09-11T23:06:15.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.715+0000 7f2b4e532640 1 -- 172.21.15.12:0/3280119233 shutdown_connections 2024-09-11T23:06:15.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.715+0000 7f2b4e532640 1 --2- 172.21.15.12:0/3280119233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b4809c0f0 0x7f2b4809c4d0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:15.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.715+0000 7f2b4e532640 1 -- 172.21.15.12:0/3280119233 >> 172.21.15.12:0/3280119233 conn(0x7f2b48071940 msgr2=0x7f2b4809a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:15.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.715+0000 7f2b4e532640 1 -- 172.21.15.12:0/3280119233 shutdown_connections 2024-09-11T23:06:15.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.715+0000 7f2b4e532640 1 -- 172.21.15.12:0/3280119233 wait complete. 2024-09-11T23:06:15.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.719+0000 7f2b4e532640 1 Processor -- start 2024-09-11T23:06:15.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.719+0000 7f2b4e532640 1 -- start start 2024-09-11T23:06:15.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.719+0000 7f2b4e532640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b4809d9f0 0x7f2b480a9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:15.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.719+0000 7f2b4e532640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2b4809e100 con 0x7f2b4809d9f0 2024-09-11T23:06:15.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.719+0000 7f2b47fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b4809d9f0 0x7f2b480a9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:15.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.719+0000 7f2b47fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b4809d9f0 0x7f2b480a9440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34488/0 (socket says 172.21.15.12:34488) 2024-09-11T23:06:15.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.719+0000 7f2b47fff640 1 -- 172.21.15.12:0/3046340317 learned_addr learned my addr 172.21.15.12:0/3046340317 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:15.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.719+0000 7f2b47fff640 1 -- 172.21.15.12:0/3046340317 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b480a8650 con 0x7f2b4809d9f0 2024-09-11T23:06:15.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.719+0000 7f2b47fff640 1 --2- 172.21.15.12:0/3046340317 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b4809d9f0 0x7f2b480a9440 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f2b40019fc0 tx=0x7f2b4001abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:15.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.719+0000 7f2b44ff9640 1 -- 172.21.15.12:0/3046340317 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b400b0040 con 0x7f2b4809d9f0 2024-09-11T23:06:15.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.719+0000 7f2b44ff9640 1 -- 172.21.15.12:0/3046340317 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b400abe40 con 0x7f2b4809d9f0 2024-09-11T23:06:15.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.719+0000 7f2b4e532640 1 -- 172.21.15.12:0/3046340317 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b481211b0 con 0x7f2b4809d9f0 2024-09-11T23:06:15.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.719+0000 7f2b44ff9640 1 -- 172.21.15.12:0/3046340317 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b40004030 con 0x7f2b4809d9f0 2024-09-11T23:06:15.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.719+0000 7f2b4e532640 1 -- 172.21.15.12:0/3046340317 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b480a9170 con 0x7f2b4809d9f0 2024-09-11T23:06:15.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.719+0000 7f2b44ff9640 1 -- 172.21.15.12:0/3046340317 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 31) ==== 43891+0+0 (secure 0 0 0) 0x7f2b400041d0 con 0x7f2b4809d9f0 2024-09-11T23:06:15.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.719+0000 7f2b4e532640 1 -- 172.21.15.12:0/3046340317 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b480a8890 con 0x7f2b4809d9f0 2024-09-11T23:06:15.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.719+0000 7f2b44ff9640 1 --2- 172.21.15.12:0/3046340317 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f2b2c035c00 0x7f2b2c0380c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:15.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.719+0000 7f2b44ff9640 1 -- 172.21.15.12:0/3046340317 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 3646+0+0 (secure 0 0 0) 0x7f2b400e3190 con 0x7f2b4809d9f0 2024-09-11T23:06:15.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.719+0000 7f2b477fe640 1 --2- 172.21.15.12:0/3046340317 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f2b2c035c00 0x7f2b2c0380c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:15.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.719+0000 7f2b477fe640 1 --2- 172.21.15.12:0/3046340317 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f2b2c035c00 0x7f2b2c0380c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2b38000f90 tx=0x7f2b380016c0 comp rx=0 tx=0).ready entity=mgr.4903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:15.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.727+0000 7f2b44ff9640 1 -- 172.21.15.12:0/3046340317 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2b40016010 con 0x7f2b4809d9f0 2024-09-11T23:06:15.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:15.903+0000 7f2b4e532640 1 -- 172.21.15.12:0/3046340317 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f2b4809c4d0 con 0x7f2b4809d9f0 2024-09-11T23:06:16.347 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:16.343+0000 7f02a2c51640 -1 client.4935: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.4890:b65aeaeb-3f3a-4da2-97b5-6988dece6be2:v1:172.21.15.12:0/2496375865] 2024-09-11T23:06:16.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.543+0000 7f2b44ff9640 1 -- 172.21.15.12:0/3046340317 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v59) ==== 169+0+0 (secure 0 0 0) 0x7f2b400c0400 con 0x7f2b4809d9f0 2024-09-11T23:06:16.546 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' removed 2024-09-11T23:06:16.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.547+0000 7f2b4e532640 1 -- 172.21.15.12:0/3046340317 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f2b2c035c00 msgr2=0x7f2b2c0380c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:16.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.547+0000 7f2b4e532640 1 --2- 172.21.15.12:0/3046340317 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f2b2c035c00 0x7f2b2c0380c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2b38000f90 tx=0x7f2b380016c0 comp rx=0 tx=0).stop 2024-09-11T23:06:16.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.547+0000 7f2b4e532640 1 -- 172.21.15.12:0/3046340317 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b4809d9f0 msgr2=0x7f2b480a9440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:16.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.547+0000 7f2b4e532640 1 --2- 172.21.15.12:0/3046340317 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b4809d9f0 0x7f2b480a9440 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f2b40019fc0 tx=0x7f2b4001abd0 comp rx=0 tx=0).stop 2024-09-11T23:06:16.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.547+0000 7f2b4e532640 1 -- 172.21.15.12:0/3046340317 shutdown_connections 2024-09-11T23:06:16.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.547+0000 7f2b4e532640 1 --2- 172.21.15.12:0/3046340317 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f2b2c035c00 0x7f2b2c0380c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:16.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.547+0000 7f2b4e532640 1 --2- 172.21.15.12:0/3046340317 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b4809d9f0 0x7f2b480a9440 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:16.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.547+0000 7f2b4e532640 1 -- 172.21.15.12:0/3046340317 >> 172.21.15.12:0/3046340317 conn(0x7f2b48071940 msgr2=0x7f2b481372a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:16.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.547+0000 7f2b4e532640 1 -- 172.21.15.12:0/3046340317 shutdown_connections 2024-09-11T23:06:16.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.547+0000 7f2b4e532640 1 -- 172.21.15.12:0/3046340317 wait complete. 2024-09-11T23:06:16.583 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-11T23:06:16.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.755+0000 7f4880a92640 1 Processor -- start 2024-09-11T23:06:16.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.755+0000 7f4880a92640 1 -- start start 2024-09-11T23:06:16.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.759+0000 7f4880a92640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f487c0a2db0 0x7f487c13ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:16.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.759+0000 7f4880a92640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f487c06e440 con 0x7f487c136e00 2024-09-11T23:06:16.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.759+0000 7f4880a92640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f487c0a10d0 con 0x7f487c0a2db0 2024-09-11T23:06:16.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.759+0000 7f4879d9b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f487c0a2db0 0x7f487c13ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:16.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.759+0000 7f487a59c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f487c136e00 0x7f487c1371e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38022/0 (socket says 172.21.15.12:38022) 2024-09-11T23:06:16.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.759+0000 7f487a59c640 1 -- 172.21.15.12:0/3666570119 learned_addr learned my addr 172.21.15.12:0/3666570119 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:16.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.759+0000 7f4879d9b640 1 -- 172.21.15.12:0/3666570119 >> v1:172.21.15.12:6789/0 conn(0x7f487c136e00 legacy=0x7f487c1371e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:16.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.759+0000 7f4879d9b640 1 -- 172.21.15.12:0/3666570119 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f487c0a23b0 con 0x7f487c0a2db0 2024-09-11T23:06:16.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.759+0000 7f4879d9b640 1 --2- 172.21.15.12:0/3666570119 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f487c0a2db0 0x7f487c13ef50 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f4870009740 tx=0x7f487001c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bacb6bec970a464e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:16.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.759+0000 7f487959a640 1 -- 172.21.15.12:0/3666570119 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48700b0070 con 0x7f487c0a2db0 2024-09-11T23:06:16.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.759+0000 7f487959a640 1 -- 172.21.15.12:0/3666570119 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48700ab530 con 0x7f487c0a2db0 2024-09-11T23:06:16.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.759+0000 7f487959a640 1 -- 172.21.15.12:0/3666570119 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48700ab830 con 0x7f487c0a2db0 2024-09-11T23:06:16.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.759+0000 7f4880a92640 1 -- 172.21.15.12:0/3666570119 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f487c0a2db0 msgr2=0x7f487c13ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:16.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.759+0000 7f4880a92640 1 --2- 172.21.15.12:0/3666570119 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f487c0a2db0 0x7f487c13ef50 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f4870009740 tx=0x7f487001c390 comp rx=0 tx=0).stop 2024-09-11T23:06:16.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.759+0000 7f4880a92640 1 -- 172.21.15.12:0/3666570119 shutdown_connections 2024-09-11T23:06:16.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.759+0000 7f4880a92640 1 --2- 172.21.15.12:0/3666570119 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f487c0a2db0 0x7f487c13ef50 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:16.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.759+0000 7f4880a92640 1 -- 172.21.15.12:0/3666570119 >> 172.21.15.12:0/3666570119 conn(0x7f487c070ba0 msgr2=0x7f487c072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:16.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.759+0000 7f4880a92640 1 -- 172.21.15.12:0/3666570119 shutdown_connections 2024-09-11T23:06:16.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.759+0000 7f4880a92640 1 -- 172.21.15.12:0/3666570119 wait complete. 2024-09-11T23:06:16.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.763+0000 7f4880a92640 1 Processor -- start 2024-09-11T23:06:16.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.763+0000 7f4880a92640 1 -- start start 2024-09-11T23:06:16.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.763+0000 7f4880a92640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f487c0a2db0 0x7f487c0a59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:16.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.763+0000 7f4880a92640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f487c0a1de0 con 0x7f487c0a2db0 2024-09-11T23:06:16.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.763+0000 7f487a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f487c0a2db0 0x7f487c0a59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:16.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.763+0000 7f487a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f487c0a2db0 0x7f487c0a59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34506/0 (socket says 172.21.15.12:34506) 2024-09-11T23:06:16.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.763+0000 7f487a59c640 1 -- 172.21.15.12:0/3305410728 learned_addr learned my addr 172.21.15.12:0/3305410728 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:16.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.763+0000 7f487a59c640 1 -- 172.21.15.12:0/3305410728 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f487c0a7cb0 con 0x7f487c0a2db0 2024-09-11T23:06:16.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.763+0000 7f487a59c640 1 --2- 172.21.15.12:0/3305410728 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f487c0a2db0 0x7f487c0a59d0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f486c00c480 tx=0x7f486c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:16.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.763+0000 7f486affd640 1 -- 172.21.15.12:0/3305410728 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f486c017070 con 0x7f487c0a2db0 2024-09-11T23:06:16.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.763+0000 7f486affd640 1 -- 172.21.15.12:0/3305410728 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f486c005c20 con 0x7f487c0a2db0 2024-09-11T23:06:16.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.763+0000 7f4880a92640 1 -- 172.21.15.12:0/3305410728 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f487c0a93b0 con 0x7f487c0a2db0 2024-09-11T23:06:16.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.763+0000 7f486affd640 1 -- 172.21.15.12:0/3305410728 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f486c007070 con 0x7f487c0a2db0 2024-09-11T23:06:16.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.763+0000 7f4880a92640 1 -- 172.21.15.12:0/3305410728 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f487c0a80c0 con 0x7f487c0a2db0 2024-09-11T23:06:16.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.763+0000 7f486affd640 1 -- 172.21.15.12:0/3305410728 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 32) ==== 43997+0+0 (secure 0 0 0) 0x7f486c01a070 con 0x7f487c0a2db0 2024-09-11T23:06:16.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.763+0000 7f4880a92640 1 -- 172.21.15.12:0/3305410728 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f487c0008e0 con 0x7f487c0a2db0 2024-09-11T23:06:16.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.763+0000 7f486affd640 1 --2- 172.21.15.12:0/3305410728 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f485c035d20 0x7f485c0381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:16.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.763+0000 7f486affd640 1 -- 172.21.15.12:0/3305410728 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 3232+0+0 (secure 0 0 0) 0x7f486c047720 con 0x7f487c0a2db0 2024-09-11T23:06:16.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.763+0000 7f4879d9b640 1 --2- 172.21.15.12:0/3305410728 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f485c035d20 0x7f485c0381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:16.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.767+0000 7f4879d9b640 1 --2- 172.21.15.12:0/3305410728 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f485c035d20 0x7f485c0381e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f48700ad000 tx=0x7f48700a6000 comp rx=0 tx=0).ready entity=mgr.4903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:16.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.771+0000 7f486affd640 1 -- 172.21.15.12:0/3305410728 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f486c007210 con 0x7f487c0a2db0 2024-09-11T23:06:16.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.943+0000 7f4880a92640 1 -- 172.21.15.12:0/3305410728 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f487c0a90a0 con 0x7f487c0a2db0 2024-09-11T23:06:16.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.947+0000 7f486affd640 1 -- 172.21.15.12:0/3305410728 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7f486c012450 con 0x7f487c0a2db0 2024-09-11T23:06:16.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.951+0000 7f4880a92640 1 -- 172.21.15.12:0/3305410728 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f485c035d20 msgr2=0x7f485c0381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:16.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.951+0000 7f4880a92640 1 --2- 172.21.15.12:0/3305410728 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f485c035d20 0x7f485c0381e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f48700ad000 tx=0x7f48700a6000 comp rx=0 tx=0).stop 2024-09-11T23:06:16.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.951+0000 7f4880a92640 1 -- 172.21.15.12:0/3305410728 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f487c0a2db0 msgr2=0x7f487c0a59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:16.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.951+0000 7f4880a92640 1 --2- 172.21.15.12:0/3305410728 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f487c0a2db0 0x7f487c0a59d0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f486c00c480 tx=0x7f486c00c940 comp rx=0 tx=0).stop 2024-09-11T23:06:16.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.951+0000 7f4880a92640 1 -- 172.21.15.12:0/3305410728 shutdown_connections 2024-09-11T23:06:16.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.951+0000 7f4880a92640 1 --2- 172.21.15.12:0/3305410728 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f485c035d20 0x7f485c0381e0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:16.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.951+0000 7f4880a92640 1 --2- 172.21.15.12:0/3305410728 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f487c0a2db0 0x7f487c0a59d0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:16.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.951+0000 7f4880a92640 1 -- 172.21.15.12:0/3305410728 >> 172.21.15.12:0/3305410728 conn(0x7f487c070ba0 msgr2=0x7f487c071a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:16.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.951+0000 7f4880a92640 1 -- 172.21.15.12:0/3305410728 shutdown_connections 2024-09-11T23:06:16.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:16.951+0000 7f4880a92640 1 -- 172.21.15.12:0/3305410728 wait complete. 2024-09-11T23:06:16.975 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_fstop.TestFSTop.test_fstop' 2024-09-11T23:06:17.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.091+0000 7f4c38540640 1 Processor -- start 2024-09-11T23:06:17.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.091+0000 7f4c38540640 1 -- start start 2024-09-11T23:06:17.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.091+0000 7f4c38540640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4c30136ca0 0x7f4c3009ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:17.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.091+0000 7f4c38540640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c300a1ff0 con 0x7f4c30137080 2024-09-11T23:06:17.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.091+0000 7f4c38540640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f4c300a12e0 con 0x7f4c30136ca0 2024-09-11T23:06:17.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.091+0000 7f4c362dc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4c30136ca0 0x7f4c3009ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:17.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.091+0000 7f4c35adb640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f4c30137080 0x7f4c300a36a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38024/0 (socket says 172.21.15.12:38024) 2024-09-11T23:06:17.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.091+0000 7f4c35adb640 1 -- 172.21.15.12:0/288038698 learned_addr learned my addr 172.21.15.12:0/288038698 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:17.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.091+0000 7f4c362dc640 1 -- 172.21.15.12:0/288038698 >> v1:172.21.15.12:6789/0 conn(0x7f4c30137080 legacy=0x7f4c300a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:17.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.091+0000 7f4c362dc640 1 -- 172.21.15.12:0/288038698 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c300a0eb0 con 0x7f4c30136ca0 2024-09-11T23:06:17.096 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:17.091+0000 7f02a2c51640 -1 client.4935: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.4890:b65aeaeb-3f3a-4da2-97b5-6988dece6be2:v1:172.21.15.12:0/2496375865] 2024-09-11T23:06:17.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.095+0000 7f4c362dc640 1 --2- 172.21.15.12:0/288038698 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c30136ca0 0x7f4c3009ad90 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c009740 tx=0x7f4c2c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fb7df29425cb7d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:17.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.095+0000 7f4c352da640 1 -- 172.21.15.12:0/288038698 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c2c0b0070 con 0x7f4c30136ca0 2024-09-11T23:06:17.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.095+0000 7f4c352da640 1 -- 172.21.15.12:0/288038698 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c2c0ab400 con 0x7f4c30136ca0 2024-09-11T23:06:17.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.095+0000 7f4c352da640 1 -- 172.21.15.12:0/288038698 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c2c0ab700 con 0x7f4c30136ca0 2024-09-11T23:06:17.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.095+0000 7f4c38540640 1 -- 172.21.15.12:0/288038698 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c30136ca0 msgr2=0x7f4c3009ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:17.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.095+0000 7f4c38540640 1 --2- 172.21.15.12:0/288038698 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c30136ca0 0x7f4c3009ad90 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c009740 tx=0x7f4c2c01c420 comp rx=0 tx=0).stop 2024-09-11T23:06:17.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.095+0000 7f4c38540640 1 -- 172.21.15.12:0/288038698 shutdown_connections 2024-09-11T23:06:17.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.095+0000 7f4c38540640 1 --2- 172.21.15.12:0/288038698 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c30136ca0 0x7f4c3009ad90 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:17.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.095+0000 7f4c38540640 1 -- 172.21.15.12:0/288038698 >> 172.21.15.12:0/288038698 conn(0x7f4c300a8450 msgr2=0x7f4c300a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:17.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.095+0000 7f4c38540640 1 -- 172.21.15.12:0/288038698 shutdown_connections 2024-09-11T23:06:17.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.095+0000 7f4c38540640 1 -- 172.21.15.12:0/288038698 wait complete. 2024-09-11T23:06:17.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.095+0000 7f4c38540640 1 Processor -- start 2024-09-11T23:06:17.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.095+0000 7f4c38540640 1 -- start start 2024-09-11T23:06:17.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.099+0000 7f4c38540640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c30136ca0 0x7f4c3006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:17.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.099+0000 7f4c38540640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4c3013ed10 con 0x7f4c30136ca0 2024-09-11T23:06:17.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.099+0000 7f4c362dc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c30136ca0 0x7f4c3006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:17.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.099+0000 7f4c362dc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c30136ca0 0x7f4c3006fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34524/0 (socket says 172.21.15.12:34524) 2024-09-11T23:06:17.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.099+0000 7f4c362dc640 1 -- 172.21.15.12:0/921058459 learned_addr learned my addr 172.21.15.12:0/921058459 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:17.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.099+0000 7f4c362dc640 1 -- 172.21.15.12:0/921058459 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c300718c0 con 0x7f4c30136ca0 2024-09-11T23:06:17.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.099+0000 7f4c362dc640 1 --2- 172.21.15.12:0/921058459 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c30136ca0 0x7f4c3006fd50 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c0ae040 tx=0x7f4c2c0191c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:17.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.099+0000 7f4c26ffd640 1 -- 172.21.15.12:0/921058459 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c2c0b8070 con 0x7f4c30136ca0 2024-09-11T23:06:17.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.099+0000 7f4c26ffd640 1 -- 172.21.15.12:0/921058459 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c2c0abe40 con 0x7f4c30136ca0 2024-09-11T23:06:17.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.099+0000 7f4c38540640 1 -- 172.21.15.12:0/921058459 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c30134150 con 0x7f4c30136ca0 2024-09-11T23:06:17.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.099+0000 7f4c26ffd640 1 -- 172.21.15.12:0/921058459 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c2c0b0040 con 0x7f4c30136ca0 2024-09-11T23:06:17.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.099+0000 7f4c38540640 1 -- 172.21.15.12:0/921058459 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c30071ba0 con 0x7f4c30136ca0 2024-09-11T23:06:17.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.099+0000 7f4c38540640 1 -- 172.21.15.12:0/921058459 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c3011e2e0 con 0x7f4c30136ca0 2024-09-11T23:06:17.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.099+0000 7f4c26ffd640 1 -- 172.21.15.12:0/921058459 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 32) ==== 43997+0+0 (secure 0 0 0) 0x7f4c2c0bb070 con 0x7f4c30136ca0 2024-09-11T23:06:17.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.099+0000 7f4c26ffd640 1 --2- 172.21.15.12:0/921058459 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f4c14035d20 0x7f4c140381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:17.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.099+0000 7f4c26ffd640 1 -- 172.21.15.12:0/921058459 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 3232+0+0 (secure 0 0 0) 0x7f4c2c0e22b0 con 0x7f4c30136ca0 2024-09-11T23:06:17.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.099+0000 7f4c35adb640 1 --2- 172.21.15.12:0/921058459 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f4c14035d20 0x7f4c140381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:17.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.099+0000 7f4c35adb640 1 --2- 172.21.15.12:0/921058459 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f4c14035d20 0x7f4c140381e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4c20000f70 tx=0x7f4c20007a90 comp rx=0 tx=0).ready entity=mgr.4903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:17.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.103+0000 7f4c26ffd640 1 -- 172.21.15.12:0/921058459 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4c2c016010 con 0x7f4c30136ca0 2024-09-11T23:06:17.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.347+0000 7f4c38540640 1 -- 172.21.15.12:0/921058459 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_fstop.TestFSTop.test_fstop"]} v 0) -- 0x7f4c3009ad90 con 0x7f4c30136ca0 2024-09-11T23:06:17.895 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:17.891+0000 7f02a2c51640 -1 client.4935: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.4890:b65aeaeb-3f3a-4da2-97b5-6988dece6be2:v1:172.21.15.12:0/2496375865] 2024-09-11T23:06:17.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.931+0000 7f4c26ffd640 1 -- 172.21.15.12:0/921058459 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_fstop.TestFSTop.test_fstop"]}]=0 v166) ==== 123+0+0 (secure 0 0 0) 0x7f4c2c0b3e20 con 0x7f4c30136ca0 2024-09-11T23:06:17.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.935+0000 7f4c38540640 1 -- 172.21.15.12:0/921058459 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f4c14035d20 msgr2=0x7f4c140381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:17.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.935+0000 7f4c38540640 1 --2- 172.21.15.12:0/921058459 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f4c14035d20 0x7f4c140381e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4c20000f70 tx=0x7f4c20007a90 comp rx=0 tx=0).stop 2024-09-11T23:06:17.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.935+0000 7f4c38540640 1 -- 172.21.15.12:0/921058459 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c30136ca0 msgr2=0x7f4c3006fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:17.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.935+0000 7f4c38540640 1 --2- 172.21.15.12:0/921058459 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c30136ca0 0x7f4c3006fd50 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c0ae040 tx=0x7f4c2c0191c0 comp rx=0 tx=0).stop 2024-09-11T23:06:17.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.935+0000 7f4c38540640 1 -- 172.21.15.12:0/921058459 shutdown_connections 2024-09-11T23:06:17.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.935+0000 7f4c38540640 1 --2- 172.21.15.12:0/921058459 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f4c14035d20 0x7f4c140381e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:17.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.935+0000 7f4c38540640 1 --2- 172.21.15.12:0/921058459 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c30136ca0 0x7f4c3006fd50 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:17.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.935+0000 7f4c38540640 1 -- 172.21.15.12:0/921058459 >> 172.21.15.12:0/921058459 conn(0x7f4c300a8450 msgr2=0x7f4c300a74b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:17.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.935+0000 7f4c38540640 1 -- 172.21.15.12:0/921058459 shutdown_connections 2024-09-11T23:06:17.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:17.935+0000 7f4c38540640 1 -- 172.21.15.12:0/921058459 wait complete. 2024-09-11T23:06:17.961 INFO:tasks.cephfs_test_runner:test_fstop (tasks.cephfs.test_fstop.TestFSTop) ... ok 2024-09-11T23:06:17.961 INFO:tasks.cephfs_test_runner:Starting test: test_fstop_non_existent_cluster (tasks.cephfs.test_fstop.TestFSTop) 2024-09-11T23:06:17.961 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:06:18.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.087+0000 7f0d65fcb640 1 Processor -- start 2024-09-11T23:06:18.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.087+0000 7f0d65fcb640 1 -- start start 2024-09-11T23:06:18.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.087+0000 7f0d65fcb640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0d600a4b80 0x7f0d600a7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:18.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.087+0000 7f0d65fcb640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d600a82a0 con 0x7f0d6013a410 2024-09-11T23:06:18.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.087+0000 7f0d65fcb640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f0d600a3cb0 con 0x7f0d600a4b80 2024-09-11T23:06:18.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.087+0000 7f0d5effd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0d600a4b80 0x7f0d600a7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:18.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.087+0000 7f0d5f7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f0d6013a410 0x7f0d600a6af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38030/0 (socket says 172.21.15.12:38030) 2024-09-11T23:06:18.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.087+0000 7f0d5f7fe640 1 -- 172.21.15.12:0/268745511 learned_addr learned my addr 172.21.15.12:0/268745511 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:18.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.087+0000 7f0d5effd640 1 -- 172.21.15.12:0/268745511 >> v1:172.21.15.12:6789/0 conn(0x7f0d6013a410 legacy=0x7f0d600a6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:18.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.087+0000 7f0d5effd640 1 -- 172.21.15.12:0/268745511 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d60139fe0 con 0x7f0d600a4b80 2024-09-11T23:06:18.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.091+0000 7f0d5effd640 1 --2- 172.21.15.12:0/268745511 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d600a4b80 0x7f0d600a7200 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f0d54009740 tx=0x7f0d5401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e05a55af93f94b7f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:18.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.091+0000 7f0d5e7fc640 1 -- 172.21.15.12:0/268745511 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d540b0070 con 0x7f0d600a4b80 2024-09-11T23:06:18.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.091+0000 7f0d5e7fc640 1 -- 172.21.15.12:0/268745511 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d540ab530 con 0x7f0d600a4b80 2024-09-11T23:06:18.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.091+0000 7f0d5e7fc640 1 -- 172.21.15.12:0/268745511 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d540ab830 con 0x7f0d600a4b80 2024-09-11T23:06:18.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.091+0000 7f0d65fcb640 1 -- 172.21.15.12:0/268745511 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d600a4b80 msgr2=0x7f0d600a7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:18.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.091+0000 7f0d65fcb640 1 --2- 172.21.15.12:0/268745511 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d600a4b80 0x7f0d600a7200 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f0d54009740 tx=0x7f0d5401c390 comp rx=0 tx=0).stop 2024-09-11T23:06:18.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.091+0000 7f0d65fcb640 1 -- 172.21.15.12:0/268745511 shutdown_connections 2024-09-11T23:06:18.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.091+0000 7f0d65fcb640 1 --2- 172.21.15.12:0/268745511 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d600a4b80 0x7f0d600a7200 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:18.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.091+0000 7f0d65fcb640 1 -- 172.21.15.12:0/268745511 >> 172.21.15.12:0/268745511 conn(0x7f0d600ac2c0 msgr2=0x7f0d600ac6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:18.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.091+0000 7f0d65fcb640 1 -- 172.21.15.12:0/268745511 shutdown_connections 2024-09-11T23:06:18.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.091+0000 7f0d65fcb640 1 -- 172.21.15.12:0/268745511 wait complete. 2024-09-11T23:06:18.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.091+0000 7f0d65fcb640 1 Processor -- start 2024-09-11T23:06:18.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.091+0000 7f0d65fcb640 1 -- start start 2024-09-11T23:06:18.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.091+0000 7f0d65fcb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d600a4b80 0x7f0d600a0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:18.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.091+0000 7f0d65fcb640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0d600a7740 con 0x7f0d600a4b80 2024-09-11T23:06:18.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.091+0000 7f0d5f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d600a4b80 0x7f0d600a0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:18.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.091+0000 7f0d5f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d600a4b80 0x7f0d600a0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34542/0 (socket says 172.21.15.12:34542) 2024-09-11T23:06:18.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.091+0000 7f0d5f7fe640 1 -- 172.21.15.12:0/1823534315 learned_addr learned my addr 172.21.15.12:0/1823534315 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:18.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.091+0000 7f0d5f7fe640 1 -- 172.21.15.12:0/1823534315 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d600a1710 con 0x7f0d600a4b80 2024-09-11T23:06:18.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.091+0000 7f0d5f7fe640 1 --2- 172.21.15.12:0/1823534315 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d600a4b80 0x7f0d600a0fd0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f0d5000c480 tx=0x7f0d5000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:18.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.091+0000 7f0d47fff640 1 -- 172.21.15.12:0/1823534315 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d50017070 con 0x7f0d600a4b80 2024-09-11T23:06:18.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.091+0000 7f0d47fff640 1 -- 172.21.15.12:0/1823534315 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d50005c20 con 0x7f0d600a4b80 2024-09-11T23:06:18.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.091+0000 7f0d65fcb640 1 -- 172.21.15.12:0/1823534315 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d600a1a30 con 0x7f0d600a4b80 2024-09-11T23:06:18.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.091+0000 7f0d47fff640 1 -- 172.21.15.12:0/1823534315 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d50007070 con 0x7f0d600a4b80 2024-09-11T23:06:18.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.091+0000 7f0d65fcb640 1 -- 172.21.15.12:0/1823534315 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d6009f590 con 0x7f0d600a4b80 2024-09-11T23:06:18.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.095+0000 7f0d47fff640 1 -- 172.21.15.12:0/1823534315 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 32) ==== 43997+0+0 (secure 0 0 0) 0x7f0d5001a070 con 0x7f0d600a4b80 2024-09-11T23:06:18.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.095+0000 7f0d65fcb640 1 -- 172.21.15.12:0/1823534315 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d600a1510 con 0x7f0d600a4b80 2024-09-11T23:06:18.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.095+0000 7f0d47fff640 1 --2- 172.21.15.12:0/1823534315 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f0d4c035d20 0x7f0d4c0381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:18.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.095+0000 7f0d47fff640 1 -- 172.21.15.12:0/1823534315 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 3232+0+0 (secure 0 0 0) 0x7f0d500477e0 con 0x7f0d600a4b80 2024-09-11T23:06:18.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.095+0000 7f0d5effd640 1 --2- 172.21.15.12:0/1823534315 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f0d4c035d20 0x7f0d4c0381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:18.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.095+0000 7f0d5effd640 1 --2- 172.21.15.12:0/1823534315 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f0d4c035d20 0x7f0d4c0381e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0d540ad000 tx=0x7f0d54008040 comp rx=0 tx=0).ready entity=mgr.4903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:18.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.099+0000 7f0d47fff640 1 -- 172.21.15.12:0/1823534315 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0d50007210 con 0x7f0d600a4b80 2024-09-11T23:06:18.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.275+0000 7f0d65fcb640 1 -- 172.21.15.12:0/1823534315 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0d6009ecb0 con 0x7f0d600a4b80 2024-09-11T23:06:18.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.275+0000 7f0d47fff640 1 -- 172.21.15.12:0/1823534315 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) ==== 74+0+7736 (secure 0 0 0) 0x7f0d50012450 con 0x7f0d600a4b80 2024-09-11T23:06:18.279 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:06:18.279 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":59,"fsid":"8be14356-3340-4500-91a2-4cbc6b511f65","created":"2024-09-11T23:03:10.620234+0000","modified":"2024-09-11T23:06:16.542975+0000","last_up_change":"2024-09-11T23:03:22.359028+0000","last_in_change":"2024-09-11T23:03:11.545817+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:03:23.587068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"153b72a1-40b1-400d-93ea-333e733f9bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6817","nonce":3680911937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6819","nonce":3680911937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6823","nonce":3680911937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6821","nonce":3680911937}]},"public_addr":"172.21.15.12:6817/3680911937","cluster_addr":"172.21.15.12:6819/3680911937","heartbeat_back_addr":"172.21.15.12:6823/3680911937","heartbeat_front_addr":"172.21.15.12:6821/3680911937","state":["exists","up"]},{"osd":1,"uuid":"94669e49-ee4f-4acf-9e25-e94374dda8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6801","nonce":236825163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6803","nonce":236825163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6807","nonce":236825163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6805","nonce":236825163}]},"public_addr":"172.21.15.12:6801/236825163","cluster_addr":"172.21.15.12:6803/236825163","heartbeat_back_addr":"172.21.15.12:6807/236825163","heartbeat_front_addr":"172.21.15.12:6805/236825163","state":["exists","up"]},{"osd":2,"uuid":"826dae4d-8888-4ec5-8f00-425b3be93814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6809","nonce":3263521655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6811","nonce":3263521655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6815","nonce":3263521655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6813","nonce":3263521655}]},"public_addr":"172.21.15.12:6809/3263521655","cluster_addr":"172.21.15.12:6811/3263521655","heartbeat_back_addr":"172.21.15.12:6815/3263521655","heartbeat_front_addr":"172.21.15.12:6813/3263521655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:19.398518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.761524+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.904997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:6824/378652896":"2024-09-12T23:06:13.528630+0000","172.21.15.12:0/485788875":"2024-09-12T23:06:13.528630+0000","172.21.15.12:0/1634088323":"2024-09-12T23:06:13.528630+0000","172.21.15.12:0/864838529":"2024-09-12T23:06:13.528630+0000","172.21.15.12:0/2457801507":"2024-09-12T23:06:13.528630+0000","172.21.15.12:6828/2605601020":"2024-09-12T23:06:13.474101+0000","172.21.15.12:0/1044732542":"2024-09-12T23:06:07.866565+0000","172.21.15.12:0/1734477438":"2024-09-12T23:06:07.866565+0000","172.21.15.12:0/462043258":"2024-09-12T23:06:07.866565+0000","172.21.15.12:0/2496375865":"2024-09-12T23:06:13.528630+0000","172.21.15.12:6829/2605601020":"2024-09-12T23:06:13.474101+0000","172.21.15.12:0/3818284364":"2024-09-12T23:06:07.866565+0000","172.21.15.12:6825/378652896":"2024-09-12T23:06:13.528630+0000","172.21.15.12:6825/1925124150":"2024-09-12T23:06:07.866565+0000","172.21.15.12:6824/1925124150":"2024-09-12T23:06:07.866565+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:06:18.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.279+0000 7f0d65fcb640 1 -- 172.21.15.12:0/1823534315 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f0d4c035d20 msgr2=0x7f0d4c0381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:18.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.279+0000 7f0d65fcb640 1 --2- 172.21.15.12:0/1823534315 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f0d4c035d20 0x7f0d4c0381e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0d540ad000 tx=0x7f0d54008040 comp rx=0 tx=0).stop 2024-09-11T23:06:18.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.279+0000 7f0d65fcb640 1 -- 172.21.15.12:0/1823534315 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d600a4b80 msgr2=0x7f0d600a0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:18.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.279+0000 7f0d65fcb640 1 --2- 172.21.15.12:0/1823534315 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d600a4b80 0x7f0d600a0fd0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f0d5000c480 tx=0x7f0d5000c940 comp rx=0 tx=0).stop 2024-09-11T23:06:18.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.279+0000 7f0d65fcb640 1 -- 172.21.15.12:0/1823534315 shutdown_connections 2024-09-11T23:06:18.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.279+0000 7f0d65fcb640 1 --2- 172.21.15.12:0/1823534315 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f0d4c035d20 0x7f0d4c0381e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:18.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.279+0000 7f0d65fcb640 1 --2- 172.21.15.12:0/1823534315 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d600a4b80 0x7f0d600a0fd0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:18.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.279+0000 7f0d65fcb640 1 -- 172.21.15.12:0/1823534315 >> 172.21.15.12:0/1823534315 conn(0x7f0d600ac2c0 msgr2=0x7f0d600aa560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:18.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.279+0000 7f0d65fcb640 1 -- 172.21.15.12:0/1823534315 shutdown_connections 2024-09-11T23:06:18.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.279+0000 7f0d65fcb640 1 -- 172.21.15.12:0/1823534315 wait complete. 2024-09-11T23:06:18.298 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T23:03:23.587068+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T23:06:18.299 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-11T23:06:18.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.423+0000 7f001c6ff640 1 Processor -- start 2024-09-11T23:06:18.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.423+0000 7f001c6ff640 1 -- start start 2024-09-11T23:06:18.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.423+0000 7f001c6ff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f001413a200 0x7f001413a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:18.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.423+0000 7f001c6ff640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00140a1c00 con 0x7f001409fc40 2024-09-11T23:06:18.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.423+0000 7f001c6ff640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f00140a0e40 con 0x7f001413a200 2024-09-11T23:06:18.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.423+0000 7f001a49b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f001413a200 0x7f001413a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:18.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.423+0000 7f0019c9a640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f001409fc40 0x7f001409d9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38042/0 (socket says 172.21.15.12:38042) 2024-09-11T23:06:18.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.423+0000 7f0019c9a640 1 -- 172.21.15.12:0/3770323451 learned_addr learned my addr 172.21.15.12:0/3770323451 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:18.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.423+0000 7f001a49b640 1 -- 172.21.15.12:0/3770323451 >> v1:172.21.15.12:6789/0 conn(0x7f001409fc40 legacy=0x7f001409d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:18.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.423+0000 7f001a49b640 1 -- 172.21.15.12:0/3770323451 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f001413ab20 con 0x7f001413a200 2024-09-11T23:06:18.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.427+0000 7f001a49b640 1 --2- 172.21.15.12:0/3770323451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f001413a200 0x7f001413a5e0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f0010009740 tx=0x7f001001c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc7f4a149fb6f79d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:18.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.427+0000 7f0019499640 1 -- 172.21.15.12:0/3770323451 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00100b0070 con 0x7f001413a200 2024-09-11T23:06:18.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.427+0000 7f0019499640 1 -- 172.21.15.12:0/3770323451 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00100ab530 con 0x7f001413a200 2024-09-11T23:06:18.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.427+0000 7f0019499640 1 -- 172.21.15.12:0/3770323451 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00100ab830 con 0x7f001413a200 2024-09-11T23:06:18.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.427+0000 7f001c6ff640 1 -- 172.21.15.12:0/3770323451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f001413a200 msgr2=0x7f001413a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:18.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.427+0000 7f001c6ff640 1 --2- 172.21.15.12:0/3770323451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f001413a200 0x7f001413a5e0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f0010009740 tx=0x7f001001c390 comp rx=0 tx=0).stop 2024-09-11T23:06:18.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.427+0000 7f001c6ff640 1 -- 172.21.15.12:0/3770323451 shutdown_connections 2024-09-11T23:06:18.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.427+0000 7f001c6ff640 1 --2- 172.21.15.12:0/3770323451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f001413a200 0x7f001413a5e0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:18.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.427+0000 7f001c6ff640 1 -- 172.21.15.12:0/3770323451 >> 172.21.15.12:0/3770323451 conn(0x7f001406da30 msgr2=0x7f001406de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:18.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.427+0000 7f001c6ff640 1 -- 172.21.15.12:0/3770323451 shutdown_connections 2024-09-11T23:06:18.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.427+0000 7f001c6ff640 1 -- 172.21.15.12:0/3770323451 wait complete. 2024-09-11T23:06:18.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.427+0000 7f001c6ff640 1 Processor -- start 2024-09-11T23:06:18.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.427+0000 7f001c6ff640 1 -- start start 2024-09-11T23:06:18.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.427+0000 7f001c6ff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f001413a200 0x7f00140a55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:18.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.427+0000 7f001c6ff640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f00140a17c0 con 0x7f001413a200 2024-09-11T23:06:18.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.427+0000 7f001a49b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f001413a200 0x7f00140a55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:18.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.427+0000 7f001a49b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f001413a200 0x7f00140a55f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34566/0 (socket says 172.21.15.12:34566) 2024-09-11T23:06:18.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.427+0000 7f001a49b640 1 -- 172.21.15.12:0/1895496666 learned_addr learned my addr 172.21.15.12:0/1895496666 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:18.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.427+0000 7f001a49b640 1 -- 172.21.15.12:0/1895496666 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00141d1a50 con 0x7f001413a200 2024-09-11T23:06:18.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.431+0000 7f001a49b640 1 --2- 172.21.15.12:0/1895496666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f001413a200 0x7f00140a55f0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f0010019fc0 tx=0x7f001001abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:18.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.431+0000 7f000affd640 1 -- 172.21.15.12:0/1895496666 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00100b0050 con 0x7f001413a200 2024-09-11T23:06:18.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.431+0000 7f000affd640 1 -- 172.21.15.12:0/1895496666 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00100b1040 con 0x7f001413a200 2024-09-11T23:06:18.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.431+0000 7f000affd640 1 -- 172.21.15.12:0/1895496666 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00100b5740 con 0x7f001413a200 2024-09-11T23:06:18.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.431+0000 7f001c6ff640 1 -- 172.21.15.12:0/1895496666 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00140a6670 con 0x7f001413a200 2024-09-11T23:06:18.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.431+0000 7f001c6ff640 1 -- 172.21.15.12:0/1895496666 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00140a6360 con 0x7f001413a200 2024-09-11T23:06:18.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.431+0000 7f001c6ff640 1 -- 172.21.15.12:0/1895496666 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00140a0530 con 0x7f001413a200 2024-09-11T23:06:18.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.431+0000 7f000affd640 1 -- 172.21.15.12:0/1895496666 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 32) ==== 43997+0+0 (secure 0 0 0) 0x7f00100be030 con 0x7f001413a200 2024-09-11T23:06:18.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.431+0000 7f000affd640 1 --2- 172.21.15.12:0/1895496666 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7efff8035d20 0x7efff80381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:18.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.431+0000 7f000affd640 1 -- 172.21.15.12:0/1895496666 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 3232+0+0 (secure 0 0 0) 0x7f00100bc070 con 0x7f001413a200 2024-09-11T23:06:18.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.431+0000 7f0019c9a640 1 --2- 172.21.15.12:0/1895496666 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7efff8035d20 0x7efff80381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:18.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.431+0000 7f0019c9a640 1 --2- 172.21.15.12:0/1895496666 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7efff8035d20 0x7efff80381e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0004001610 tx=0x7f0004007ad0 comp rx=0 tx=0).ready entity=mgr.4903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:18.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.435+0000 7f000affd640 1 -- 172.21.15.12:0/1895496666 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f00100c5020 con 0x7f001413a200 2024-09-11T23:06:18.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.607+0000 7f001c6ff640 1 -- 172.21.15.12:0/1895496666 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f001413a660 con 0x7f001413a200 2024-09-11T23:06:18.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.607+0000 7f000affd640 1 -- 172.21.15.12:0/1895496666 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v59) ==== 93+0+10 (secure 0 0 0) 0x7f0010016010 con 0x7f001413a200 2024-09-11T23:06:18.610 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2024-09-11T23:06:18.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.611+0000 7f001c6ff640 1 -- 172.21.15.12:0/1895496666 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7efff8035d20 msgr2=0x7efff80381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:18.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.611+0000 7f001c6ff640 1 --2- 172.21.15.12:0/1895496666 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7efff8035d20 0x7efff80381e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0004001610 tx=0x7f0004007ad0 comp rx=0 tx=0).stop 2024-09-11T23:06:18.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.611+0000 7f001c6ff640 1 -- 172.21.15.12:0/1895496666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f001413a200 msgr2=0x7f00140a55f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:18.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.611+0000 7f001c6ff640 1 --2- 172.21.15.12:0/1895496666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f001413a200 0x7f00140a55f0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f0010019fc0 tx=0x7f001001abd0 comp rx=0 tx=0).stop 2024-09-11T23:06:18.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.611+0000 7f001c6ff640 1 -- 172.21.15.12:0/1895496666 shutdown_connections 2024-09-11T23:06:18.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.611+0000 7f001c6ff640 1 --2- 172.21.15.12:0/1895496666 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7efff8035d20 0x7efff80381e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:18.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.611+0000 7f001c6ff640 1 --2- 172.21.15.12:0/1895496666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f001413a200 0x7f00140a55f0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:18.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.611+0000 7f001c6ff640 1 -- 172.21.15.12:0/1895496666 >> 172.21.15.12:0/1895496666 conn(0x7f001406da30 msgr2=0x7f0014137370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:18.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.611+0000 7f001c6ff640 1 -- 172.21.15.12:0/1895496666 shutdown_connections 2024-09-11T23:06:18.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.611+0000 7f001c6ff640 1 -- 172.21.15.12:0/1895496666 wait complete. 2024-09-11T23:06:18.622 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:18.619+0000 7f02a2c51640 -1 client.4935: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.4890:b65aeaeb-3f3a-4da2-97b5-6988dece6be2:v1:172.21.15.12:0/2496375865] 2024-09-11T23:06:18.629 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_fstop.TestFSTop.test_fstop_non_existent_cluster' 2024-09-11T23:06:18.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.743+0000 7f2de4a44640 1 Processor -- start 2024-09-11T23:06:18.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.743+0000 7f2de4a44640 1 -- start start 2024-09-11T23:06:18.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.743+0000 7f2de4a44640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2de0139b00 0x7f2de0139ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:18.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.743+0000 7f2de4a44640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2de006d8d0 con 0x7f2de009f530 2024-09-11T23:06:18.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.743+0000 7f2de4a44640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f2de006cd70 con 0x7f2de0139b00 2024-09-11T23:06:18.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.743+0000 7f2dddd9b640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f2de009f530 0x7f2de009feb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38052/0 (socket says 172.21.15.12:38052) 2024-09-11T23:06:18.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.743+0000 7f2dddd9b640 1 -- 172.21.15.12:0/3465614249 learned_addr learned my addr 172.21.15.12:0/3465614249 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:18.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.743+0000 7f2dde59c640 1 --2- 172.21.15.12:0/3465614249 >> v2:172.21.15.12:3300/0 conn(0x7f2de0139b00 0x7f2de0139ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:18.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.743+0000 7f2ddd59a640 1 -- 172.21.15.12:0/3465614249 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3694569116 0 0) 0x7f2de006d8d0 con 0x7f2de009f530 2024-09-11T23:06:18.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.743+0000 7f2ddd59a640 1 -- 172.21.15.12:0/3465614249 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2dc8003530 con 0x7f2de009f530 2024-09-11T23:06:18.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.743+0000 7f2dde59c640 1 -- 172.21.15.12:0/3465614249 >> v1:172.21.15.12:6789/0 conn(0x7f2de009f530 legacy=0x7f2de009feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:18.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.743+0000 7f2dde59c640 1 -- 172.21.15.12:0/3465614249 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2de009fba0 con 0x7f2de0139b00 2024-09-11T23:06:18.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.743+0000 7f2dde59c640 1 --2- 172.21.15.12:0/3465614249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2de0139b00 0x7f2de0139ee0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f2dd0009740 tx=0x7f2dd001c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94c761d008b21a47 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:18.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.747+0000 7f2ddd59a640 1 -- 172.21.15.12:0/3465614249 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dd00b0070 con 0x7f2de0139b00 2024-09-11T23:06:18.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.747+0000 7f2ddd59a640 1 -- 172.21.15.12:0/3465614249 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dd00ab530 con 0x7f2de0139b00 2024-09-11T23:06:18.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.747+0000 7f2ddd59a640 1 -- 172.21.15.12:0/3465614249 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dd00ab810 con 0x7f2de0139b00 2024-09-11T23:06:18.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.747+0000 7f2de4a44640 1 -- 172.21.15.12:0/3465614249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2de0139b00 msgr2=0x7f2de0139ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:18.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.747+0000 7f2de4a44640 1 --2- 172.21.15.12:0/3465614249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2de0139b00 0x7f2de0139ee0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f2dd0009740 tx=0x7f2dd001c390 comp rx=0 tx=0).stop 2024-09-11T23:06:18.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.747+0000 7f2de4a44640 1 -- 172.21.15.12:0/3465614249 shutdown_connections 2024-09-11T23:06:18.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.747+0000 7f2de4a44640 1 --2- 172.21.15.12:0/3465614249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2de0139b00 0x7f2de0139ee0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:18.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.747+0000 7f2de4a44640 1 -- 172.21.15.12:0/3465614249 >> 172.21.15.12:0/3465614249 conn(0x7f2de00aa330 msgr2=0x7f2de00aa740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:18.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.747+0000 7f2de4a44640 1 -- 172.21.15.12:0/3465614249 shutdown_connections 2024-09-11T23:06:18.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.747+0000 7f2de4a44640 1 -- 172.21.15.12:0/3465614249 wait complete. 2024-09-11T23:06:18.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.747+0000 7f2de4a44640 1 Processor -- start 2024-09-11T23:06:18.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.747+0000 7f2de4a44640 1 -- start start 2024-09-11T23:06:18.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.747+0000 7f2de4a44640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2de0139b00 0x7f2de013c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:18.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.747+0000 7f2de4a44640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2de0141e40 con 0x7f2de0139b00 2024-09-11T23:06:18.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.747+0000 7f2dde59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2de0139b00 0x7f2de013c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:18.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.747+0000 7f2dde59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2de0139b00 0x7f2de013c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34586/0 (socket says 172.21.15.12:34586) 2024-09-11T23:06:18.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.747+0000 7f2dde59c640 1 -- 172.21.15.12:0/374737043 learned_addr learned my addr 172.21.15.12:0/374737043 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:18.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.747+0000 7f2dde59c640 1 -- 172.21.15.12:0/374737043 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2de013ba20 con 0x7f2de0139b00 2024-09-11T23:06:18.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.747+0000 7f2dde59c640 1 --2- 172.21.15.12:0/374737043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2de0139b00 0x7f2de013c170 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f2dd00ae040 tx=0x7f2dd0019130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:18.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.747+0000 7f2dceffd640 1 -- 172.21.15.12:0/374737043 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dd00b8020 con 0x7f2de0139b00 2024-09-11T23:06:18.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.747+0000 7f2dceffd640 1 -- 172.21.15.12:0/374737043 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dd00abdb0 con 0x7f2de0139b00 2024-09-11T23:06:18.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.747+0000 7f2de4a44640 1 -- 172.21.15.12:0/374737043 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2de0138ea0 con 0x7f2de0139b00 2024-09-11T23:06:18.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.747+0000 7f2dceffd640 1 -- 172.21.15.12:0/374737043 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dd00b0040 con 0x7f2de0139b00 2024-09-11T23:06:18.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.747+0000 7f2de4a44640 1 -- 172.21.15.12:0/374737043 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2de00a40f0 con 0x7f2de0139b00 2024-09-11T23:06:18.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.751+0000 7f2de4a44640 1 -- 172.21.15.12:0/374737043 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2de0139ee0 con 0x7f2de0139b00 2024-09-11T23:06:18.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.751+0000 7f2dceffd640 1 -- 172.21.15.12:0/374737043 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 32) ==== 43997+0+0 (secure 0 0 0) 0x7f2dd00bb020 con 0x7f2de0139b00 2024-09-11T23:06:18.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.751+0000 7f2dceffd640 1 --2- 172.21.15.12:0/374737043 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f2dc0035d20 0x7f2dc00381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:18.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.751+0000 7f2dceffd640 1 -- 172.21.15.12:0/374737043 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 3232+0+0 (secure 0 0 0) 0x7f2dd00e20a0 con 0x7f2de0139b00 2024-09-11T23:06:18.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.751+0000 7f2dddd9b640 1 --2- 172.21.15.12:0/374737043 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f2dc0035d20 0x7f2dc00381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:18.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.751+0000 7f2dddd9b640 1 --2- 172.21.15.12:0/374737043 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f2dc0035d20 0x7f2dc00381e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4000f70 tx=0x7f2dd40010b0 comp rx=0 tx=0).ready entity=mgr.4903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:18.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.755+0000 7f2dceffd640 1 -- 172.21.15.12:0/374737043 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2dd00c2030 con 0x7f2de0139b00 2024-09-11T23:06:18.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:18.987+0000 7f2de4a44640 1 -- 172.21.15.12:0/374737043 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fstop.TestFSTop.test_fstop_non_existent_cluster"]} v 0) -- 0x7f2de006bc60 con 0x7f2de0139b00 2024-09-11T23:06:19.395 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:19.391+0000 7f02a2c51640 -1 client.4935: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.4890:b65aeaeb-3f3a-4da2-97b5-6988dece6be2:v1:172.21.15.12:0/2496375865] 2024-09-11T23:06:19.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:19.939+0000 7f2dceffd640 1 -- 172.21.15.12:0/374737043 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fstop.TestFSTop.test_fstop_non_existent_cluster"]}]=0 v168) ==== 147+0+0 (secure 0 0 0) 0x7f2dd0016010 con 0x7f2de0139b00 2024-09-11T23:06:19.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:19.943+0000 7f2de4a44640 1 -- 172.21.15.12:0/374737043 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f2dc0035d20 msgr2=0x7f2dc00381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:19.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:19.943+0000 7f2de4a44640 1 --2- 172.21.15.12:0/374737043 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f2dc0035d20 0x7f2dc00381e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4000f70 tx=0x7f2dd40010b0 comp rx=0 tx=0).stop 2024-09-11T23:06:19.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:19.943+0000 7f2de4a44640 1 -- 172.21.15.12:0/374737043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2de0139b00 msgr2=0x7f2de013c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:19.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:19.943+0000 7f2de4a44640 1 --2- 172.21.15.12:0/374737043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2de0139b00 0x7f2de013c170 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f2dd00ae040 tx=0x7f2dd0019130 comp rx=0 tx=0).stop 2024-09-11T23:06:19.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:19.943+0000 7f2de4a44640 1 -- 172.21.15.12:0/374737043 shutdown_connections 2024-09-11T23:06:19.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:19.943+0000 7f2de4a44640 1 --2- 172.21.15.12:0/374737043 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f2dc0035d20 0x7f2dc00381e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:19.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:19.943+0000 7f2de4a44640 1 --2- 172.21.15.12:0/374737043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2de0139b00 0x7f2de013c170 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:19.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:19.943+0000 7f2de4a44640 1 -- 172.21.15.12:0/374737043 >> 172.21.15.12:0/374737043 conn(0x7f2de00aa330 msgr2=0x7f2de0136ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:19.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:19.943+0000 7f2de4a44640 1 -- 172.21.15.12:0/374737043 shutdown_connections 2024-09-11T23:06:19.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:19.943+0000 7f2de4a44640 1 -- 172.21.15.12:0/374737043 wait complete. 2024-09-11T23:06:19.966 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-11T23:06:20.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.099+0000 7ff5b3e69640 1 Processor -- start 2024-09-11T23:06:20.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.099+0000 7ff5b3e69640 1 -- start start 2024-09-11T23:06:20.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.103+0000 7ff5b3e69640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff5ac133690 0x7ff5ac133a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:20.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.103+0000 7ff5b3e69640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5ac067fd0 con 0x7ff5ac0728b0 2024-09-11T23:06:20.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.103+0000 7ff5b3e69640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7ff5ac073ce0 con 0x7ff5ac133690 2024-09-11T23:06:20.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.103+0000 7ff5b1c05640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff5ac133690 0x7ff5ac133a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:20.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.103+0000 7ff5b1404640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff5ac0728b0 0x7ff5ac136760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38068/0 (socket says 172.21.15.12:38068) 2024-09-11T23:06:20.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.103+0000 7ff5b1404640 1 -- 172.21.15.12:0/4042400222 learned_addr learned my addr 172.21.15.12:0/4042400222 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:20.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.103+0000 7ff5b1c05640 1 -- 172.21.15.12:0/4042400222 >> v1:172.21.15.12:6789/0 conn(0x7ff5ac0728b0 legacy=0x7ff5ac136760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:20.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.103+0000 7ff5b1c05640 1 -- 172.21.15.12:0/4042400222 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5ac133260 con 0x7ff5ac133690 2024-09-11T23:06:20.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.103+0000 7ff5b0c03640 1 -- 172.21.15.12:0/4042400222 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3056783103 0 0) 0x7ff59c001120 con 0x7ff5ac0728b0 2024-09-11T23:06:20.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.103+0000 7ff5b1c05640 1 --2- 172.21.15.12:0/4042400222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5ac133690 0x7ff5ac133a70 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7ff5a8009dc0 tx=0x7ff5a801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f3f7ecd66402e62 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:20.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.103+0000 7ff5b0c03640 1 -- 172.21.15.12:0/4042400222 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5a80b2070 con 0x7ff5ac133690 2024-09-11T23:06:20.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.103+0000 7ff5b0c03640 1 -- 172.21.15.12:0/4042400222 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5a80a56c0 con 0x7ff5ac133690 2024-09-11T23:06:20.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.103+0000 7ff5b0c03640 1 -- 172.21.15.12:0/4042400222 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5a80a59c0 con 0x7ff5ac133690 2024-09-11T23:06:20.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.107+0000 7ff5b3e69640 1 -- 172.21.15.12:0/4042400222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5ac133690 msgr2=0x7ff5ac133a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:20.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.107+0000 7ff5b3e69640 1 --2- 172.21.15.12:0/4042400222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5ac133690 0x7ff5ac133a70 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7ff5a8009dc0 tx=0x7ff5a801c950 comp rx=0 tx=0).stop 2024-09-11T23:06:20.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.107+0000 7ff5b3e69640 1 -- 172.21.15.12:0/4042400222 shutdown_connections 2024-09-11T23:06:20.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.107+0000 7ff5b3e69640 1 --2- 172.21.15.12:0/4042400222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5ac133690 0x7ff5ac133a70 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:20.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.107+0000 7ff5b3e69640 1 -- 172.21.15.12:0/4042400222 >> 172.21.15.12:0/4042400222 conn(0x7ff5ac09aba0 msgr2=0x7ff5ac09afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:20.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.107+0000 7ff5b3e69640 1 -- 172.21.15.12:0/4042400222 shutdown_connections 2024-09-11T23:06:20.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.107+0000 7ff5b3e69640 1 -- 172.21.15.12:0/4042400222 wait complete. 2024-09-11T23:06:20.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.107+0000 7ff5b3e69640 1 Processor -- start 2024-09-11T23:06:20.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.107+0000 7ff5b3e69640 1 -- start start 2024-09-11T23:06:20.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.107+0000 7ff5b3e69640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5ac133690 0x7ff5ac0a0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:20.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.107+0000 7ff5b3e69640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff5ac13eaa0 con 0x7ff5ac133690 2024-09-11T23:06:20.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.107+0000 7ff5b1c05640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5ac133690 0x7ff5ac0a0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:20.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.107+0000 7ff5b1c05640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5ac133690 0x7ff5ac0a0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34610/0 (socket says 172.21.15.12:34610) 2024-09-11T23:06:20.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.107+0000 7ff5b1c05640 1 -- 172.21.15.12:0/4072373305 learned_addr learned my addr 172.21.15.12:0/4072373305 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:20.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.107+0000 7ff5b1c05640 1 -- 172.21.15.12:0/4072373305 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5ac0a8ff0 con 0x7ff5ac133690 2024-09-11T23:06:20.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.107+0000 7ff5b1c05640 1 --2- 172.21.15.12:0/4072373305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5ac133690 0x7ff5ac0a0a30 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7ff5a8019560 tx=0x7ff5a80196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:20.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.107+0000 7ff5a27fc640 1 -- 172.21.15.12:0/4072373305 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5a80ad440 con 0x7ff5ac133690 2024-09-11T23:06:20.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.107+0000 7ff5a27fc640 1 -- 172.21.15.12:0/4072373305 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5a80ad5e0 con 0x7ff5ac133690 2024-09-11T23:06:20.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.107+0000 7ff5a27fc640 1 -- 172.21.15.12:0/4072373305 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5a80ad900 con 0x7ff5ac133690 2024-09-11T23:06:20.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.107+0000 7ff5b3e69640 1 -- 172.21.15.12:0/4072373305 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5ac13ae50 con 0x7ff5ac133690 2024-09-11T23:06:20.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.107+0000 7ff5b3e69640 1 -- 172.21.15.12:0/4072373305 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5ac13ab70 con 0x7ff5ac133690 2024-09-11T23:06:20.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.107+0000 7ff5a27fc640 1 -- 172.21.15.12:0/4072373305 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 32) ==== 43997+0+0 (secure 0 0 0) 0x7ff5a80c6060 con 0x7ff5ac133690 2024-09-11T23:06:20.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.107+0000 7ff5b3e69640 1 -- 172.21.15.12:0/4072373305 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5ac133a70 con 0x7ff5ac133690 2024-09-11T23:06:20.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.107+0000 7ff5a27fc640 1 --2- 172.21.15.12:0/4072373305 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7ff590035d20 0x7ff5900381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:20.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.107+0000 7ff5a27fc640 1 -- 172.21.15.12:0/4072373305 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 3232+0+0 (secure 0 0 0) 0x7ff5a80e4b10 con 0x7ff5ac133690 2024-09-11T23:06:20.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.107+0000 7ff5b1404640 1 --2- 172.21.15.12:0/4072373305 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7ff590035d20 0x7ff5900381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:20.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.111+0000 7ff5b1404640 1 --2- 172.21.15.12:0/4072373305 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7ff590035d20 0x7ff5900381e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff59c0013c0 tx=0x7ff59c001330 comp rx=0 tx=0).ready entity=mgr.4903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:20.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.115+0000 7ff5a27fc640 1 -- 172.21.15.12:0/4072373305 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff5a80ba070 con 0x7ff5ac133690 2024-09-11T23:06:20.204 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:20.199+0000 7f02a2c51640 -1 client.4935: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.4890:b65aeaeb-3f3a-4da2-97b5-6988dece6be2:v1:172.21.15.12:0/2496375865] 2024-09-11T23:06:20.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.283+0000 7ff5b3e69640 1 -- 172.21.15.12:0/4072373305 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7ff5ac13a4f0 con 0x7ff5ac133690 2024-09-11T23:06:20.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.287+0000 7ff5a27fc640 1 -- 172.21.15.12:0/4072373305 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v11)=0 v11) ==== 122+0+0 (secure 0 0 0) 0x7ff5ac13a4f0 con 0x7ff5ac133690 2024-09-11T23:06:20.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.291+0000 7ff5b3e69640 1 -- 172.21.15.12:0/4072373305 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7ff590035d20 msgr2=0x7ff5900381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:20.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.291+0000 7ff5b3e69640 1 --2- 172.21.15.12:0/4072373305 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7ff590035d20 0x7ff5900381e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff59c0013c0 tx=0x7ff59c001330 comp rx=0 tx=0).stop 2024-09-11T23:06:20.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.291+0000 7ff5b3e69640 1 -- 172.21.15.12:0/4072373305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5ac133690 msgr2=0x7ff5ac0a0a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:20.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.291+0000 7ff5b3e69640 1 --2- 172.21.15.12:0/4072373305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5ac133690 0x7ff5ac0a0a30 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7ff5a8019560 tx=0x7ff5a80196f0 comp rx=0 tx=0).stop 2024-09-11T23:06:20.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.291+0000 7ff5b3e69640 1 -- 172.21.15.12:0/4072373305 shutdown_connections 2024-09-11T23:06:20.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.291+0000 7ff5b3e69640 1 --2- 172.21.15.12:0/4072373305 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7ff590035d20 0x7ff5900381e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:20.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.291+0000 7ff5b3e69640 1 --2- 172.21.15.12:0/4072373305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5ac133690 0x7ff5ac0a0a30 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:20.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.291+0000 7ff5b3e69640 1 -- 172.21.15.12:0/4072373305 >> 172.21.15.12:0/4072373305 conn(0x7ff5ac09aba0 msgr2=0x7ff5ac130830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:20.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.291+0000 7ff5b3e69640 1 -- 172.21.15.12:0/4072373305 shutdown_connections 2024-09-11T23:06:20.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.291+0000 7ff5b3e69640 1 -- 172.21.15.12:0/4072373305 wait complete. 2024-09-11T23:06:20.311 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T23:06:20.311 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:06:20.358 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T23:06:20.358 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T23:06:20.358 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:06:20.409 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339568k,nr_inodes=4084892,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15839 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275300k,nr_inodes=818825,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-09-11T23:06:20.410 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T23:06:20.410 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:06:20.457 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339568k,nr_inodes=4084892,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15839 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275300k,nr_inodes=818825,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-09-11T23:06:20.457 INFO:tasks.cephfs.cephfs_test_case:[, ] 2024-09-11T23:06:20.457 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:06:20.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.631+0000 7f34ca495640 1 Processor -- start 2024-09-11T23:06:20.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.631+0000 7f34ca495640 1 -- start start 2024-09-11T23:06:20.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.631+0000 7f34ca495640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f34c40a55f0 0x7f34c40a3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:20.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.631+0000 7f34ca495640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34c40a53f0 con 0x7f34c40a59d0 2024-09-11T23:06:20.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.631+0000 7f34ca495640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f34c40a2020 con 0x7f34c40a55f0 2024-09-11T23:06:20.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.631+0000 7f34c3fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f34c40a55f0 0x7f34c40a3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:20.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.631+0000 7f34c37fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f34c40a59d0 0x7f34c4137a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38070/0 (socket says 172.21.15.12:38070) 2024-09-11T23:06:20.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.631+0000 7f34c3fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f34c40a55f0 0x7f34c40a3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34624/0 (socket says 172.21.15.12:34624) 2024-09-11T23:06:20.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.631+0000 7f34c3fff640 1 -- 172.21.15.12:0/290385110 learned_addr learned my addr 172.21.15.12:0/290385110 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:20.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.631+0000 7f34c3fff640 1 -- 172.21.15.12:0/290385110 >> v1:172.21.15.12:6789/0 conn(0x7f34c40a59d0 legacy=0x7f34c4137a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:20.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.635+0000 7f34c2ffd640 1 -- 172.21.15.12:0/290385110 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3214254324 0 0) 0x7f34c40a53f0 con 0x7f34c40a59d0 2024-09-11T23:06:20.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.635+0000 7f34c3fff640 1 -- 172.21.15.12:0/290385110 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34c40a3160 con 0x7f34c40a55f0 2024-09-11T23:06:20.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.635+0000 7f34c3fff640 1 --2- 172.21.15.12:0/290385110 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34c40a55f0 0x7f34c40a3ba0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f34b40097f0 tx=0x7f34b401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21f01eb9af22743b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:20.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.635+0000 7f34c2ffd640 1 -- 172.21.15.12:0/290385110 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34b40b0070 con 0x7f34c40a55f0 2024-09-11T23:06:20.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.635+0000 7f34c2ffd640 1 -- 172.21.15.12:0/290385110 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34b40ab530 con 0x7f34c40a55f0 2024-09-11T23:06:20.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.635+0000 7f34c2ffd640 1 -- 172.21.15.12:0/290385110 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34b40ab830 con 0x7f34c40a55f0 2024-09-11T23:06:20.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.635+0000 7f34ca495640 1 -- 172.21.15.12:0/290385110 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34c40a55f0 msgr2=0x7f34c40a3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:20.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.635+0000 7f34ca495640 1 --2- 172.21.15.12:0/290385110 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34c40a55f0 0x7f34c40a3ba0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f34b40097f0 tx=0x7f34b401c450 comp rx=0 tx=0).stop 2024-09-11T23:06:20.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.635+0000 7f34ca495640 1 -- 172.21.15.12:0/290385110 shutdown_connections 2024-09-11T23:06:20.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.635+0000 7f34ca495640 1 --2- 172.21.15.12:0/290385110 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34c40a55f0 0x7f34c40a3ba0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:20.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.635+0000 7f34ca495640 1 -- 172.21.15.12:0/290385110 >> 172.21.15.12:0/290385110 conn(0x7f34c40aa2c0 msgr2=0x7f34c40aa6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:20.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.635+0000 7f34ca495640 1 -- 172.21.15.12:0/290385110 shutdown_connections 2024-09-11T23:06:20.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.635+0000 7f34ca495640 1 -- 172.21.15.12:0/290385110 wait complete. 2024-09-11T23:06:20.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.639+0000 7f34ca495640 1 Processor -- start 2024-09-11T23:06:20.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.639+0000 7f34ca495640 1 -- start start 2024-09-11T23:06:20.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.639+0000 7f34ca495640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34c40a55f0 0x7f34c409f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:20.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.639+0000 7f34ca495640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f34c413fd40 con 0x7f34c40a55f0 2024-09-11T23:06:20.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.639+0000 7f34c3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34c40a55f0 0x7f34c409f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:20.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.639+0000 7f34c3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34c40a55f0 0x7f34c409f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34626/0 (socket says 172.21.15.12:34626) 2024-09-11T23:06:20.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.639+0000 7f34c3fff640 1 -- 172.21.15.12:0/2198412637 learned_addr learned my addr 172.21.15.12:0/2198412637 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:20.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.639+0000 7f34c3fff640 1 -- 172.21.15.12:0/2198412637 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34c4120c60 con 0x7f34c40a55f0 2024-09-11T23:06:20.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.639+0000 7f34c3fff640 1 --2- 172.21.15.12:0/2198412637 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34c40a55f0 0x7f34c409f3b0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f34b4019060 tx=0x7f34b401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:20.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.639+0000 7f34c0ff9640 1 -- 172.21.15.12:0/2198412637 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34b40b0040 con 0x7f34c40a55f0 2024-09-11T23:06:20.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.639+0000 7f34c0ff9640 1 -- 172.21.15.12:0/2198412637 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34b4004020 con 0x7f34c40a55f0 2024-09-11T23:06:20.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.639+0000 7f34c0ff9640 1 -- 172.21.15.12:0/2198412637 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34b40abe60 con 0x7f34c40a55f0 2024-09-11T23:06:20.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.639+0000 7f34ca495640 1 -- 172.21.15.12:0/2198412637 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34c4120510 con 0x7f34c40a55f0 2024-09-11T23:06:20.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.639+0000 7f34ca495640 1 -- 172.21.15.12:0/2198412637 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34c406dcb0 con 0x7f34c40a55f0 2024-09-11T23:06:20.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.639+0000 7f34c0ff9640 1 -- 172.21.15.12:0/2198412637 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 32) ==== 43997+0+0 (secure 0 0 0) 0x7f34b40b3070 con 0x7f34c40a55f0 2024-09-11T23:06:20.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.639+0000 7f34ca495640 1 -- 172.21.15.12:0/2198412637 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34c40a3ba0 con 0x7f34c40a55f0 2024-09-11T23:06:20.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.639+0000 7f34c0ff9640 1 --2- 172.21.15.12:0/2198412637 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f34b0035d20 0x7f34b00381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:20.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.639+0000 7f34c0ff9640 1 -- 172.21.15.12:0/2198412637 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 3232+0+0 (secure 0 0 0) 0x7f34b40e2940 con 0x7f34c40a55f0 2024-09-11T23:06:20.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.639+0000 7f34c37fe640 1 --2- 172.21.15.12:0/2198412637 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f34b0035d20 0x7f34b00381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:20.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.639+0000 7f34c37fe640 1 --2- 172.21.15.12:0/2198412637 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f34b0035d20 0x7f34b00381e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f34b8000c10 tx=0x7f34b80078c0 comp rx=0 tx=0).ready entity=mgr.4903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:20.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.647+0000 7f34c0ff9640 1 -- 172.21.15.12:0/2198412637 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f34b40c3030 con 0x7f34c40a55f0 2024-09-11T23:06:20.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.855+0000 7f34ca495640 1 -- 172.21.15.12:0/2198412637 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f34c4120e40 con 0x7f34c40a55f0 2024-09-11T23:06:20.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.859+0000 7f34c0ff9640 1 -- 172.21.15.12:0/2198412637 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+2261 (secure 0 0 0) 0x7f34c4120c60 con 0x7f34c40a55f0 2024-09-11T23:06:20.861 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:06:20.861 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":42,"btime":"2024-09-11T23:06:14:529678+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4812,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6827/1404954527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":1404954527},{"type":"v1","addr":"172.21.15.12:6827","nonce":1404954527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":4933,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6825/2280102004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2280102004},{"type":"v1","addr":"172.21.15.12:6825","nonce":2280102004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42}],"filesystems":[]} 2024-09-11T23:06:20.861 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 42 2024-09-11T23:06:20.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.859+0000 7f34ca495640 1 -- 172.21.15.12:0/2198412637 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f34b0035d20 msgr2=0x7f34b00381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:20.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.859+0000 7f34ca495640 1 --2- 172.21.15.12:0/2198412637 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f34b0035d20 0x7f34b00381e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f34b8000c10 tx=0x7f34b80078c0 comp rx=0 tx=0).stop 2024-09-11T23:06:20.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.859+0000 7f34ca495640 1 -- 172.21.15.12:0/2198412637 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34c40a55f0 msgr2=0x7f34c409f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:20.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.859+0000 7f34ca495640 1 --2- 172.21.15.12:0/2198412637 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34c40a55f0 0x7f34c409f3b0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f34b4019060 tx=0x7f34b401ac90 comp rx=0 tx=0).stop 2024-09-11T23:06:20.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.859+0000 7f34ca495640 1 -- 172.21.15.12:0/2198412637 shutdown_connections 2024-09-11T23:06:20.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.859+0000 7f34ca495640 1 --2- 172.21.15.12:0/2198412637 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f34b0035d20 0x7f34b00381e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:20.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.859+0000 7f34ca495640 1 --2- 172.21.15.12:0/2198412637 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34c40a55f0 0x7f34c409f3b0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:20.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.859+0000 7f34ca495640 1 -- 172.21.15.12:0/2198412637 >> 172.21.15.12:0/2198412637 conn(0x7f34c40aa2c0 msgr2=0x7f34c40732c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:20.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.859+0000 7f34ca495640 1 -- 172.21.15.12:0/2198412637 shutdown_connections 2024-09-11T23:06:20.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:20.859+0000 7f34ca495640 1 -- 172.21.15.12:0/2198412637 wait complete. 2024-09-11T23:06:20.882 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-11T23:06:20.882 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-11T23:06:20.882 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-11T23:06:20.882 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:06:20.882 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-11T23:06:20.882 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-11T23:06:20.883 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-11T23:06:20.883 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:06:20.894 INFO:tasks.ceph.mds.a:Stopped 2024-09-11T23:06:20.895 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-11T23:06:20.896 INFO:tasks.ceph.mds.b:Stopped 2024-09-11T23:06:20.896 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-11T23:06:20.937 INFO:tasks.ceph.mds.a:Started 2024-09-11T23:06:20.938 DEBUG:teuthology.parallel:result is None 2024-09-11T23:06:20.938 INFO:tasks.ceph.mds.b:Started 2024-09-11T23:06:20.938 DEBUG:teuthology.parallel:result is None 2024-09-11T23:06:20.939 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-11T23:06:20.978 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:20.975+0000 7f02a2c51640 -1 client.4935: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.4890:b65aeaeb-3f3a-4da2-97b5-6988dece6be2:v1:172.21.15.12:0/2496375865] 2024-09-11T23:06:21.010 INFO:tasks.ceph.mds.a.smithi012.stdout:starting mds.a at 2024-09-11T23:06:21.010 INFO:tasks.ceph.mds.b.smithi012.stdout:starting mds.b at 2024-09-11T23:06:21.011 INFO:tasks.ceph.mds.a.smithi012.stderr:2024-09-11T23:06:21.007+0000 7f2469168640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6824/0: (98) Address already in use 2024-09-11T23:06:21.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.059+0000 7f75074e3640 1 Processor -- start 2024-09-11T23:06:21.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.059+0000 7f75074e3640 1 -- start start 2024-09-11T23:06:21.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.059+0000 7f75074e3640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f750013a130 0x7f75000a19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:21.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.059+0000 7f75074e3640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7500139f60 con 0x7f750013a510 2024-09-11T23:06:21.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.059+0000 7f75074e3640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f750009feb0 con 0x7f750013a130 2024-09-11T23:06:21.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.059+0000 7f750527f640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f750013a130 0x7f75000a19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:21.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.059+0000 7f7504a7e640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f750013a510 0x7f7500136500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38088/0 (socket says 172.21.15.12:38088) 2024-09-11T23:06:21.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.059+0000 7f7504a7e640 1 -- 172.21.15.12:0/953444976 learned_addr learned my addr 172.21.15.12:0/953444976 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:21.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.063+0000 7f74f7fff640 1 -- 172.21.15.12:0/953444976 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2243141478 0 0) 0x7f7500139f60 con 0x7f750013a510 2024-09-11T23:06:21.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.063+0000 7f74f7fff640 1 -- 172.21.15.12:0/953444976 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74ec003530 con 0x7f750013a510 2024-09-11T23:06:21.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.063+0000 7f750527f640 1 -- 172.21.15.12:0/953444976 >> v1:172.21.15.12:6789/0 conn(0x7f750013a510 legacy=0x7f7500136500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:21.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.063+0000 7f750527f640 1 -- 172.21.15.12:0/953444976 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75000a0c60 con 0x7f750013a130 2024-09-11T23:06:21.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.063+0000 7f750527f640 1 --2- 172.21.15.12:0/953444976 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f750013a130 0x7f75000a19b0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f74fc009740 tx=0x7f74fc01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d50a681fe8569c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:21.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.063+0000 7f74f7fff640 1 -- 172.21.15.12:0/953444976 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74fc0b0070 con 0x7f750013a130 2024-09-11T23:06:21.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.063+0000 7f74f7fff640 1 -- 172.21.15.12:0/953444976 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74fc0ab530 con 0x7f750013a130 2024-09-11T23:06:21.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.063+0000 7f74f7fff640 1 -- 172.21.15.12:0/953444976 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74fc0ab810 con 0x7f750013a130 2024-09-11T23:06:21.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.063+0000 7f75074e3640 1 -- 172.21.15.12:0/953444976 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f750013a130 msgr2=0x7f75000a19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:21.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.063+0000 7f75074e3640 1 --2- 172.21.15.12:0/953444976 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f750013a130 0x7f75000a19b0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f74fc009740 tx=0x7f74fc01c390 comp rx=0 tx=0).stop 2024-09-11T23:06:21.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.063+0000 7f75074e3640 1 -- 172.21.15.12:0/953444976 shutdown_connections 2024-09-11T23:06:21.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.063+0000 7f75074e3640 1 --2- 172.21.15.12:0/953444976 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f750013a130 0x7f75000a19b0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:21.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.063+0000 7f75074e3640 1 -- 172.21.15.12:0/953444976 >> 172.21.15.12:0/953444976 conn(0x7f7500068490 msgr2=0x7f750006d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:21.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.063+0000 7f75074e3640 1 -- 172.21.15.12:0/953444976 shutdown_connections 2024-09-11T23:06:21.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.063+0000 7f75074e3640 1 -- 172.21.15.12:0/953444976 wait complete. 2024-09-11T23:06:21.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.067+0000 7f75074e3640 1 Processor -- start 2024-09-11T23:06:21.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.067+0000 7f75074e3640 1 -- start start 2024-09-11T23:06:21.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.067+0000 7f75074e3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f750013a130 0x7f75001ce2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:21.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.067+0000 7f75074e3640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f75000a0360 con 0x7f750013a130 2024-09-11T23:06:21.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.067+0000 7f750527f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f750013a130 0x7f75001ce2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:21.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.067+0000 7f750527f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f750013a130 0x7f75001ce2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34696/0 (socket says 172.21.15.12:34696) 2024-09-11T23:06:21.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.067+0000 7f750527f640 1 -- 172.21.15.12:0/3666272587 learned_addr learned my addr 172.21.15.12:0/3666272587 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:21.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.067+0000 7f750527f640 1 -- 172.21.15.12:0/3666272587 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75001ce030 con 0x7f750013a130 2024-09-11T23:06:21.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.067+0000 7f750527f640 1 --2- 172.21.15.12:0/3666272587 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f750013a130 0x7f75001ce2d0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f74fc0ae040 tx=0x7f74fc019130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:21.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.067+0000 7f74f5ffb640 1 -- 172.21.15.12:0/3666272587 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74fc0b8020 con 0x7f750013a130 2024-09-11T23:06:21.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.067+0000 7f74f5ffb640 1 -- 172.21.15.12:0/3666272587 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74fc0b4410 con 0x7f750013a130 2024-09-11T23:06:21.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.067+0000 7f75074e3640 1 -- 172.21.15.12:0/3666272587 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f750009e950 con 0x7f750013a130 2024-09-11T23:06:21.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.067+0000 7f74f5ffb640 1 -- 172.21.15.12:0/3666272587 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74fc0b0040 con 0x7f750013a130 2024-09-11T23:06:21.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.067+0000 7f75074e3640 1 -- 172.21.15.12:0/3666272587 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75000a3500 con 0x7f750013a130 2024-09-11T23:06:21.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.067+0000 7f74f5ffb640 1 -- 172.21.15.12:0/3666272587 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 32) ==== 43997+0+0 (secure 0 0 0) 0x7f74fc0bb020 con 0x7f750013a130 2024-09-11T23:06:21.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.067+0000 7f74f5ffb640 1 --2- 172.21.15.12:0/3666272587 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f74e4035cd0 0x7f74e4038190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:21.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.067+0000 7f74f5ffb640 1 -- 172.21.15.12:0/3666272587 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 3232+0+0 (secure 0 0 0) 0x7f74fc0e21f0 con 0x7f750013a130 2024-09-11T23:06:21.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.067+0000 7f75074e3640 1 -- 172.21.15.12:0/3666272587 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75000a19b0 con 0x7f750013a130 2024-09-11T23:06:21.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.067+0000 7f7504a7e640 1 --2- 172.21.15.12:0/3666272587 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f74e4035cd0 0x7f74e4038190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:21.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.067+0000 7f7504a7e640 1 --2- 172.21.15.12:0/3666272587 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f74e4035cd0 0x7f74e4038190 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f74f0000f70 tx=0x7f74f00010b0 comp rx=0 tx=0).ready entity=mgr.4903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:21.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.071+0000 7f74f5ffb640 1 -- 172.21.15.12:0/3666272587 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f74fc0c2030 con 0x7f750013a130 2024-09-11T23:06:21.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.259+0000 7f75074e3640 1 -- 172.21.15.12:0/3666272587 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f7500073390 con 0x7f750013a130 2024-09-11T23:06:21.788 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:21.783+0000 7f02a2c51640 -1 client.4935: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.4890:b65aeaeb-3f3a-4da2-97b5-6988dece6be2:v1:172.21.15.12:0/2496375865] 2024-09-11T23:06:21.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.955+0000 7f74f5ffb640 1 -- 172.21.15.12:0/3666272587 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v61) ==== 97+0+0 (secure 0 0 0) 0x7f74fc0a4e20 con 0x7f750013a130 2024-09-11T23:06:21.959 INFO:teuthology.orchestra.run.smithi012.stderr: removed all blocklist entries 2024-09-11T23:06:21.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.959+0000 7f75074e3640 1 -- 172.21.15.12:0/3666272587 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f74e4035cd0 msgr2=0x7f74e4038190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:21.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.959+0000 7f75074e3640 1 --2- 172.21.15.12:0/3666272587 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f74e4035cd0 0x7f74e4038190 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f74f0000f70 tx=0x7f74f00010b0 comp rx=0 tx=0).stop 2024-09-11T23:06:21.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.959+0000 7f75074e3640 1 -- 172.21.15.12:0/3666272587 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f750013a130 msgr2=0x7f75001ce2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:21.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.959+0000 7f75074e3640 1 --2- 172.21.15.12:0/3666272587 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f750013a130 0x7f75001ce2d0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f74fc0ae040 tx=0x7f74fc019130 comp rx=0 tx=0).stop 2024-09-11T23:06:21.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.959+0000 7f75074e3640 1 -- 172.21.15.12:0/3666272587 shutdown_connections 2024-09-11T23:06:21.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.959+0000 7f75074e3640 1 --2- 172.21.15.12:0/3666272587 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f74e4035cd0 0x7f74e4038190 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:21.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.959+0000 7f75074e3640 1 --2- 172.21.15.12:0/3666272587 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f750013a130 0x7f75001ce2d0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:21.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.959+0000 7f75074e3640 1 -- 172.21.15.12:0/3666272587 >> 172.21.15.12:0/3666272587 conn(0x7f7500068490 msgr2=0x7f7500133430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:21.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.959+0000 7f75074e3640 1 -- 172.21.15.12:0/3666272587 shutdown_connections 2024-09-11T23:06:21.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:21.959+0000 7f75074e3640 1 -- 172.21.15.12:0/3666272587 wait complete. 2024-09-11T23:06:21.984 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-11T23:06:22.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.163+0000 7fc58429d640 1 Processor -- start 2024-09-11T23:06:22.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.163+0000 7fc58429d640 1 -- start start 2024-09-11T23:06:22.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.163+0000 7fc58429d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc57c13a410 0x7fc57c0a6af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:22.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.163+0000 7fc58429d640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc57c0a82a0 con 0x7fc57c0a4b80 2024-09-11T23:06:22.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.163+0000 7fc58429d640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fc57c0a3cb0 con 0x7fc57c13a410 2024-09-11T23:06:22.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.163+0000 7fc582039640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc57c13a410 0x7fc57c0a6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:22.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.163+0000 7fc581838640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fc57c0a4b80 0x7fc57c0a7030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38098/0 (socket says 172.21.15.12:38098) 2024-09-11T23:06:22.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.163+0000 7fc581838640 1 -- 172.21.15.12:0/2910026969 learned_addr learned my addr 172.21.15.12:0/2910026969 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:22.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.163+0000 7fc581037640 1 -- 172.21.15.12:0/2910026969 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3491678167 0 0) 0x7fc57c0a82a0 con 0x7fc57c0a4b80 2024-09-11T23:06:22.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.163+0000 7fc581037640 1 -- 172.21.15.12:0/2910026969 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc568003530 con 0x7fc57c0a4b80 2024-09-11T23:06:22.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.163+0000 7fc582039640 1 -- 172.21.15.12:0/2910026969 >> v1:172.21.15.12:6789/0 conn(0x7fc57c0a4b80 legacy=0x7fc57c0a7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:22.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.163+0000 7fc582039640 1 -- 172.21.15.12:0/2910026969 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc57c139fe0 con 0x7fc57c13a410 2024-09-11T23:06:22.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.163+0000 7fc582039640 1 --2- 172.21.15.12:0/2910026969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc57c13a410 0x7fc57c0a6af0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fc570009740 tx=0x7fc57001c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21d84d547818fc4b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:22.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.163+0000 7fc581037640 1 -- 172.21.15.12:0/2910026969 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5700b0070 con 0x7fc57c13a410 2024-09-11T23:06:22.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.167+0000 7fc581037640 1 -- 172.21.15.12:0/2910026969 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5700ab530 con 0x7fc57c13a410 2024-09-11T23:06:22.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.167+0000 7fc581037640 1 -- 172.21.15.12:0/2910026969 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5700ab830 con 0x7fc57c13a410 2024-09-11T23:06:22.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.167+0000 7fc58429d640 1 -- 172.21.15.12:0/2910026969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc57c13a410 msgr2=0x7fc57c0a6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:22.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.167+0000 7fc58429d640 1 --2- 172.21.15.12:0/2910026969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc57c13a410 0x7fc57c0a6af0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fc570009740 tx=0x7fc57001c390 comp rx=0 tx=0).stop 2024-09-11T23:06:22.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.167+0000 7fc58429d640 1 -- 172.21.15.12:0/2910026969 shutdown_connections 2024-09-11T23:06:22.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.167+0000 7fc58429d640 1 --2- 172.21.15.12:0/2910026969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc57c13a410 0x7fc57c0a6af0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:22.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.167+0000 7fc58429d640 1 -- 172.21.15.12:0/2910026969 >> 172.21.15.12:0/2910026969 conn(0x7fc57c0ac2c0 msgr2=0x7fc57c0ac6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:22.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.167+0000 7fc58429d640 1 -- 172.21.15.12:0/2910026969 shutdown_connections 2024-09-11T23:06:22.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.167+0000 7fc58429d640 1 -- 172.21.15.12:0/2910026969 wait complete. 2024-09-11T23:06:22.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.167+0000 7fc58429d640 1 Processor -- start 2024-09-11T23:06:22.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.167+0000 7fc58429d640 1 -- start start 2024-09-11T23:06:22.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.167+0000 7fc58429d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc57c0a4b80 0x7fc57c1ce880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:22.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.167+0000 7fc58429d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc57c0a7740 con 0x7fc57c0a4b80 2024-09-11T23:06:22.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.167+0000 7fc582039640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc57c0a4b80 0x7fc57c1ce880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:22.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.167+0000 7fc582039640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc57c0a4b80 0x7fc57c1ce880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34706/0 (socket says 172.21.15.12:34706) 2024-09-11T23:06:22.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.167+0000 7fc582039640 1 -- 172.21.15.12:0/3373090422 learned_addr learned my addr 172.21.15.12:0/3373090422 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:22.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.167+0000 7fc582039640 1 -- 172.21.15.12:0/3373090422 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc57c13eba0 con 0x7fc57c0a4b80 2024-09-11T23:06:22.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.167+0000 7fc582039640 1 --2- 172.21.15.12:0/3373090422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc57c0a4b80 0x7fc57c1ce880 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fc570019fc0 tx=0x7fc57001abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:22.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.167+0000 7fc56effd640 1 -- 172.21.15.12:0/3373090422 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5700b0050 con 0x7fc57c0a4b80 2024-09-11T23:06:22.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.167+0000 7fc56effd640 1 -- 172.21.15.12:0/3373090422 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5700b1040 con 0x7fc57c0a4b80 2024-09-11T23:06:22.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.167+0000 7fc56effd640 1 -- 172.21.15.12:0/3373090422 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5700b7580 con 0x7fc57c0a4b80 2024-09-11T23:06:22.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.167+0000 7fc58429d640 1 -- 172.21.15.12:0/3373090422 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc57c09c450 con 0x7fc57c0a4b80 2024-09-11T23:06:22.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.167+0000 7fc58429d640 1 -- 172.21.15.12:0/3373090422 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc57c13ef70 con 0x7fc57c0a4b80 2024-09-11T23:06:22.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.171+0000 7fc56effd640 1 -- 172.21.15.12:0/3373090422 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 32) ==== 43997+0+0 (secure 0 0 0) 0x7fc5700be030 con 0x7fc57c0a4b80 2024-09-11T23:06:22.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.171+0000 7fc58429d640 1 -- 172.21.15.12:0/3373090422 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc57c0a6af0 con 0x7fc57c0a4b80 2024-09-11T23:06:22.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.171+0000 7fc56effd640 1 --2- 172.21.15.12:0/3373090422 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fc560035d20 0x7fc5600381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:22.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.171+0000 7fc56effd640 1 -- 172.21.15.12:0/3373090422 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 2587+0+0 (secure 0 0 0) 0x7fc5700bc070 con 0x7fc57c0a4b80 2024-09-11T23:06:22.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.171+0000 7fc581838640 1 --2- 172.21.15.12:0/3373090422 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fc560035d20 0x7fc5600381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:22.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.171+0000 7fc581838640 1 --2- 172.21.15.12:0/3373090422 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fc560035d20 0x7fc5600381e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc578007fd0 tx=0x7fc578007980 comp rx=0 tx=0).ready entity=mgr.4903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:22.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.175+0000 7fc56effd640 1 -- 172.21.15.12:0/3373090422 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc5700c5020 con 0x7fc57c0a4b80 2024-09-11T23:06:22.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.411+0000 7fc58429d640 1 -- 172.21.15.12:0/3373090422 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fc57c0a2eb0 con 0x7fc57c0a4b80 2024-09-11T23:06:22.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.411+0000 7fc56effd640 1 -- 172.21.15.12:0/3373090422 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) ==== 80+0+2534 (secure 0 0 0) 0x7fc570016010 con 0x7fc57c0a4b80 2024-09-11T23:06:22.415 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:06:22.415 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T23:06:22.415 INFO:teuthology.orchestra.run.smithi012.stdout: "auth_dump": [ 2024-09-11T23:06:22.415 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:06:22.416 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.a", 2024-09-11T23:06:22.416 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCgIeJmhYe5CRAAlzmzDPKc12SodkPehqtl6w==", 2024-09-11T23:06:22.416 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-11T23:06:22.416 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2024-09-11T23:06:22.416 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2024-09-11T23:06:22.416 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2024-09-11T23:06:22.417 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-09-11T23:06:22.417 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:06:22.417 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:06:22.417 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:06:22.417 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.b", 2024-09-11T23:06:22.417 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCgIeJmnvKREhAAp9c3Qvihpy4qTm50E9U26Q==", 2024-09-11T23:06:22.417 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-11T23:06:22.417 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2024-09-11T23:06:22.418 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2024-09-11T23:06:22.418 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2024-09-11T23:06:22.418 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-09-11T23:06:22.418 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:06:22.418 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:06:22.419 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:06:22.419 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.0", 2024-09-11T23:06:22.419 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCiIeJmy2qOLxAARUVUTFfFVrdRIhNhThjbTw==", 2024-09-11T23:06:22.419 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-11T23:06:22.419 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2024-09-11T23:06:22.419 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2024-09-11T23:06:22.419 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-09-11T23:06:22.420 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:06:22.420 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:06:22.420 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:06:22.420 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.1", 2024-09-11T23:06:22.420 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCmIeJmuc99HxAA0QxYJ1hvAsHb4uZPlh9GdA==", 2024-09-11T23:06:22.420 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-11T23:06:22.421 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2024-09-11T23:06:22.421 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2024-09-11T23:06:22.421 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-09-11T23:06:22.421 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:06:22.421 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:06:22.421 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:06:22.422 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.2", 2024-09-11T23:06:22.422 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCpIeJmBDhCMBAAipbJzeGy0AughJ+PfcX8ZA==", 2024-09-11T23:06:22.422 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-11T23:06:22.422 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2024-09-11T23:06:22.422 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2024-09-11T23:06:22.422 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-09-11T23:06:22.422 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:06:22.423 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:06:22.423 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:06:22.423 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.0", 2024-09-11T23:06:22.423 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCgIeJmTz6nGhAAveLcJxI+RD0GsD9nnR2S/w==", 2024-09-11T23:06:22.423 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-11T23:06:22.423 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2024-09-11T23:06:22.423 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow r", 2024-09-11T23:06:22.424 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-11T23:06:22.424 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:06:22.424 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:06:22.424 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:06:22.424 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.1", 2024-09-11T23:06:22.424 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCgIeJmkfu2HxAAKhML2j7GrGF1q/7cuNJtSA==", 2024-09-11T23:06:22.425 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-11T23:06:22.425 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2024-09-11T23:06:22.425 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow r", 2024-09-11T23:06:22.425 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow rw", 2024-09-11T23:06:22.425 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rwx" 2024-09-11T23:06:22.425 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:06:22.426 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:06:22.426 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:06:22.426 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.admin", 2024-09-11T23:06:22.426 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCfIeJml/f1MBAAdf0RuoLeBB0rcTxgaS2N3w==", 2024-09-11T23:06:22.426 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-11T23:06:22.426 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2024-09-11T23:06:22.427 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2024-09-11T23:06:22.427 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2024-09-11T23:06:22.427 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-09-11T23:06:22.427 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:06:22.427 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:06:22.427 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:06:22.428 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.x", 2024-09-11T23:06:22.428 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQCgIeJmgNCCBBAAS9gR6zgZL5ZX8chT2/0RUw==", 2024-09-11T23:06:22.428 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2024-09-11T23:06:22.428 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2024-09-11T23:06:22.428 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2024-09-11T23:06:22.429 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2024-09-11T23:06:22.429 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:06:22.429 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:06:22.429 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-11T23:06:22.429 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T23:06:22.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.415+0000 7fc58429d640 1 -- 172.21.15.12:0/3373090422 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fc560035d20 msgr2=0x7fc5600381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:22.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.415+0000 7fc58429d640 1 --2- 172.21.15.12:0/3373090422 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fc560035d20 0x7fc5600381e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc578007fd0 tx=0x7fc578007980 comp rx=0 tx=0).stop 2024-09-11T23:06:22.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.415+0000 7fc58429d640 1 -- 172.21.15.12:0/3373090422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc57c0a4b80 msgr2=0x7fc57c1ce880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:22.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.415+0000 7fc58429d640 1 --2- 172.21.15.12:0/3373090422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc57c0a4b80 0x7fc57c1ce880 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fc570019fc0 tx=0x7fc57001abd0 comp rx=0 tx=0).stop 2024-09-11T23:06:22.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.415+0000 7fc58429d640 1 -- 172.21.15.12:0/3373090422 shutdown_connections 2024-09-11T23:06:22.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.415+0000 7fc58429d640 1 --2- 172.21.15.12:0/3373090422 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fc560035d20 0x7fc5600381e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:22.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.415+0000 7fc58429d640 1 --2- 172.21.15.12:0/3373090422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc57c0a4b80 0x7fc57c1ce880 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:22.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.415+0000 7fc58429d640 1 -- 172.21.15.12:0/3373090422 >> 172.21.15.12:0/3373090422 conn(0x7fc57c0ac2c0 msgr2=0x7fc57c13f660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:22.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.415+0000 7fc58429d640 1 -- 172.21.15.12:0/3373090422 shutdown_connections 2024-09-11T23:06:22.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.415+0000 7fc58429d640 1 -- 172.21.15.12:0/3373090422 wait complete. 2024-09-11T23:06:22.436 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-11T23:06:22.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.563+0000 7fc09875f640 1 Processor -- start 2024-09-11T23:06:22.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.563+0000 7fc09875f640 1 -- start start 2024-09-11T23:06:22.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.563+0000 7fc09875f640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc090137080 0x7fc09013bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:22.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.563+0000 7fc09875f640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0900a1ff0 con 0x7fc090136ca0 2024-09-11T23:06:22.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.563+0000 7fc09875f640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fc09009b4a0 con 0x7fc090137080 2024-09-11T23:06:22.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.563+0000 7fc0964fb640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fc090136ca0 0x7fc09009ad90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38108/0 (socket says 172.21.15.12:38108) 2024-09-11T23:06:22.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.563+0000 7fc095cfa640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc090137080 0x7fc09013bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:22.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.563+0000 7fc0964fb640 1 -- 172.21.15.12:0/1653922448 learned_addr learned my addr 172.21.15.12:0/1653922448 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:22.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.567+0000 7fc095cfa640 1 -- 172.21.15.12:0/1653922448 >> v1:172.21.15.12:6789/0 conn(0x7fc090136ca0 legacy=0x7fc09009ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:22.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.567+0000 7fc095cfa640 1 -- 172.21.15.12:0/1653922448 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0900a0eb0 con 0x7fc090137080 2024-09-11T23:06:22.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.567+0000 7fc095cfa640 1 --2- 172.21.15.12:0/1653922448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc090137080 0x7fc09013bb70 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fc084009d90 tx=0x7fc08401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d97ff8655b316fb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:22.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.567+0000 7fc0954f9640 1 -- 172.21.15.12:0/1653922448 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0840b2070 con 0x7fc090137080 2024-09-11T23:06:22.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.567+0000 7fc0954f9640 1 -- 172.21.15.12:0/1653922448 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0840a56e0 con 0x7fc090137080 2024-09-11T23:06:22.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.567+0000 7fc0954f9640 1 -- 172.21.15.12:0/1653922448 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0840a59e0 con 0x7fc090137080 2024-09-11T23:06:22.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.567+0000 7fc09875f640 1 -- 172.21.15.12:0/1653922448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc090137080 msgr2=0x7fc09013bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:22.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.567+0000 7fc09875f640 1 --2- 172.21.15.12:0/1653922448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc090137080 0x7fc09013bb70 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fc084009d90 tx=0x7fc08401c970 comp rx=0 tx=0).stop 2024-09-11T23:06:22.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.567+0000 7fc09875f640 1 -- 172.21.15.12:0/1653922448 shutdown_connections 2024-09-11T23:06:22.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.567+0000 7fc09875f640 1 --2- 172.21.15.12:0/1653922448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc090137080 0x7fc09013bb70 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:22.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.567+0000 7fc09875f640 1 -- 172.21.15.12:0/1653922448 >> 172.21.15.12:0/1653922448 conn(0x7fc0900a8450 msgr2=0x7fc0900a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:22.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.567+0000 7fc09875f640 1 -- 172.21.15.12:0/1653922448 shutdown_connections 2024-09-11T23:06:22.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.567+0000 7fc09875f640 1 -- 172.21.15.12:0/1653922448 wait complete. 2024-09-11T23:06:22.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.571+0000 7fc09875f640 1 Processor -- start 2024-09-11T23:06:22.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.571+0000 7fc09875f640 1 -- start start 2024-09-11T23:06:22.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.571+0000 7fc09875f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc090136ca0 0x7fc09006fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:22.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.571+0000 7fc09875f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc09013ec60 con 0x7fc090136ca0 2024-09-11T23:06:22.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.571+0000 7fc0964fb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc090136ca0 0x7fc09006fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:22.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.571+0000 7fc0964fb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc090136ca0 0x7fc09006fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34728/0 (socket says 172.21.15.12:34728) 2024-09-11T23:06:22.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.571+0000 7fc0964fb640 1 -- 172.21.15.12:0/4021288248 learned_addr learned my addr 172.21.15.12:0/4021288248 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:22.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.571+0000 7fc0964fb640 1 -- 172.21.15.12:0/4021288248 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc090134280 con 0x7fc090136ca0 2024-09-11T23:06:22.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.571+0000 7fc0964fb640 1 --2- 172.21.15.12:0/4021288248 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc090136ca0 0x7fc09006fc40 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fc08c00c380 tx=0x7fc08c00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:22.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.571+0000 7fc082ffd640 1 -- 172.21.15.12:0/4021288248 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc08c017070 con 0x7fc090136ca0 2024-09-11T23:06:22.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.571+0000 7fc082ffd640 1 -- 172.21.15.12:0/4021288248 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc08c005c20 con 0x7fc090136ca0 2024-09-11T23:06:22.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.571+0000 7fc09875f640 1 -- 172.21.15.12:0/4021288248 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc09011e560 con 0x7fc090136ca0 2024-09-11T23:06:22.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.571+0000 7fc082ffd640 1 -- 172.21.15.12:0/4021288248 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc08c0070d0 con 0x7fc090136ca0 2024-09-11T23:06:22.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.571+0000 7fc09875f640 1 -- 172.21.15.12:0/4021288248 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc090136540 con 0x7fc090136ca0 2024-09-11T23:06:22.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.571+0000 7fc082ffd640 1 -- 172.21.15.12:0/4021288248 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 32) ==== 43997+0+0 (secure 0 0 0) 0x7fc08c01a070 con 0x7fc090136ca0 2024-09-11T23:06:22.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.571+0000 7fc09875f640 1 -- 172.21.15.12:0/4021288248 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc09009ad90 con 0x7fc090136ca0 2024-09-11T23:06:22.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.571+0000 7fc082ffd640 1 --2- 172.21.15.12:0/4021288248 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fc074035cd0 0x7fc074038190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:22.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.571+0000 7fc082ffd640 1 -- 172.21.15.12:0/4021288248 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 2587+0+0 (secure 0 0 0) 0x7fc08c047550 con 0x7fc090136ca0 2024-09-11T23:06:22.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.571+0000 7fc095cfa640 1 --2- 172.21.15.12:0/4021288248 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fc074035cd0 0x7fc074038190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:22.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.571+0000 7fc095cfa640 1 --2- 172.21.15.12:0/4021288248 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fc074035cd0 0x7fc074038190 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc0840af000 tx=0x7fc0840a7070 comp rx=0 tx=0).ready entity=mgr.4903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:22.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.579+0000 7fc082ffd640 1 -- 172.21.15.12:0/4021288248 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc08c010900 con 0x7fc090136ca0 2024-09-11T23:06:22.581 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:22.575+0000 7f02a2c51640 -1 client.4935: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.4890:b65aeaeb-3f3a-4da2-97b5-6988dece6be2:v1:172.21.15.12:0/2496375865] 2024-09-11T23:06:22.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.755+0000 7fc09875f640 1 -- 172.21.15.12:0/4021288248 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fc09011e9a0 con 0x7fc090136ca0 2024-09-11T23:06:22.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.755+0000 7fc082ffd640 1 -- 172.21.15.12:0/4021288248 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v61) ==== 84+0+65 (secure 0 0 0) 0x7fc08c01b730 con 0x7fc090136ca0 2024-09-11T23:06:22.758 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:06:22.758 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2024-09-11T23:06:22.758 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-11T23:06:22.758 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 1, 2024-09-11T23:06:22.758 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": ".mgr" 2024-09-11T23:06:22.758 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:06:22.758 INFO:teuthology.orchestra.run.smithi012.stdout:] 2024-09-11T23:06:22.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.759+0000 7fc09875f640 1 -- 172.21.15.12:0/4021288248 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fc074035cd0 msgr2=0x7fc074038190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:22.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.759+0000 7fc09875f640 1 --2- 172.21.15.12:0/4021288248 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fc074035cd0 0x7fc074038190 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc0840af000 tx=0x7fc0840a7070 comp rx=0 tx=0).stop 2024-09-11T23:06:22.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.759+0000 7fc09875f640 1 -- 172.21.15.12:0/4021288248 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc090136ca0 msgr2=0x7fc09006fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:22.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.759+0000 7fc09875f640 1 --2- 172.21.15.12:0/4021288248 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc090136ca0 0x7fc09006fc40 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fc08c00c380 tx=0x7fc08c00c840 comp rx=0 tx=0).stop 2024-09-11T23:06:22.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.759+0000 7fc09875f640 1 -- 172.21.15.12:0/4021288248 shutdown_connections 2024-09-11T23:06:22.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.759+0000 7fc09875f640 1 --2- 172.21.15.12:0/4021288248 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fc074035cd0 0x7fc074038190 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:22.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.759+0000 7fc09875f640 1 --2- 172.21.15.12:0/4021288248 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc090136ca0 0x7fc09006fc40 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:22.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.759+0000 7fc09875f640 1 -- 172.21.15.12:0/4021288248 >> 172.21.15.12:0/4021288248 conn(0x7fc0900a8450 msgr2=0x7fc0900a7330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:22.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.759+0000 7fc09875f640 1 -- 172.21.15.12:0/4021288248 shutdown_connections 2024-09-11T23:06:22.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.759+0000 7fc09875f640 1 -- 172.21.15.12:0/4021288248 wait complete. 2024-09-11T23:06:22.777 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T23:06:22.778 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T23:06:22.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.911+0000 7f2713a0e640 1 Processor -- start 2024-09-11T23:06:22.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.911+0000 7f2713a0e640 1 -- start start 2024-09-11T23:06:22.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.911+0000 7f2713a0e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f270c070160 0x7f270c070540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:22.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.911+0000 7f2713a0e640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f270c072850 con 0x7f270c070a80 2024-09-11T23:06:22.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.911+0000 7f2713a0e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f270c074130 con 0x7f270c070160 2024-09-11T23:06:22.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.911+0000 7f27117aa640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f270c070160 0x7f270c070540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:22.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.915+0000 7f27117aa640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f270c070160 0x7f270c070540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34742/0 (socket says 172.21.15.12:34742) 2024-09-11T23:06:22.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.915+0000 7f2710fa9640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f270c070a80 0x7f270c13a050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38120/0 (socket says 172.21.15.12:38120) 2024-09-11T23:06:22.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.915+0000 7f27117aa640 1 -- 172.21.15.12:0/2244050221 learned_addr learned my addr 172.21.15.12:0/2244050221 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:22.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.915+0000 7f27117aa640 1 -- 172.21.15.12:0/2244050221 >> v1:172.21.15.12:6789/0 conn(0x7f270c070a80 legacy=0x7f270c13a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:22.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.915+0000 7f27117aa640 1 -- 172.21.15.12:0/2244050221 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f270c072b60 con 0x7f270c070160 2024-09-11T23:06:22.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.915+0000 7f27117aa640 1 --2- 172.21.15.12:0/2244050221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f270c070160 0x7f270c070540 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f27040097f0 tx=0x7f270401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=910db440f135be1f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:22.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.915+0000 7f2703fff640 1 -- 172.21.15.12:0/2244050221 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27040b0070 con 0x7f270c070160 2024-09-11T23:06:22.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.915+0000 7f2703fff640 1 -- 172.21.15.12:0/2244050221 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27040ab530 con 0x7f270c070160 2024-09-11T23:06:22.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.915+0000 7f2703fff640 1 -- 172.21.15.12:0/2244050221 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27040ab830 con 0x7f270c070160 2024-09-11T23:06:22.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.915+0000 7f2713a0e640 1 -- 172.21.15.12:0/2244050221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f270c070160 msgr2=0x7f270c070540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:22.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.915+0000 7f2713a0e640 1 --2- 172.21.15.12:0/2244050221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f270c070160 0x7f270c070540 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f27040097f0 tx=0x7f270401c450 comp rx=0 tx=0).stop 2024-09-11T23:06:22.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.915+0000 7f2713a0e640 1 -- 172.21.15.12:0/2244050221 shutdown_connections 2024-09-11T23:06:22.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.915+0000 7f2713a0e640 1 --2- 172.21.15.12:0/2244050221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f270c070160 0x7f270c070540 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:22.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.915+0000 7f2713a0e640 1 -- 172.21.15.12:0/2244050221 >> 172.21.15.12:0/2244050221 conn(0x7f270c09add0 msgr2=0x7f270c09b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:22.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.915+0000 7f2713a0e640 1 -- 172.21.15.12:0/2244050221 shutdown_connections 2024-09-11T23:06:22.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.915+0000 7f2713a0e640 1 -- 172.21.15.12:0/2244050221 wait complete. 2024-09-11T23:06:22.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.919+0000 7f2713a0e640 1 Processor -- start 2024-09-11T23:06:22.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.919+0000 7f2713a0e640 1 -- start start 2024-09-11T23:06:22.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.919+0000 7f2713a0e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f270c070a80 0x7f270c11eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:22.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.919+0000 7f2713a0e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f270c070e90 con 0x7f270c070a80 2024-09-11T23:06:22.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.919+0000 7f27117aa640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f270c070a80 0x7f270c11eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:22.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.919+0000 7f27117aa640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f270c070a80 0x7f270c11eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34752/0 (socket says 172.21.15.12:34752) 2024-09-11T23:06:22.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.919+0000 7f27117aa640 1 -- 172.21.15.12:0/3756657304 learned_addr learned my addr 172.21.15.12:0/3756657304 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:22.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.919+0000 7f27117aa640 1 -- 172.21.15.12:0/3756657304 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f270c0a7300 con 0x7f270c070a80 2024-09-11T23:06:22.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.919+0000 7f27117aa640 1 --2- 172.21.15.12:0/3756657304 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f270c070a80 0x7f270c11eea0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f270401a080 tx=0x7f270401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:22.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.919+0000 7f2701ffb640 1 -- 172.21.15.12:0/3756657304 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27040ba020 con 0x7f270c070a80 2024-09-11T23:06:22.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.919+0000 7f2701ffb640 1 -- 172.21.15.12:0/3756657304 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27040b6420 con 0x7f270c070a80 2024-09-11T23:06:22.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.919+0000 7f2713a0e640 1 -- 172.21.15.12:0/3756657304 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f270c0a4de0 con 0x7f270c070a80 2024-09-11T23:06:22.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.919+0000 7f2701ffb640 1 -- 172.21.15.12:0/3756657304 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27040b0040 con 0x7f270c070a80 2024-09-11T23:06:22.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.919+0000 7f2713a0e640 1 -- 172.21.15.12:0/3756657304 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f270c0a8000 con 0x7f270c070a80 2024-09-11T23:06:22.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.919+0000 7f2701ffb640 1 -- 172.21.15.12:0/3756657304 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 32) ==== 43997+0+0 (secure 0 0 0) 0x7f27040bd020 con 0x7f270c070a80 2024-09-11T23:06:22.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.919+0000 7f2713a0e640 1 -- 172.21.15.12:0/3756657304 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f270c067c60 con 0x7f270c070a80 2024-09-11T23:06:22.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.919+0000 7f2701ffb640 1 --2- 172.21.15.12:0/3756657304 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f26f0035d20 0x7f26f00381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:22.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.919+0000 7f2701ffb640 1 -- 172.21.15.12:0/3756657304 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 2587+0+0 (secure 0 0 0) 0x7f27040e2440 con 0x7f270c070a80 2024-09-11T23:06:22.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.919+0000 7f2710fa9640 1 --2- 172.21.15.12:0/3756657304 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f26f0035d20 0x7f26f00381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:22.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.919+0000 7f2710fa9640 1 --2- 172.21.15.12:0/3756657304 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f26f0035d20 0x7f26f00381e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f26fc001620 tx=0x7f26fc007a10 comp rx=0 tx=0).ready entity=mgr.4903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:22.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:22.923+0000 7f2701ffb640 1 -- 172.21.15.12:0/3756657304 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f27040c4030 con 0x7f270c070a80 2024-09-11T23:06:23.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:23.099+0000 7f2713a0e640 1 -- 172.21.15.12:0/3756657304 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f270c072d80 con 0x7f270c070a80 2024-09-11T23:06:23.356 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:23.351+0000 7f02a2c51640 -1 client.4935: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.4890:b65aeaeb-3f3a-4da2-97b5-6988dece6be2:v1:172.21.15.12:0/2496375865] 2024-09-11T23:06:23.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:23.963+0000 7f2701ffb640 1 -- 172.21.15.12:0/3756657304 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v62) ==== 138+0+0 (secure 0 0 0) 0x7f27040160d0 con 0x7f270c070a80 2024-09-11T23:06:23.967 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' created 2024-09-11T23:06:23.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:23.967+0000 7f2713a0e640 1 -- 172.21.15.12:0/3756657304 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f26f0035d20 msgr2=0x7f26f00381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:23.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:23.967+0000 7f2713a0e640 1 --2- 172.21.15.12:0/3756657304 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f26f0035d20 0x7f26f00381e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f26fc001620 tx=0x7f26fc007a10 comp rx=0 tx=0).stop 2024-09-11T23:06:23.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:23.967+0000 7f2713a0e640 1 -- 172.21.15.12:0/3756657304 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f270c070a80 msgr2=0x7f270c11eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:23.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:23.967+0000 7f2713a0e640 1 --2- 172.21.15.12:0/3756657304 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f270c070a80 0x7f270c11eea0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f270401a080 tx=0x7f270401ac90 comp rx=0 tx=0).stop 2024-09-11T23:06:23.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:23.967+0000 7f2713a0e640 1 -- 172.21.15.12:0/3756657304 shutdown_connections 2024-09-11T23:06:23.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:23.967+0000 7f2713a0e640 1 --2- 172.21.15.12:0/3756657304 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f26f0035d20 0x7f26f00381e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:23.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:23.967+0000 7f2713a0e640 1 --2- 172.21.15.12:0/3756657304 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f270c070a80 0x7f270c11eea0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:23.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:23.967+0000 7f2713a0e640 1 -- 172.21.15.12:0/3756657304 >> 172.21.15.12:0/3756657304 conn(0x7f270c09add0 msgr2=0x7f270c13c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:23.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:23.967+0000 7f2713a0e640 1 -- 172.21.15.12:0/3756657304 shutdown_connections 2024-09-11T23:06:23.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:23.967+0000 7f2713a0e640 1 -- 172.21.15.12:0/3756657304 wait complete. 2024-09-11T23:06:23.999 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T23:06:24.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.139+0000 7fb9c3849640 1 Processor -- start 2024-09-11T23:06:24.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.139+0000 7fb9c3849640 1 -- start start 2024-09-11T23:06:24.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.139+0000 7fb9c3849640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb9bc09f060 0x7fb9bc13cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:24.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.139+0000 7fb9c3849640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9bc134500 con 0x7fb9bc134720 2024-09-11T23:06:24.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.139+0000 7fb9c3849640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fb9bc135210 con 0x7fb9bc09f060 2024-09-11T23:06:24.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.139+0000 7fb9c0de4640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb9bc09f060 0x7fb9bc13cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:24.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.139+0000 7fb9c15e5640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fb9bc134720 0x7fb9bc134b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38128/0 (socket says 172.21.15.12:38128) 2024-09-11T23:06:24.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.139+0000 7fb9c15e5640 1 -- 172.21.15.12:0/1070153660 learned_addr learned my addr 172.21.15.12:0/1070153660 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:24.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.143+0000 7fb9c0de4640 1 -- 172.21.15.12:0/1070153660 >> v1:172.21.15.12:6789/0 conn(0x7fb9bc134720 legacy=0x7fb9bc134b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:24.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.143+0000 7fb9c0de4640 1 -- 172.21.15.12:0/1070153660 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9bc1341f0 con 0x7fb9bc09f060 2024-09-11T23:06:24.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.143+0000 7fb9b3fff640 1 -- 172.21.15.12:0/1070153660 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2376378448 0 0) 0x7fb9bc134500 con 0x7fb9bc134720 2024-09-11T23:06:24.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.143+0000 7fb9c0de4640 1 --2- 172.21.15.12:0/1070153660 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9bc09f060 0x7fb9bc13cb60 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac009740 tx=0x7fb9ac01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e88ce85353b1899 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:24.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.143+0000 7fb9b3fff640 1 -- 172.21.15.12:0/1070153660 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9ac0b0070 con 0x7fb9bc09f060 2024-09-11T23:06:24.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.143+0000 7fb9b3fff640 1 -- 172.21.15.12:0/1070153660 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9ac0ab530 con 0x7fb9bc09f060 2024-09-11T23:06:24.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.143+0000 7fb9b3fff640 1 -- 172.21.15.12:0/1070153660 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9ac0ab830 con 0x7fb9bc09f060 2024-09-11T23:06:24.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.143+0000 7fb9c3849640 1 -- 172.21.15.12:0/1070153660 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9bc09f060 msgr2=0x7fb9bc13cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:24.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.143+0000 7fb9c3849640 1 --2- 172.21.15.12:0/1070153660 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9bc09f060 0x7fb9bc13cb60 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac009740 tx=0x7fb9ac01c420 comp rx=0 tx=0).stop 2024-09-11T23:06:24.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.143+0000 7fb9c3849640 1 -- 172.21.15.12:0/1070153660 shutdown_connections 2024-09-11T23:06:24.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.143+0000 7fb9c3849640 1 --2- 172.21.15.12:0/1070153660 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9bc09f060 0x7fb9bc13cb60 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:24.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.143+0000 7fb9c3849640 1 -- 172.21.15.12:0/1070153660 >> 172.21.15.12:0/1070153660 conn(0x7fb9bc09a9d0 msgr2=0x7fb9bc09cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:24.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.143+0000 7fb9c3849640 1 -- 172.21.15.12:0/1070153660 shutdown_connections 2024-09-11T23:06:24.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.143+0000 7fb9c3849640 1 -- 172.21.15.12:0/1070153660 wait complete. 2024-09-11T23:06:24.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.147+0000 7fb9c3849640 1 Processor -- start 2024-09-11T23:06:24.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.147+0000 7fb9c3849640 1 -- start start 2024-09-11T23:06:24.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.147+0000 7fb9c3849640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9bc09f060 0x7fb9bc0a5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:24.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.147+0000 7fb9c3849640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb9bc13f8c0 con 0x7fb9bc09f060 2024-09-11T23:06:24.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.147+0000 7fb9c15e5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9bc09f060 0x7fb9bc0a5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:24.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.147+0000 7fb9c15e5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9bc09f060 0x7fb9bc0a5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34764/0 (socket says 172.21.15.12:34764) 2024-09-11T23:06:24.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.147+0000 7fb9c15e5640 1 -- 172.21.15.12:0/3364254425 learned_addr learned my addr 172.21.15.12:0/3364254425 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:24.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.147+0000 7fb9c15e5640 1 -- 172.21.15.12:0/3364254425 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9bc0a51f0 con 0x7fb9bc09f060 2024-09-11T23:06:24.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.147+0000 7fb9c15e5640 1 --2- 172.21.15.12:0/3364254425 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9bc09f060 0x7fb9bc0a5c30 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fb9b800c420 tx=0x7fb9b800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:24.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.147+0000 7fb9b1ffb640 1 -- 172.21.15.12:0/3364254425 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9b8018070 con 0x7fb9bc09f060 2024-09-11T23:06:24.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.147+0000 7fb9b1ffb640 1 -- 172.21.15.12:0/3364254425 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9b80074d0 con 0x7fb9bc09f060 2024-09-11T23:06:24.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.147+0000 7fb9c3849640 1 -- 172.21.15.12:0/3364254425 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9bc0a28a0 con 0x7fb9bc09f060 2024-09-11T23:06:24.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.147+0000 7fb9b1ffb640 1 -- 172.21.15.12:0/3364254425 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9b8004960 con 0x7fb9bc09f060 2024-09-11T23:06:24.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.147+0000 7fb9c3849640 1 -- 172.21.15.12:0/3364254425 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9bc0a4ee0 con 0x7fb9bc09f060 2024-09-11T23:06:24.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.147+0000 7fb9b1ffb640 1 -- 172.21.15.12:0/3364254425 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 32) ==== 43997+0+0 (secure 0 0 0) 0x7fb9b801b070 con 0x7fb9bc09f060 2024-09-11T23:06:24.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.147+0000 7fb9c3849640 1 -- 172.21.15.12:0/3364254425 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9bc0a6170 con 0x7fb9bc09f060 2024-09-11T23:06:24.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.147+0000 7fb9b1ffb640 1 --2- 172.21.15.12:0/3364254425 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fb9a0035d20 0x7fb9a00381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:24.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.147+0000 7fb9b1ffb640 1 -- 172.21.15.12:0/3364254425 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 2957+0+0 (secure 0 0 0) 0x7fb9b80476d0 con 0x7fb9bc09f060 2024-09-11T23:06:24.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.147+0000 7fb9c0de4640 1 --2- 172.21.15.12:0/3364254425 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fb9a0035d20 0x7fb9a00381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:24.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.147+0000 7fb9c0de4640 1 --2- 172.21.15.12:0/3364254425 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fb9a0035d20 0x7fb9a00381e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac0ad000 tx=0x7fb9ac0a6000 comp rx=0 tx=0).ready entity=mgr.4903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:24.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.155+0000 7fb9b1ffb640 1 -- 172.21.15.12:0/3364254425 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb9b801ae10 con 0x7fb9bc09f060 2024-09-11T23:06:24.213 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:24.211+0000 7f02a2c51640 -1 client.4935: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.4890:b65aeaeb-3f3a-4da2-97b5-6988dece6be2:v1:172.21.15.12:0/2496375865] 2024-09-11T23:06:24.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.327+0000 7fb9c3849640 1 -- 172.21.15.12:0/3364254425 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fb9bc06be50 con 0x7fb9bc09f060 2024-09-11T23:06:24.742 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:06:24.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.971+0000 7fb9b1ffb640 1 -- 172.21.15.12:0/3364254425 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v63) ==== 170+0+0 (secure 0 0 0) 0x7fb9b8011920 con 0x7fb9bc09f060 2024-09-11T23:06:24.995 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' created 2024-09-11T23:06:24.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.979+0000 7fb9c3849640 1 -- 172.21.15.12:0/3364254425 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fb9a0035d20 msgr2=0x7fb9a00381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:24.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.979+0000 7fb9c3849640 1 --2- 172.21.15.12:0/3364254425 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fb9a0035d20 0x7fb9a00381e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac0ad000 tx=0x7fb9ac0a6000 comp rx=0 tx=0).stop 2024-09-11T23:06:24.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.979+0000 7fb9c3849640 1 -- 172.21.15.12:0/3364254425 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9bc09f060 msgr2=0x7fb9bc0a5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:24.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.979+0000 7fb9c3849640 1 --2- 172.21.15.12:0/3364254425 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9bc09f060 0x7fb9bc0a5c30 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fb9b800c420 tx=0x7fb9b800c8e0 comp rx=0 tx=0).stop 2024-09-11T23:06:24.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.979+0000 7fb9c3849640 1 -- 172.21.15.12:0/3364254425 shutdown_connections 2024-09-11T23:06:24.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.979+0000 7fb9c3849640 1 --2- 172.21.15.12:0/3364254425 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fb9a0035d20 0x7fb9a00381e0 secure :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac0ad000 tx=0x7fb9ac0a6000 comp rx=0 tx=0).stop 2024-09-11T23:06:24.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.979+0000 7fb9c3849640 1 --2- 172.21.15.12:0/3364254425 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9bc09f060 0x7fb9bc0a5c30 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:24.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.979+0000 7fb9c3849640 1 -- 172.21.15.12:0/3364254425 >> 172.21.15.12:0/3364254425 conn(0x7fb9bc09a9d0 msgr2=0x7fb9bc09be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:24.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.979+0000 7fb9c3849640 1 -- 172.21.15.12:0/3364254425 shutdown_connections 2024-09-11T23:06:24.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:24.979+0000 7fb9c3849640 1 -- 172.21.15.12:0/3364254425 wait complete. 2024-09-11T23:06:25.019 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T23:06:25.109 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:25.103+0000 7f02a2c51640 -1 client.4935: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.4890:b65aeaeb-3f3a-4da2-97b5-6988dece6be2:v1:172.21.15.12:0/2496375865] 2024-09-11T23:06:25.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.147+0000 7f7a3a826640 1 Processor -- start 2024-09-11T23:06:25.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.147+0000 7f7a3a826640 1 -- start start 2024-09-11T23:06:25.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.147+0000 7f7a3a826640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7a34136da0 0x7f7a34137180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:25.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.147+0000 7f7a3a826640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a340a1e90 con 0x7f7a3409ac20 2024-09-11T23:06:25.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.147+0000 7f7a3a826640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f7a341376c0 con 0x7f7a34136da0 2024-09-11T23:06:25.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.147+0000 7f7a33fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7a34136da0 0x7f7a34137180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:25.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.147+0000 7f7a337fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f7a3409ac20 0x7f7a340a36a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38596/0 (socket says 172.21.15.12:38596) 2024-09-11T23:06:25.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.147+0000 7f7a337fe640 1 -- 172.21.15.12:0/88221 learned_addr learned my addr 172.21.15.12:0/88221 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:25.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.147+0000 7f7a33fff640 1 -- 172.21.15.12:0/88221 >> v1:172.21.15.12:6789/0 conn(0x7f7a3409ac20 legacy=0x7f7a340a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:25.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.147+0000 7f7a33fff640 1 -- 172.21.15.12:0/88221 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a340a0650 con 0x7f7a34136da0 2024-09-11T23:06:25.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.147+0000 7f7a32ffd640 1 -- 172.21.15.12:0/88221 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 111003808 0 0) 0x7f7a340a1e90 con 0x7f7a3409ac20 2024-09-11T23:06:25.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.151+0000 7f7a33fff640 1 --2- 172.21.15.12:0/88221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a34136da0 0x7f7a34137180 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c009d90 tx=0x7f7a2c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea2bdad321aafc54 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:25.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.151+0000 7f7a32ffd640 1 -- 172.21.15.12:0/88221 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a2c0b2070 con 0x7f7a34136da0 2024-09-11T23:06:25.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.151+0000 7f7a32ffd640 1 -- 172.21.15.12:0/88221 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a2c0a56e0 con 0x7f7a34136da0 2024-09-11T23:06:25.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.151+0000 7f7a32ffd640 1 -- 172.21.15.12:0/88221 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a2c0a59e0 con 0x7f7a34136da0 2024-09-11T23:06:25.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.151+0000 7f7a3a826640 1 -- 172.21.15.12:0/88221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a34136da0 msgr2=0x7f7a34137180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:25.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.151+0000 7f7a3a826640 1 --2- 172.21.15.12:0/88221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a34136da0 0x7f7a34137180 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c009d90 tx=0x7f7a2c01c970 comp rx=0 tx=0).stop 2024-09-11T23:06:25.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.151+0000 7f7a3a826640 1 -- 172.21.15.12:0/88221 shutdown_connections 2024-09-11T23:06:25.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.151+0000 7f7a3a826640 1 --2- 172.21.15.12:0/88221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a34136da0 0x7f7a34137180 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:25.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.151+0000 7f7a3a826640 1 -- 172.21.15.12:0/88221 >> 172.21.15.12:0/88221 conn(0x7f7a340a82f0 msgr2=0x7f7a340a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:25.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.151+0000 7f7a3a826640 1 -- 172.21.15.12:0/88221 shutdown_connections 2024-09-11T23:06:25.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.151+0000 7f7a3a826640 1 -- 172.21.15.12:0/88221 wait complete. 2024-09-11T23:06:25.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.151+0000 7f7a3a826640 1 Processor -- start 2024-09-11T23:06:25.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.151+0000 7f7a3a826640 1 -- start start 2024-09-11T23:06:25.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.151+0000 7f7a3a826640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a3409ac20 0x7f7a34071bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:25.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.151+0000 7f7a3a826640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7a3413ee20 con 0x7f7a3409ac20 2024-09-11T23:06:25.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.151+0000 7f7a33fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a3409ac20 0x7f7a34071bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:25.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.151+0000 7f7a33fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a3409ac20 0x7f7a34071bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49184/0 (socket says 172.21.15.12:49184) 2024-09-11T23:06:25.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.151+0000 7f7a33fff640 1 -- 172.21.15.12:0/1457400218 learned_addr learned my addr 172.21.15.12:0/1457400218 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:25.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.151+0000 7f7a33fff640 1 -- 172.21.15.12:0/1457400218 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a3411edc0 con 0x7f7a3409ac20 2024-09-11T23:06:25.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.151+0000 7f7a33fff640 1 --2- 172.21.15.12:0/1457400218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a3409ac20 0x7f7a34071bc0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c01a5a0 tx=0x7f7a2c019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:25.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.151+0000 7f7a30ff9640 1 -- 172.21.15.12:0/1457400218 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a2c0bd030 con 0x7f7a3409ac20 2024-09-11T23:06:25.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.151+0000 7f7a30ff9640 1 -- 172.21.15.12:0/1457400218 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a2c0b85a0 con 0x7f7a3409ac20 2024-09-11T23:06:25.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.151+0000 7f7a3a826640 1 -- 172.21.15.12:0/1457400218 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a34120450 con 0x7f7a3409ac20 2024-09-11T23:06:25.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.151+0000 7f7a30ff9640 1 -- 172.21.15.12:0/1457400218 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a2c0b2040 con 0x7f7a3409ac20 2024-09-11T23:06:25.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.151+0000 7f7a3a826640 1 -- 172.21.15.12:0/1457400218 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a3413bd20 con 0x7f7a3409ac20 2024-09-11T23:06:25.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.155+0000 7f7a3a826640 1 -- 172.21.15.12:0/1457400218 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a34120800 con 0x7f7a3409ac20 2024-09-11T23:06:25.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.155+0000 7f7a30ff9640 1 -- 172.21.15.12:0/1457400218 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 32) ==== 43997+0+0 (secure 0 0 0) 0x7f7a2c0c0070 con 0x7f7a3409ac20 2024-09-11T23:06:25.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.155+0000 7f7a30ff9640 1 --2- 172.21.15.12:0/1457400218 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f7a14035d20 0x7f7a140381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:25.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.155+0000 7f7a30ff9640 1 -- 172.21.15.12:0/1457400218 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 3339+0+0 (secure 0 0 0) 0x7f7a2c0be070 con 0x7f7a3409ac20 2024-09-11T23:06:25.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.155+0000 7f7a337fe640 1 --2- 172.21.15.12:0/1457400218 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f7a14035d20 0x7f7a140381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:25.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.155+0000 7f7a337fe640 1 --2- 172.21.15.12:0/1457400218 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f7a14035d20 0x7f7a140381e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7a24007fd0 tx=0x7f7a24007920 comp rx=0 tx=0).ready entity=mgr.4903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:25.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.159+0000 7f7a30ff9640 1 -- 172.21.15.12:0/1457400218 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7a2c0c7070 con 0x7f7a3409ac20 2024-09-11T23:06:25.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.371+0000 7f7a3a826640 1 -- 172.21.15.12:0/1457400218 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f7a340738b0 con 0x7f7a3409ac20 2024-09-11T23:06:25.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.975+0000 7f7a30ff9640 1 -- 172.21.15.12:0/1457400218 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v45) ==== 174+0+0 (secure 0 0 0) 0x7f7a2c016560 con 0x7f7a3409ac20 2024-09-11T23:06:25.977 INFO:teuthology.orchestra.run.smithi012.stderr:new fs with metadata pool 12 and data pool 13 2024-09-11T23:06:25.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.979+0000 7f7a3a826640 1 -- 172.21.15.12:0/1457400218 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f7a14035d20 msgr2=0x7f7a140381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:25.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.979+0000 7f7a3a826640 1 --2- 172.21.15.12:0/1457400218 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f7a14035d20 0x7f7a140381e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7a24007fd0 tx=0x7f7a24007920 comp rx=0 tx=0).stop 2024-09-11T23:06:25.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.979+0000 7f7a3a826640 1 -- 172.21.15.12:0/1457400218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a3409ac20 msgr2=0x7f7a34071bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:25.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.979+0000 7f7a3a826640 1 --2- 172.21.15.12:0/1457400218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a3409ac20 0x7f7a34071bc0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c01a5a0 tx=0x7f7a2c019710 comp rx=0 tx=0).stop 2024-09-11T23:06:25.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.979+0000 7f7a3a826640 1 -- 172.21.15.12:0/1457400218 shutdown_connections 2024-09-11T23:06:25.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.979+0000 7f7a3a826640 1 --2- 172.21.15.12:0/1457400218 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f7a14035d20 0x7f7a140381e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:25.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.979+0000 7f7a3a826640 1 --2- 172.21.15.12:0/1457400218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a3409ac20 0x7f7a34071bc0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:25.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.979+0000 7f7a3a826640 1 -- 172.21.15.12:0/1457400218 >> 172.21.15.12:0/1457400218 conn(0x7f7a340a82f0 msgr2=0x7f7a340a7170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:25.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.979+0000 7f7a3a826640 1 -- 172.21.15.12:0/1457400218 shutdown_connections 2024-09-11T23:06:25.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:25.979+0000 7f7a3a826640 1 -- 172.21.15.12:0/1457400218 wait complete. 2024-09-11T23:06:25.985 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:25.979+0000 7f02a2c51640 -1 client.4935: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.4890:b65aeaeb-3f3a-4da2-97b5-6988dece6be2:v1:172.21.15.12:0/2496375865] 2024-09-11T23:06:26.024 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:06:26.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.143+0000 7fc222b04640 1 Processor -- start 2024-09-11T23:06:26.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.143+0000 7fc222b04640 1 -- start start 2024-09-11T23:06:26.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.143+0000 7fc222b04640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc21c0a3ba0 0x7fc21c13cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:26.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.143+0000 7fc222b04640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc21c0a53f0 con 0x7fc21c0a55f0 2024-09-11T23:06:26.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.143+0000 7fc222b04640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fc21c0a2020 con 0x7fc21c0a3ba0 2024-09-11T23:06:26.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.143+0000 7fc21bfff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc21c0a3ba0 0x7fc21c13cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:26.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.143+0000 7fc2208a0640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fc21c0a55f0 0x7fc21c0a59d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38604/0 (socket says 172.21.15.12:38604) 2024-09-11T23:06:26.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.143+0000 7fc2208a0640 1 -- 172.21.15.12:0/4220550746 learned_addr learned my addr 172.21.15.12:0/4220550746 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:26.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.143+0000 7fc21bfff640 1 -- 172.21.15.12:0/4220550746 >> v1:172.21.15.12:6789/0 conn(0x7fc21c0a55f0 legacy=0x7fc21c0a59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:26.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.143+0000 7fc21bfff640 1 -- 172.21.15.12:0/4220550746 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc21c0a3160 con 0x7fc21c0a3ba0 2024-09-11T23:06:26.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.147+0000 7fc21bfff640 1 --2- 172.21.15.12:0/4220550746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc21c0a3ba0 0x7fc21c13cd20 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fc208009720 tx=0x7fc20801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cfe9871e99b28d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:26.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.147+0000 7fc21b7fe640 1 -- 172.21.15.12:0/4220550746 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2080b0070 con 0x7fc21c0a3ba0 2024-09-11T23:06:26.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.147+0000 7fc21b7fe640 1 -- 172.21.15.12:0/4220550746 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2080ab530 con 0x7fc21c0a3ba0 2024-09-11T23:06:26.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.147+0000 7fc21b7fe640 1 -- 172.21.15.12:0/4220550746 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2080ab830 con 0x7fc21c0a3ba0 2024-09-11T23:06:26.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.147+0000 7fc222b04640 1 -- 172.21.15.12:0/4220550746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc21c0a3ba0 msgr2=0x7fc21c13cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:26.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.147+0000 7fc222b04640 1 --2- 172.21.15.12:0/4220550746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc21c0a3ba0 0x7fc21c13cd20 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fc208009720 tx=0x7fc20801c370 comp rx=0 tx=0).stop 2024-09-11T23:06:26.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.147+0000 7fc222b04640 1 -- 172.21.15.12:0/4220550746 shutdown_connections 2024-09-11T23:06:26.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.147+0000 7fc222b04640 1 --2- 172.21.15.12:0/4220550746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc21c0a3ba0 0x7fc21c13cd20 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:26.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.147+0000 7fc222b04640 1 -- 172.21.15.12:0/4220550746 >> 172.21.15.12:0/4220550746 conn(0x7fc21c0aa2c0 msgr2=0x7fc21c0aa6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:26.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.147+0000 7fc222b04640 1 -- 172.21.15.12:0/4220550746 shutdown_connections 2024-09-11T23:06:26.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.147+0000 7fc222b04640 1 -- 172.21.15.12:0/4220550746 wait complete. 2024-09-11T23:06:26.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.147+0000 7fc222b04640 1 Processor -- start 2024-09-11T23:06:26.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.147+0000 7fc222b04640 1 -- start start 2024-09-11T23:06:26.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.151+0000 7fc222b04640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc21c0a3ba0 0x7fc21c13b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:26.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.151+0000 7fc222b04640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc21c0a1a80 con 0x7fc21c0a3ba0 2024-09-11T23:06:26.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.151+0000 7fc2208a0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc21c0a3ba0 0x7fc21c13b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:26.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.151+0000 7fc2208a0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc21c0a3ba0 0x7fc21c13b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49202/0 (socket says 172.21.15.12:49202) 2024-09-11T23:06:26.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.151+0000 7fc2208a0640 1 -- 172.21.15.12:0/2061926406 learned_addr learned my addr 172.21.15.12:0/2061926406 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:26.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.151+0000 7fc2208a0640 1 -- 172.21.15.12:0/2061926406 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc21c138c00 con 0x7fc21c0a3ba0 2024-09-11T23:06:26.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.151+0000 7fc2208a0640 1 --2- 172.21.15.12:0/2061926406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc21c0a3ba0 0x7fc21c13b0f0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fc21000c480 tx=0x7fc21000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:26.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.151+0000 7fc2197fa640 1 -- 172.21.15.12:0/2061926406 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc210017070 con 0x7fc21c0a3ba0 2024-09-11T23:06:26.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.151+0000 7fc2197fa640 1 -- 172.21.15.12:0/2061926406 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc210005c20 con 0x7fc21c0a3ba0 2024-09-11T23:06:26.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.151+0000 7fc222b04640 1 -- 172.21.15.12:0/2061926406 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc21c13a9a0 con 0x7fc21c0a3ba0 2024-09-11T23:06:26.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.151+0000 7fc2197fa640 1 -- 172.21.15.12:0/2061926406 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc210007070 con 0x7fc21c0a3ba0 2024-09-11T23:06:26.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.151+0000 7fc222b04640 1 -- 172.21.15.12:0/2061926406 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc21c139720 con 0x7fc21c0a3ba0 2024-09-11T23:06:26.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.151+0000 7fc222b04640 1 -- 172.21.15.12:0/2061926406 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc21c138e40 con 0x7fc21c0a3ba0 2024-09-11T23:06:26.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.151+0000 7fc2197fa640 1 -- 172.21.15.12:0/2061926406 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 32) ==== 43997+0+0 (secure 0 0 0) 0x7fc21001a070 con 0x7fc21c0a3ba0 2024-09-11T23:06:26.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.151+0000 7fc2197fa640 1 --2- 172.21.15.12:0/2061926406 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fc200035d20 0x7fc2000381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:26.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.151+0000 7fc2197fa640 1 -- 172.21.15.12:0/2061926406 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 3439+0+0 (secure 0 0 0) 0x7fc210047780 con 0x7fc21c0a3ba0 2024-09-11T23:06:26.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.151+0000 7fc21bfff640 1 --2- 172.21.15.12:0/2061926406 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fc200035d20 0x7fc2000381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:26.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.151+0000 7fc21bfff640 1 --2- 172.21.15.12:0/2061926406 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fc200035d20 0x7fc2000381e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc2080ad000 tx=0x7fc208008040 comp rx=0 tx=0).ready entity=mgr.4903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:26.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.155+0000 7fc2197fa640 1 -- 172.21.15.12:0/2061926406 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc210007210 con 0x7fc21c0a3ba0 2024-09-11T23:06:26.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.327+0000 7fc222b04640 1 -- 172.21.15.12:0/2061926406 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc21c06bc60 con 0x7fc21c0a3ba0 2024-09-11T23:06:26.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.327+0000 7fc2197fa640 1 -- 172.21.15.12:0/2061926406 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) ==== 74+0+10691 (secure 0 0 0) 0x7fc21001b3b0 con 0x7fc21c0a3ba0 2024-09-11T23:06:26.331 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:06:26.331 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":64,"fsid":"8be14356-3340-4500-91a2-4cbc6b511f65","created":"2024-09-11T23:03:10.620234+0000","modified":"2024-09-11T23:06:25.374460+0000","last_up_change":"2024-09-11T23:03:22.359028+0000","last_in_change":"2024-09-11T23:03:11.545817+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:03:23.587068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:06:23.143303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.4099999666213989,"score_stable":1.4099999666213989,"optimal_score":1,"raw_score_acting":1.4099999666213989,"raw_score_stable":1.4099999666213989,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-11T23:06:24.374658+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"153b72a1-40b1-400d-93ea-333e733f9bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6817","nonce":3680911937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6819","nonce":3680911937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6823","nonce":3680911937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6821","nonce":3680911937}]},"public_addr":"172.21.15.12:6817/3680911937","cluster_addr":"172.21.15.12:6819/3680911937","heartbeat_back_addr":"172.21.15.12:6823/3680911937","heartbeat_front_addr":"172.21.15.12:6821/3680911937","state":["exists","up"]},{"osd":1,"uuid":"94669e49-ee4f-4acf-9e25-e94374dda8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6801","nonce":236825163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6803","nonce":236825163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6807","nonce":236825163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6805","nonce":236825163}]},"public_addr":"172.21.15.12:6801/236825163","cluster_addr":"172.21.15.12:6803/236825163","heartbeat_back_addr":"172.21.15.12:6807/236825163","heartbeat_front_addr":"172.21.15.12:6805/236825163","state":["exists","up"]},{"osd":2,"uuid":"826dae4d-8888-4ec5-8f00-425b3be93814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6809","nonce":3263521655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6811","nonce":3263521655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6815","nonce":3263521655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6813","nonce":3263521655}]},"public_addr":"172.21.15.12:6809/3263521655","cluster_addr":"172.21.15.12:6811/3263521655","heartbeat_back_addr":"172.21.15.12:6815/3263521655","heartbeat_front_addr":"172.21.15.12:6813/3263521655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:19.398518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.761524+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.904997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:06:26.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.331+0000 7fc222b04640 1 -- 172.21.15.12:0/2061926406 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fc200035d20 msgr2=0x7fc2000381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:26.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.331+0000 7fc222b04640 1 --2- 172.21.15.12:0/2061926406 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fc200035d20 0x7fc2000381e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc2080ad000 tx=0x7fc208008040 comp rx=0 tx=0).stop 2024-09-11T23:06:26.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.331+0000 7fc222b04640 1 -- 172.21.15.12:0/2061926406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc21c0a3ba0 msgr2=0x7fc21c13b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:26.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.331+0000 7fc222b04640 1 --2- 172.21.15.12:0/2061926406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc21c0a3ba0 0x7fc21c13b0f0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fc21000c480 tx=0x7fc21000c940 comp rx=0 tx=0).stop 2024-09-11T23:06:26.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.331+0000 7fc222b04640 1 -- 172.21.15.12:0/2061926406 shutdown_connections 2024-09-11T23:06:26.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.331+0000 7fc222b04640 1 --2- 172.21.15.12:0/2061926406 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fc200035d20 0x7fc2000381e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:26.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.331+0000 7fc222b04640 1 --2- 172.21.15.12:0/2061926406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc21c0a3ba0 0x7fc21c13b0f0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:26.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.331+0000 7fc222b04640 1 -- 172.21.15.12:0/2061926406 >> 172.21.15.12:0/2061926406 conn(0x7fc21c0aa2c0 msgr2=0x7fc21c0718d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:26.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.331+0000 7fc222b04640 1 -- 172.21.15.12:0/2061926406 shutdown_connections 2024-09-11T23:06:26.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.331+0000 7fc222b04640 1 -- 172.21.15.12:0/2061926406 wait complete. 2024-09-11T23:06:26.350 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:06:26.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.471+0000 7f6a94547640 1 Processor -- start 2024-09-11T23:06:26.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.471+0000 7f6a94547640 1 -- start start 2024-09-11T23:06:26.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.471+0000 7f6a94547640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6a8c09f6e0 0x7f6a8c13cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:26.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.471+0000 7f6a94547640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a8c09e930 con 0x7f6a8c137e60 2024-09-11T23:06:26.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.471+0000 7f6a94547640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f6a8c1379e0 con 0x7f6a8c09f6e0 2024-09-11T23:06:26.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.471+0000 7f6a922e3640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f6a8c137e60 0x7f6a8c138240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38618/0 (socket says 172.21.15.12:38618) 2024-09-11T23:06:26.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.471+0000 7f6a922e3640 1 -- 172.21.15.12:0/1370011372 learned_addr learned my addr 172.21.15.12:0/1370011372 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:26.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.471+0000 7f6a91ae2640 1 --2- 172.21.15.12:0/1370011372 >> v2:172.21.15.12:3300/0 conn(0x7f6a8c09f6e0 0x7f6a8c13cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:26.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.475+0000 7f6a912e1640 1 -- 172.21.15.12:0/1370011372 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 325658364 0 0) 0x7f6a8c09e930 con 0x7f6a8c137e60 2024-09-11T23:06:26.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.475+0000 7f6a912e1640 1 -- 172.21.15.12:0/1370011372 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a78003530 con 0x7f6a8c137e60 2024-09-11T23:06:26.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.475+0000 7f6a91ae2640 1 -- 172.21.15.12:0/1370011372 >> v1:172.21.15.12:6789/0 conn(0x7f6a8c137e60 legacy=0x7f6a8c138240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:26.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.475+0000 7f6a91ae2640 1 -- 172.21.15.12:0/1370011372 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a8c09d910 con 0x7f6a8c09f6e0 2024-09-11T23:06:26.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.475+0000 7f6a91ae2640 1 --2- 172.21.15.12:0/1370011372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a8c09f6e0 0x7f6a8c13cc60 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f6a88009740 tx=0x7f6a8801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=137fd0d58acff3de server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:26.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.475+0000 7f6a912e1640 1 -- 172.21.15.12:0/1370011372 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a880ab570 con 0x7f6a8c09f6e0 2024-09-11T23:06:26.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.475+0000 7f6a912e1640 1 -- 172.21.15.12:0/1370011372 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a880b0070 con 0x7f6a8c09f6e0 2024-09-11T23:06:26.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.475+0000 7f6a912e1640 1 -- 172.21.15.12:0/1370011372 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a880ab840 con 0x7f6a8c09f6e0 2024-09-11T23:06:26.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.475+0000 7f6a94547640 1 -- 172.21.15.12:0/1370011372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a8c09f6e0 msgr2=0x7f6a8c13cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:26.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.475+0000 7f6a94547640 1 --2- 172.21.15.12:0/1370011372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a8c09f6e0 0x7f6a8c13cc60 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f6a88009740 tx=0x7f6a8801c420 comp rx=0 tx=0).stop 2024-09-11T23:06:26.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.475+0000 7f6a94547640 1 -- 172.21.15.12:0/1370011372 shutdown_connections 2024-09-11T23:06:26.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.475+0000 7f6a94547640 1 --2- 172.21.15.12:0/1370011372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a8c09f6e0 0x7f6a8c13cc60 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:26.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.475+0000 7f6a94547640 1 -- 172.21.15.12:0/1370011372 >> 172.21.15.12:0/1370011372 conn(0x7f6a8c0a8450 msgr2=0x7f6a8c0a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:26.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.475+0000 7f6a94547640 1 -- 172.21.15.12:0/1370011372 shutdown_connections 2024-09-11T23:06:26.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.475+0000 7f6a94547640 1 -- 172.21.15.12:0/1370011372 wait complete. 2024-09-11T23:06:26.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.479+0000 7f6a94547640 1 Processor -- start 2024-09-11T23:06:26.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.479+0000 7f6a94547640 1 -- start start 2024-09-11T23:06:26.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.479+0000 7f6a94547640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a8c09f6e0 0x7f6a8c11e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:26.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.479+0000 7f6a94547640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6a8c13fd50 con 0x7f6a8c09f6e0 2024-09-11T23:06:26.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.479+0000 7f6a922e3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a8c09f6e0 0x7f6a8c11e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:26.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.479+0000 7f6a922e3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a8c09f6e0 0x7f6a8c11e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49214/0 (socket says 172.21.15.12:49214) 2024-09-11T23:06:26.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.479+0000 7f6a922e3640 1 -- 172.21.15.12:0/1850448585 learned_addr learned my addr 172.21.15.12:0/1850448585 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:26.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.479+0000 7f6a922e3640 1 -- 172.21.15.12:0/1850448585 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a8c0714d0 con 0x7f6a8c09f6e0 2024-09-11T23:06:26.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.479+0000 7f6a922e3640 1 --2- 172.21.15.12:0/1850448585 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a8c09f6e0 0x7f6a8c11e490 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c00c3d0 tx=0x7f6a7c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:26.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.479+0000 7f6a82ffd640 1 -- 172.21.15.12:0/1850448585 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a7c017070 con 0x7f6a8c09f6e0 2024-09-11T23:06:26.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.479+0000 7f6a82ffd640 1 -- 172.21.15.12:0/1850448585 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a7c005ce0 con 0x7f6a8c09f6e0 2024-09-11T23:06:26.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.479+0000 7f6a94547640 1 -- 172.21.15.12:0/1850448585 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a8c071740 con 0x7f6a8c09f6e0 2024-09-11T23:06:26.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.479+0000 7f6a82ffd640 1 -- 172.21.15.12:0/1850448585 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a7c0070d0 con 0x7f6a8c09f6e0 2024-09-11T23:06:26.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.479+0000 7f6a94547640 1 -- 172.21.15.12:0/1850448585 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a8c072390 con 0x7f6a8c09f6e0 2024-09-11T23:06:26.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.479+0000 7f6a94547640 1 -- 172.21.15.12:0/1850448585 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a8c073200 con 0x7f6a8c09f6e0 2024-09-11T23:06:26.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.479+0000 7f6a82ffd640 1 -- 172.21.15.12:0/1850448585 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 32) ==== 43997+0+0 (secure 0 0 0) 0x7f6a7c01a070 con 0x7f6a8c09f6e0 2024-09-11T23:06:26.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.479+0000 7f6a82ffd640 1 --2- 172.21.15.12:0/1850448585 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f6a70035d20 0x7f6a700381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:26.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.479+0000 7f6a82ffd640 1 -- 172.21.15.12:0/1850448585 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 3439+0+0 (secure 0 0 0) 0x7f6a7c047950 con 0x7f6a8c09f6e0 2024-09-11T23:06:26.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.479+0000 7f6a91ae2640 1 --2- 172.21.15.12:0/1850448585 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f6a70035d20 0x7f6a700381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:26.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.479+0000 7f6a91ae2640 1 --2- 172.21.15.12:0/1850448585 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f6a70035d20 0x7f6a700381e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6a880af000 tx=0x7f6a880a7000 comp rx=0 tx=0).ready entity=mgr.4903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:26.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.483+0000 7f6a82ffd640 1 -- 172.21.15.12:0/1850448585 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6a7c019e10 con 0x7f6a8c09f6e0 2024-09-11T23:06:26.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.647+0000 7f6a94547640 1 -- 172.21.15.12:0/1850448585 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6a8c06bc60 con 0x7f6a8c09f6e0 2024-09-11T23:06:26.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.651+0000 7f6a82ffd640 1 -- 172.21.15.12:0/1850448585 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) ==== 74+0+10691 (secure 0 0 0) 0x7f6a7c01b8d0 con 0x7f6a8c09f6e0 2024-09-11T23:06:26.653 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:06:26.653 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":64,"fsid":"8be14356-3340-4500-91a2-4cbc6b511f65","created":"2024-09-11T23:03:10.620234+0000","modified":"2024-09-11T23:06:25.374460+0000","last_up_change":"2024-09-11T23:03:22.359028+0000","last_in_change":"2024-09-11T23:03:11.545817+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:03:23.587068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:06:23.143303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.4099999666213989,"score_stable":1.4099999666213989,"optimal_score":1,"raw_score_acting":1.4099999666213989,"raw_score_stable":1.4099999666213989,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-11T23:06:24.374658+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"153b72a1-40b1-400d-93ea-333e733f9bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6817","nonce":3680911937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6819","nonce":3680911937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6823","nonce":3680911937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6821","nonce":3680911937}]},"public_addr":"172.21.15.12:6817/3680911937","cluster_addr":"172.21.15.12:6819/3680911937","heartbeat_back_addr":"172.21.15.12:6823/3680911937","heartbeat_front_addr":"172.21.15.12:6821/3680911937","state":["exists","up"]},{"osd":1,"uuid":"94669e49-ee4f-4acf-9e25-e94374dda8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6801","nonce":236825163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6803","nonce":236825163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6807","nonce":236825163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6805","nonce":236825163}]},"public_addr":"172.21.15.12:6801/236825163","cluster_addr":"172.21.15.12:6803/236825163","heartbeat_back_addr":"172.21.15.12:6807/236825163","heartbeat_front_addr":"172.21.15.12:6805/236825163","state":["exists","up"]},{"osd":2,"uuid":"826dae4d-8888-4ec5-8f00-425b3be93814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6809","nonce":3263521655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6811","nonce":3263521655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6815","nonce":3263521655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6813","nonce":3263521655}]},"public_addr":"172.21.15.12:6809/3263521655","cluster_addr":"172.21.15.12:6811/3263521655","heartbeat_back_addr":"172.21.15.12:6815/3263521655","heartbeat_front_addr":"172.21.15.12:6813/3263521655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:19.398518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.761524+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.904997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:06:26.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.651+0000 7f6a94547640 1 -- 172.21.15.12:0/1850448585 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f6a70035d20 msgr2=0x7f6a700381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:26.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.651+0000 7f6a94547640 1 --2- 172.21.15.12:0/1850448585 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f6a70035d20 0x7f6a700381e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6a880af000 tx=0x7f6a880a7000 comp rx=0 tx=0).stop 2024-09-11T23:06:26.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.651+0000 7f6a94547640 1 -- 172.21.15.12:0/1850448585 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a8c09f6e0 msgr2=0x7f6a8c11e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:26.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.651+0000 7f6a94547640 1 --2- 172.21.15.12:0/1850448585 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a8c09f6e0 0x7f6a8c11e490 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c00c3d0 tx=0x7f6a7c00c890 comp rx=0 tx=0).stop 2024-09-11T23:06:26.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.651+0000 7f6a94547640 1 -- 172.21.15.12:0/1850448585 shutdown_connections 2024-09-11T23:06:26.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.651+0000 7f6a94547640 1 --2- 172.21.15.12:0/1850448585 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f6a70035d20 0x7f6a700381e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:26.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.651+0000 7f6a94547640 1 --2- 172.21.15.12:0/1850448585 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a8c09f6e0 0x7f6a8c11e490 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:26.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.651+0000 7f6a94547640 1 -- 172.21.15.12:0/1850448585 >> 172.21.15.12:0/1850448585 conn(0x7f6a8c0a8450 msgr2=0x7f6a8c0a14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:26.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.651+0000 7f6a94547640 1 -- 172.21.15.12:0/1850448585 shutdown_connections 2024-09-11T23:06:26.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.651+0000 7f6a94547640 1 -- 172.21.15.12:0/1850448585 wait complete. 2024-09-11T23:06:26.673 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-11T23:06:26.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.791+0000 7f7bc2ba2640 1 Processor -- start 2024-09-11T23:06:26.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.791+0000 7f7bc2ba2640 1 -- start start 2024-09-11T23:06:26.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.791+0000 7f7bc2ba2640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7bbc13ac80 0x7f7bbc13d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:26.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.791+0000 7f7bc2ba2640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bbc137950 con 0x7f7bbc137f10 2024-09-11T23:06:26.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.791+0000 7f7bc2ba2640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f7bbc09ff80 con 0x7f7bbc13ac80 2024-09-11T23:06:26.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.791+0000 7f7bbbfff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7bbc13ac80 0x7f7bbc13d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:26.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.795+0000 7f7bbbfff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7bbc13ac80 0x7f7bbc13d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49218/0 (socket says 172.21.15.12:49218) 2024-09-11T23:06:26.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.795+0000 7f7bbbfff640 1 -- 172.21.15.12:0/473572387 learned_addr learned my addr 172.21.15.12:0/473572387 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:26.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.795+0000 7f7bbbfff640 1 -- 172.21.15.12:0/473572387 >> v1:172.21.15.12:6789/0 conn(0x7f7bbc137f10 legacy=0x7f7bbc1382f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:26.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.795+0000 7f7bbbfff640 1 -- 172.21.15.12:0/473572387 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bbc073d00 con 0x7f7bbc13ac80 2024-09-11T23:06:26.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.795+0000 7f7bbbfff640 1 --2- 172.21.15.12:0/473572387 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bbc13ac80 0x7f7bbc13d070 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f7ba80097f0 tx=0x7f7ba801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e068ab226dee68e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:26.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.795+0000 7f7bbb7fe640 1 -- 172.21.15.12:0/473572387 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ba80b0070 con 0x7f7bbc13ac80 2024-09-11T23:06:26.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.795+0000 7f7bbb7fe640 1 -- 172.21.15.12:0/473572387 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ba80ab530 con 0x7f7bbc13ac80 2024-09-11T23:06:26.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.795+0000 7f7bbb7fe640 1 -- 172.21.15.12:0/473572387 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ba80ab830 con 0x7f7bbc13ac80 2024-09-11T23:06:26.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.795+0000 7f7bc2ba2640 1 -- 172.21.15.12:0/473572387 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bbc13ac80 msgr2=0x7f7bbc13d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:26.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.795+0000 7f7bc2ba2640 1 --2- 172.21.15.12:0/473572387 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bbc13ac80 0x7f7bbc13d070 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f7ba80097f0 tx=0x7f7ba801c450 comp rx=0 tx=0).stop 2024-09-11T23:06:26.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.795+0000 7f7bc2ba2640 1 -- 172.21.15.12:0/473572387 shutdown_connections 2024-09-11T23:06:26.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.795+0000 7f7bc2ba2640 1 --2- 172.21.15.12:0/473572387 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bbc13ac80 0x7f7bbc13d070 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:26.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.795+0000 7f7bc2ba2640 1 -- 172.21.15.12:0/473572387 >> 172.21.15.12:0/473572387 conn(0x7f7bbc09a9d0 msgr2=0x7f7bbc09ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:26.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.795+0000 7f7bc2ba2640 1 -- 172.21.15.12:0/473572387 shutdown_connections 2024-09-11T23:06:26.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.795+0000 7f7bc2ba2640 1 -- 172.21.15.12:0/473572387 wait complete. 2024-09-11T23:06:26.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.799+0000 7f7bc2ba2640 1 Processor -- start 2024-09-11T23:06:26.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.799+0000 7f7bc2ba2640 1 -- start start 2024-09-11T23:06:26.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.799+0000 7f7bc2ba2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bbc137f10 0x7f7bbc0a3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:26.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.799+0000 7f7bc2ba2640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7bbc073730 con 0x7f7bbc137f10 2024-09-11T23:06:26.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.799+0000 7f7bc093e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bbc137f10 0x7f7bbc0a3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:26.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.799+0000 7f7bc093e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bbc137f10 0x7f7bbc0a3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49232/0 (socket says 172.21.15.12:49232) 2024-09-11T23:06:26.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.799+0000 7f7bc093e640 1 -- 172.21.15.12:0/1134245098 learned_addr learned my addr 172.21.15.12:0/1134245098 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:26.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.799+0000 7f7bc093e640 1 -- 172.21.15.12:0/1134245098 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bbc0a9070 con 0x7f7bbc137f10 2024-09-11T23:06:26.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.799+0000 7f7bc093e640 1 --2- 172.21.15.12:0/1134245098 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bbc137f10 0x7f7bbc0a3f30 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f7bb000c340 tx=0x7f7bb000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:26.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.799+0000 7f7bb97fa640 1 -- 172.21.15.12:0/1134245098 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bb0005150 con 0x7f7bbc137f10 2024-09-11T23:06:26.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.799+0000 7f7bb97fa640 1 -- 172.21.15.12:0/1134245098 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bb00052f0 con 0x7f7bbc137f10 2024-09-11T23:06:26.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.799+0000 7f7bc2ba2640 1 -- 172.21.15.12:0/1134245098 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bbc0a4f50 con 0x7f7bbc137f10 2024-09-11T23:06:26.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.799+0000 7f7bb97fa640 1 -- 172.21.15.12:0/1134245098 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bb0007030 con 0x7f7bbc137f10 2024-09-11T23:06:26.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.799+0000 7f7bc2ba2640 1 -- 172.21.15.12:0/1134245098 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bbc070390 con 0x7f7bbc137f10 2024-09-11T23:06:26.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.799+0000 7f7bb97fa640 1 -- 172.21.15.12:0/1134245098 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 32) ==== 43997+0+0 (secure 0 0 0) 0x7f7bb0019020 con 0x7f7bbc137f10 2024-09-11T23:06:26.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.799+0000 7f7bc2ba2640 1 -- 172.21.15.12:0/1134245098 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bbc0a8e80 con 0x7f7bbc137f10 2024-09-11T23:06:26.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.799+0000 7f7bb97fa640 1 --2- 172.21.15.12:0/1134245098 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f7ba0035d20 0x7f7ba00381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:26.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.799+0000 7f7bb97fa640 1 -- 172.21.15.12:0/1134245098 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 3439+0+0 (secure 0 0 0) 0x7f7bb0047820 con 0x7f7bbc137f10 2024-09-11T23:06:26.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.799+0000 7f7bbbfff640 1 --2- 172.21.15.12:0/1134245098 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f7ba0035d20 0x7f7ba00381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:26.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.799+0000 7f7bbbfff640 1 --2- 172.21.15.12:0/1134245098 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f7ba0035d20 0x7f7ba00381e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7ba80097f0 tx=0x7f7ba80a6000 comp rx=0 tx=0).ready entity=mgr.4903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:26.806 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:26.803+0000 7f02a2c51640 -1 client.4935: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.4890:b65aeaeb-3f3a-4da2-97b5-6988dece6be2:v1:172.21.15.12:0/2496375865] 2024-09-11T23:06:26.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:26.803+0000 7f7bb97fa640 1 -- 172.21.15.12:0/1134245098 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7bbc137950 con 0x7f7bbc137f10 2024-09-11T23:06:27.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:27.007+0000 7f7bc2ba2640 1 -- 172.21.15.12:0/1134245098 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f7bbc1382f0 con 0x7f7bbc137f10 2024-09-11T23:06:27.696 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:27.691+0000 7f02a2c51640 -1 client.4935: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.4890:b65aeaeb-3f3a-4da2-97b5-6988dece6be2:v1:172.21.15.12:0/2496375865] 2024-09-11T23:06:27.961 INFO:tasks.ceph.mds.a.smithi012.stderr:2024-09-11T23:06:27.959+0000 7f246315c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T23:06:28.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:27.999+0000 7f7bb97fa640 1 -- 172.21.15.12:0/1134245098 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v48) ==== 118+0+0 (secure 0 0 0) 0x7f7bb0006db0 con 0x7f7bbc137f10 2024-09-11T23:06:28.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.003+0000 7f7bc2ba2640 1 -- 172.21.15.12:0/1134245098 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f7ba0035d20 msgr2=0x7f7ba00381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:28.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.003+0000 7f7bc2ba2640 1 --2- 172.21.15.12:0/1134245098 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f7ba0035d20 0x7f7ba00381e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7ba80097f0 tx=0x7f7ba80a6000 comp rx=0 tx=0).stop 2024-09-11T23:06:28.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.003+0000 7f7bc2ba2640 1 -- 172.21.15.12:0/1134245098 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bbc137f10 msgr2=0x7f7bbc0a3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:28.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.003+0000 7f7bc2ba2640 1 --2- 172.21.15.12:0/1134245098 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bbc137f10 0x7f7bbc0a3f30 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f7bb000c340 tx=0x7f7bb000c800 comp rx=0 tx=0).stop 2024-09-11T23:06:28.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.003+0000 7f7bc2ba2640 1 -- 172.21.15.12:0/1134245098 shutdown_connections 2024-09-11T23:06:28.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.003+0000 7f7bc2ba2640 1 --2- 172.21.15.12:0/1134245098 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f7ba0035d20 0x7f7ba00381e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:28.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.003+0000 7f7bc2ba2640 1 --2- 172.21.15.12:0/1134245098 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bbc137f10 0x7f7bbc0a3f30 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:28.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.003+0000 7f7bc2ba2640 1 -- 172.21.15.12:0/1134245098 >> 172.21.15.12:0/1134245098 conn(0x7f7bbc09a9d0 msgr2=0x7f7bbc09c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:28.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.003+0000 7f7bc2ba2640 1 -- 172.21.15.12:0/1134245098 shutdown_connections 2024-09-11T23:06:28.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.003+0000 7f7bc2ba2640 1 -- 172.21.15.12:0/1134245098 wait complete. 2024-09-11T23:06:28.026 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-11T23:06:28.027 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-11T23:06:28.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.163+0000 7f5292aed640 1 Processor -- start 2024-09-11T23:06:28.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.163+0000 7f5292aed640 1 -- start start 2024-09-11T23:06:28.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.163+0000 7f5292aed640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f528c09a9d0 0x7f528c13b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:28.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.163+0000 7f5292aed640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f528c0a0670 con 0x7f528c09f190 2024-09-11T23:06:28.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.163+0000 7f5292aed640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f528c0a0e30 con 0x7f528c09a9d0 2024-09-11T23:06:28.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.163+0000 7f528bfff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f528c09a9d0 0x7f528c13b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:28.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.163+0000 7f528bfff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f528c09a9d0 0x7f528c13b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49246/0 (socket says 172.21.15.12:49246) 2024-09-11T23:06:28.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.163+0000 7f528bfff640 1 -- 172.21.15.12:0/3672329325 learned_addr learned my addr 172.21.15.12:0/3672329325 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:28.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.163+0000 7f5290889640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f528c09f190 0x7f528c09f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38640/0 (socket says 172.21.15.12:38640) 2024-09-11T23:06:28.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.163+0000 7f528bfff640 1 -- 172.21.15.12:0/3672329325 >> v1:172.21.15.12:6789/0 conn(0x7f528c09f190 legacy=0x7f528c09f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:28.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.163+0000 7f528bfff640 1 -- 172.21.15.12:0/3672329325 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f528c0a3ec0 con 0x7f528c09a9d0 2024-09-11T23:06:28.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.163+0000 7f528b7fe640 1 -- 172.21.15.12:0/3672329325 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 363008148 0 0) 0x7f528c0a0670 con 0x7f528c09f190 2024-09-11T23:06:28.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.167+0000 7f528bfff640 1 --2- 172.21.15.12:0/3672329325 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f528c09a9d0 0x7f528c13b6a0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f527400ba90 tx=0x7f527401eb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7e944524767654f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:28.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.167+0000 7f528b7fe640 1 -- 172.21.15.12:0/3672329325 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52740b4070 con 0x7f528c09a9d0 2024-09-11T23:06:28.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.167+0000 7f528b7fe640 1 -- 172.21.15.12:0/3672329325 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52740a7880 con 0x7f528c09a9d0 2024-09-11T23:06:28.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.167+0000 7f528b7fe640 1 -- 172.21.15.12:0/3672329325 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52740a7b80 con 0x7f528c09a9d0 2024-09-11T23:06:28.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.167+0000 7f5292aed640 1 -- 172.21.15.12:0/3672329325 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f528c09a9d0 msgr2=0x7f528c13b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:28.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.167+0000 7f5292aed640 1 --2- 172.21.15.12:0/3672329325 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f528c09a9d0 0x7f528c13b6a0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f527400ba90 tx=0x7f527401eb00 comp rx=0 tx=0).stop 2024-09-11T23:06:28.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.167+0000 7f5292aed640 1 -- 172.21.15.12:0/3672329325 shutdown_connections 2024-09-11T23:06:28.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.167+0000 7f5292aed640 1 --2- 172.21.15.12:0/3672329325 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f528c09a9d0 0x7f528c13b6a0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:28.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.167+0000 7f5292aed640 1 -- 172.21.15.12:0/3672329325 >> 172.21.15.12:0/3672329325 conn(0x7f528c0a82f0 msgr2=0x7f528c0a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:28.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.167+0000 7f5292aed640 1 -- 172.21.15.12:0/3672329325 shutdown_connections 2024-09-11T23:06:28.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.167+0000 7f5292aed640 1 -- 172.21.15.12:0/3672329325 wait complete. 2024-09-11T23:06:28.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.167+0000 7f5292aed640 1 Processor -- start 2024-09-11T23:06:28.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.167+0000 7f5292aed640 1 -- start start 2024-09-11T23:06:28.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.167+0000 7f5292aed640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f528c09f190 0x7f528c11e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:28.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.167+0000 7f5292aed640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f528c13dbf0 con 0x7f528c09f190 2024-09-11T23:06:28.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.167+0000 7f5290889640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f528c09f190 0x7f528c11e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:28.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.167+0000 7f5290889640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f528c09f190 0x7f528c11e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49254/0 (socket says 172.21.15.12:49254) 2024-09-11T23:06:28.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.167+0000 7f5290889640 1 -- 172.21.15.12:0/465740235 learned_addr learned my addr 172.21.15.12:0/465740235 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:28.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.167+0000 7f5290889640 1 -- 172.21.15.12:0/465740235 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f528c120ca0 con 0x7f528c09f190 2024-09-11T23:06:28.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.167+0000 7f5290889640 1 --2- 172.21.15.12:0/465740235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f528c09f190 0x7f528c11e2e0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f527c00c840 tx=0x7f527c00cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:28.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.167+0000 7f52897fa640 1 -- 172.21.15.12:0/465740235 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f527c018070 con 0x7f528c09f190 2024-09-11T23:06:28.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.167+0000 7f52897fa640 1 -- 172.21.15.12:0/465740235 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f527c00a660 con 0x7f528c09f190 2024-09-11T23:06:28.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.167+0000 7f5292aed640 1 -- 172.21.15.12:0/465740235 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f528c11fa80 con 0x7f528c09f190 2024-09-11T23:06:28.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.167+0000 7f52897fa640 1 -- 172.21.15.12:0/465740235 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f527c00a850 con 0x7f528c09f190 2024-09-11T23:06:28.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.167+0000 7f5292aed640 1 -- 172.21.15.12:0/465740235 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f528c09b370 con 0x7f528c09f190 2024-09-11T23:06:28.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.171+0000 7f52897fa640 1 -- 172.21.15.12:0/465740235 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 32) ==== 43997+0+0 (secure 0 0 0) 0x7f527c01b070 con 0x7f528c09f190 2024-09-11T23:06:28.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.171+0000 7f5292aed640 1 -- 172.21.15.12:0/465740235 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f528c120a90 con 0x7f528c09f190 2024-09-11T23:06:28.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.171+0000 7f52897fa640 1 --2- 172.21.15.12:0/465740235 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f526c035d20 0x7f526c0381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:28.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.171+0000 7f52897fa640 1 -- 172.21.15.12:0/465740235 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 3439+0+0 (secure 0 0 0) 0x7f527c047c30 con 0x7f528c09f190 2024-09-11T23:06:28.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.171+0000 7f528bfff640 1 --2- 172.21.15.12:0/465740235 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f526c035d20 0x7f526c0381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:28.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.171+0000 7f528bfff640 1 --2- 172.21.15.12:0/465740235 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f526c035d20 0x7f526c0381e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f52740b1000 tx=0x7f52740a9070 comp rx=0 tx=0).ready entity=mgr.4903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:28.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.175+0000 7f52897fa640 1 -- 172.21.15.12:0/465740235 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f527c011360 con 0x7f528c09f190 2024-09-11T23:06:28.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.387+0000 7f5292aed640 1 -- 172.21.15.12:0/465740235 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f528c09f570 con 0x7f528c09f190 2024-09-11T23:06:28.579 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:28.575+0000 7f02a2c51640 -1 client.4935: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.4890:b65aeaeb-3f3a-4da2-97b5-6988dece6be2:v1:172.21.15.12:0/2496375865] 2024-09-11T23:06:29.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:28.999+0000 7f52897fa640 1 -- 172.21.15.12:0/465740235 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v49) ==== 122+0+0 (secure 0 0 0) 0x7f527c01cda0 con 0x7f528c09f190 2024-09-11T23:06:29.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.003+0000 7f5292aed640 1 -- 172.21.15.12:0/465740235 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f526c035d20 msgr2=0x7f526c0381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:29.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.003+0000 7f5292aed640 1 --2- 172.21.15.12:0/465740235 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f526c035d20 0x7f526c0381e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f52740b1000 tx=0x7f52740a9070 comp rx=0 tx=0).stop 2024-09-11T23:06:29.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.003+0000 7f5292aed640 1 -- 172.21.15.12:0/465740235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f528c09f190 msgr2=0x7f528c11e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:29.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.003+0000 7f5292aed640 1 --2- 172.21.15.12:0/465740235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f528c09f190 0x7f528c11e2e0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f527c00c840 tx=0x7f527c00cd00 comp rx=0 tx=0).stop 2024-09-11T23:06:29.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.003+0000 7f5292aed640 1 -- 172.21.15.12:0/465740235 shutdown_connections 2024-09-11T23:06:29.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.003+0000 7f5292aed640 1 --2- 172.21.15.12:0/465740235 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f526c035d20 0x7f526c0381e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:29.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.003+0000 7f5292aed640 1 --2- 172.21.15.12:0/465740235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f528c09f190 0x7f528c11e2e0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:29.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.003+0000 7f5292aed640 1 -- 172.21.15.12:0/465740235 >> 172.21.15.12:0/465740235 conn(0x7f528c0a82f0 msgr2=0x7f528c09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:29.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.003+0000 7f5292aed640 1 -- 172.21.15.12:0/465740235 shutdown_connections 2024-09-11T23:06:29.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.003+0000 7f5292aed640 1 -- 172.21.15.12:0/465740235 wait complete. 2024-09-11T23:06:29.029 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-11T23:06:29.029 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:06:29.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.159+0000 7f5e6086b640 1 Processor -- start 2024-09-11T23:06:29.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.159+0000 7f5e6086b640 1 -- start start 2024-09-11T23:06:29.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.163+0000 7f5e6086b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5e5c13cde0 0x7f5e5c13f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:29.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.163+0000 7f5e6086b640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e5c0a1df0 con 0x7f5e5c135a10 2024-09-11T23:06:29.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.163+0000 7f5e6086b640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f5e5c0a0c70 con 0x7f5e5c13cde0 2024-09-11T23:06:29.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.163+0000 7f5e59d9b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5e5c13cde0 0x7f5e5c13f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:29.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.163+0000 7f5e5a59c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f5e5c135a10 0x7f5e5c135df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38656/0 (socket says 172.21.15.12:38656) 2024-09-11T23:06:29.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.163+0000 7f5e5a59c640 1 -- 172.21.15.12:0/4066955324 learned_addr learned my addr 172.21.15.12:0/4066955324 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:29.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.163+0000 7f5e59d9b640 1 -- 172.21.15.12:0/4066955324 >> v1:172.21.15.12:6789/0 conn(0x7f5e5c135a10 legacy=0x7f5e5c135df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:29.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.163+0000 7f5e59d9b640 1 -- 172.21.15.12:0/4066955324 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e5c0a02a0 con 0x7f5e5c13cde0 2024-09-11T23:06:29.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.163+0000 7f5e59d9b640 1 --2- 172.21.15.12:0/4066955324 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e5c13cde0 0x7f5e5c13f1d0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f5e50009740 tx=0x7f5e5001c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef573930517e2129 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:29.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.163+0000 7f5e5959a640 1 -- 172.21.15.12:0/4066955324 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e500b0070 con 0x7f5e5c13cde0 2024-09-11T23:06:29.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.163+0000 7f5e5959a640 1 -- 172.21.15.12:0/4066955324 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e500ab530 con 0x7f5e5c13cde0 2024-09-11T23:06:29.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.163+0000 7f5e5959a640 1 -- 172.21.15.12:0/4066955324 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e500ab830 con 0x7f5e5c13cde0 2024-09-11T23:06:29.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.167+0000 7f5e6086b640 1 -- 172.21.15.12:0/4066955324 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e5c13cde0 msgr2=0x7f5e5c13f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:29.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.167+0000 7f5e6086b640 1 --2- 172.21.15.12:0/4066955324 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e5c13cde0 0x7f5e5c13f1d0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f5e50009740 tx=0x7f5e5001c390 comp rx=0 tx=0).stop 2024-09-11T23:06:29.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.167+0000 7f5e6086b640 1 -- 172.21.15.12:0/4066955324 shutdown_connections 2024-09-11T23:06:29.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.167+0000 7f5e6086b640 1 --2- 172.21.15.12:0/4066955324 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e5c13cde0 0x7f5e5c13f1d0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:29.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.167+0000 7f5e6086b640 1 -- 172.21.15.12:0/4066955324 >> 172.21.15.12:0/4066955324 conn(0x7f5e5c0a93a0 msgr2=0x7f5e5c0a58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:29.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.167+0000 7f5e6086b640 1 -- 172.21.15.12:0/4066955324 shutdown_connections 2024-09-11T23:06:29.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.167+0000 7f5e6086b640 1 -- 172.21.15.12:0/4066955324 wait complete. 2024-09-11T23:06:29.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.167+0000 7f5e6086b640 1 Processor -- start 2024-09-11T23:06:29.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.167+0000 7f5e6086b640 1 -- start start 2024-09-11T23:06:29.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.167+0000 7f5e6086b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e5c135a10 0x7f5e5c09b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:29.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.167+0000 7f5e6086b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5e5c06c9a0 con 0x7f5e5c135a10 2024-09-11T23:06:29.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.167+0000 7f5e5a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e5c135a10 0x7f5e5c09b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:29.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.167+0000 7f5e5a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e5c135a10 0x7f5e5c09b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49272/0 (socket says 172.21.15.12:49272) 2024-09-11T23:06:29.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.167+0000 7f5e5a59c640 1 -- 172.21.15.12:0/3981736618 learned_addr learned my addr 172.21.15.12:0/3981736618 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:29.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.167+0000 7f5e5a59c640 1 -- 172.21.15.12:0/3981736618 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e5c09d5f0 con 0x7f5e5c135a10 2024-09-11T23:06:29.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.167+0000 7f5e5a59c640 1 --2- 172.21.15.12:0/3981736618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e5c135a10 0x7f5e5c09b7d0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c00c380 tx=0x7f5e4c00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:29.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.167+0000 7f5e4affd640 1 -- 172.21.15.12:0/3981736618 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e4c017070 con 0x7f5e5c135a10 2024-09-11T23:06:29.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.167+0000 7f5e4affd640 1 -- 172.21.15.12:0/3981736618 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e4c005c20 con 0x7f5e5c135a10 2024-09-11T23:06:29.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.167+0000 7f5e6086b640 1 -- 172.21.15.12:0/3981736618 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e5c09a9d0 con 0x7f5e5c135a10 2024-09-11T23:06:29.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.167+0000 7f5e4affd640 1 -- 172.21.15.12:0/3981736618 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e4c0070d0 con 0x7f5e5c135a10 2024-09-11T23:06:29.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.167+0000 7f5e6086b640 1 -- 172.21.15.12:0/3981736618 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e5c09c470 con 0x7f5e5c135a10 2024-09-11T23:06:29.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.171+0000 7f5e4affd640 1 -- 172.21.15.12:0/3981736618 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 32) ==== 43997+0+0 (secure 0 0 0) 0x7f5e4c01a070 con 0x7f5e5c135a10 2024-09-11T23:06:29.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.171+0000 7f5e6086b640 1 -- 172.21.15.12:0/3981736618 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e5c075590 con 0x7f5e5c135a10 2024-09-11T23:06:29.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.171+0000 7f5e4affd640 1 --2- 172.21.15.12:0/3981736618 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f5e3c035d20 0x7f5e3c0381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:29.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.171+0000 7f5e4affd640 1 -- 172.21.15.12:0/3981736618 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 3439+0+0 (secure 0 0 0) 0x7f5e4c0477d0 con 0x7f5e5c135a10 2024-09-11T23:06:29.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.171+0000 7f5e59d9b640 1 --2- 172.21.15.12:0/3981736618 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f5e3c035d20 0x7f5e3c0381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:29.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.171+0000 7f5e59d9b640 1 --2- 172.21.15.12:0/3981736618 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f5e3c035d20 0x7f5e3c0381e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5e500ad000 tx=0x7f5e50008040 comp rx=0 tx=0).ready entity=mgr.4903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:29.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.175+0000 7f5e4affd640 1 -- 172.21.15.12:0/3981736618 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5e4c007270 con 0x7f5e5c135a10 2024-09-11T23:06:29.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.383+0000 7f5e6086b640 1 -- 172.21.15.12:0/3981736618 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5e5c135df0 con 0x7f5e5c135a10 2024-09-11T23:06:29.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.383+0000 7f5e4affd640 1 -- 172.21.15.12:0/3981736618 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+3575 (secure 0 0 0) 0x7f5e4c01b3b0 con 0x7f5e5c135a10 2024-09-11T23:06:29.388 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:06:29.388 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":49,"btime":"2024-09-11T23:06:29:001694+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4978,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6826/1855322655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1855322655},{"type":"v1","addr":"172.21.15.12:6826","nonce":1855322655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:06:25.374780+0000","modified":"2024-09-11T23:06:28.391440+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4979},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4979":{"gid":4979,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6827/4133903177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":4133903177},{"type":"v1","addr":"172.21.15.12:6827","nonce":4133903177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4979,"qdb_cluster":[4979]},"id":6}]} 2024-09-11T23:06:29.388 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 49 2024-09-11T23:06:29.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.387+0000 7f5e6086b640 1 -- 172.21.15.12:0/3981736618 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f5e3c035d20 msgr2=0x7f5e3c0381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:29.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.387+0000 7f5e6086b640 1 --2- 172.21.15.12:0/3981736618 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f5e3c035d20 0x7f5e3c0381e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5e500ad000 tx=0x7f5e50008040 comp rx=0 tx=0).stop 2024-09-11T23:06:29.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.387+0000 7f5e6086b640 1 -- 172.21.15.12:0/3981736618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e5c135a10 msgr2=0x7f5e5c09b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:29.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.387+0000 7f5e6086b640 1 --2- 172.21.15.12:0/3981736618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e5c135a10 0x7f5e5c09b7d0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c00c380 tx=0x7f5e4c00c840 comp rx=0 tx=0).stop 2024-09-11T23:06:29.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.387+0000 7f5e6086b640 1 -- 172.21.15.12:0/3981736618 shutdown_connections 2024-09-11T23:06:29.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.387+0000 7f5e6086b640 1 --2- 172.21.15.12:0/3981736618 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f5e3c035d20 0x7f5e3c0381e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:29.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.387+0000 7f5e6086b640 1 --2- 172.21.15.12:0/3981736618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e5c135a10 0x7f5e5c09b7d0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:29.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.387+0000 7f5e6086b640 1 -- 172.21.15.12:0/3981736618 >> 172.21.15.12:0/3981736618 conn(0x7f5e5c0a93a0 msgr2=0x7f5e5c0a8550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:29.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.387+0000 7f5e6086b640 1 -- 172.21.15.12:0/3981736618 shutdown_connections 2024-09-11T23:06:29.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.387+0000 7f5e6086b640 1 -- 172.21.15.12:0/3981736618 wait complete. 2024-09-11T23:06:29.409 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:06:29.470 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:29.467+0000 7f02a2c51640 -1 client.4935: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.4890:b65aeaeb-3f3a-4da2-97b5-6988dece6be2:v1:172.21.15.12:0/2496375865] 2024-09-11T23:06:29.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.539+0000 7f23830b0640 1 Processor -- start 2024-09-11T23:06:29.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.539+0000 7f23830b0640 1 -- start start 2024-09-11T23:06:29.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.539+0000 7f23830b0640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f237c09f3b0 0x7f237c13ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:29.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.539+0000 7f23830b0640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f237c09f820 con 0x7f237c0a0380 2024-09-11T23:06:29.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.539+0000 7f23830b0640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f237c06e890 con 0x7f237c09f3b0 2024-09-11T23:06:29.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.539+0000 7f237bfff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f237c09f3b0 0x7f237c13ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:29.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.539+0000 7f2380e4c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f237c0a0380 0x7f237c0a0760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38658/0 (socket says 172.21.15.12:38658) 2024-09-11T23:06:29.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.539+0000 7f2380e4c640 1 -- 172.21.15.12:0/2498654453 learned_addr learned my addr 172.21.15.12:0/2498654453 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:29.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.539+0000 7f237bfff640 1 -- 172.21.15.12:0/2498654453 >> v1:172.21.15.12:6789/0 conn(0x7f237c0a0380 legacy=0x7f237c0a0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:29.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.539+0000 7f237bfff640 1 -- 172.21.15.12:0/2498654453 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f237c06ed80 con 0x7f237c09f3b0 2024-09-11T23:06:29.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.539+0000 7f237bfff640 1 --2- 172.21.15.12:0/2498654453 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f237c09f3b0 0x7f237c13ee90 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f236c009720 tx=0x7f236c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dd88a77af753805 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:29.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.543+0000 7f237b7fe640 1 -- 172.21.15.12:0/2498654453 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f236c0b0070 con 0x7f237c09f3b0 2024-09-11T23:06:29.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.543+0000 7f237b7fe640 1 -- 172.21.15.12:0/2498654453 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f236c0ab530 con 0x7f237c09f3b0 2024-09-11T23:06:29.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.543+0000 7f237b7fe640 1 -- 172.21.15.12:0/2498654453 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f236c0ab830 con 0x7f237c09f3b0 2024-09-11T23:06:29.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.543+0000 7f23830b0640 1 -- 172.21.15.12:0/2498654453 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f237c09f3b0 msgr2=0x7f237c13ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:29.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.543+0000 7f23830b0640 1 --2- 172.21.15.12:0/2498654453 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f237c09f3b0 0x7f237c13ee90 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f236c009720 tx=0x7f236c01c370 comp rx=0 tx=0).stop 2024-09-11T23:06:29.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.543+0000 7f23830b0640 1 -- 172.21.15.12:0/2498654453 shutdown_connections 2024-09-11T23:06:29.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.543+0000 7f23830b0640 1 --2- 172.21.15.12:0/2498654453 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f237c09f3b0 0x7f237c13ee90 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:29.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.543+0000 7f23830b0640 1 -- 172.21.15.12:0/2498654453 >> 172.21.15.12:0/2498654453 conn(0x7f237c0aa2c0 msgr2=0x7f237c0aa6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:29.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.543+0000 7f23830b0640 1 -- 172.21.15.12:0/2498654453 shutdown_connections 2024-09-11T23:06:29.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.543+0000 7f23830b0640 1 -- 172.21.15.12:0/2498654453 wait complete. 2024-09-11T23:06:29.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.543+0000 7f23830b0640 1 Processor -- start 2024-09-11T23:06:29.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.543+0000 7f23830b0640 1 -- start start 2024-09-11T23:06:29.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.543+0000 7f23830b0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f237c09f3b0 0x7f237c13b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:29.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.543+0000 7f23830b0640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f237c141f80 con 0x7f237c09f3b0 2024-09-11T23:06:29.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.543+0000 7f2380e4c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f237c09f3b0 0x7f237c13b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:29.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.543+0000 7f2380e4c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f237c09f3b0 0x7f237c13b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49290/0 (socket says 172.21.15.12:49290) 2024-09-11T23:06:29.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.543+0000 7f2380e4c640 1 -- 172.21.15.12:0/1602674656 learned_addr learned my addr 172.21.15.12:0/1602674656 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:29.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.543+0000 7f2380e4c640 1 -- 172.21.15.12:0/1602674656 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f237c13ceb0 con 0x7f237c09f3b0 2024-09-11T23:06:29.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.543+0000 7f2380e4c640 1 --2- 172.21.15.12:0/1602674656 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f237c09f3b0 0x7f237c13b0a0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f237400cb20 tx=0x7f237400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:29.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.543+0000 7f23797fa640 1 -- 172.21.15.12:0/1602674656 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2374017070 con 0x7f237c09f3b0 2024-09-11T23:06:29.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.543+0000 7f23797fa640 1 -- 172.21.15.12:0/1602674656 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f237400abf0 con 0x7f237c09f3b0 2024-09-11T23:06:29.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.543+0000 7f23830b0640 1 -- 172.21.15.12:0/1602674656 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f237c1209a0 con 0x7f237c09f3b0 2024-09-11T23:06:29.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.543+0000 7f23797fa640 1 -- 172.21.15.12:0/1602674656 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2374012400 con 0x7f237c09f3b0 2024-09-11T23:06:29.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.543+0000 7f23830b0640 1 -- 172.21.15.12:0/1602674656 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f237c13cbd0 con 0x7f237c09f3b0 2024-09-11T23:06:29.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.547+0000 7f23797fa640 1 -- 172.21.15.12:0/1602674656 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 32) ==== 43997+0+0 (secure 0 0 0) 0x7f237401a070 con 0x7f237c09f3b0 2024-09-11T23:06:29.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.547+0000 7f23830b0640 1 -- 172.21.15.12:0/1602674656 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f237c0008e0 con 0x7f237c09f3b0 2024-09-11T23:06:29.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.547+0000 7f23797fa640 1 --2- 172.21.15.12:0/1602674656 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f2368035d20 0x7f23680381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:29.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.547+0000 7f23797fa640 1 -- 172.21.15.12:0/1602674656 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 3439+0+0 (secure 0 0 0) 0x7f2374048340 con 0x7f237c09f3b0 2024-09-11T23:06:29.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.547+0000 7f237bfff640 1 --2- 172.21.15.12:0/1602674656 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f2368035d20 0x7f23680381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:29.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.547+0000 7f237bfff640 1 --2- 172.21.15.12:0/1602674656 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f2368035d20 0x7f23680381e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f236c0ad000 tx=0x7f236c008040 comp rx=0 tx=0).ready entity=mgr.4903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:29.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.551+0000 7f23797fa640 1 -- 172.21.15.12:0/1602674656 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f237c09f820 con 0x7f237c09f3b0 2024-09-11T23:06:29.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.723+0000 7f23830b0640 1 -- 172.21.15.12:0/1602674656 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f237c13e930 con 0x7f237c09f3b0 2024-09-11T23:06:29.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.727+0000 7f23797fa640 1 -- 172.21.15.12:0/1602674656 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) ==== 74+0+10678 (secure 0 0 0) 0x7f23740113a0 con 0x7f237c09f3b0 2024-09-11T23:06:29.729 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:06:29.729 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":65,"fsid":"8be14356-3340-4500-91a2-4cbc6b511f65","created":"2024-09-11T23:03:10.620234+0000","modified":"2024-09-11T23:06:26.987533+0000","last_up_change":"2024-09-11T23:03:22.359028+0000","last_in_change":"2024-09-11T23:03:11.545817+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:03:23.587068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:06:23.143303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.4099999666213989,"score_stable":1.4099999666213989,"optimal_score":1,"raw_score_acting":1.4099999666213989,"raw_score_stable":1.4099999666213989,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-11T23:06:24.374658+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"153b72a1-40b1-400d-93ea-333e733f9bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6817","nonce":3680911937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6819","nonce":3680911937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6823","nonce":3680911937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6821","nonce":3680911937}]},"public_addr":"172.21.15.12:6817/3680911937","cluster_addr":"172.21.15.12:6819/3680911937","heartbeat_back_addr":"172.21.15.12:6823/3680911937","heartbeat_front_addr":"172.21.15.12:6821/3680911937","state":["exists","up"]},{"osd":1,"uuid":"94669e49-ee4f-4acf-9e25-e94374dda8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6801","nonce":236825163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6803","nonce":236825163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6807","nonce":236825163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6805","nonce":236825163}]},"public_addr":"172.21.15.12:6801/236825163","cluster_addr":"172.21.15.12:6803/236825163","heartbeat_back_addr":"172.21.15.12:6807/236825163","heartbeat_front_addr":"172.21.15.12:6805/236825163","state":["exists","up"]},{"osd":2,"uuid":"826dae4d-8888-4ec5-8f00-425b3be93814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6809","nonce":3263521655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6811","nonce":3263521655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6815","nonce":3263521655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6813","nonce":3263521655}]},"public_addr":"172.21.15.12:6809/3263521655","cluster_addr":"172.21.15.12:6811/3263521655","heartbeat_back_addr":"172.21.15.12:6815/3263521655","heartbeat_front_addr":"172.21.15.12:6813/3263521655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:19.398518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.761524+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.904997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:06:29.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.727+0000 7f23830b0640 1 -- 172.21.15.12:0/1602674656 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f2368035d20 msgr2=0x7f23680381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:29.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.727+0000 7f23830b0640 1 --2- 172.21.15.12:0/1602674656 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f2368035d20 0x7f23680381e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f236c0ad000 tx=0x7f236c008040 comp rx=0 tx=0).stop 2024-09-11T23:06:29.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.727+0000 7f23830b0640 1 -- 172.21.15.12:0/1602674656 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f237c09f3b0 msgr2=0x7f237c13b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:29.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.727+0000 7f23830b0640 1 --2- 172.21.15.12:0/1602674656 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f237c09f3b0 0x7f237c13b0a0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f237400cb20 tx=0x7f237400a060 comp rx=0 tx=0).stop 2024-09-11T23:06:29.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.727+0000 7f23830b0640 1 -- 172.21.15.12:0/1602674656 shutdown_connections 2024-09-11T23:06:29.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.727+0000 7f23830b0640 1 --2- 172.21.15.12:0/1602674656 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f2368035d20 0x7f23680381e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:29.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.727+0000 7f23830b0640 1 --2- 172.21.15.12:0/1602674656 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f237c09f3b0 0x7f237c13b0a0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:29.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.727+0000 7f23830b0640 1 -- 172.21.15.12:0/1602674656 >> 172.21.15.12:0/1602674656 conn(0x7f237c0aa2c0 msgr2=0x7f237c072820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:29.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.727+0000 7f23830b0640 1 -- 172.21.15.12:0/1602674656 shutdown_connections 2024-09-11T23:06:29.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.727+0000 7f23830b0640 1 -- 172.21.15.12:0/1602674656 wait complete. 2024-09-11T23:06:29.749 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T23:06:29.749 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:06:29.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.871+0000 7f34012d7640 1 Processor -- start 2024-09-11T23:06:29.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.871+0000 7f34012d7640 1 -- start start 2024-09-11T23:06:29.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.871+0000 7f34012d7640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f33fc0a4b80 0x7f33fc0a7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:29.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.871+0000 7f34012d7640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33fc0a82a0 con 0x7f33fc13a410 2024-09-11T23:06:29.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.871+0000 7f34012d7640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f33fc0a3cb0 con 0x7f33fc0a4b80 2024-09-11T23:06:29.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.871+0000 7f33f3fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f33fc0a4b80 0x7f33fc0a7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:29.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.871+0000 7f33faffd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f33fc13a410 0x7f33fc0a6af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38666/0 (socket says 172.21.15.12:38666) 2024-09-11T23:06:29.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.871+0000 7f33f3fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f33fc0a4b80 0x7f33fc0a7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49300/0 (socket says 172.21.15.12:49300) 2024-09-11T23:06:29.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.871+0000 7f33faffd640 1 -- 172.21.15.12:0/200462327 learned_addr learned my addr 172.21.15.12:0/200462327 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:29.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.871+0000 7f33f3fff640 1 -- 172.21.15.12:0/200462327 >> v1:172.21.15.12:6789/0 conn(0x7f33fc13a410 legacy=0x7f33fc0a6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:29.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.871+0000 7f33f3fff640 1 -- 172.21.15.12:0/200462327 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33fc139fe0 con 0x7f33fc0a4b80 2024-09-11T23:06:29.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.875+0000 7f33f3fff640 1 --2- 172.21.15.12:0/200462327 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33fc0a4b80 0x7f33fc0a7200 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f33e4009740 tx=0x7f33e401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b4e59269c462ef1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:29.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.875+0000 7f33fa7fc640 1 -- 172.21.15.12:0/200462327 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33e40b0070 con 0x7f33fc0a4b80 2024-09-11T23:06:29.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.875+0000 7f33fa7fc640 1 -- 172.21.15.12:0/200462327 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33e40ab530 con 0x7f33fc0a4b80 2024-09-11T23:06:29.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.875+0000 7f33fa7fc640 1 -- 172.21.15.12:0/200462327 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33e40ab830 con 0x7f33fc0a4b80 2024-09-11T23:06:29.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.875+0000 7f34012d7640 1 -- 172.21.15.12:0/200462327 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33fc0a4b80 msgr2=0x7f33fc0a7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:29.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.875+0000 7f34012d7640 1 --2- 172.21.15.12:0/200462327 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33fc0a4b80 0x7f33fc0a7200 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f33e4009740 tx=0x7f33e401c390 comp rx=0 tx=0).stop 2024-09-11T23:06:29.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.875+0000 7f34012d7640 1 -- 172.21.15.12:0/200462327 shutdown_connections 2024-09-11T23:06:29.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.875+0000 7f34012d7640 1 --2- 172.21.15.12:0/200462327 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33fc0a4b80 0x7f33fc0a7200 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:29.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.875+0000 7f34012d7640 1 -- 172.21.15.12:0/200462327 >> 172.21.15.12:0/200462327 conn(0x7f33fc0ac2c0 msgr2=0x7f33fc0ac6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:29.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.875+0000 7f34012d7640 1 -- 172.21.15.12:0/200462327 shutdown_connections 2024-09-11T23:06:29.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.875+0000 7f34012d7640 1 -- 172.21.15.12:0/200462327 wait complete. 2024-09-11T23:06:29.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.875+0000 7f34012d7640 1 Processor -- start 2024-09-11T23:06:29.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.875+0000 7f34012d7640 1 -- start start 2024-09-11T23:06:29.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.875+0000 7f34012d7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33fc0a4b80 0x7f33fc1d1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:29.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.875+0000 7f34012d7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f33fc0a7740 con 0x7f33fc0a4b80 2024-09-11T23:06:29.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.875+0000 7f33faffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33fc0a4b80 0x7f33fc1d1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:29.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.875+0000 7f33faffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33fc0a4b80 0x7f33fc1d1ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49306/0 (socket says 172.21.15.12:49306) 2024-09-11T23:06:29.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.875+0000 7f33faffd640 1 -- 172.21.15.12:0/2916136595 learned_addr learned my addr 172.21.15.12:0/2916136595 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:29.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.875+0000 7f33faffd640 1 -- 172.21.15.12:0/2916136595 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33fc1d1c00 con 0x7f33fc0a4b80 2024-09-11T23:06:29.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.875+0000 7f33faffd640 1 --2- 172.21.15.12:0/2916136595 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33fc0a4b80 0x7f33fc1d1ea0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f33ec00c3a0 tx=0x7f33ec00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:29.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.875+0000 7f33f37fe640 1 -- 172.21.15.12:0/2916136595 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33ec017070 con 0x7f33fc0a4b80 2024-09-11T23:06:29.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.875+0000 7f33f37fe640 1 -- 172.21.15.12:0/2916136595 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33ec005c20 con 0x7f33fc0a4b80 2024-09-11T23:06:29.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.875+0000 7f33f37fe640 1 -- 172.21.15.12:0/2916136595 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33ec0070d0 con 0x7f33fc0a4b80 2024-09-11T23:06:29.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.875+0000 7f34012d7640 1 -- 172.21.15.12:0/2916136595 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33fc13efe0 con 0x7f33fc0a4b80 2024-09-11T23:06:29.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.875+0000 7f34012d7640 1 -- 172.21.15.12:0/2916136595 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33fc0a0900 con 0x7f33fc0a4b80 2024-09-11T23:06:29.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.879+0000 7f34012d7640 1 -- 172.21.15.12:0/2916136595 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33fc0a6af0 con 0x7f33fc0a4b80 2024-09-11T23:06:29.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.879+0000 7f33f37fe640 1 -- 172.21.15.12:0/2916136595 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 32) ==== 43997+0+0 (secure 0 0 0) 0x7f33ec01a070 con 0x7f33fc0a4b80 2024-09-11T23:06:29.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.879+0000 7f33f37fe640 1 --2- 172.21.15.12:0/2916136595 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f33dc035d20 0x7f33dc0381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:29.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.879+0000 7f33f37fe640 1 -- 172.21.15.12:0/2916136595 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 3439+0+0 (secure 0 0 0) 0x7f33ec0477e0 con 0x7f33fc0a4b80 2024-09-11T23:06:29.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.879+0000 7f33f3fff640 1 --2- 172.21.15.12:0/2916136595 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f33dc035d20 0x7f33dc0381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:29.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.879+0000 7f33f3fff640 1 --2- 172.21.15.12:0/2916136595 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f33dc035d20 0x7f33dc0381e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f33e40ad000 tx=0x7f33e4008040 comp rx=0 tx=0).ready entity=mgr.4903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:29.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:29.883+0000 7f33f37fe640 1 -- 172.21.15.12:0/2916136595 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f33ec007270 con 0x7f33fc0a4b80 2024-09-11T23:06:30.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.055+0000 7f34012d7640 1 -- 172.21.15.12:0/2916136595 --> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f33fc0a2e90 con 0x7f33dc035d20 2024-09-11T23:06:30.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.063+0000 7f33f37fe640 1 -- 172.21.15.12:0/2916136595 <== mgr.4903 v2:172.21.15.12:6828/4277951488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+235306 (secure 0 0 0) 0x7f33fc0a2e90 con 0x7f33dc035d20 2024-09-11T23:06:30.070 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:06:30.071 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-11T23:06:30.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.067+0000 7f34012d7640 1 -- 172.21.15.12:0/2916136595 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f33dc035d20 msgr2=0x7f33dc0381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:30.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.067+0000 7f34012d7640 1 --2- 172.21.15.12:0/2916136595 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f33dc035d20 0x7f33dc0381e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f33e40ad000 tx=0x7f33e4008040 comp rx=0 tx=0).stop 2024-09-11T23:06:30.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.067+0000 7f34012d7640 1 -- 172.21.15.12:0/2916136595 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33fc0a4b80 msgr2=0x7f33fc1d1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:30.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.067+0000 7f34012d7640 1 --2- 172.21.15.12:0/2916136595 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33fc0a4b80 0x7f33fc1d1ea0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f33ec00c3a0 tx=0x7f33ec00c860 comp rx=0 tx=0).stop 2024-09-11T23:06:30.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.067+0000 7f34012d7640 1 -- 172.21.15.12:0/2916136595 shutdown_connections 2024-09-11T23:06:30.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.067+0000 7f34012d7640 1 --2- 172.21.15.12:0/2916136595 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f33dc035d20 0x7f33dc0381e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:30.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.067+0000 7f34012d7640 1 --2- 172.21.15.12:0/2916136595 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33fc0a4b80 0x7f33fc1d1ea0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:30.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.067+0000 7f34012d7640 1 -- 172.21.15.12:0/2916136595 >> 172.21.15.12:0/2916136595 conn(0x7f33fc0ac2c0 msgr2=0x7f33fc0aa490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:30.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.067+0000 7f34012d7640 1 -- 172.21.15.12:0/2916136595 shutdown_connections 2024-09-11T23:06:30.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.067+0000 7f34012d7640 1 -- 172.21.15.12:0/2916136595 wait complete. 2024-09-11T23:06:30.088 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-09-11T23:06:29.541099+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":528,"num_read_kb":1012,"num_write":219,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1283,"ondisk_log_size":1283,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":104764,"kb_used_data":2872,"kb_used_omap":4,"kb_used_meta":101819,"kb_avail":283010756,"statfs":{"total":289910292480,"available":289803014144,"internally_reserved":0,"allocated":2940928,"data_stored":1870704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":104262991},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.571784"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.981804+0000","last_change":"2024-09-11T23:06:23.981804+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.981804+0000","last_undegraded":"2024-09-11T23:06:23.981804+0000","last_fullsized":"2024-09-11T23:06:23.981804+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.977548+0000","last_change":"2024-09-11T23:06:23.977548+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.977548+0000","last_undegraded":"2024-09-11T23:06:23.977548+0000","last_fullsized":"2024-09-11T23:06:23.977548+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.982403+0000","last_change":"2024-09-11T23:06:23.982403+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.982403+0000","last_undegraded":"2024-09-11T23:06:23.982403+0000","last_fullsized":"2024-09-11T23:06:23.982403+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.983055+0000","last_change":"2024-09-11T23:06:23.983055+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.983055+0000","last_undegraded":"2024-09-11T23:06:23.983055+0000","last_fullsized":"2024-09-11T23:06:23.983055+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.983895+0000","last_change":"2024-09-11T23:06:23.983895+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.983895+0000","last_undegraded":"2024-09-11T23:06:23.983895+0000","last_fullsized":"2024-09-11T23:06:23.983895+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.976637+0000","last_change":"2024-09-11T23:06:23.976637+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.976637+0000","last_undegraded":"2024-09-11T23:06:23.976637+0000","last_fullsized":"2024-09-11T23:06:23.976637+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.980055+0000","last_change":"2024-09-11T23:06:23.980055+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.980055+0000","last_undegraded":"2024-09-11T23:06:23.980055+0000","last_fullsized":"2024-09-11T23:06:23.980055+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.977622+0000","last_change":"2024-09-11T23:06:23.977622+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.977622+0000","last_undegraded":"2024-09-11T23:06:23.977622+0000","last_fullsized":"2024-09-11T23:06:23.977622+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.978622+0000","last_change":"2024-09-11T23:06:23.978622+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.978622+0000","last_undegraded":"2024-09-11T23:06:23.978622+0000","last_fullsized":"2024-09-11T23:06:23.978622+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.976560+0000","last_change":"2024-09-11T23:06:23.976560+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.976560+0000","last_undegraded":"2024-09-11T23:06:23.976560+0000","last_fullsized":"2024-09-11T23:06:23.976560+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.978896+0000","last_change":"2024-09-11T23:06:23.978896+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.978896+0000","last_undegraded":"2024-09-11T23:06:23.978896+0000","last_fullsized":"2024-09-11T23:06:23.978896+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.982525+0000","last_change":"2024-09-11T23:06:23.982525+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.982525+0000","last_undegraded":"2024-09-11T23:06:23.982525+0000","last_fullsized":"2024-09-11T23:06:23.982525+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.977154+0000","last_change":"2024-09-11T23:06:23.977154+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.977154+0000","last_undegraded":"2024-09-11T23:06:23.977154+0000","last_fullsized":"2024-09-11T23:06:23.977154+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.981344+0000","last_change":"2024-09-11T23:06:23.981344+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.981344+0000","last_undegraded":"2024-09-11T23:06:23.981344+0000","last_fullsized":"2024-09-11T23:06:23.981344+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.976240+0000","last_change":"2024-09-11T23:06:23.976240+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.976240+0000","last_undegraded":"2024-09-11T23:06:23.976240+0000","last_fullsized":"2024-09-11T23:06:23.976240+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.983364+0000","last_change":"2024-09-11T23:06:23.983364+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.983364+0000","last_undegraded":"2024-09-11T23:06:23.983364+0000","last_fullsized":"2024-09-11T23:06:23.983364+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.981281+0000","last_change":"2024-09-11T23:06:23.981281+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.981281+0000","last_undegraded":"2024-09-11T23:06:23.981281+0000","last_fullsized":"2024-09-11T23:06:23.981281+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.981294+0000","last_change":"2024-09-11T23:06:23.981294+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.981294+0000","last_undegraded":"2024-09-11T23:06:23.981294+0000","last_fullsized":"2024-09-11T23:06:23.981294+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.980426+0000","last_change":"2024-09-11T23:06:23.980426+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.980426+0000","last_undegraded":"2024-09-11T23:06:23.980426+0000","last_fullsized":"2024-09-11T23:06:23.980426+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.983371+0000","last_change":"2024-09-11T23:06:23.983371+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.983371+0000","last_undegraded":"2024-09-11T23:06:23.983371+0000","last_fullsized":"2024-09-11T23:06:23.983371+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.976124+0000","last_change":"2024-09-11T23:06:23.976124+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.976124+0000","last_undegraded":"2024-09-11T23:06:23.976124+0000","last_fullsized":"2024-09-11T23:06:23.976124+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.974933+0000","last_change":"2024-09-11T23:06:23.974933+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.974933+0000","last_undegraded":"2024-09-11T23:06:23.974933+0000","last_fullsized":"2024-09-11T23:06:23.974933+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.974806+0000","last_change":"2024-09-11T23:06:23.974806+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.974806+0000","last_undegraded":"2024-09-11T23:06:23.974806+0000","last_fullsized":"2024-09-11T23:06:23.974806+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.977435+0000","last_change":"2024-09-11T23:06:23.977435+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.977435+0000","last_undegraded":"2024-09-11T23:06:23.977435+0000","last_fullsized":"2024-09-11T23:06:23.977435+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.977097+0000","last_change":"2024-09-11T23:06:23.977097+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.977097+0000","last_undegraded":"2024-09-11T23:06:23.977097+0000","last_fullsized":"2024-09-11T23:06:23.977097+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.980917+0000","last_change":"2024-09-11T23:06:23.980917+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.980917+0000","last_undegraded":"2024-09-11T23:06:23.980917+0000","last_fullsized":"2024-09-11T23:06:23.980917+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.975299+0000","last_change":"2024-09-11T23:06:23.975299+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.975299+0000","last_undegraded":"2024-09-11T23:06:23.975299+0000","last_fullsized":"2024-09-11T23:06:23.975299+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.982848+0000","last_change":"2024-09-11T23:06:23.982848+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.982848+0000","last_undegraded":"2024-09-11T23:06:23.982848+0000","last_fullsized":"2024-09-11T23:06:23.982848+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.975437+0000","last_change":"2024-09-11T23:06:23.975437+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.975437+0000","last_undegraded":"2024-09-11T23:06:23.975437+0000","last_fullsized":"2024-09-11T23:06:23.975437+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.977062+0000","last_change":"2024-09-11T23:06:23.977062+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.977062+0000","last_undegraded":"2024-09-11T23:06:23.977062+0000","last_fullsized":"2024-09-11T23:06:23.977062+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.980318+0000","last_change":"2024-09-11T23:06:23.980318+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.980318+0000","last_undegraded":"2024-09-11T23:06:23.980318+0000","last_fullsized":"2024-09-11T23:06:23.980318+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.977468+0000","last_change":"2024-09-11T23:06:23.977468+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.977468+0000","last_undegraded":"2024-09-11T23:06:23.977468+0000","last_fullsized":"2024-09-11T23:06:23.977468+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"62'1283","reported_seq":1553,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:06:24.532469+0000","last_change":"2024-09-11T23:03:26.382905+0000","last_active":"2024-09-11T23:06:24.532469+0000","last_peered":"2024-09-11T23:06:24.532469+0000","last_clean":"2024-09-11T23:06:24.532469+0000","last_became_active":"2024-09-11T23:03:26.380590+0000","last_became_peered":"2024-09-11T23:03:26.380590+0000","last_unstale":"2024-09-11T23:06:24.532469+0000","last_undegraded":"2024-09-11T23:06:24.532469+0000","last_fullsized":"2024-09-11T23:06:24.532469+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:24.361793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:24.361793+0000","last_clean_scrub_stamp":"2024-09-11T23:03:24.361793+0000","objects_scrubbed":0,"log_size":1283,"log_dups_size":0,"ondisk_log_size":1283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:46.577063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":528,"num_read_kb":1012,"num_write":219,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":528,"num_read_kb":1012,"num_write":219,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1283,"ondisk_log_size":1283,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738405,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31756,"kb_used_data":568,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340084,"statfs":{"total":96636764160,"available":96604246016,"internally_reserved":0,"allocated":581632,"data_stored":228807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738405,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36508,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335332,"statfs":{"total":96636764160,"available":96599379968,"internally_reserved":0,"allocated":1183744,"data_stored":822722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738405,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36500,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335340,"statfs":{"total":96636764160,"available":96599388160,"internally_reserved":0,"allocated":1175552,"data_stored":819175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:06:30.093 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:06:30.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.263+0000 7f2cd3ef5640 1 Processor -- start 2024-09-11T23:06:30.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.263+0000 7f2cd3ef5640 1 -- start start 2024-09-11T23:06:30.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.263+0000 7f2cd3ef5640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2ccc0a4b80 0x7f2ccc0a7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:30.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.263+0000 7f2cd3ef5640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ccc0a82a0 con 0x7f2ccc13a410 2024-09-11T23:06:30.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.263+0000 7f2cd3ef5640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f2ccc0a3cb0 con 0x7f2ccc0a4b80 2024-09-11T23:06:30.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.263+0000 7f2cd1490640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2ccc0a4b80 0x7f2ccc0a7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:30.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.263+0000 7f2cd1c91640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f2ccc13a410 0x7f2ccc0a6af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38672/0 (socket says 172.21.15.12:38672) 2024-09-11T23:06:30.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.263+0000 7f2cd1c91640 1 -- 172.21.15.12:0/1287138147 learned_addr learned my addr 172.21.15.12:0/1287138147 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:30.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.263+0000 7f2cd1490640 1 -- 172.21.15.12:0/1287138147 >> v1:172.21.15.12:6789/0 conn(0x7f2ccc13a410 legacy=0x7f2ccc0a6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:30.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.263+0000 7f2cd1490640 1 -- 172.21.15.12:0/1287138147 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ccc139fe0 con 0x7f2ccc0a4b80 2024-09-11T23:06:30.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.263+0000 7f2cd0c8f640 1 -- 172.21.15.12:0/1287138147 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4100366796 0 0) 0x7f2ccc0a82a0 con 0x7f2ccc13a410 2024-09-11T23:06:30.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.267+0000 7f2cd1490640 1 --2- 172.21.15.12:0/1287138147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ccc0a4b80 0x7f2ccc0a7200 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc009740 tx=0x7f2cbc01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4955d712201a2ae server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:30.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.267+0000 7f2cd0c8f640 1 -- 172.21.15.12:0/1287138147 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cbc0b0070 con 0x7f2ccc0a4b80 2024-09-11T23:06:30.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.267+0000 7f2cd0c8f640 1 -- 172.21.15.12:0/1287138147 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cbc0ab530 con 0x7f2ccc0a4b80 2024-09-11T23:06:30.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.267+0000 7f2cd0c8f640 1 -- 172.21.15.12:0/1287138147 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cbc0ab830 con 0x7f2ccc0a4b80 2024-09-11T23:06:30.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.267+0000 7f2cd3ef5640 1 -- 172.21.15.12:0/1287138147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ccc0a4b80 msgr2=0x7f2ccc0a7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:30.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.267+0000 7f2cd3ef5640 1 --2- 172.21.15.12:0/1287138147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ccc0a4b80 0x7f2ccc0a7200 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc009740 tx=0x7f2cbc01c390 comp rx=0 tx=0).stop 2024-09-11T23:06:30.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.267+0000 7f2cd3ef5640 1 -- 172.21.15.12:0/1287138147 shutdown_connections 2024-09-11T23:06:30.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.267+0000 7f2cd3ef5640 1 --2- 172.21.15.12:0/1287138147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ccc0a4b80 0x7f2ccc0a7200 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:30.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.267+0000 7f2cd3ef5640 1 -- 172.21.15.12:0/1287138147 >> 172.21.15.12:0/1287138147 conn(0x7f2ccc0ac2c0 msgr2=0x7f2ccc0ac6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:30.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.267+0000 7f2cd3ef5640 1 -- 172.21.15.12:0/1287138147 shutdown_connections 2024-09-11T23:06:30.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.267+0000 7f2cd3ef5640 1 -- 172.21.15.12:0/1287138147 wait complete. 2024-09-11T23:06:30.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.267+0000 7f2cd3ef5640 1 Processor -- start 2024-09-11T23:06:30.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.267+0000 7f2cd3ef5640 1 -- start start 2024-09-11T23:06:30.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.267+0000 7f2cd3ef5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ccc0a4b80 0x7f2ccc1cecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:30.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.267+0000 7f2cd3ef5640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2ccc0a7740 con 0x7f2ccc0a4b80 2024-09-11T23:06:30.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.267+0000 7f2cd1c91640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ccc0a4b80 0x7f2ccc1cecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:30.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.267+0000 7f2cd1c91640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ccc0a4b80 0x7f2ccc1cecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49318/0 (socket says 172.21.15.12:49318) 2024-09-11T23:06:30.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.267+0000 7f2cd1c91640 1 -- 172.21.15.12:0/4047081026 learned_addr learned my addr 172.21.15.12:0/4047081026 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:30.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.267+0000 7f2cd1c91640 1 -- 172.21.15.12:0/4047081026 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ccc09c7a0 con 0x7f2ccc0a4b80 2024-09-11T23:06:30.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.267+0000 7f2cd1c91640 1 --2- 172.21.15.12:0/4047081026 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ccc0a4b80 0x7f2ccc1cecb0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f2cc800c450 tx=0x7f2cc800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:30.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.267+0000 7f2cc27fc640 1 -- 172.21.15.12:0/4047081026 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cc8005c20 con 0x7f2ccc0a4b80 2024-09-11T23:06:30.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.267+0000 7f2cc27fc640 1 -- 172.21.15.12:0/4047081026 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cc8005dc0 con 0x7f2ccc0a4b80 2024-09-11T23:06:30.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.267+0000 7f2cd3ef5640 1 -- 172.21.15.12:0/4047081026 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ccc09a9d0 con 0x7f2ccc0a4b80 2024-09-11T23:06:30.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.267+0000 7f2cc27fc640 1 -- 172.21.15.12:0/4047081026 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cc80071a0 con 0x7f2ccc0a4b80 2024-09-11T23:06:30.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.267+0000 7f2cd3ef5640 1 -- 172.21.15.12:0/4047081026 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ccc1ce810 con 0x7f2ccc0a4b80 2024-09-11T23:06:30.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.271+0000 7f2cd3ef5640 1 -- 172.21.15.12:0/4047081026 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ccc0a6af0 con 0x7f2ccc0a4b80 2024-09-11T23:06:30.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.271+0000 7f2cc27fc640 1 -- 172.21.15.12:0/4047081026 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 32) ==== 43997+0+0 (secure 0 0 0) 0x7f2cc8007400 con 0x7f2ccc0a4b80 2024-09-11T23:06:30.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.271+0000 7f2cc27fc640 1 --2- 172.21.15.12:0/4047081026 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f2cb0035cd0 0x7f2cb0038190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:30.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.271+0000 7f2cc27fc640 1 -- 172.21.15.12:0/4047081026 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 3439+0+0 (secure 0 0 0) 0x7f2cc8048230 con 0x7f2ccc0a4b80 2024-09-11T23:06:30.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.271+0000 7f2cd1490640 1 --2- 172.21.15.12:0/4047081026 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f2cb0035cd0 0x7f2cb0038190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:30.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.271+0000 7f2cd1490640 1 --2- 172.21.15.12:0/4047081026 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f2cb0035cd0 0x7f2cb0038190 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc0ad000 tx=0x7f2cbc008040 comp rx=0 tx=0).ready entity=mgr.4903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:30.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.275+0000 7f2cc27fc640 1 -- 172.21.15.12:0/4047081026 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2cc80182b0 con 0x7f2ccc0a4b80 2024-09-11T23:06:30.296 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:30.291+0000 7f02a2c51640 -1 client.4935: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.4890:b65aeaeb-3f3a-4da2-97b5-6988dece6be2:v1:172.21.15.12:0/2496375865] 2024-09-11T23:06:30.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.459+0000 7f2cd3ef5640 1 -- 172.21.15.12:0/4047081026 --> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2ccc09c490 con 0x7f2cb0035cd0 2024-09-11T23:06:30.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.467+0000 7f2cc27fc640 1 -- 172.21.15.12:0/4047081026 <== mgr.4903 v2:172.21.15.12:6828/4277951488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+235306 (secure 0 0 0) 0x7f2cbc0b1040 con 0x7f2cb0035cd0 2024-09-11T23:06:30.474 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:06:30.475 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-11T23:06:30.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.471+0000 7f2cd3ef5640 1 -- 172.21.15.12:0/4047081026 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f2cb0035cd0 msgr2=0x7f2cb0038190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:30.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.471+0000 7f2cd3ef5640 1 --2- 172.21.15.12:0/4047081026 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f2cb0035cd0 0x7f2cb0038190 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc0ad000 tx=0x7f2cbc008040 comp rx=0 tx=0).stop 2024-09-11T23:06:30.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.471+0000 7f2cd3ef5640 1 -- 172.21.15.12:0/4047081026 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ccc0a4b80 msgr2=0x7f2ccc1cecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:30.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.471+0000 7f2cd3ef5640 1 --2- 172.21.15.12:0/4047081026 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ccc0a4b80 0x7f2ccc1cecb0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f2cc800c450 tx=0x7f2cc800c910 comp rx=0 tx=0).stop 2024-09-11T23:06:30.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.471+0000 7f2cd3ef5640 1 -- 172.21.15.12:0/4047081026 shutdown_connections 2024-09-11T23:06:30.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.471+0000 7f2cd3ef5640 1 --2- 172.21.15.12:0/4047081026 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f2cb0035cd0 0x7f2cb0038190 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:30.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.471+0000 7f2cd3ef5640 1 --2- 172.21.15.12:0/4047081026 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ccc0a4b80 0x7f2ccc1cecb0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:30.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.471+0000 7f2cd3ef5640 1 -- 172.21.15.12:0/4047081026 >> 172.21.15.12:0/4047081026 conn(0x7f2ccc0ac2c0 msgr2=0x7f2ccc13f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:30.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.471+0000 7f2cd3ef5640 1 -- 172.21.15.12:0/4047081026 shutdown_connections 2024-09-11T23:06:30.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.471+0000 7f2cd3ef5640 1 -- 172.21.15.12:0/4047081026 wait complete. 2024-09-11T23:06:30.493 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-09-11T23:06:29.541099+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":528,"num_read_kb":1012,"num_write":219,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1283,"ondisk_log_size":1283,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":104764,"kb_used_data":2872,"kb_used_omap":4,"kb_used_meta":101819,"kb_avail":283010756,"statfs":{"total":289910292480,"available":289803014144,"internally_reserved":0,"allocated":2940928,"data_stored":1870704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":104262991},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.571784"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.981804+0000","last_change":"2024-09-11T23:06:23.981804+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.981804+0000","last_undegraded":"2024-09-11T23:06:23.981804+0000","last_fullsized":"2024-09-11T23:06:23.981804+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.977548+0000","last_change":"2024-09-11T23:06:23.977548+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.977548+0000","last_undegraded":"2024-09-11T23:06:23.977548+0000","last_fullsized":"2024-09-11T23:06:23.977548+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.982403+0000","last_change":"2024-09-11T23:06:23.982403+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.982403+0000","last_undegraded":"2024-09-11T23:06:23.982403+0000","last_fullsized":"2024-09-11T23:06:23.982403+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.983055+0000","last_change":"2024-09-11T23:06:23.983055+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.983055+0000","last_undegraded":"2024-09-11T23:06:23.983055+0000","last_fullsized":"2024-09-11T23:06:23.983055+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.983895+0000","last_change":"2024-09-11T23:06:23.983895+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.983895+0000","last_undegraded":"2024-09-11T23:06:23.983895+0000","last_fullsized":"2024-09-11T23:06:23.983895+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.976637+0000","last_change":"2024-09-11T23:06:23.976637+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.976637+0000","last_undegraded":"2024-09-11T23:06:23.976637+0000","last_fullsized":"2024-09-11T23:06:23.976637+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.980055+0000","last_change":"2024-09-11T23:06:23.980055+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.980055+0000","last_undegraded":"2024-09-11T23:06:23.980055+0000","last_fullsized":"2024-09-11T23:06:23.980055+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.977622+0000","last_change":"2024-09-11T23:06:23.977622+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.977622+0000","last_undegraded":"2024-09-11T23:06:23.977622+0000","last_fullsized":"2024-09-11T23:06:23.977622+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.978622+0000","last_change":"2024-09-11T23:06:23.978622+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.978622+0000","last_undegraded":"2024-09-11T23:06:23.978622+0000","last_fullsized":"2024-09-11T23:06:23.978622+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.976560+0000","last_change":"2024-09-11T23:06:23.976560+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.976560+0000","last_undegraded":"2024-09-11T23:06:23.976560+0000","last_fullsized":"2024-09-11T23:06:23.976560+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.978896+0000","last_change":"2024-09-11T23:06:23.978896+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.978896+0000","last_undegraded":"2024-09-11T23:06:23.978896+0000","last_fullsized":"2024-09-11T23:06:23.978896+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.982525+0000","last_change":"2024-09-11T23:06:23.982525+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.982525+0000","last_undegraded":"2024-09-11T23:06:23.982525+0000","last_fullsized":"2024-09-11T23:06:23.982525+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.977154+0000","last_change":"2024-09-11T23:06:23.977154+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.977154+0000","last_undegraded":"2024-09-11T23:06:23.977154+0000","last_fullsized":"2024-09-11T23:06:23.977154+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.981344+0000","last_change":"2024-09-11T23:06:23.981344+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.981344+0000","last_undegraded":"2024-09-11T23:06:23.981344+0000","last_fullsized":"2024-09-11T23:06:23.981344+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.976240+0000","last_change":"2024-09-11T23:06:23.976240+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.976240+0000","last_undegraded":"2024-09-11T23:06:23.976240+0000","last_fullsized":"2024-09-11T23:06:23.976240+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.983364+0000","last_change":"2024-09-11T23:06:23.983364+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.983364+0000","last_undegraded":"2024-09-11T23:06:23.983364+0000","last_fullsized":"2024-09-11T23:06:23.983364+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.981281+0000","last_change":"2024-09-11T23:06:23.981281+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.981281+0000","last_undegraded":"2024-09-11T23:06:23.981281+0000","last_fullsized":"2024-09-11T23:06:23.981281+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.981294+0000","last_change":"2024-09-11T23:06:23.981294+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.981294+0000","last_undegraded":"2024-09-11T23:06:23.981294+0000","last_fullsized":"2024-09-11T23:06:23.981294+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.980426+0000","last_change":"2024-09-11T23:06:23.980426+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.980426+0000","last_undegraded":"2024-09-11T23:06:23.980426+0000","last_fullsized":"2024-09-11T23:06:23.980426+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.983371+0000","last_change":"2024-09-11T23:06:23.983371+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.983371+0000","last_undegraded":"2024-09-11T23:06:23.983371+0000","last_fullsized":"2024-09-11T23:06:23.983371+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.976124+0000","last_change":"2024-09-11T23:06:23.976124+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.976124+0000","last_undegraded":"2024-09-11T23:06:23.976124+0000","last_fullsized":"2024-09-11T23:06:23.976124+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.974933+0000","last_change":"2024-09-11T23:06:23.974933+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.974933+0000","last_undegraded":"2024-09-11T23:06:23.974933+0000","last_fullsized":"2024-09-11T23:06:23.974933+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.974806+0000","last_change":"2024-09-11T23:06:23.974806+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.974806+0000","last_undegraded":"2024-09-11T23:06:23.974806+0000","last_fullsized":"2024-09-11T23:06:23.974806+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.977435+0000","last_change":"2024-09-11T23:06:23.977435+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.977435+0000","last_undegraded":"2024-09-11T23:06:23.977435+0000","last_fullsized":"2024-09-11T23:06:23.977435+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.977097+0000","last_change":"2024-09-11T23:06:23.977097+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.977097+0000","last_undegraded":"2024-09-11T23:06:23.977097+0000","last_fullsized":"2024-09-11T23:06:23.977097+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.980917+0000","last_change":"2024-09-11T23:06:23.980917+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.980917+0000","last_undegraded":"2024-09-11T23:06:23.980917+0000","last_fullsized":"2024-09-11T23:06:23.980917+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.975299+0000","last_change":"2024-09-11T23:06:23.975299+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.975299+0000","last_undegraded":"2024-09-11T23:06:23.975299+0000","last_fullsized":"2024-09-11T23:06:23.975299+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.982848+0000","last_change":"2024-09-11T23:06:23.982848+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.982848+0000","last_undegraded":"2024-09-11T23:06:23.982848+0000","last_fullsized":"2024-09-11T23:06:23.982848+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.975437+0000","last_change":"2024-09-11T23:06:23.975437+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.975437+0000","last_undegraded":"2024-09-11T23:06:23.975437+0000","last_fullsized":"2024-09-11T23:06:23.975437+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.977062+0000","last_change":"2024-09-11T23:06:23.977062+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.977062+0000","last_undegraded":"2024-09-11T23:06:23.977062+0000","last_fullsized":"2024-09-11T23:06:23.977062+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.980318+0000","last_change":"2024-09-11T23:06:23.980318+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.980318+0000","last_undegraded":"2024-09-11T23:06:23.980318+0000","last_fullsized":"2024-09-11T23:06:23.980318+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.977468+0000","last_change":"2024-09-11T23:06:23.977468+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.977468+0000","last_undegraded":"2024-09-11T23:06:23.977468+0000","last_fullsized":"2024-09-11T23:06:23.977468+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"62'1283","reported_seq":1553,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:06:24.532469+0000","last_change":"2024-09-11T23:03:26.382905+0000","last_active":"2024-09-11T23:06:24.532469+0000","last_peered":"2024-09-11T23:06:24.532469+0000","last_clean":"2024-09-11T23:06:24.532469+0000","last_became_active":"2024-09-11T23:03:26.380590+0000","last_became_peered":"2024-09-11T23:03:26.380590+0000","last_unstale":"2024-09-11T23:06:24.532469+0000","last_undegraded":"2024-09-11T23:06:24.532469+0000","last_fullsized":"2024-09-11T23:06:24.532469+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:24.361793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:24.361793+0000","last_clean_scrub_stamp":"2024-09-11T23:03:24.361793+0000","objects_scrubbed":0,"log_size":1283,"log_dups_size":0,"ondisk_log_size":1283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:46.577063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":528,"num_read_kb":1012,"num_write":219,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":528,"num_read_kb":1012,"num_write":219,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1283,"ondisk_log_size":1283,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738405,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31756,"kb_used_data":568,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340084,"statfs":{"total":96636764160,"available":96604246016,"internally_reserved":0,"allocated":581632,"data_stored":228807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738405,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36508,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335332,"statfs":{"total":96636764160,"available":96599379968,"internally_reserved":0,"allocated":1183744,"data_stored":822722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738405,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36500,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335340,"statfs":{"total":96636764160,"available":96599388160,"internally_reserved":0,"allocated":1175552,"data_stored":819175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:06:30.497 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:06:30.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.667+0000 7fb78a90d640 1 Processor -- start 2024-09-11T23:06:30.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.667+0000 7fb78a90d640 1 -- start start 2024-09-11T23:06:30.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.667+0000 7fb78a90d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb7840a24b0 0x7fb78406fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:30.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.667+0000 7fb78a90d640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7840703e0 con 0x7fb7840a2890 2024-09-11T23:06:30.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.667+0000 7fb78a90d640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fb78406c9f0 con 0x7fb7840a24b0 2024-09-11T23:06:30.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.667+0000 7fb783fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb7840a24b0 0x7fb78406fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:30.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.667+0000 7fb783fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb7840a24b0 0x7fb78406fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49322/0 (socket says 172.21.15.12:49322) 2024-09-11T23:06:30.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.667+0000 7fb783fff640 1 -- 172.21.15.12:0/3886031717 learned_addr learned my addr 172.21.15.12:0/3886031717 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:30.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.667+0000 7fb783fff640 1 -- 172.21.15.12:0/3886031717 >> v1:172.21.15.12:6789/0 conn(0x7fb7840a2890 legacy=0x7fb7840a2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:30.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.667+0000 7fb783fff640 1 -- 172.21.15.12:0/3886031717 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb78406bc60 con 0x7fb7840a24b0 2024-09-11T23:06:30.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.667+0000 7fb782ffd640 1 -- 172.21.15.12:0/3886031717 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 227468905 0 0) 0x7fb7840703e0 con 0x7fb7840a2890 2024-09-11T23:06:30.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.671+0000 7fb783fff640 1 --2- 172.21.15.12:0/3886031717 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7840a24b0 0x7fb78406fd00 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fb7740097f0 tx=0x7fb77401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64cc1ed196c7ccb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:30.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.671+0000 7fb782ffd640 1 -- 172.21.15.12:0/3886031717 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7740a6040 con 0x7fb7840a24b0 2024-09-11T23:06:30.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.671+0000 7fb782ffd640 1 -- 172.21.15.12:0/3886031717 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7740af070 con 0x7fb7840a24b0 2024-09-11T23:06:30.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.671+0000 7fb782ffd640 1 -- 172.21.15.12:0/3886031717 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7740aa6c0 con 0x7fb7840a24b0 2024-09-11T23:06:30.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.671+0000 7fb78a90d640 1 -- 172.21.15.12:0/3886031717 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7840a24b0 msgr2=0x7fb78406fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:30.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.671+0000 7fb78a90d640 1 --2- 172.21.15.12:0/3886031717 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7840a24b0 0x7fb78406fd00 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fb7740097f0 tx=0x7fb77401c4e0 comp rx=0 tx=0).stop 2024-09-11T23:06:30.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.671+0000 7fb78a90d640 1 -- 172.21.15.12:0/3886031717 shutdown_connections 2024-09-11T23:06:30.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.671+0000 7fb78a90d640 1 --2- 172.21.15.12:0/3886031717 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7840a24b0 0x7fb78406fd00 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:30.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.671+0000 7fb78a90d640 1 -- 172.21.15.12:0/3886031717 >> 172.21.15.12:0/3886031717 conn(0x7fb784068000 msgr2=0x7fb7840a5910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:30.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.671+0000 7fb78a90d640 1 -- 172.21.15.12:0/3886031717 shutdown_connections 2024-09-11T23:06:30.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.671+0000 7fb78a90d640 1 -- 172.21.15.12:0/3886031717 wait complete. 2024-09-11T23:06:30.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.671+0000 7fb78a90d640 1 Processor -- start 2024-09-11T23:06:30.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.671+0000 7fb78a90d640 1 -- start start 2024-09-11T23:06:30.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.671+0000 7fb78a90d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7840a24b0 0x7fb784134900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:30.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.671+0000 7fb78a90d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb7840a6400 con 0x7fb7840a24b0 2024-09-11T23:06:30.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.671+0000 7fb783fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7840a24b0 0x7fb784134900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:30.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.671+0000 7fb783fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7840a24b0 0x7fb784134900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49328/0 (socket says 172.21.15.12:49328) 2024-09-11T23:06:30.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.671+0000 7fb783fff640 1 -- 172.21.15.12:0/632790262 learned_addr learned my addr 172.21.15.12:0/632790262 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:30.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.671+0000 7fb783fff640 1 -- 172.21.15.12:0/632790262 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb78409f310 con 0x7fb7840a24b0 2024-09-11T23:06:30.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.671+0000 7fb783fff640 1 --2- 172.21.15.12:0/632790262 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7840a24b0 0x7fb784134900 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fb7740190f0 tx=0x7fb77401ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:30.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.675+0000 7fb780ff9640 1 -- 172.21.15.12:0/632790262 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7740aad10 con 0x7fb7840a24b0 2024-09-11T23:06:30.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.675+0000 7fb780ff9640 1 -- 172.21.15.12:0/632790262 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7740bd3f0 con 0x7fb7840a24b0 2024-09-11T23:06:30.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.675+0000 7fb78a90d640 1 -- 172.21.15.12:0/632790262 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb78409e650 con 0x7fb7840a24b0 2024-09-11T23:06:30.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.675+0000 7fb780ff9640 1 -- 172.21.15.12:0/632790262 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7740bd6d0 con 0x7fb7840a24b0 2024-09-11T23:06:30.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.675+0000 7fb78a90d640 1 -- 172.21.15.12:0/632790262 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb78409e910 con 0x7fb7840a24b0 2024-09-11T23:06:30.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.675+0000 7fb78a90d640 1 -- 172.21.15.12:0/632790262 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb78406fd00 con 0x7fb7840a24b0 2024-09-11T23:06:30.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.675+0000 7fb780ff9640 1 -- 172.21.15.12:0/632790262 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 32) ==== 43997+0+0 (secure 0 0 0) 0x7fb7740c6430 con 0x7fb7840a24b0 2024-09-11T23:06:30.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.675+0000 7fb780ff9640 1 --2- 172.21.15.12:0/632790262 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fb770035d20 0x7fb7700381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:30.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.675+0000 7fb780ff9640 1 -- 172.21.15.12:0/632790262 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 3439+0+0 (secure 0 0 0) 0x7fb7740e2a00 con 0x7fb7840a24b0 2024-09-11T23:06:30.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.675+0000 7fb7837fe640 1 --2- 172.21.15.12:0/632790262 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fb770035d20 0x7fb7700381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:30.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.675+0000 7fb7837fe640 1 --2- 172.21.15.12:0/632790262 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fb770035d20 0x7fb7700381e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb778007fd0 tx=0x7fb778007940 comp rx=0 tx=0).ready entity=mgr.4903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:30.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.679+0000 7fb780ff9640 1 -- 172.21.15.12:0/632790262 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb7740160d0 con 0x7fb7840a24b0 2024-09-11T23:06:30.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.847+0000 7fb78a90d640 1 -- 172.21.15.12:0/632790262 --> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb78409e340 con 0x7fb770035d20 2024-09-11T23:06:30.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.859+0000 7fb780ff9640 1 -- 172.21.15.12:0/632790262 <== mgr.4903 v2:172.21.15.12:6828/4277951488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+235306 (secure 0 0 0) 0x7fb7780050d0 con 0x7fb770035d20 2024-09-11T23:06:30.865 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:06:30.867 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-11T23:06:30.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.863+0000 7fb78a90d640 1 -- 172.21.15.12:0/632790262 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fb770035d20 msgr2=0x7fb7700381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:30.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.863+0000 7fb78a90d640 1 --2- 172.21.15.12:0/632790262 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fb770035d20 0x7fb7700381e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb778007fd0 tx=0x7fb778007940 comp rx=0 tx=0).stop 2024-09-11T23:06:30.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.863+0000 7fb78a90d640 1 -- 172.21.15.12:0/632790262 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7840a24b0 msgr2=0x7fb784134900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:30.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.863+0000 7fb78a90d640 1 --2- 172.21.15.12:0/632790262 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7840a24b0 0x7fb784134900 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fb7740190f0 tx=0x7fb77401ad20 comp rx=0 tx=0).stop 2024-09-11T23:06:30.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.863+0000 7fb78a90d640 1 -- 172.21.15.12:0/632790262 shutdown_connections 2024-09-11T23:06:30.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.863+0000 7fb78a90d640 1 --2- 172.21.15.12:0/632790262 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fb770035d20 0x7fb7700381e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:30.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.863+0000 7fb78a90d640 1 --2- 172.21.15.12:0/632790262 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7840a24b0 0x7fb784134900 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:30.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.863+0000 7fb78a90d640 1 -- 172.21.15.12:0/632790262 >> 172.21.15.12:0/632790262 conn(0x7fb784068000 msgr2=0x7fb784072910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:30.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.863+0000 7fb78a90d640 1 -- 172.21.15.12:0/632790262 shutdown_connections 2024-09-11T23:06:30.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:30.863+0000 7fb78a90d640 1 -- 172.21.15.12:0/632790262 wait complete. 2024-09-11T23:06:30.885 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-09-11T23:06:29.541099+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":528,"num_read_kb":1012,"num_write":219,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1283,"ondisk_log_size":1283,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":104764,"kb_used_data":2872,"kb_used_omap":4,"kb_used_meta":101819,"kb_avail":283010756,"statfs":{"total":289910292480,"available":289803014144,"internally_reserved":0,"allocated":2940928,"data_stored":1870704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":104262991},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.571784"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.981804+0000","last_change":"2024-09-11T23:06:23.981804+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.981804+0000","last_undegraded":"2024-09-11T23:06:23.981804+0000","last_fullsized":"2024-09-11T23:06:23.981804+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.977548+0000","last_change":"2024-09-11T23:06:23.977548+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.977548+0000","last_undegraded":"2024-09-11T23:06:23.977548+0000","last_fullsized":"2024-09-11T23:06:23.977548+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.982403+0000","last_change":"2024-09-11T23:06:23.982403+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.982403+0000","last_undegraded":"2024-09-11T23:06:23.982403+0000","last_fullsized":"2024-09-11T23:06:23.982403+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.983055+0000","last_change":"2024-09-11T23:06:23.983055+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.983055+0000","last_undegraded":"2024-09-11T23:06:23.983055+0000","last_fullsized":"2024-09-11T23:06:23.983055+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.983895+0000","last_change":"2024-09-11T23:06:23.983895+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.983895+0000","last_undegraded":"2024-09-11T23:06:23.983895+0000","last_fullsized":"2024-09-11T23:06:23.983895+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.976637+0000","last_change":"2024-09-11T23:06:23.976637+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.976637+0000","last_undegraded":"2024-09-11T23:06:23.976637+0000","last_fullsized":"2024-09-11T23:06:23.976637+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.980055+0000","last_change":"2024-09-11T23:06:23.980055+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.980055+0000","last_undegraded":"2024-09-11T23:06:23.980055+0000","last_fullsized":"2024-09-11T23:06:23.980055+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.977622+0000","last_change":"2024-09-11T23:06:23.977622+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.977622+0000","last_undegraded":"2024-09-11T23:06:23.977622+0000","last_fullsized":"2024-09-11T23:06:23.977622+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.978622+0000","last_change":"2024-09-11T23:06:23.978622+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.978622+0000","last_undegraded":"2024-09-11T23:06:23.978622+0000","last_fullsized":"2024-09-11T23:06:23.978622+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.976560+0000","last_change":"2024-09-11T23:06:23.976560+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.976560+0000","last_undegraded":"2024-09-11T23:06:23.976560+0000","last_fullsized":"2024-09-11T23:06:23.976560+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.978896+0000","last_change":"2024-09-11T23:06:23.978896+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.978896+0000","last_undegraded":"2024-09-11T23:06:23.978896+0000","last_fullsized":"2024-09-11T23:06:23.978896+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.982525+0000","last_change":"2024-09-11T23:06:23.982525+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.982525+0000","last_undegraded":"2024-09-11T23:06:23.982525+0000","last_fullsized":"2024-09-11T23:06:23.982525+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.977154+0000","last_change":"2024-09-11T23:06:23.977154+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.977154+0000","last_undegraded":"2024-09-11T23:06:23.977154+0000","last_fullsized":"2024-09-11T23:06:23.977154+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.981344+0000","last_change":"2024-09-11T23:06:23.981344+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.981344+0000","last_undegraded":"2024-09-11T23:06:23.981344+0000","last_fullsized":"2024-09-11T23:06:23.981344+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.976240+0000","last_change":"2024-09-11T23:06:23.976240+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.976240+0000","last_undegraded":"2024-09-11T23:06:23.976240+0000","last_fullsized":"2024-09-11T23:06:23.976240+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.983364+0000","last_change":"2024-09-11T23:06:23.983364+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.983364+0000","last_undegraded":"2024-09-11T23:06:23.983364+0000","last_fullsized":"2024-09-11T23:06:23.983364+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.981281+0000","last_change":"2024-09-11T23:06:23.981281+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.981281+0000","last_undegraded":"2024-09-11T23:06:23.981281+0000","last_fullsized":"2024-09-11T23:06:23.981281+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.981294+0000","last_change":"2024-09-11T23:06:23.981294+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.981294+0000","last_undegraded":"2024-09-11T23:06:23.981294+0000","last_fullsized":"2024-09-11T23:06:23.981294+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.980426+0000","last_change":"2024-09-11T23:06:23.980426+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.980426+0000","last_undegraded":"2024-09-11T23:06:23.980426+0000","last_fullsized":"2024-09-11T23:06:23.980426+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.983371+0000","last_change":"2024-09-11T23:06:23.983371+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.983371+0000","last_undegraded":"2024-09-11T23:06:23.983371+0000","last_fullsized":"2024-09-11T23:06:23.983371+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.976124+0000","last_change":"2024-09-11T23:06:23.976124+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.976124+0000","last_undegraded":"2024-09-11T23:06:23.976124+0000","last_fullsized":"2024-09-11T23:06:23.976124+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.974933+0000","last_change":"2024-09-11T23:06:23.974933+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.974933+0000","last_undegraded":"2024-09-11T23:06:23.974933+0000","last_fullsized":"2024-09-11T23:06:23.974933+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.974806+0000","last_change":"2024-09-11T23:06:23.974806+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.974806+0000","last_undegraded":"2024-09-11T23:06:23.974806+0000","last_fullsized":"2024-09-11T23:06:23.974806+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.977435+0000","last_change":"2024-09-11T23:06:23.977435+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.977435+0000","last_undegraded":"2024-09-11T23:06:23.977435+0000","last_fullsized":"2024-09-11T23:06:23.977435+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.977097+0000","last_change":"2024-09-11T23:06:23.977097+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.977097+0000","last_undegraded":"2024-09-11T23:06:23.977097+0000","last_fullsized":"2024-09-11T23:06:23.977097+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.980917+0000","last_change":"2024-09-11T23:06:23.980917+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.980917+0000","last_undegraded":"2024-09-11T23:06:23.980917+0000","last_fullsized":"2024-09-11T23:06:23.980917+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.975299+0000","last_change":"2024-09-11T23:06:23.975299+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.975299+0000","last_undegraded":"2024-09-11T23:06:23.975299+0000","last_fullsized":"2024-09-11T23:06:23.975299+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.982848+0000","last_change":"2024-09-11T23:06:23.982848+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.982848+0000","last_undegraded":"2024-09-11T23:06:23.982848+0000","last_fullsized":"2024-09-11T23:06:23.982848+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.975437+0000","last_change":"2024-09-11T23:06:23.975437+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.975437+0000","last_undegraded":"2024-09-11T23:06:23.975437+0000","last_fullsized":"2024-09-11T23:06:23.975437+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.977062+0000","last_change":"2024-09-11T23:06:23.977062+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.977062+0000","last_undegraded":"2024-09-11T23:06:23.977062+0000","last_fullsized":"2024-09-11T23:06:23.977062+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.980318+0000","last_change":"2024-09-11T23:06:23.980318+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.980318+0000","last_undegraded":"2024-09-11T23:06:23.980318+0000","last_fullsized":"2024-09-11T23:06:23.980318+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:06:24.967462+0000","last_change":"2024-09-11T23:06:24.967462+0000","last_active":"2024-09-11T23:06:24.967462+0000","last_peered":"2024-09-11T23:06:24.967462+0000","last_clean":"2024-09-11T23:06:24.967462+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:24.967462+0000","last_undegraded":"2024-09-11T23:06:24.967462+0000","last_fullsized":"2024-09-11T23:06:24.967462+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-11T23:06:23.977468+0000","last_change":"2024-09-11T23:06:23.977468+0000","last_active":"2024-09-11T23:06:23.958001+0000","last_peered":"2024-09-11T23:06:23.958001+0000","last_clean":"2024-09-11T23:06:23.958001+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:06:23.977468+0000","last_undegraded":"2024-09-11T23:06:23.977468+0000","last_fullsized":"2024-09-11T23:06:23.977468+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"62'1283","reported_seq":1553,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-11T23:06:24.532469+0000","last_change":"2024-09-11T23:03:26.382905+0000","last_active":"2024-09-11T23:06:24.532469+0000","last_peered":"2024-09-11T23:06:24.532469+0000","last_clean":"2024-09-11T23:06:24.532469+0000","last_became_active":"2024-09-11T23:03:26.380590+0000","last_became_peered":"2024-09-11T23:03:26.380590+0000","last_unstale":"2024-09-11T23:06:24.532469+0000","last_undegraded":"2024-09-11T23:06:24.532469+0000","last_fullsized":"2024-09-11T23:06:24.532469+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:24.361793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:24.361793+0000","last_clean_scrub_stamp":"2024-09-11T23:03:24.361793+0000","objects_scrubbed":0,"log_size":1283,"log_dups_size":0,"ondisk_log_size":1283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:46.577063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":528,"num_read_kb":1012,"num_write":219,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":528,"num_read_kb":1012,"num_write":219,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1283,"ondisk_log_size":1283,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738405,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31756,"kb_used_data":568,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340084,"statfs":{"total":96636764160,"available":96604246016,"internally_reserved":0,"allocated":581632,"data_stored":228807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738405,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36508,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335332,"statfs":{"total":96636764160,"available":96599379968,"internally_reserved":0,"allocated":1183744,"data_stored":822722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738405,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36500,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335340,"statfs":{"total":96636764160,"available":96599388160,"internally_reserved":0,"allocated":1175552,"data_stored":819175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:06:30.888 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3f is not active+clean 2024-09-11T23:06:30.889 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.889 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3e is not active+clean 2024-09-11T23:06:30.889 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.889 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3d is not active+clean 2024-09-11T23:06:30.889 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.889 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3c is not active+clean 2024-09-11T23:06:30.889 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.889 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3b is not active+clean 2024-09-11T23:06:30.889 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.889 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3a is not active+clean 2024-09-11T23:06:30.890 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.890 INFO:tasks.ceph.ceph_manager.ceph:PG 13.39 is not active+clean 2024-09-11T23:06:30.890 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.890 INFO:tasks.ceph.ceph_manager.ceph:PG 13.38 is not active+clean 2024-09-11T23:06:30.890 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.890 INFO:tasks.ceph.ceph_manager.ceph:PG 13.37 is not active+clean 2024-09-11T23:06:30.890 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.890 INFO:tasks.ceph.ceph_manager.ceph:PG 13.36 is not active+clean 2024-09-11T23:06:30.890 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.890 INFO:tasks.ceph.ceph_manager.ceph:PG 13.35 is not active+clean 2024-09-11T23:06:30.890 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.891 INFO:tasks.ceph.ceph_manager.ceph:PG 13.34 is not active+clean 2024-09-11T23:06:30.891 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.891 INFO:tasks.ceph.ceph_manager.ceph:PG 13.33 is not active+clean 2024-09-11T23:06:30.891 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.891 INFO:tasks.ceph.ceph_manager.ceph:PG 13.32 is not active+clean 2024-09-11T23:06:30.891 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.891 INFO:tasks.ceph.ceph_manager.ceph:PG 13.31 is not active+clean 2024-09-11T23:06:30.891 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.891 INFO:tasks.ceph.ceph_manager.ceph:PG 13.30 is not active+clean 2024-09-11T23:06:30.891 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.891 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2f is not active+clean 2024-09-11T23:06:30.891 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.892 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2e is not active+clean 2024-09-11T23:06:30.892 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.892 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2d is not active+clean 2024-09-11T23:06:30.892 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.892 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2c is not active+clean 2024-09-11T23:06:30.892 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.892 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2b is not active+clean 2024-09-11T23:06:30.892 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.892 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2a is not active+clean 2024-09-11T23:06:30.892 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.892 INFO:tasks.ceph.ceph_manager.ceph:PG 13.29 is not active+clean 2024-09-11T23:06:30.893 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.893 INFO:tasks.ceph.ceph_manager.ceph:PG 13.28 is not active+clean 2024-09-11T23:06:30.893 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.893 INFO:tasks.ceph.ceph_manager.ceph:PG 13.27 is not active+clean 2024-09-11T23:06:30.893 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.893 INFO:tasks.ceph.ceph_manager.ceph:PG 13.26 is not active+clean 2024-09-11T23:06:30.893 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.893 INFO:tasks.ceph.ceph_manager.ceph:PG 13.25 is not active+clean 2024-09-11T23:06:30.893 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.893 INFO:tasks.ceph.ceph_manager.ceph:PG 13.24 is not active+clean 2024-09-11T23:06:30.893 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.894 INFO:tasks.ceph.ceph_manager.ceph:PG 13.23 is not active+clean 2024-09-11T23:06:30.894 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.894 INFO:tasks.ceph.ceph_manager.ceph:PG 13.22 is not active+clean 2024-09-11T23:06:30.894 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.894 INFO:tasks.ceph.ceph_manager.ceph:PG 13.21 is not active+clean 2024-09-11T23:06:30.894 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.894 INFO:tasks.ceph.ceph_manager.ceph:PG 13.20 is not active+clean 2024-09-11T23:06:30.894 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.894 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1e is not active+clean 2024-09-11T23:06:30.894 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.894 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1f is not active+clean 2024-09-11T23:06:30.895 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:06:23.981804+0000', 'last_change': '2024-09-11T23:06:23.981804+0000', 'last_active': '2024-09-11T23:06:23.958001+0000', 'last_peered': '2024-09-11T23:06:23.958001+0000', 'last_clean': '2024-09-11T23:06:23.958001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:23.981804+0000', 'last_undegraded': '2024-09-11T23:06:23.981804+0000', 'last_fullsized': '2024-09-11T23:06:23.981804+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:06:30.895 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1f is not active+clean 2024-09-11T23:06:30.895 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.895 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1e is not active+clean 2024-09-11T23:06:30.895 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:06:23.977548+0000', 'last_change': '2024-09-11T23:06:23.977548+0000', 'last_active': '2024-09-11T23:06:23.958001+0000', 'last_peered': '2024-09-11T23:06:23.958001+0000', 'last_clean': '2024-09-11T23:06:23.958001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:23.977548+0000', 'last_undegraded': '2024-09-11T23:06:23.977548+0000', 'last_fullsized': '2024-09-11T23:06:23.977548+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T23:06:30.895 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1c is not active+clean 2024-09-11T23:06:30.895 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.895 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1d is not active+clean 2024-09-11T23:06:30.895 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:06:23.982403+0000', 'last_change': '2024-09-11T23:06:23.982403+0000', 'last_active': '2024-09-11T23:06:23.958001+0000', 'last_peered': '2024-09-11T23:06:23.958001+0000', 'last_clean': '2024-09-11T23:06:23.958001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:23.982403+0000', 'last_undegraded': '2024-09-11T23:06:23.982403+0000', 'last_fullsized': '2024-09-11T23:06:23.982403+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:06:30.895 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1d is not active+clean 2024-09-11T23:06:30.895 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.895 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1c is not active+clean 2024-09-11T23:06:30.896 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:06:23.983055+0000', 'last_change': '2024-09-11T23:06:23.983055+0000', 'last_active': '2024-09-11T23:06:23.958001+0000', 'last_peered': '2024-09-11T23:06:23.958001+0000', 'last_clean': '2024-09-11T23:06:23.958001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:23.983055+0000', 'last_undegraded': '2024-09-11T23:06:23.983055+0000', 'last_fullsized': '2024-09-11T23:06:23.983055+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:06:30.896 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1a is not active+clean 2024-09-11T23:06:30.896 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.896 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1b is not active+clean 2024-09-11T23:06:30.896 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:06:23.983895+0000', 'last_change': '2024-09-11T23:06:23.983895+0000', 'last_active': '2024-09-11T23:06:23.958001+0000', 'last_peered': '2024-09-11T23:06:23.958001+0000', 'last_clean': '2024-09-11T23:06:23.958001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:23.983895+0000', 'last_undegraded': '2024-09-11T23:06:23.983895+0000', 'last_fullsized': '2024-09-11T23:06:23.983895+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:06:30.896 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1b is not active+clean 2024-09-11T23:06:30.896 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.896 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1a is not active+clean 2024-09-11T23:06:30.896 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:06:23.976637+0000', 'last_change': '2024-09-11T23:06:23.976637+0000', 'last_active': '2024-09-11T23:06:23.958001+0000', 'last_peered': '2024-09-11T23:06:23.958001+0000', 'last_clean': '2024-09-11T23:06:23.958001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:23.976637+0000', 'last_undegraded': '2024-09-11T23:06:23.976637+0000', 'last_fullsized': '2024-09-11T23:06:23.976637+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T23:06:30.896 INFO:tasks.ceph.ceph_manager.ceph:PG 13.18 is not active+clean 2024-09-11T23:06:30.896 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.897 INFO:tasks.ceph.ceph_manager.ceph:PG 12.19 is not active+clean 2024-09-11T23:06:30.897 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:06:23.980055+0000', 'last_change': '2024-09-11T23:06:23.980055+0000', 'last_active': '2024-09-11T23:06:23.958001+0000', 'last_peered': '2024-09-11T23:06:23.958001+0000', 'last_clean': '2024-09-11T23:06:23.958001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:23.980055+0000', 'last_undegraded': '2024-09-11T23:06:23.980055+0000', 'last_fullsized': '2024-09-11T23:06:23.980055+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:06:30.897 INFO:tasks.ceph.ceph_manager.ceph:PG 13.19 is not active+clean 2024-09-11T23:06:30.897 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.897 INFO:tasks.ceph.ceph_manager.ceph:PG 12.18 is not active+clean 2024-09-11T23:06:30.897 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:06:23.977622+0000', 'last_change': '2024-09-11T23:06:23.977622+0000', 'last_active': '2024-09-11T23:06:23.958001+0000', 'last_peered': '2024-09-11T23:06:23.958001+0000', 'last_clean': '2024-09-11T23:06:23.958001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:23.977622+0000', 'last_undegraded': '2024-09-11T23:06:23.977622+0000', 'last_fullsized': '2024-09-11T23:06:23.977622+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T23:06:30.897 INFO:tasks.ceph.ceph_manager.ceph:PG 13.16 is not active+clean 2024-09-11T23:06:30.897 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.897 INFO:tasks.ceph.ceph_manager.ceph:PG 12.17 is not active+clean 2024-09-11T23:06:30.897 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:06:23.978622+0000', 'last_change': '2024-09-11T23:06:23.978622+0000', 'last_active': '2024-09-11T23:06:23.958001+0000', 'last_peered': '2024-09-11T23:06:23.958001+0000', 'last_clean': '2024-09-11T23:06:23.958001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:23.978622+0000', 'last_undegraded': '2024-09-11T23:06:23.978622+0000', 'last_fullsized': '2024-09-11T23:06:23.978622+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T23:06:30.897 INFO:tasks.ceph.ceph_manager.ceph:PG 13.17 is not active+clean 2024-09-11T23:06:30.898 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.898 INFO:tasks.ceph.ceph_manager.ceph:PG 12.16 is not active+clean 2024-09-11T23:06:30.898 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:06:23.976560+0000', 'last_change': '2024-09-11T23:06:23.976560+0000', 'last_active': '2024-09-11T23:06:23.958001+0000', 'last_peered': '2024-09-11T23:06:23.958001+0000', 'last_clean': '2024-09-11T23:06:23.958001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:23.976560+0000', 'last_undegraded': '2024-09-11T23:06:23.976560+0000', 'last_fullsized': '2024-09-11T23:06:23.976560+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T23:06:30.898 INFO:tasks.ceph.ceph_manager.ceph:PG 13.14 is not active+clean 2024-09-11T23:06:30.898 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.898 INFO:tasks.ceph.ceph_manager.ceph:PG 12.15 is not active+clean 2024-09-11T23:06:30.898 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:06:23.978896+0000', 'last_change': '2024-09-11T23:06:23.978896+0000', 'last_active': '2024-09-11T23:06:23.958001+0000', 'last_peered': '2024-09-11T23:06:23.958001+0000', 'last_clean': '2024-09-11T23:06:23.958001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:23.978896+0000', 'last_undegraded': '2024-09-11T23:06:23.978896+0000', 'last_fullsized': '2024-09-11T23:06:23.978896+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T23:06:30.898 INFO:tasks.ceph.ceph_manager.ceph:PG 13.15 is not active+clean 2024-09-11T23:06:30.898 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.898 INFO:tasks.ceph.ceph_manager.ceph:PG 12.14 is not active+clean 2024-09-11T23:06:30.898 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:06:23.982525+0000', 'last_change': '2024-09-11T23:06:23.982525+0000', 'last_active': '2024-09-11T23:06:23.958001+0000', 'last_peered': '2024-09-11T23:06:23.958001+0000', 'last_clean': '2024-09-11T23:06:23.958001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:23.982525+0000', 'last_undegraded': '2024-09-11T23:06:23.982525+0000', 'last_fullsized': '2024-09-11T23:06:23.982525+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:06:30.899 INFO:tasks.ceph.ceph_manager.ceph:PG 13.12 is not active+clean 2024-09-11T23:06:30.899 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.899 INFO:tasks.ceph.ceph_manager.ceph:PG 12.13 is not active+clean 2024-09-11T23:06:30.899 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:06:23.977154+0000', 'last_change': '2024-09-11T23:06:23.977154+0000', 'last_active': '2024-09-11T23:06:23.958001+0000', 'last_peered': '2024-09-11T23:06:23.958001+0000', 'last_clean': '2024-09-11T23:06:23.958001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:23.977154+0000', 'last_undegraded': '2024-09-11T23:06:23.977154+0000', 'last_fullsized': '2024-09-11T23:06:23.977154+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T23:06:30.899 INFO:tasks.ceph.ceph_manager.ceph:PG 13.13 is not active+clean 2024-09-11T23:06:30.899 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.899 INFO:tasks.ceph.ceph_manager.ceph:PG 12.12 is not active+clean 2024-09-11T23:06:30.899 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:06:23.981344+0000', 'last_change': '2024-09-11T23:06:23.981344+0000', 'last_active': '2024-09-11T23:06:23.958001+0000', 'last_peered': '2024-09-11T23:06:23.958001+0000', 'last_clean': '2024-09-11T23:06:23.958001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:23.981344+0000', 'last_undegraded': '2024-09-11T23:06:23.981344+0000', 'last_fullsized': '2024-09-11T23:06:23.981344+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:06:30.899 INFO:tasks.ceph.ceph_manager.ceph:PG 13.10 is not active+clean 2024-09-11T23:06:30.899 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.899 INFO:tasks.ceph.ceph_manager.ceph:PG 12.11 is not active+clean 2024-09-11T23:06:30.899 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:06:23.976240+0000', 'last_change': '2024-09-11T23:06:23.976240+0000', 'last_active': '2024-09-11T23:06:23.958001+0000', 'last_peered': '2024-09-11T23:06:23.958001+0000', 'last_clean': '2024-09-11T23:06:23.958001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:23.976240+0000', 'last_undegraded': '2024-09-11T23:06:23.976240+0000', 'last_fullsized': '2024-09-11T23:06:23.976240+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T23:06:30.900 INFO:tasks.ceph.ceph_manager.ceph:PG 13.11 is not active+clean 2024-09-11T23:06:30.900 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.900 INFO:tasks.ceph.ceph_manager.ceph:PG 12.10 is not active+clean 2024-09-11T23:06:30.900 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:06:23.983364+0000', 'last_change': '2024-09-11T23:06:23.983364+0000', 'last_active': '2024-09-11T23:06:23.958001+0000', 'last_peered': '2024-09-11T23:06:23.958001+0000', 'last_clean': '2024-09-11T23:06:23.958001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:23.983364+0000', 'last_undegraded': '2024-09-11T23:06:23.983364+0000', 'last_fullsized': '2024-09-11T23:06:23.983364+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:06:30.900 INFO:tasks.ceph.ceph_manager.ceph:PG 13.e is not active+clean 2024-09-11T23:06:30.900 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.900 INFO:tasks.ceph.ceph_manager.ceph:PG 12.f is not active+clean 2024-09-11T23:06:30.900 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:06:23.981281+0000', 'last_change': '2024-09-11T23:06:23.981281+0000', 'last_active': '2024-09-11T23:06:23.958001+0000', 'last_peered': '2024-09-11T23:06:23.958001+0000', 'last_clean': '2024-09-11T23:06:23.958001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:23.981281+0000', 'last_undegraded': '2024-09-11T23:06:23.981281+0000', 'last_fullsized': '2024-09-11T23:06:23.981281+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:06:30.900 INFO:tasks.ceph.ceph_manager.ceph:PG 13.f is not active+clean 2024-09-11T23:06:30.900 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.901 INFO:tasks.ceph.ceph_manager.ceph:PG 12.e is not active+clean 2024-09-11T23:06:30.901 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:06:23.981294+0000', 'last_change': '2024-09-11T23:06:23.981294+0000', 'last_active': '2024-09-11T23:06:23.958001+0000', 'last_peered': '2024-09-11T23:06:23.958001+0000', 'last_clean': '2024-09-11T23:06:23.958001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:23.981294+0000', 'last_undegraded': '2024-09-11T23:06:23.981294+0000', 'last_fullsized': '2024-09-11T23:06:23.981294+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:06:30.901 INFO:tasks.ceph.ceph_manager.ceph:PG 13.d is not active+clean 2024-09-11T23:06:30.901 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.901 INFO:tasks.ceph.ceph_manager.ceph:PG 12.c is not active+clean 2024-09-11T23:06:30.901 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:06:23.980426+0000', 'last_change': '2024-09-11T23:06:23.980426+0000', 'last_active': '2024-09-11T23:06:23.958001+0000', 'last_peered': '2024-09-11T23:06:23.958001+0000', 'last_clean': '2024-09-11T23:06:23.958001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:23.980426+0000', 'last_undegraded': '2024-09-11T23:06:23.980426+0000', 'last_fullsized': '2024-09-11T23:06:23.980426+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:06:30.901 INFO:tasks.ceph.ceph_manager.ceph:PG 13.a is not active+clean 2024-09-11T23:06:30.901 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.901 INFO:tasks.ceph.ceph_manager.ceph:PG 12.b is not active+clean 2024-09-11T23:06:30.901 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:06:23.983371+0000', 'last_change': '2024-09-11T23:06:23.983371+0000', 'last_active': '2024-09-11T23:06:23.958001+0000', 'last_peered': '2024-09-11T23:06:23.958001+0000', 'last_clean': '2024-09-11T23:06:23.958001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:23.983371+0000', 'last_undegraded': '2024-09-11T23:06:23.983371+0000', 'last_fullsized': '2024-09-11T23:06:23.983371+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:06:30.902 INFO:tasks.ceph.ceph_manager.ceph:PG 13.b is not active+clean 2024-09-11T23:06:30.902 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.902 INFO:tasks.ceph.ceph_manager.ceph:PG 12.a is not active+clean 2024-09-11T23:06:30.902 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:06:23.976124+0000', 'last_change': '2024-09-11T23:06:23.976124+0000', 'last_active': '2024-09-11T23:06:23.958001+0000', 'last_peered': '2024-09-11T23:06:23.958001+0000', 'last_clean': '2024-09-11T23:06:23.958001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:23.976124+0000', 'last_undegraded': '2024-09-11T23:06:23.976124+0000', 'last_fullsized': '2024-09-11T23:06:23.976124+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T23:06:30.902 INFO:tasks.ceph.ceph_manager.ceph:PG 13.8 is not active+clean 2024-09-11T23:06:30.902 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.902 INFO:tasks.ceph.ceph_manager.ceph:PG 12.9 is not active+clean 2024-09-11T23:06:30.902 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:06:23.974933+0000', 'last_change': '2024-09-11T23:06:23.974933+0000', 'last_active': '2024-09-11T23:06:23.958001+0000', 'last_peered': '2024-09-11T23:06:23.958001+0000', 'last_clean': '2024-09-11T23:06:23.958001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:23.974933+0000', 'last_undegraded': '2024-09-11T23:06:23.974933+0000', 'last_fullsized': '2024-09-11T23:06:23.974933+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T23:06:30.902 INFO:tasks.ceph.ceph_manager.ceph:PG 13.9 is not active+clean 2024-09-11T23:06:30.902 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.902 INFO:tasks.ceph.ceph_manager.ceph:PG 12.8 is not active+clean 2024-09-11T23:06:30.903 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:06:23.974806+0000', 'last_change': '2024-09-11T23:06:23.974806+0000', 'last_active': '2024-09-11T23:06:23.958001+0000', 'last_peered': '2024-09-11T23:06:23.958001+0000', 'last_clean': '2024-09-11T23:06:23.958001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:23.974806+0000', 'last_undegraded': '2024-09-11T23:06:23.974806+0000', 'last_fullsized': '2024-09-11T23:06:23.974806+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T23:06:30.903 INFO:tasks.ceph.ceph_manager.ceph:PG 13.6 is not active+clean 2024-09-11T23:06:30.903 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.903 INFO:tasks.ceph.ceph_manager.ceph:PG 12.7 is not active+clean 2024-09-11T23:06:30.903 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:06:23.977435+0000', 'last_change': '2024-09-11T23:06:23.977435+0000', 'last_active': '2024-09-11T23:06:23.958001+0000', 'last_peered': '2024-09-11T23:06:23.958001+0000', 'last_clean': '2024-09-11T23:06:23.958001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:23.977435+0000', 'last_undegraded': '2024-09-11T23:06:23.977435+0000', 'last_fullsized': '2024-09-11T23:06:23.977435+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T23:06:30.903 INFO:tasks.ceph.ceph_manager.ceph:PG 13.7 is not active+clean 2024-09-11T23:06:30.903 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.903 INFO:tasks.ceph.ceph_manager.ceph:PG 12.6 is not active+clean 2024-09-11T23:06:30.903 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:06:23.977097+0000', 'last_change': '2024-09-11T23:06:23.977097+0000', 'last_active': '2024-09-11T23:06:23.958001+0000', 'last_peered': '2024-09-11T23:06:23.958001+0000', 'last_clean': '2024-09-11T23:06:23.958001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:23.977097+0000', 'last_undegraded': '2024-09-11T23:06:23.977097+0000', 'last_fullsized': '2024-09-11T23:06:23.977097+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T23:06:30.903 INFO:tasks.ceph.ceph_manager.ceph:PG 13.4 is not active+clean 2024-09-11T23:06:30.903 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.904 INFO:tasks.ceph.ceph_manager.ceph:PG 12.5 is not active+clean 2024-09-11T23:06:30.904 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:06:23.980917+0000', 'last_change': '2024-09-11T23:06:23.980917+0000', 'last_active': '2024-09-11T23:06:23.958001+0000', 'last_peered': '2024-09-11T23:06:23.958001+0000', 'last_clean': '2024-09-11T23:06:23.958001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:23.980917+0000', 'last_undegraded': '2024-09-11T23:06:23.980917+0000', 'last_fullsized': '2024-09-11T23:06:23.980917+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:06:30.904 INFO:tasks.ceph.ceph_manager.ceph:PG 13.5 is not active+clean 2024-09-11T23:06:30.904 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.904 INFO:tasks.ceph.ceph_manager.ceph:PG 12.4 is not active+clean 2024-09-11T23:06:30.904 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:06:23.975299+0000', 'last_change': '2024-09-11T23:06:23.975299+0000', 'last_active': '2024-09-11T23:06:23.958001+0000', 'last_peered': '2024-09-11T23:06:23.958001+0000', 'last_clean': '2024-09-11T23:06:23.958001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:23.975299+0000', 'last_undegraded': '2024-09-11T23:06:23.975299+0000', 'last_fullsized': '2024-09-11T23:06:23.975299+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T23:06:30.904 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2 is not active+clean 2024-09-11T23:06:30.904 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.904 INFO:tasks.ceph.ceph_manager.ceph:PG 12.3 is not active+clean 2024-09-11T23:06:30.904 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:06:23.982848+0000', 'last_change': '2024-09-11T23:06:23.982848+0000', 'last_active': '2024-09-11T23:06:23.958001+0000', 'last_peered': '2024-09-11T23:06:23.958001+0000', 'last_clean': '2024-09-11T23:06:23.958001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:23.982848+0000', 'last_undegraded': '2024-09-11T23:06:23.982848+0000', 'last_fullsized': '2024-09-11T23:06:23.982848+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:06:30.904 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3 is not active+clean 2024-09-11T23:06:30.905 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.905 INFO:tasks.ceph.ceph_manager.ceph:PG 12.2 is not active+clean 2024-09-11T23:06:30.905 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:06:23.975437+0000', 'last_change': '2024-09-11T23:06:23.975437+0000', 'last_active': '2024-09-11T23:06:23.958001+0000', 'last_peered': '2024-09-11T23:06:23.958001+0000', 'last_clean': '2024-09-11T23:06:23.958001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:23.975437+0000', 'last_undegraded': '2024-09-11T23:06:23.975437+0000', 'last_fullsized': '2024-09-11T23:06:23.975437+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T23:06:30.905 INFO:tasks.ceph.ceph_manager.ceph:PG 13.0 is not active+clean 2024-09-11T23:06:30.905 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.905 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1 is not active+clean 2024-09-11T23:06:30.905 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:06:23.977062+0000', 'last_change': '2024-09-11T23:06:23.977062+0000', 'last_active': '2024-09-11T23:06:23.958001+0000', 'last_peered': '2024-09-11T23:06:23.958001+0000', 'last_clean': '2024-09-11T23:06:23.958001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:23.977062+0000', 'last_undegraded': '2024-09-11T23:06:23.977062+0000', 'last_fullsized': '2024-09-11T23:06:23.977062+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T23:06:30.905 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1 is not active+clean 2024-09-11T23:06:30.905 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.905 INFO:tasks.ceph.ceph_manager.ceph:PG 12.0 is not active+clean 2024-09-11T23:06:30.905 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:06:23.980318+0000', 'last_change': '2024-09-11T23:06:23.980318+0000', 'last_active': '2024-09-11T23:06:23.958001+0000', 'last_peered': '2024-09-11T23:06:23.958001+0000', 'last_clean': '2024-09-11T23:06:23.958001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:23.980318+0000', 'last_undegraded': '2024-09-11T23:06:23.980318+0000', 'last_fullsized': '2024-09-11T23:06:23.980318+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:06:30.905 INFO:tasks.ceph.ceph_manager.ceph:PG 13.c is not active+clean 2024-09-11T23:06:30.906 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-11T23:06:24.967462+0000', 'last_change': '2024-09-11T23:06:24.967462+0000', 'last_active': '2024-09-11T23:06:24.967462+0000', 'last_peered': '2024-09-11T23:06:24.967462+0000', 'last_clean': '2024-09-11T23:06:24.967462+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:24.967462+0000', 'last_undegraded': '2024-09-11T23:06:24.967462+0000', 'last_fullsized': '2024-09-11T23:06:24.967462+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:24.967462+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-11T23:06:30.906 INFO:tasks.ceph.ceph_manager.ceph:PG 12.d is not active+clean 2024-09-11T23:06:30.906 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:06:23.977468+0000', 'last_change': '2024-09-11T23:06:23.977468+0000', 'last_active': '2024-09-11T23:06:23.958001+0000', 'last_peered': '2024-09-11T23:06:23.958001+0000', 'last_clean': '2024-09-11T23:06:23.958001+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:06:23.977468+0000', 'last_undegraded': '2024-09-11T23:06:23.977468+0000', 'last_fullsized': '2024-09-11T23:06:23.977468+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'last_clean_scrub_stamp': '2024-09-11T23:06:23.958001+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T23:06:30.906 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-11T23:06:31.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.055+0000 7fad9688e640 1 Processor -- start 2024-09-11T23:06:31.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.055+0000 7fad9688e640 1 -- start start 2024-09-11T23:06:31.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.055+0000 7fad9688e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fad900a29b0 0x7fad90133ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:31.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.055+0000 7fad9688e640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad900a1f70 con 0x7fad901341e0 2024-09-11T23:06:31.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.055+0000 7fad9688e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fad900a0b40 con 0x7fad900a29b0 2024-09-11T23:06:31.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.055+0000 7fad8f7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fad901341e0 0x7fad90136850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38682/0 (socket says 172.21.15.12:38682) 2024-09-11T23:06:31.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.055+0000 7fad8f7fe640 1 -- 172.21.15.12:0/2892863894 learned_addr learned my addr 172.21.15.12:0/2892863894 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:31.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.055+0000 7fad8ffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fad900a29b0 0x7fad90133ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:31.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.059+0000 7fad8ffff640 1 -- 172.21.15.12:0/2892863894 >> v1:172.21.15.12:6789/0 conn(0x7fad901341e0 legacy=0x7fad90136850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:31.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.059+0000 7fad8ffff640 1 -- 172.21.15.12:0/2892863894 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad900a08c0 con 0x7fad900a29b0 2024-09-11T23:06:31.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.059+0000 7fad8ffff640 1 --2- 172.21.15.12:0/2892863894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad900a29b0 0x7fad90133ca0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fad80009740 tx=0x7fad8001c220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dc4ac807f20614d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:31.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.059+0000 7fad8effd640 1 -- 172.21.15.12:0/2892863894 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad800b0070 con 0x7fad900a29b0 2024-09-11T23:06:31.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.059+0000 7fad8effd640 1 -- 172.21.15.12:0/2892863894 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad800ab530 con 0x7fad900a29b0 2024-09-11T23:06:31.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.059+0000 7fad8effd640 1 -- 172.21.15.12:0/2892863894 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad800ab830 con 0x7fad900a29b0 2024-09-11T23:06:31.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.059+0000 7fad9688e640 1 -- 172.21.15.12:0/2892863894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad900a29b0 msgr2=0x7fad90133ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:31.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.059+0000 7fad9688e640 1 --2- 172.21.15.12:0/2892863894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad900a29b0 0x7fad90133ca0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fad80009740 tx=0x7fad8001c220 comp rx=0 tx=0).stop 2024-09-11T23:06:31.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.059+0000 7fad9688e640 1 -- 172.21.15.12:0/2892863894 shutdown_connections 2024-09-11T23:06:31.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.059+0000 7fad9688e640 1 --2- 172.21.15.12:0/2892863894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad900a29b0 0x7fad90133ca0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:31.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.059+0000 7fad9688e640 1 -- 172.21.15.12:0/2892863894 >> 172.21.15.12:0/2892863894 conn(0x7fad900a9320 msgr2=0x7fad900a9730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:31.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.059+0000 7fad9688e640 1 -- 172.21.15.12:0/2892863894 shutdown_connections 2024-09-11T23:06:31.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.059+0000 7fad9688e640 1 -- 172.21.15.12:0/2892863894 wait complete. 2024-09-11T23:06:31.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.063+0000 7fad9688e640 1 Processor -- start 2024-09-11T23:06:31.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.063+0000 7fad9688e640 1 -- start start 2024-09-11T23:06:31.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.063+0000 7fad9688e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad900a29b0 0x7fad9009ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:31.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.063+0000 7fad9688e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fad9013ed10 con 0x7fad900a29b0 2024-09-11T23:06:31.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.063+0000 7fad8ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad900a29b0 0x7fad9009ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:31.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.063+0000 7fad8ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad900a29b0 0x7fad9009ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49346/0 (socket says 172.21.15.12:49346) 2024-09-11T23:06:31.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.063+0000 7fad8ffff640 1 -- 172.21.15.12:0/4284979893 learned_addr learned my addr 172.21.15.12:0/4284979893 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:31.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.063+0000 7fad8ffff640 1 -- 172.21.15.12:0/4284979893 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad90139ca0 con 0x7fad900a29b0 2024-09-11T23:06:31.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.063+0000 7fad8ffff640 1 --2- 172.21.15.12:0/4284979893 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad900a29b0 0x7fad9009ede0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fad800ae040 tx=0x7fad8001aa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:31.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.063+0000 7fad8cff9640 1 -- 172.21.15.12:0/4284979893 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad800b0050 con 0x7fad900a29b0 2024-09-11T23:06:31.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.063+0000 7fad8cff9640 1 -- 172.21.15.12:0/4284979893 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad800b1040 con 0x7fad900a29b0 2024-09-11T23:06:31.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.063+0000 7fad8cff9640 1 -- 172.21.15.12:0/4284979893 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad800b5740 con 0x7fad900a29b0 2024-09-11T23:06:31.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.063+0000 7fad9688e640 1 -- 172.21.15.12:0/4284979893 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad90136bc0 con 0x7fad900a29b0 2024-09-11T23:06:31.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.063+0000 7fad9688e640 1 -- 172.21.15.12:0/4284979893 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad901395f0 con 0x7fad900a29b0 2024-09-11T23:06:31.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.063+0000 7fad9688e640 1 -- 172.21.15.12:0/4284979893 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad90133ca0 con 0x7fad900a29b0 2024-09-11T23:06:31.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.063+0000 7fad8cff9640 1 -- 172.21.15.12:0/4284979893 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 32) ==== 43997+0+0 (secure 0 0 0) 0x7fad800be030 con 0x7fad900a29b0 2024-09-11T23:06:31.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.063+0000 7fad8cff9640 1 --2- 172.21.15.12:0/4284979893 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fad7c035d20 0x7fad7c0381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:31.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.063+0000 7fad8cff9640 1 -- 172.21.15.12:0/4284979893 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 3439+0+0 (secure 0 0 0) 0x7fad800bc070 con 0x7fad900a29b0 2024-09-11T23:06:31.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.063+0000 7fad8f7fe640 1 --2- 172.21.15.12:0/4284979893 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fad7c035d20 0x7fad7c0381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:31.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.067+0000 7fad8f7fe640 1 --2- 172.21.15.12:0/4284979893 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fad7c035d20 0x7fad7c0381e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fad840017d0 tx=0x7fad84007ab0 comp rx=0 tx=0).ready entity=mgr.4903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:31.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.071+0000 7fad8cff9640 1 -- 172.21.15.12:0/4284979893 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fad800c5020 con 0x7fad900a29b0 2024-09-11T23:06:31.106 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:31.103+0000 7f02a2c51640 -1 client.4935: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.4890:b65aeaeb-3f3a-4da2-97b5-6988dece6be2:v1:172.21.15.12:0/2496375865] 2024-09-11T23:06:31.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.323+0000 7fad9688e640 1 -- 172.21.15.12:0/4284979893 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fad900a0090 con 0x7fad900a29b0 2024-09-11T23:06:31.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.323+0000 7fad8cff9640 1 -- 172.21.15.12:0/4284979893 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+2107 (secure 0 0 0) 0x7fad80015f30 con 0x7fad900a29b0 2024-09-11T23:06:31.327 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:06:31.327 INFO:teuthology.orchestra.run.smithi012.stdout:{"fsid":"8be14356-3340-4500-91a2-4cbc6b511f65","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":200,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":65,"num_osds":3,"num_up_osds":3,"osd_up_since":1726095802,"num_in_osds":3,"osd_in_since":1726095791,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":107278336,"bytes_avail":289803014144,"bytes_total":289910292480,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042,"read_bytes_sec":1102,"read_op_per_sec":1,"write_op_per_sec":0},"fsmap":{"epoch":49,"btime":"2024-09-11T23:06:29:001694+0000","id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":4979}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-09-11T23:05:40.267800+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-11T23:06:31.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.327+0000 7fad9688e640 1 -- 172.21.15.12:0/4284979893 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fad7c035d20 msgr2=0x7fad7c0381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:31.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.327+0000 7fad9688e640 1 --2- 172.21.15.12:0/4284979893 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fad7c035d20 0x7fad7c0381e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fad840017d0 tx=0x7fad84007ab0 comp rx=0 tx=0).stop 2024-09-11T23:06:31.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.327+0000 7fad9688e640 1 -- 172.21.15.12:0/4284979893 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad900a29b0 msgr2=0x7fad9009ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:31.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.327+0000 7fad9688e640 1 --2- 172.21.15.12:0/4284979893 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad900a29b0 0x7fad9009ede0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fad800ae040 tx=0x7fad8001aa60 comp rx=0 tx=0).stop 2024-09-11T23:06:31.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.327+0000 7fad9688e640 1 -- 172.21.15.12:0/4284979893 shutdown_connections 2024-09-11T23:06:31.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.327+0000 7fad9688e640 1 --2- 172.21.15.12:0/4284979893 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fad7c035d20 0x7fad7c0381e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:31.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.327+0000 7fad9688e640 1 --2- 172.21.15.12:0/4284979893 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad900a29b0 0x7fad9009ede0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:31.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.327+0000 7fad9688e640 1 -- 172.21.15.12:0/4284979893 >> 172.21.15.12:0/4284979893 conn(0x7fad900a9320 msgr2=0x7fad901346c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:31.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.327+0000 7fad9688e640 1 -- 172.21.15.12:0/4284979893 shutdown_connections 2024-09-11T23:06:31.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.327+0000 7fad9688e640 1 -- 172.21.15.12:0/4284979893 wait complete. 2024-09-11T23:06:31.348 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-11T23:06:31.348 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:06:31.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.475+0000 7fe9a6c26640 1 Processor -- start 2024-09-11T23:06:31.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.475+0000 7fe9a6c26640 1 -- start start 2024-09-11T23:06:31.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.475+0000 7fe9a6c26640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe9a013b080 0x7fe9a00a1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:31.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.475+0000 7fe9a6c26640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9a00a1c70 con 0x7fe9a013b460 2024-09-11T23:06:31.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.475+0000 7fe9a6c26640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fe9a009f240 con 0x7fe9a013b080 2024-09-11T23:06:31.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.475+0000 7fe9a49c2640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe9a013b080 0x7fe9a00a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:31.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.475+0000 7fe99ffff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe9a013b460 0x7fe9a00a36a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38698/0 (socket says 172.21.15.12:38698) 2024-09-11T23:06:31.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.475+0000 7fe99ffff640 1 -- 172.21.15.12:0/1015690210 learned_addr learned my addr 172.21.15.12:0/1015690210 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:31.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.475+0000 7fe9a49c2640 1 -- 172.21.15.12:0/1015690210 >> v1:172.21.15.12:6789/0 conn(0x7fe9a013b460 legacy=0x7fe9a00a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:31.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.475+0000 7fe9a49c2640 1 -- 172.21.15.12:0/1015690210 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9a00a0ee0 con 0x7fe9a013b080 2024-09-11T23:06:31.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.479+0000 7fe9a49c2640 1 --2- 172.21.15.12:0/1015690210 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9a013b080 0x7fe9a00a1630 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fe990009d90 tx=0x7fe99001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ee0bb9aecf8fa51 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:31.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.479+0000 7fe99f7fe640 1 -- 172.21.15.12:0/1015690210 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9900b2070 con 0x7fe9a013b080 2024-09-11T23:06:31.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.479+0000 7fe99f7fe640 1 -- 172.21.15.12:0/1015690210 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9900a5750 con 0x7fe9a013b080 2024-09-11T23:06:31.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.479+0000 7fe99f7fe640 1 -- 172.21.15.12:0/1015690210 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9900a5a50 con 0x7fe9a013b080 2024-09-11T23:06:31.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.479+0000 7fe9a6c26640 1 -- 172.21.15.12:0/1015690210 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9a013b080 msgr2=0x7fe9a00a1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:31.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.479+0000 7fe9a6c26640 1 --2- 172.21.15.12:0/1015690210 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9a013b080 0x7fe9a00a1630 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fe990009d90 tx=0x7fe99001c8c0 comp rx=0 tx=0).stop 2024-09-11T23:06:31.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.479+0000 7fe9a6c26640 1 -- 172.21.15.12:0/1015690210 shutdown_connections 2024-09-11T23:06:31.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.479+0000 7fe9a6c26640 1 --2- 172.21.15.12:0/1015690210 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9a013b080 0x7fe9a00a1630 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:31.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.479+0000 7fe9a6c26640 1 -- 172.21.15.12:0/1015690210 >> 172.21.15.12:0/1015690210 conn(0x7fe9a00a8450 msgr2=0x7fe9a00a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:31.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.479+0000 7fe9a6c26640 1 -- 172.21.15.12:0/1015690210 shutdown_connections 2024-09-11T23:06:31.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.479+0000 7fe9a6c26640 1 -- 172.21.15.12:0/1015690210 wait complete. 2024-09-11T23:06:31.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.483+0000 7fe9a6c26640 1 Processor -- start 2024-09-11T23:06:31.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.483+0000 7fe9a6c26640 1 -- start start 2024-09-11T23:06:31.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.483+0000 7fe9a6c26640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9a013b080 0x7fe9a0142330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:31.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.483+0000 7fe9a6c26640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a00a5280 con 0x7fe9a013b080 2024-09-11T23:06:31.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.483+0000 7fe9a49c2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9a013b080 0x7fe9a0142330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:31.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.483+0000 7fe9a49c2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9a013b080 0x7fe9a0142330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49362/0 (socket says 172.21.15.12:49362) 2024-09-11T23:06:31.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.483+0000 7fe9a49c2640 1 -- 172.21.15.12:0/189308648 learned_addr learned my addr 172.21.15.12:0/189308648 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:31.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.483+0000 7fe9a49c2640 1 -- 172.21.15.12:0/189308648 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9a0141a00 con 0x7fe9a013b080 2024-09-11T23:06:31.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.483+0000 7fe9a49c2640 1 --2- 172.21.15.12:0/189308648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9a013b080 0x7fe9a0142330 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fe99001a4f0 tx=0x7fe990019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:31.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.483+0000 7fe99d7fa640 1 -- 172.21.15.12:0/189308648 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9900bd020 con 0x7fe9a013b080 2024-09-11T23:06:31.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.483+0000 7fe99d7fa640 1 -- 172.21.15.12:0/189308648 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9900b85a0 con 0x7fe9a013b080 2024-09-11T23:06:31.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.483+0000 7fe9a6c26640 1 -- 172.21.15.12:0/189308648 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9a0141180 con 0x7fe9a013b080 2024-09-11T23:06:31.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.483+0000 7fe99d7fa640 1 -- 172.21.15.12:0/189308648 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9900b2040 con 0x7fe9a013b080 2024-09-11T23:06:31.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.483+0000 7fe9a6c26640 1 -- 172.21.15.12:0/189308648 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9a013fc10 con 0x7fe9a013b080 2024-09-11T23:06:31.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.483+0000 7fe9a6c26640 1 -- 172.21.15.12:0/189308648 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9a0142150 con 0x7fe9a013b080 2024-09-11T23:06:31.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.483+0000 7fe99d7fa640 1 -- 172.21.15.12:0/189308648 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 32) ==== 43997+0+0 (secure 0 0 0) 0x7fe9900c0020 con 0x7fe9a013b080 2024-09-11T23:06:31.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.483+0000 7fe99d7fa640 1 --2- 172.21.15.12:0/189308648 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fe980035d20 0x7fe9800381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:31.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.483+0000 7fe99d7fa640 1 -- 172.21.15.12:0/189308648 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 3439+0+0 (secure 0 0 0) 0x7fe9900e39d0 con 0x7fe9a013b080 2024-09-11T23:06:31.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.483+0000 7fe99ffff640 1 --2- 172.21.15.12:0/189308648 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fe980035d20 0x7fe9800381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:31.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.487+0000 7fe99ffff640 1 --2- 172.21.15.12:0/189308648 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fe980035d20 0x7fe9800381e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe988005890 tx=0x7fe988007a90 comp rx=0 tx=0).ready entity=mgr.4903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:31.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.491+0000 7fe99d7fa640 1 -- 172.21.15.12:0/189308648 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe9a0142150 con 0x7fe9a013b080 2024-09-11T23:06:31.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.655+0000 7fe9a6c26640 1 -- 172.21.15.12:0/189308648 --> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe9a013e2e0 con 0x7fe980035d20 2024-09-11T23:06:31.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.663+0000 7fe99d7fa640 1 -- 172.21.15.12:0/189308648 <== mgr.4903 v2:172.21.15.12:6828/4277951488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246094 (secure 0 0 0) 0x7fe988001c00 con 0x7fe980035d20 2024-09-11T23:06:31.668 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:06:31.669 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-11T23:06:31.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.667+0000 7fe9a6c26640 1 -- 172.21.15.12:0/189308648 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fe980035d20 msgr2=0x7fe9800381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:31.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.667+0000 7fe9a6c26640 1 --2- 172.21.15.12:0/189308648 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fe980035d20 0x7fe9800381e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe988005890 tx=0x7fe988007a90 comp rx=0 tx=0).stop 2024-09-11T23:06:31.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.667+0000 7fe9a6c26640 1 -- 172.21.15.12:0/189308648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9a013b080 msgr2=0x7fe9a0142330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:31.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.667+0000 7fe9a6c26640 1 --2- 172.21.15.12:0/189308648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9a013b080 0x7fe9a0142330 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fe99001a4f0 tx=0x7fe990019660 comp rx=0 tx=0).stop 2024-09-11T23:06:31.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.667+0000 7fe9a6c26640 1 -- 172.21.15.12:0/189308648 shutdown_connections 2024-09-11T23:06:31.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.667+0000 7fe9a6c26640 1 --2- 172.21.15.12:0/189308648 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fe980035d20 0x7fe9800381e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:31.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.667+0000 7fe9a6c26640 1 --2- 172.21.15.12:0/189308648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9a013b080 0x7fe9a0142330 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:31.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.667+0000 7fe9a6c26640 1 -- 172.21.15.12:0/189308648 >> 172.21.15.12:0/189308648 conn(0x7fe9a00a8450 msgr2=0x7fe9a00a5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:31.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.667+0000 7fe9a6c26640 1 -- 172.21.15.12:0/189308648 shutdown_connections 2024-09-11T23:06:31.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:31.667+0000 7fe9a6c26640 1 -- 172.21.15.12:0/189308648 wait complete. 2024-09-11T23:06:31.688 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-11T23:06:31.541461+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":534,"num_read_kb":1018,"num_write":264,"num_write_kb":1908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1893,"ondisk_log_size":1893,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":142,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":104900,"kb_used_data":3024,"kb_used_omap":4,"kb_used_meta":101819,"kb_avail":283010620,"statfs":{"total":289910292480,"available":289802874880,"internally_reserved":0,"allocated":3096576,"data_stored":1919998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":104262991},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.563357"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.136327+0000","last_change":"2024-09-11T23:06:26.017373+0000","last_active":"2024-09-11T23:06:27.136327+0000","last_peered":"2024-09-11T23:06:27.136327+0000","last_clean":"2024-09-11T23:06:27.136327+0000","last_became_active":"2024-09-11T23:06:26.016768+0000","last_became_peered":"2024-09-11T23:06:26.016768+0000","last_unstale":"2024-09-11T23:06:27.136327+0000","last_undegraded":"2024-09-11T23:06:27.136327+0000","last_fullsized":"2024-09-11T23:06:27.136327+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:08.832436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.137672+0000","last_change":"2024-09-11T23:06:26.016431+0000","last_active":"2024-09-11T23:06:27.137672+0000","last_peered":"2024-09-11T23:06:27.137672+0000","last_clean":"2024-09-11T23:06:27.137672+0000","last_became_active":"2024-09-11T23:06:26.016010+0000","last_became_peered":"2024-09-11T23:06:26.016010+0000","last_unstale":"2024-09-11T23:06:27.137672+0000","last_undegraded":"2024-09-11T23:06:27.137672+0000","last_fullsized":"2024-09-11T23:06:27.137672+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:57.112448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.001066+0000","last_change":"2024-09-11T23:06:26.015747+0000","last_active":"2024-09-11T23:06:27.001066+0000","last_peered":"2024-09-11T23:06:27.001066+0000","last_clean":"2024-09-11T23:06:27.001066+0000","last_became_active":"2024-09-11T23:06:26.014861+0000","last_became_peered":"2024-09-11T23:06:26.014861+0000","last_unstale":"2024-09-11T23:06:27.001066+0000","last_undegraded":"2024-09-11T23:06:27.001066+0000","last_fullsized":"2024-09-11T23:06:27.001066+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:30.781959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.000313+0000","last_change":"2024-09-11T23:06:26.015101+0000","last_active":"2024-09-11T23:06:27.000313+0000","last_peered":"2024-09-11T23:06:27.000313+0000","last_clean":"2024-09-11T23:06:27.000313+0000","last_became_active":"2024-09-11T23:06:26.014821+0000","last_became_peered":"2024-09-11T23:06:26.014821+0000","last_unstale":"2024-09-11T23:06:27.000313+0000","last_undegraded":"2024-09-11T23:06:27.000313+0000","last_fullsized":"2024-09-11T23:06:27.000313+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:09:08.128786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.000746+0000","last_change":"2024-09-11T23:06:26.013603+0000","last_active":"2024-09-11T23:06:27.000746+0000","last_peered":"2024-09-11T23:06:27.000746+0000","last_clean":"2024-09-11T23:06:27.000746+0000","last_became_active":"2024-09-11T23:06:26.013330+0000","last_became_peered":"2024-09-11T23:06:26.013330+0000","last_unstale":"2024-09-11T23:06:27.000746+0000","last_undegraded":"2024-09-11T23:06:27.000746+0000","last_fullsized":"2024-09-11T23:06:27.000746+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:15:00.702142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.000940+0000","last_change":"2024-09-11T23:06:26.030941+0000","last_active":"2024-09-11T23:06:27.000940+0000","last_peered":"2024-09-11T23:06:27.000940+0000","last_clean":"2024-09-11T23:06:27.000940+0000","last_became_active":"2024-09-11T23:06:26.023279+0000","last_became_peered":"2024-09-11T23:06:26.023279+0000","last_unstale":"2024-09-11T23:06:27.000940+0000","last_undegraded":"2024-09-11T23:06:27.000940+0000","last_fullsized":"2024-09-11T23:06:27.000940+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:21.708996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:26.999692+0000","last_change":"2024-09-11T23:06:25.995213+0000","last_active":"2024-09-11T23:06:26.999692+0000","last_peered":"2024-09-11T23:06:26.999692+0000","last_clean":"2024-09-11T23:06:26.999692+0000","last_became_active":"2024-09-11T23:06:25.994970+0000","last_became_peered":"2024-09-11T23:06:25.994970+0000","last_unstale":"2024-09-11T23:06:26.999692+0000","last_undegraded":"2024-09-11T23:06:26.999692+0000","last_fullsized":"2024-09-11T23:06:26.999692+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:57.137092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.143668+0000","last_change":"2024-09-11T23:06:26.012703+0000","last_active":"2024-09-11T23:06:27.143668+0000","last_peered":"2024-09-11T23:06:27.143668+0000","last_clean":"2024-09-11T23:06:27.143668+0000","last_became_active":"2024-09-11T23:06:26.011616+0000","last_became_peered":"2024-09-11T23:06:26.011616+0000","last_unstale":"2024-09-11T23:06:27.143668+0000","last_undegraded":"2024-09-11T23:06:27.143668+0000","last_fullsized":"2024-09-11T23:06:27.143668+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:53.457071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.136748+0000","last_change":"2024-09-11T23:06:26.026949+0000","last_active":"2024-09-11T23:06:27.136748+0000","last_peered":"2024-09-11T23:06:27.136748+0000","last_clean":"2024-09-11T23:06:27.136748+0000","last_became_active":"2024-09-11T23:06:26.026696+0000","last_became_peered":"2024-09-11T23:06:26.026696+0000","last_unstale":"2024-09-11T23:06:27.136748+0000","last_undegraded":"2024-09-11T23:06:27.136748+0000","last_fullsized":"2024-09-11T23:06:27.136748+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:42.264619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.001649+0000","last_change":"2024-09-11T23:06:26.013095+0000","last_active":"2024-09-11T23:06:27.001649+0000","last_peered":"2024-09-11T23:06:27.001649+0000","last_clean":"2024-09-11T23:06:27.001649+0000","last_became_active":"2024-09-11T23:06:26.012779+0000","last_became_peered":"2024-09-11T23:06:26.012779+0000","last_unstale":"2024-09-11T23:06:27.001649+0000","last_undegraded":"2024-09-11T23:06:27.001649+0000","last_fullsized":"2024-09-11T23:06:27.001649+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:30.051796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.137007+0000","last_change":"2024-09-11T23:06:26.019373+0000","last_active":"2024-09-11T23:06:27.137007+0000","last_peered":"2024-09-11T23:06:27.137007+0000","last_clean":"2024-09-11T23:06:27.137007+0000","last_became_active":"2024-09-11T23:06:26.018910+0000","last_became_peered":"2024-09-11T23:06:26.018910+0000","last_unstale":"2024-09-11T23:06:27.137007+0000","last_undegraded":"2024-09-11T23:06:27.137007+0000","last_fullsized":"2024-09-11T23:06:27.137007+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:57.744079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.145412+0000","last_change":"2024-09-11T23:06:26.022439+0000","last_active":"2024-09-11T23:06:27.145412+0000","last_peered":"2024-09-11T23:06:27.145412+0000","last_clean":"2024-09-11T23:06:27.145412+0000","last_became_active":"2024-09-11T23:06:26.021782+0000","last_became_peered":"2024-09-11T23:06:26.021782+0000","last_unstale":"2024-09-11T23:06:27.145412+0000","last_undegraded":"2024-09-11T23:06:27.145412+0000","last_fullsized":"2024-09-11T23:06:27.145412+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:24:18.106844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.146019+0000","last_change":"2024-09-11T23:06:26.022466+0000","last_active":"2024-09-11T23:06:27.146019+0000","last_peered":"2024-09-11T23:06:27.146019+0000","last_clean":"2024-09-11T23:06:27.146019+0000","last_became_active":"2024-09-11T23:06:26.008963+0000","last_became_peered":"2024-09-11T23:06:26.008963+0000","last_unstale":"2024-09-11T23:06:27.146019+0000","last_undegraded":"2024-09-11T23:06:27.146019+0000","last_fullsized":"2024-09-11T23:06:27.146019+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:25.230405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.001290+0000","last_change":"2024-09-11T23:06:26.016498+0000","last_active":"2024-09-11T23:06:27.001290+0000","last_peered":"2024-09-11T23:06:27.001290+0000","last_clean":"2024-09-11T23:06:27.001290+0000","last_became_active":"2024-09-11T23:06:26.015640+0000","last_became_peered":"2024-09-11T23:06:26.015640+0000","last_unstale":"2024-09-11T23:06:27.001290+0000","last_undegraded":"2024-09-11T23:06:27.001290+0000","last_fullsized":"2024-09-11T23:06:27.001290+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:08.581125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.135656+0000","last_change":"2024-09-11T23:06:26.029233+0000","last_active":"2024-09-11T23:06:27.135656+0000","last_peered":"2024-09-11T23:06:27.135656+0000","last_clean":"2024-09-11T23:06:27.135656+0000","last_became_active":"2024-09-11T23:06:26.028536+0000","last_became_peered":"2024-09-11T23:06:26.028536+0000","last_unstale":"2024-09-11T23:06:27.135656+0000","last_undegraded":"2024-09-11T23:06:27.135656+0000","last_fullsized":"2024-09-11T23:06:27.135656+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:24.277318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:26.999687+0000","last_change":"2024-09-11T23:06:26.005785+0000","last_active":"2024-09-11T23:06:26.999687+0000","last_peered":"2024-09-11T23:06:26.999687+0000","last_clean":"2024-09-11T23:06:26.999687+0000","last_became_active":"2024-09-11T23:06:26.005450+0000","last_became_peered":"2024-09-11T23:06:26.005450+0000","last_unstale":"2024-09-11T23:06:26.999687+0000","last_undegraded":"2024-09-11T23:06:26.999687+0000","last_fullsized":"2024-09-11T23:06:26.999687+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:30.293666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.146052+0000","last_change":"2024-09-11T23:06:26.017719+0000","last_active":"2024-09-11T23:06:27.146052+0000","last_peered":"2024-09-11T23:06:27.146052+0000","last_clean":"2024-09-11T23:06:27.146052+0000","last_became_active":"2024-09-11T23:06:26.017455+0000","last_became_peered":"2024-09-11T23:06:26.017455+0000","last_unstale":"2024-09-11T23:06:27.146052+0000","last_undegraded":"2024-09-11T23:06:27.146052+0000","last_fullsized":"2024-09-11T23:06:27.146052+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:49.461279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.002008+0000","last_change":"2024-09-11T23:06:26.026036+0000","last_active":"2024-09-11T23:06:27.002008+0000","last_peered":"2024-09-11T23:06:27.002008+0000","last_clean":"2024-09-11T23:06:27.002008+0000","last_became_active":"2024-09-11T23:06:26.025700+0000","last_became_peered":"2024-09-11T23:06:26.025700+0000","last_unstale":"2024-09-11T23:06:27.002008+0000","last_undegraded":"2024-09-11T23:06:27.002008+0000","last_fullsized":"2024-09-11T23:06:27.002008+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:53.645719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.145295+0000","last_change":"2024-09-11T23:06:26.020736+0000","last_active":"2024-09-11T23:06:27.145295+0000","last_peered":"2024-09-11T23:06:27.145295+0000","last_clean":"2024-09-11T23:06:27.145295+0000","last_became_active":"2024-09-11T23:06:26.020469+0000","last_became_peered":"2024-09-11T23:06:26.020469+0000","last_unstale":"2024-09-11T23:06:27.145295+0000","last_undegraded":"2024-09-11T23:06:27.145295+0000","last_fullsized":"2024-09-11T23:06:27.145295+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:56.915005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.000187+0000","last_change":"2024-09-11T23:06:26.023329+0000","last_active":"2024-09-11T23:06:27.000187+0000","last_peered":"2024-09-11T23:06:27.000187+0000","last_clean":"2024-09-11T23:06:27.000187+0000","last_became_active":"2024-09-11T23:06:26.020462+0000","last_became_peered":"2024-09-11T23:06:26.020462+0000","last_unstale":"2024-09-11T23:06:27.000187+0000","last_undegraded":"2024-09-11T23:06:27.000187+0000","last_fullsized":"2024-09-11T23:06:27.000187+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:26.319061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.001173+0000","last_change":"2024-09-11T23:06:26.029868+0000","last_active":"2024-09-11T23:06:27.001173+0000","last_peered":"2024-09-11T23:06:27.001173+0000","last_clean":"2024-09-11T23:06:27.001173+0000","last_became_active":"2024-09-11T23:06:26.025899+0000","last_became_peered":"2024-09-11T23:06:26.025899+0000","last_unstale":"2024-09-11T23:06:27.001173+0000","last_undegraded":"2024-09-11T23:06:27.001173+0000","last_fullsized":"2024-09-11T23:06:27.001173+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:27.921104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.136038+0000","last_change":"2024-09-11T23:06:26.027715+0000","last_active":"2024-09-11T23:06:27.136038+0000","last_peered":"2024-09-11T23:06:27.136038+0000","last_clean":"2024-09-11T23:06:27.136038+0000","last_became_active":"2024-09-11T23:06:26.027454+0000","last_became_peered":"2024-09-11T23:06:26.027454+0000","last_unstale":"2024-09-11T23:06:27.136038+0000","last_undegraded":"2024-09-11T23:06:27.136038+0000","last_fullsized":"2024-09-11T23:06:27.136038+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:02.766648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.143892+0000","last_change":"2024-09-11T23:06:26.014859+0000","last_active":"2024-09-11T23:06:27.143892+0000","last_peered":"2024-09-11T23:06:27.143892+0000","last_clean":"2024-09-11T23:06:27.143892+0000","last_became_active":"2024-09-11T23:06:26.011282+0000","last_became_peered":"2024-09-11T23:06:26.011282+0000","last_unstale":"2024-09-11T23:06:27.143892+0000","last_undegraded":"2024-09-11T23:06:27.143892+0000","last_fullsized":"2024-09-11T23:06:27.143892+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:54.096620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:26.999455+0000","last_change":"2024-09-11T23:06:26.005707+0000","last_active":"2024-09-11T23:06:26.999455+0000","last_peered":"2024-09-11T23:06:26.999455+0000","last_clean":"2024-09-11T23:06:26.999455+0000","last_became_active":"2024-09-11T23:06:26.005104+0000","last_became_peered":"2024-09-11T23:06:26.005104+0000","last_unstale":"2024-09-11T23:06:26.999455+0000","last_undegraded":"2024-09-11T23:06:26.999455+0000","last_fullsized":"2024-09-11T23:06:26.999455+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:57.112448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.136802+0000","last_change":"2024-09-11T23:06:26.026959+0000","last_active":"2024-09-11T23:06:27.136802+0000","last_peered":"2024-09-11T23:06:27.136802+0000","last_clean":"2024-09-11T23:06:27.136802+0000","last_became_active":"2024-09-11T23:06:26.026663+0000","last_became_peered":"2024-09-11T23:06:26.026663+0000","last_unstale":"2024-09-11T23:06:27.136802+0000","last_undegraded":"2024-09-11T23:06:27.136802+0000","last_fullsized":"2024-09-11T23:06:27.136802+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:13.430448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.137866+0000","last_change":"2024-09-11T23:06:26.028907+0000","last_active":"2024-09-11T23:06:27.137866+0000","last_peered":"2024-09-11T23:06:27.137866+0000","last_clean":"2024-09-11T23:06:27.137866+0000","last_became_active":"2024-09-11T23:06:26.028601+0000","last_became_peered":"2024-09-11T23:06:26.028601+0000","last_unstale":"2024-09-11T23:06:27.137866+0000","last_undegraded":"2024-09-11T23:06:27.137866+0000","last_fullsized":"2024-09-11T23:06:27.137866+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:30.293666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.001176+0000","last_change":"2024-09-11T23:06:26.022936+0000","last_active":"2024-09-11T23:06:27.001176+0000","last_peered":"2024-09-11T23:06:27.001176+0000","last_clean":"2024-09-11T23:06:27.001176+0000","last_became_active":"2024-09-11T23:06:26.020483+0000","last_became_peered":"2024-09-11T23:06:26.020483+0000","last_unstale":"2024-09-11T23:06:27.001176+0000","last_undegraded":"2024-09-11T23:06:27.001176+0000","last_fullsized":"2024-09-11T23:06:27.001176+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:52.483589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.137715+0000","last_change":"2024-09-11T23:06:26.015790+0000","last_active":"2024-09-11T23:06:27.137715+0000","last_peered":"2024-09-11T23:06:27.137715+0000","last_clean":"2024-09-11T23:06:27.137715+0000","last_became_active":"2024-09-11T23:06:26.015516+0000","last_became_peered":"2024-09-11T23:06:26.015516+0000","last_unstale":"2024-09-11T23:06:27.137715+0000","last_undegraded":"2024-09-11T23:06:27.137715+0000","last_fullsized":"2024-09-11T23:06:27.137715+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:14.299548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.135858+0000","last_change":"2024-09-11T23:06:26.030395+0000","last_active":"2024-09-11T23:06:27.135858+0000","last_peered":"2024-09-11T23:06:27.135858+0000","last_clean":"2024-09-11T23:06:27.135858+0000","last_became_active":"2024-09-11T23:06:26.030131+0000","last_became_peered":"2024-09-11T23:06:26.030131+0000","last_unstale":"2024-09-11T23:06:27.135858+0000","last_undegraded":"2024-09-11T23:06:27.135858+0000","last_fullsized":"2024-09-11T23:06:27.135858+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:55.047279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.136434+0000","last_change":"2024-09-11T23:06:26.017145+0000","last_active":"2024-09-11T23:06:27.136434+0000","last_peered":"2024-09-11T23:06:27.136434+0000","last_clean":"2024-09-11T23:06:27.136434+0000","last_became_active":"2024-09-11T23:06:26.016174+0000","last_became_peered":"2024-09-11T23:06:26.016174+0000","last_unstale":"2024-09-11T23:06:27.136434+0000","last_undegraded":"2024-09-11T23:06:27.136434+0000","last_fullsized":"2024-09-11T23:06:27.136434+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:58:46.438133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.000017+0000","last_change":"2024-09-11T23:06:26.020675+0000","last_active":"2024-09-11T23:06:27.000017+0000","last_peered":"2024-09-11T23:06:27.000017+0000","last_clean":"2024-09-11T23:06:27.000017+0000","last_became_active":"2024-09-11T23:06:26.019768+0000","last_became_peered":"2024-09-11T23:06:26.019768+0000","last_unstale":"2024-09-11T23:06:27.000017+0000","last_undegraded":"2024-09-11T23:06:27.000017+0000","last_fullsized":"2024-09-11T23:06:27.000017+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:09.269690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:26.999519+0000","last_change":"2024-09-11T23:06:26.003016+0000","last_active":"2024-09-11T23:06:26.999519+0000","last_peered":"2024-09-11T23:06:26.999519+0000","last_clean":"2024-09-11T23:06:26.999519+0000","last_became_active":"2024-09-11T23:06:26.002158+0000","last_became_peered":"2024-09-11T23:06:26.002158+0000","last_unstale":"2024-09-11T23:06:26.999519+0000","last_undegraded":"2024-09-11T23:06:26.999519+0000","last_fullsized":"2024-09-11T23:06:26.999519+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:22.899419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.145687+0000","last_change":"2024-09-11T23:06:26.027518+0000","last_active":"2024-09-11T23:06:27.145687+0000","last_peered":"2024-09-11T23:06:27.145687+0000","last_clean":"2024-09-11T23:06:27.145687+0000","last_became_active":"2024-09-11T23:06:26.026993+0000","last_became_peered":"2024-09-11T23:06:26.026993+0000","last_unstale":"2024-09-11T23:06:27.145687+0000","last_undegraded":"2024-09-11T23:06:27.145687+0000","last_fullsized":"2024-09-11T23:06:27.145687+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:37.103317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"64'4","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.145622+0000","last_change":"2024-09-11T23:06:25.016768+0000","last_active":"2024-09-11T23:06:27.145622+0000","last_peered":"2024-09-11T23:06:27.145622+0000","last_clean":"2024-09-11T23:06:27.145622+0000","last_became_active":"2024-09-11T23:06:25.016123+0000","last_became_peered":"2024-09-11T23:06:25.016123+0000","last_unstale":"2024-09-11T23:06:27.145622+0000","last_undegraded":"2024-09-11T23:06:27.145622+0000","last_fullsized":"2024-09-11T23:06:27.145622+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:04.146333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.137178+0000","last_change":"2024-09-11T23:06:26.003148+0000","last_active":"2024-09-11T23:06:27.137178+0000","last_peered":"2024-09-11T23:06:27.137178+0000","last_clean":"2024-09-11T23:06:27.137178+0000","last_became_active":"2024-09-11T23:06:26.001833+0000","last_became_peered":"2024-09-11T23:06:26.001833+0000","last_unstale":"2024-09-11T23:06:27.137178+0000","last_undegraded":"2024-09-11T23:06:27.137178+0000","last_fullsized":"2024-09-11T23:06:27.137178+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:35.598472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1e","version":"64'1","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.002132+0000","last_change":"2024-09-11T23:06:25.013858+0000","last_active":"2024-09-11T23:06:27.002132+0000","last_peered":"2024-09-11T23:06:27.002132+0000","last_clean":"2024-09-11T23:06:27.002132+0000","last_became_active":"2024-09-11T23:06:25.013140+0000","last_became_peered":"2024-09-11T23:06:25.013140+0000","last_unstale":"2024-09-11T23:06:27.002132+0000","last_undegraded":"2024-09-11T23:06:27.002132+0000","last_fullsized":"2024-09-11T23:06:27.002132+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:17.538852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.144939+0000","last_change":"2024-09-11T23:06:26.022201+0000","last_active":"2024-09-11T23:06:27.144939+0000","last_peered":"2024-09-11T23:06:27.144939+0000","last_clean":"2024-09-11T23:06:27.144939+0000","last_became_active":"2024-09-11T23:06:26.021034+0000","last_became_peered":"2024-09-11T23:06:26.021034+0000","last_unstale":"2024-09-11T23:06:27.144939+0000","last_undegraded":"2024-09-11T23:06:27.144939+0000","last_fullsized":"2024-09-11T23:06:27.144939+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:49:37.446280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1d","version":"64'2","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.145442+0000","last_change":"2024-09-11T23:06:25.018159+0000","last_active":"2024-09-11T23:06:27.145442+0000","last_peered":"2024-09-11T23:06:27.145442+0000","last_clean":"2024-09-11T23:06:27.145442+0000","last_became_active":"2024-09-11T23:06:25.017754+0000","last_became_peered":"2024-09-11T23:06:25.017754+0000","last_unstale":"2024-09-11T23:06:27.145442+0000","last_undegraded":"2024-09-11T23:06:27.145442+0000","last_fullsized":"2024-09-11T23:06:27.145442+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:03.577610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.137156+0000","last_change":"2024-09-11T23:06:26.006696+0000","last_active":"2024-09-11T23:06:27.137156+0000","last_peered":"2024-09-11T23:06:27.137156+0000","last_clean":"2024-09-11T23:06:27.137156+0000","last_became_active":"2024-09-11T23:06:26.003115+0000","last_became_peered":"2024-09-11T23:06:26.003115+0000","last_unstale":"2024-09-11T23:06:27.137156+0000","last_undegraded":"2024-09-11T23:06:27.137156+0000","last_fullsized":"2024-09-11T23:06:27.137156+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:26.600469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1c","version":"64'2","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.145942+0000","last_change":"2024-09-11T23:06:25.015931+0000","last_active":"2024-09-11T23:06:27.145942+0000","last_peered":"2024-09-11T23:06:27.145942+0000","last_clean":"2024-09-11T23:06:27.145942+0000","last_became_active":"2024-09-11T23:06:25.015171+0000","last_became_peered":"2024-09-11T23:06:25.015171+0000","last_unstale":"2024-09-11T23:06:27.145942+0000","last_undegraded":"2024-09-11T23:06:27.145942+0000","last_fullsized":"2024-09-11T23:06:27.145942+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:07.307662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.137076+0000","last_change":"2024-09-11T23:06:26.017177+0000","last_active":"2024-09-11T23:06:27.137076+0000","last_peered":"2024-09-11T23:06:27.137076+0000","last_clean":"2024-09-11T23:06:27.137076+0000","last_became_active":"2024-09-11T23:06:26.016765+0000","last_became_peered":"2024-09-11T23:06:26.016765+0000","last_unstale":"2024-09-11T23:06:27.137076+0000","last_undegraded":"2024-09-11T23:06:27.137076+0000","last_fullsized":"2024-09-11T23:06:27.137076+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:35.908813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"64'1","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.145370+0000","last_change":"2024-09-11T23:06:25.011931+0000","last_active":"2024-09-11T23:06:27.145370+0000","last_peered":"2024-09-11T23:06:27.145370+0000","last_clean":"2024-09-11T23:06:27.145370+0000","last_became_active":"2024-09-11T23:06:25.011590+0000","last_became_peered":"2024-09-11T23:06:25.011590+0000","last_unstale":"2024-09-11T23:06:27.145370+0000","last_undegraded":"2024-09-11T23:06:27.145370+0000","last_fullsized":"2024-09-11T23:06:27.145370+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:36.315943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.001497+0000","last_change":"2024-09-11T23:06:26.030111+0000","last_active":"2024-09-11T23:06:27.001497+0000","last_peered":"2024-09-11T23:06:27.001497+0000","last_clean":"2024-09-11T23:06:27.001497+0000","last_became_active":"2024-09-11T23:06:26.029590+0000","last_became_peered":"2024-09-11T23:06:26.029590+0000","last_unstale":"2024-09-11T23:06:27.001497+0000","last_undegraded":"2024-09-11T23:06:27.001497+0000","last_fullsized":"2024-09-11T23:06:27.001497+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:36.348583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1a","version":"64'1","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.001353+0000","last_change":"2024-09-11T23:06:25.015710+0000","last_active":"2024-09-11T23:06:27.001353+0000","last_peered":"2024-09-11T23:06:27.001353+0000","last_clean":"2024-09-11T23:06:27.001353+0000","last_became_active":"2024-09-11T23:06:25.014570+0000","last_became_peered":"2024-09-11T23:06:25.014570+0000","last_unstale":"2024-09-11T23:06:27.001353+0000","last_undegraded":"2024-09-11T23:06:27.001353+0000","last_fullsized":"2024-09-11T23:06:27.001353+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:57.139220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.135506+0000","last_change":"2024-09-11T23:06:26.006929+0000","last_active":"2024-09-11T23:06:27.135506+0000","last_peered":"2024-09-11T23:06:27.135506+0000","last_clean":"2024-09-11T23:06:27.135506+0000","last_became_active":"2024-09-11T23:06:26.006576+0000","last_became_peered":"2024-09-11T23:06:26.006576+0000","last_unstale":"2024-09-11T23:06:27.135506+0000","last_undegraded":"2024-09-11T23:06:27.135506+0000","last_fullsized":"2024-09-11T23:06:27.135506+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:23:12.494003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.144249+0000","last_change":"2024-09-11T23:06:25.006580+0000","last_active":"2024-09-11T23:06:27.144249+0000","last_peered":"2024-09-11T23:06:27.144249+0000","last_clean":"2024-09-11T23:06:27.144249+0000","last_became_active":"2024-09-11T23:06:25.006148+0000","last_became_peered":"2024-09-11T23:06:25.006148+0000","last_unstale":"2024-09-11T23:06:27.144249+0000","last_undegraded":"2024-09-11T23:06:27.144249+0000","last_fullsized":"2024-09-11T23:06:27.144249+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:37.667542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:26.999793+0000","last_change":"2024-09-11T23:06:26.013511+0000","last_active":"2024-09-11T23:06:26.999793+0000","last_peered":"2024-09-11T23:06:26.999793+0000","last_clean":"2024-09-11T23:06:26.999793+0000","last_became_active":"2024-09-11T23:06:26.013240+0000","last_became_peered":"2024-09-11T23:06:26.013240+0000","last_unstale":"2024-09-11T23:06:26.999793+0000","last_undegraded":"2024-09-11T23:06:26.999793+0000","last_fullsized":"2024-09-11T23:06:26.999793+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:02.516639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.136311+0000","last_change":"2024-09-11T23:06:25.007755+0000","last_active":"2024-09-11T23:06:27.136311+0000","last_peered":"2024-09-11T23:06:27.136311+0000","last_clean":"2024-09-11T23:06:27.136311+0000","last_became_active":"2024-09-11T23:06:25.007322+0000","last_became_peered":"2024-09-11T23:06:25.007322+0000","last_unstale":"2024-09-11T23:06:27.136311+0000","last_undegraded":"2024-09-11T23:06:27.136311+0000","last_fullsized":"2024-09-11T23:06:27.136311+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:10.138407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.146320+0000","last_change":"2024-09-11T23:06:26.024676+0000","last_active":"2024-09-11T23:06:27.146320+0000","last_peered":"2024-09-11T23:06:27.146320+0000","last_clean":"2024-09-11T23:06:27.146320+0000","last_became_active":"2024-09-11T23:06:26.024187+0000","last_became_peered":"2024-09-11T23:06:26.024187+0000","last_unstale":"2024-09-11T23:06:27.146320+0000","last_undegraded":"2024-09-11T23:06:27.146320+0000","last_fullsized":"2024-09-11T23:06:27.146320+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:12.991278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.137386+0000","last_change":"2024-09-11T23:06:25.009487+0000","last_active":"2024-09-11T23:06:27.137386+0000","last_peered":"2024-09-11T23:06:27.137386+0000","last_clean":"2024-09-11T23:06:27.137386+0000","last_became_active":"2024-09-11T23:06:25.008766+0000","last_became_peered":"2024-09-11T23:06:25.008766+0000","last_unstale":"2024-09-11T23:06:27.137386+0000","last_undegraded":"2024-09-11T23:06:27.137386+0000","last_fullsized":"2024-09-11T23:06:27.137386+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:48:55.422759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.137236+0000","last_change":"2024-09-11T23:06:26.002914+0000","last_active":"2024-09-11T23:06:27.137236+0000","last_peered":"2024-09-11T23:06:27.137236+0000","last_clean":"2024-09-11T23:06:27.137236+0000","last_became_active":"2024-09-11T23:06:26.001152+0000","last_became_peered":"2024-09-11T23:06:26.001152+0000","last_unstale":"2024-09-11T23:06:27.137236+0000","last_undegraded":"2024-09-11T23:06:27.137236+0000","last_fullsized":"2024-09-11T23:06:27.137236+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:28.697535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.002391+0000","last_change":"2024-09-11T23:06:25.013525+0000","last_active":"2024-09-11T23:06:27.002391+0000","last_peered":"2024-09-11T23:06:27.002391+0000","last_clean":"2024-09-11T23:06:27.002391+0000","last_became_active":"2024-09-11T23:06:25.012659+0000","last_became_peered":"2024-09-11T23:06:25.012659+0000","last_unstale":"2024-09-11T23:06:27.002391+0000","last_undegraded":"2024-09-11T23:06:27.002391+0000","last_fullsized":"2024-09-11T23:06:27.002391+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:25.295858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.146734+0000","last_change":"2024-09-11T23:06:26.013871+0000","last_active":"2024-09-11T23:06:27.146734+0000","last_peered":"2024-09-11T23:06:27.146734+0000","last_clean":"2024-09-11T23:06:27.146734+0000","last_became_active":"2024-09-11T23:06:26.009171+0000","last_became_peered":"2024-09-11T23:06:26.009171+0000","last_unstale":"2024-09-11T23:06:27.146734+0000","last_undegraded":"2024-09-11T23:06:27.146734+0000","last_fullsized":"2024-09-11T23:06:27.146734+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:46.344469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"64'3","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.137160+0000","last_change":"2024-09-11T23:06:25.013297+0000","last_active":"2024-09-11T23:06:27.137160+0000","last_peered":"2024-09-11T23:06:27.137160+0000","last_clean":"2024-09-11T23:06:27.137160+0000","last_became_active":"2024-09-11T23:06:25.012853+0000","last_became_peered":"2024-09-11T23:06:25.012853+0000","last_unstale":"2024-09-11T23:06:27.137160+0000","last_undegraded":"2024-09-11T23:06:27.137160+0000","last_fullsized":"2024-09-11T23:06:27.137160+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:34.721113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.000632+0000","last_change":"2024-09-11T23:06:26.022505+0000","last_active":"2024-09-11T23:06:27.000632+0000","last_peered":"2024-09-11T23:06:27.000632+0000","last_clean":"2024-09-11T23:06:27.000632+0000","last_became_active":"2024-09-11T23:06:26.019821+0000","last_became_peered":"2024-09-11T23:06:26.019821+0000","last_unstale":"2024-09-11T23:06:27.000632+0000","last_undegraded":"2024-09-11T23:06:27.000632+0000","last_fullsized":"2024-09-11T23:06:27.000632+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:22.399140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.14","version":"64'6","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.146218+0000","last_change":"2024-09-11T23:06:25.016215+0000","last_active":"2024-09-11T23:06:27.146218+0000","last_peered":"2024-09-11T23:06:27.146218+0000","last_clean":"2024-09-11T23:06:27.146218+0000","last_became_active":"2024-09-11T23:06:25.015590+0000","last_became_peered":"2024-09-11T23:06:25.015590+0000","last_unstale":"2024-09-11T23:06:27.146218+0000","last_undegraded":"2024-09-11T23:06:27.146218+0000","last_fullsized":"2024-09-11T23:06:27.146218+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:40:49.945457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.144399+0000","last_change":"2024-09-11T23:06:26.021397+0000","last_active":"2024-09-11T23:06:27.144399+0000","last_peered":"2024-09-11T23:06:27.144399+0000","last_clean":"2024-09-11T23:06:27.144399+0000","last_became_active":"2024-09-11T23:06:26.020998+0000","last_became_peered":"2024-09-11T23:06:26.020998+0000","last_unstale":"2024-09-11T23:06:27.144399+0000","last_undegraded":"2024-09-11T23:06:27.144399+0000","last_fullsized":"2024-09-11T23:06:27.144399+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:14.658630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"64'2","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.136105+0000","last_change":"2024-09-11T23:06:25.016390+0000","last_active":"2024-09-11T23:06:27.136105+0000","last_peered":"2024-09-11T23:06:27.136105+0000","last_clean":"2024-09-11T23:06:27.136105+0000","last_became_active":"2024-09-11T23:06:25.016129+0000","last_became_peered":"2024-09-11T23:06:25.016129+0000","last_unstale":"2024-09-11T23:06:27.136105+0000","last_undegraded":"2024-09-11T23:06:27.136105+0000","last_fullsized":"2024-09-11T23:06:27.136105+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:19.654737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.135957+0000","last_change":"2024-09-11T23:06:26.029895+0000","last_active":"2024-09-11T23:06:27.135957+0000","last_peered":"2024-09-11T23:06:27.135957+0000","last_clean":"2024-09-11T23:06:27.135957+0000","last_became_active":"2024-09-11T23:06:26.029365+0000","last_became_peered":"2024-09-11T23:06:26.029365+0000","last_unstale":"2024-09-11T23:06:27.135957+0000","last_undegraded":"2024-09-11T23:06:27.135957+0000","last_fullsized":"2024-09-11T23:06:27.135957+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:55.742076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.144457+0000","last_change":"2024-09-11T23:06:25.012067+0000","last_active":"2024-09-11T23:06:27.144457+0000","last_peered":"2024-09-11T23:06:27.144457+0000","last_clean":"2024-09-11T23:06:27.144457+0000","last_became_active":"2024-09-11T23:06:25.011656+0000","last_became_peered":"2024-09-11T23:06:25.011656+0000","last_unstale":"2024-09-11T23:06:27.144457+0000","last_undegraded":"2024-09-11T23:06:27.144457+0000","last_fullsized":"2024-09-11T23:06:27.144457+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:22.090462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.137585+0000","last_change":"2024-09-11T23:06:26.002665+0000","last_active":"2024-09-11T23:06:27.137585+0000","last_peered":"2024-09-11T23:06:27.137585+0000","last_clean":"2024-09-11T23:06:27.137585+0000","last_became_active":"2024-09-11T23:06:26.001480+0000","last_became_peered":"2024-09-11T23:06:26.001480+0000","last_unstale":"2024-09-11T23:06:27.137585+0000","last_undegraded":"2024-09-11T23:06:27.137585+0000","last_fullsized":"2024-09-11T23:06:27.137585+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:46.022278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:26.999890+0000","last_change":"2024-09-11T23:06:25.011344+0000","last_active":"2024-09-11T23:06:26.999890+0000","last_peered":"2024-09-11T23:06:26.999890+0000","last_clean":"2024-09-11T23:06:26.999890+0000","last_became_active":"2024-09-11T23:06:25.010944+0000","last_became_peered":"2024-09-11T23:06:25.010944+0000","last_unstale":"2024-09-11T23:06:26.999890+0000","last_undegraded":"2024-09-11T23:06:26.999890+0000","last_fullsized":"2024-09-11T23:06:26.999890+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:15.979164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.136556+0000","last_change":"2024-09-11T23:06:26.028578+0000","last_active":"2024-09-11T23:06:27.136556+0000","last_peered":"2024-09-11T23:06:27.136556+0000","last_clean":"2024-09-11T23:06:27.136556+0000","last_became_active":"2024-09-11T23:06:26.028258+0000","last_became_peered":"2024-09-11T23:06:26.028258+0000","last_unstale":"2024-09-11T23:06:27.136556+0000","last_undegraded":"2024-09-11T23:06:27.136556+0000","last_fullsized":"2024-09-11T23:06:27.136556+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:46.980988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"64'8","reported_seq":22,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.143626+0000","last_change":"2024-09-11T23:06:25.012217+0000","last_active":"2024-09-11T23:06:27.143626+0000","last_peered":"2024-09-11T23:06:27.143626+0000","last_clean":"2024-09-11T23:06:27.143626+0000","last_became_active":"2024-09-11T23:06:25.011817+0000","last_became_peered":"2024-09-11T23:06:25.011817+0000","last_unstale":"2024-09-11T23:06:27.143626+0000","last_undegraded":"2024-09-11T23:06:27.143626+0000","last_fullsized":"2024-09-11T23:06:27.143626+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:17.505341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.146102+0000","last_change":"2024-09-11T23:06:26.021760+0000","last_active":"2024-09-11T23:06:27.146102+0000","last_peered":"2024-09-11T23:06:27.146102+0000","last_clean":"2024-09-11T23:06:27.146102+0000","last_became_active":"2024-09-11T23:06:26.019811+0000","last_became_peered":"2024-09-11T23:06:26.019811+0000","last_unstale":"2024-09-11T23:06:27.146102+0000","last_undegraded":"2024-09-11T23:06:27.146102+0000","last_fullsized":"2024-09-11T23:06:27.146102+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:55.641339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"64'1","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.145920+0000","last_change":"2024-09-11T23:06:25.016554+0000","last_active":"2024-09-11T23:06:27.145920+0000","last_peered":"2024-09-11T23:06:27.145920+0000","last_clean":"2024-09-11T23:06:27.145920+0000","last_became_active":"2024-09-11T23:06:25.015765+0000","last_became_peered":"2024-09-11T23:06:25.015765+0000","last_unstale":"2024-09-11T23:06:27.145920+0000","last_undegraded":"2024-09-11T23:06:27.145920+0000","last_fullsized":"2024-09-11T23:06:27.145920+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:53.950650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.002826+0000","last_change":"2024-09-11T23:06:26.020318+0000","last_active":"2024-09-11T23:06:27.002826+0000","last_peered":"2024-09-11T23:06:27.002826+0000","last_clean":"2024-09-11T23:06:27.002826+0000","last_became_active":"2024-09-11T23:06:26.018478+0000","last_became_peered":"2024-09-11T23:06:26.018478+0000","last_unstale":"2024-09-11T23:06:27.002826+0000","last_undegraded":"2024-09-11T23:06:27.002826+0000","last_fullsized":"2024-09-11T23:06:27.002826+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:18.514802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"64'2","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.146399+0000","last_change":"2024-09-11T23:06:25.014587+0000","last_active":"2024-09-11T23:06:27.146399+0000","last_peered":"2024-09-11T23:06:27.146399+0000","last_clean":"2024-09-11T23:06:27.146399+0000","last_became_active":"2024-09-11T23:06:25.014329+0000","last_became_peered":"2024-09-11T23:06:25.014329+0000","last_unstale":"2024-09-11T23:06:27.146399+0000","last_undegraded":"2024-09-11T23:06:27.146399+0000","last_fullsized":"2024-09-11T23:06:27.146399+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:45.159581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.145473+0000","last_change":"2024-09-11T23:06:26.020533+0000","last_active":"2024-09-11T23:06:27.145473+0000","last_peered":"2024-09-11T23:06:27.145473+0000","last_clean":"2024-09-11T23:06:27.145473+0000","last_became_active":"2024-09-11T23:06:26.020244+0000","last_became_peered":"2024-09-11T23:06:26.020244+0000","last_unstale":"2024-09-11T23:06:27.145473+0000","last_undegraded":"2024-09-11T23:06:27.145473+0000","last_fullsized":"2024-09-11T23:06:27.145473+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:21.771740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.146476+0000","last_change":"2024-09-11T23:06:25.013336+0000","last_active":"2024-09-11T23:06:27.146476+0000","last_peered":"2024-09-11T23:06:27.146476+0000","last_clean":"2024-09-11T23:06:27.146476+0000","last_became_active":"2024-09-11T23:06:25.013012+0000","last_became_peered":"2024-09-11T23:06:25.013012+0000","last_unstale":"2024-09-11T23:06:27.146476+0000","last_undegraded":"2024-09-11T23:06:27.146476+0000","last_fullsized":"2024-09-11T23:06:27.146476+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:06.214376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.001342+0000","last_change":"2024-09-11T23:06:26.014175+0000","last_active":"2024-09-11T23:06:27.001342+0000","last_peered":"2024-09-11T23:06:27.001342+0000","last_clean":"2024-09-11T23:06:27.001342+0000","last_became_active":"2024-09-11T23:06:26.013915+0000","last_became_peered":"2024-09-11T23:06:26.013915+0000","last_unstale":"2024-09-11T23:06:27.001342+0000","last_undegraded":"2024-09-11T23:06:27.001342+0000","last_fullsized":"2024-09-11T23:06:27.001342+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:40.747910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"64'2","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.145647+0000","last_change":"2024-09-11T23:06:25.016759+0000","last_active":"2024-09-11T23:06:27.145647+0000","last_peered":"2024-09-11T23:06:27.145647+0000","last_clean":"2024-09-11T23:06:27.145647+0000","last_became_active":"2024-09-11T23:06:25.016034+0000","last_became_peered":"2024-09-11T23:06:25.016034+0000","last_unstale":"2024-09-11T23:06:27.145647+0000","last_undegraded":"2024-09-11T23:06:27.145647+0000","last_fullsized":"2024-09-11T23:06:27.145647+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:31.499827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.001746+0000","last_change":"2024-09-11T23:06:26.029956+0000","last_active":"2024-09-11T23:06:27.001746+0000","last_peered":"2024-09-11T23:06:27.001746+0000","last_clean":"2024-09-11T23:06:27.001746+0000","last_became_active":"2024-09-11T23:06:26.029363+0000","last_became_peered":"2024-09-11T23:06:26.029363+0000","last_unstale":"2024-09-11T23:06:27.001746+0000","last_undegraded":"2024-09-11T23:06:27.001746+0000","last_fullsized":"2024-09-11T23:06:27.001746+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:02.761416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.001391+0000","last_change":"2024-09-11T23:06:25.016215+0000","last_active":"2024-09-11T23:06:27.001391+0000","last_peered":"2024-09-11T23:06:27.001391+0000","last_clean":"2024-09-11T23:06:27.001391+0000","last_became_active":"2024-09-11T23:06:25.015403+0000","last_became_peered":"2024-09-11T23:06:25.015403+0000","last_unstale":"2024-09-11T23:06:27.001391+0000","last_undegraded":"2024-09-11T23:06:27.001391+0000","last_fullsized":"2024-09-11T23:06:27.001391+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:12.175093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:26.999631+0000","last_change":"2024-09-11T23:06:26.005567+0000","last_active":"2024-09-11T23:06:26.999631+0000","last_peered":"2024-09-11T23:06:26.999631+0000","last_clean":"2024-09-11T23:06:26.999631+0000","last_became_active":"2024-09-11T23:06:26.004804+0000","last_became_peered":"2024-09-11T23:06:26.004804+0000","last_unstale":"2024-09-11T23:06:26.999631+0000","last_undegraded":"2024-09-11T23:06:26.999631+0000","last_fullsized":"2024-09-11T23:06:26.999631+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:14.299548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:26.999982+0000","last_change":"2024-09-11T23:06:25.012104+0000","last_active":"2024-09-11T23:06:26.999982+0000","last_peered":"2024-09-11T23:06:26.999982+0000","last_clean":"2024-09-11T23:06:26.999982+0000","last_became_active":"2024-09-11T23:06:25.011687+0000","last_became_peered":"2024-09-11T23:06:25.011687+0000","last_unstale":"2024-09-11T23:06:26.999982+0000","last_undegraded":"2024-09-11T23:06:26.999982+0000","last_fullsized":"2024-09-11T23:06:26.999982+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:58.195654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.143948+0000","last_change":"2024-09-11T23:06:26.014617+0000","last_active":"2024-09-11T23:06:27.143948+0000","last_peered":"2024-09-11T23:06:27.143948+0000","last_clean":"2024-09-11T23:06:27.143948+0000","last_became_active":"2024-09-11T23:06:26.009266+0000","last_became_peered":"2024-09-11T23:06:26.009266+0000","last_unstale":"2024-09-11T23:06:27.143948+0000","last_undegraded":"2024-09-11T23:06:27.143948+0000","last_fullsized":"2024-09-11T23:06:27.143948+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:57.651844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:26.999745+0000","last_change":"2024-09-11T23:06:25.012605+0000","last_active":"2024-09-11T23:06:26.999745+0000","last_peered":"2024-09-11T23:06:26.999745+0000","last_clean":"2024-09-11T23:06:26.999745+0000","last_became_active":"2024-09-11T23:06:25.012288+0000","last_became_peered":"2024-09-11T23:06:25.012288+0000","last_unstale":"2024-09-11T23:06:26.999745+0000","last_undegraded":"2024-09-11T23:06:26.999745+0000","last_fullsized":"2024-09-11T23:06:26.999745+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:34.381828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.146338+0000","last_change":"2024-09-11T23:06:26.021449+0000","last_active":"2024-09-11T23:06:27.146338+0000","last_peered":"2024-09-11T23:06:27.146338+0000","last_clean":"2024-09-11T23:06:27.146338+0000","last_became_active":"2024-09-11T23:06:26.019757+0000","last_became_peered":"2024-09-11T23:06:26.019757+0000","last_unstale":"2024-09-11T23:06:27.146338+0000","last_undegraded":"2024-09-11T23:06:27.146338+0000","last_fullsized":"2024-09-11T23:06:27.146338+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:03.170800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.7","version":"64'2","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.137657+0000","last_change":"2024-09-11T23:06:25.009188+0000","last_active":"2024-09-11T23:06:27.137657+0000","last_peered":"2024-09-11T23:06:27.137657+0000","last_clean":"2024-09-11T23:06:27.137657+0000","last_became_active":"2024-09-11T23:06:25.008182+0000","last_became_peered":"2024-09-11T23:06:25.008182+0000","last_unstale":"2024-09-11T23:06:27.137657+0000","last_undegraded":"2024-09-11T23:06:27.137657+0000","last_fullsized":"2024-09-11T23:06:27.137657+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:18:33.144721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.137602+0000","last_change":"2024-09-11T23:06:26.024344+0000","last_active":"2024-09-11T23:06:27.137602+0000","last_peered":"2024-09-11T23:06:27.137602+0000","last_clean":"2024-09-11T23:06:27.137602+0000","last_became_active":"2024-09-11T23:06:26.023883+0000","last_became_peered":"2024-09-11T23:06:26.023883+0000","last_unstale":"2024-09-11T23:06:27.137602+0000","last_undegraded":"2024-09-11T23:06:27.137602+0000","last_fullsized":"2024-09-11T23:06:27.137602+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:22.278385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.6","version":"65'1","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.138090+0000","last_change":"2024-09-11T23:06:25.018398+0000","last_active":"2024-09-11T23:06:27.138090+0000","last_peered":"2024-09-11T23:06:27.138090+0000","last_clean":"2024-09-11T23:06:27.138090+0000","last_became_active":"2024-09-11T23:06:25.018128+0000","last_became_peered":"2024-09-11T23:06:25.018128+0000","last_unstale":"2024-09-11T23:06:27.138090+0000","last_undegraded":"2024-09-11T23:06:27.138090+0000","last_fullsized":"2024-09-11T23:06:27.138090+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:05.872395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.145806+0000","last_change":"2024-09-11T23:06:26.009028+0000","last_active":"2024-09-11T23:06:27.145806+0000","last_peered":"2024-09-11T23:06:27.145806+0000","last_clean":"2024-09-11T23:06:27.145806+0000","last_became_active":"2024-09-11T23:06:26.004349+0000","last_became_peered":"2024-09-11T23:06:26.004349+0000","last_unstale":"2024-09-11T23:06:27.145806+0000","last_undegraded":"2024-09-11T23:06:27.145806+0000","last_fullsized":"2024-09-11T23:06:27.145806+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:48.099513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.145604+0000","last_change":"2024-09-11T23:06:25.017795+0000","last_active":"2024-09-11T23:06:27.145604+0000","last_peered":"2024-09-11T23:06:27.145604+0000","last_clean":"2024-09-11T23:06:27.145604+0000","last_became_active":"2024-09-11T23:06:25.017424+0000","last_became_peered":"2024-09-11T23:06:25.017424+0000","last_unstale":"2024-09-11T23:06:27.145604+0000","last_undegraded":"2024-09-11T23:06:27.145604+0000","last_fullsized":"2024-09-11T23:06:27.145604+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:19.138328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.000779+0000","last_change":"2024-09-11T23:06:26.022731+0000","last_active":"2024-09-11T23:06:27.000779+0000","last_peered":"2024-09-11T23:06:27.000779+0000","last_clean":"2024-09-11T23:06:27.000779+0000","last_became_active":"2024-09-11T23:06:26.020383+0000","last_became_peered":"2024-09-11T23:06:26.020383+0000","last_unstale":"2024-09-11T23:06:27.000779+0000","last_undegraded":"2024-09-11T23:06:27.000779+0000","last_fullsized":"2024-09-11T23:06:27.000779+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:25:55.655328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.000410+0000","last_change":"2024-09-11T23:06:25.014290+0000","last_active":"2024-09-11T23:06:27.000410+0000","last_peered":"2024-09-11T23:06:27.000410+0000","last_clean":"2024-09-11T23:06:27.000410+0000","last_became_active":"2024-09-11T23:06:25.011669+0000","last_became_peered":"2024-09-11T23:06:25.011669+0000","last_unstale":"2024-09-11T23:06:27.000410+0000","last_undegraded":"2024-09-11T23:06:27.000410+0000","last_fullsized":"2024-09-11T23:06:27.000410+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:00.835163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.137251+0000","last_change":"2024-09-11T23:06:26.001681+0000","last_active":"2024-09-11T23:06:27.137251+0000","last_peered":"2024-09-11T23:06:27.137251+0000","last_clean":"2024-09-11T23:06:27.137251+0000","last_became_active":"2024-09-11T23:06:26.001383+0000","last_became_peered":"2024-09-11T23:06:26.001383+0000","last_unstale":"2024-09-11T23:06:27.137251+0000","last_undegraded":"2024-09-11T23:06:27.137251+0000","last_fullsized":"2024-09-11T23:06:27.137251+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:55.774612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.145869+0000","last_change":"2024-09-11T23:06:25.016430+0000","last_active":"2024-09-11T23:06:27.145869+0000","last_peered":"2024-09-11T23:06:27.145869+0000","last_clean":"2024-09-11T23:06:27.145869+0000","last_became_active":"2024-09-11T23:06:25.015512+0000","last_became_peered":"2024-09-11T23:06:25.015512+0000","last_unstale":"2024-09-11T23:06:27.145869+0000","last_undegraded":"2024-09-11T23:06:27.145869+0000","last_fullsized":"2024-09-11T23:06:27.145869+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:11.718895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.145208+0000","last_change":"2024-09-11T23:06:26.022753+0000","last_active":"2024-09-11T23:06:27.145208+0000","last_peered":"2024-09-11T23:06:27.145208+0000","last_clean":"2024-09-11T23:06:27.145208+0000","last_became_active":"2024-09-11T23:06:26.011701+0000","last_became_peered":"2024-09-11T23:06:26.011701+0000","last_unstale":"2024-09-11T23:06:27.145208+0000","last_undegraded":"2024-09-11T23:06:27.145208+0000","last_fullsized":"2024-09-11T23:06:27.145208+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:59:23.639279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.001475+0000","last_change":"2024-09-11T23:06:25.015961+0000","last_active":"2024-09-11T23:06:27.001475+0000","last_peered":"2024-09-11T23:06:27.001475+0000","last_clean":"2024-09-11T23:06:27.001475+0000","last_became_active":"2024-09-11T23:06:25.014998+0000","last_became_peered":"2024-09-11T23:06:25.014998+0000","last_unstale":"2024-09-11T23:06:27.001475+0000","last_undegraded":"2024-09-11T23:06:27.001475+0000","last_fullsized":"2024-09-11T23:06:27.001475+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:02.934025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.135966+0000","last_change":"2024-09-11T23:06:26.002258+0000","last_active":"2024-09-11T23:06:27.135966+0000","last_peered":"2024-09-11T23:06:27.135966+0000","last_clean":"2024-09-11T23:06:27.135966+0000","last_became_active":"2024-09-11T23:06:26.001013+0000","last_became_peered":"2024-09-11T23:06:26.001013+0000","last_unstale":"2024-09-11T23:06:27.135966+0000","last_undegraded":"2024-09-11T23:06:27.135966+0000","last_fullsized":"2024-09-11T23:06:27.135966+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:57.233238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.136212+0000","last_change":"2024-09-11T23:06:25.015268+0000","last_active":"2024-09-11T23:06:27.136212+0000","last_peered":"2024-09-11T23:06:27.136212+0000","last_clean":"2024-09-11T23:06:27.136212+0000","last_became_active":"2024-09-11T23:06:25.015020+0000","last_became_peered":"2024-09-11T23:06:25.015020+0000","last_unstale":"2024-09-11T23:06:27.136212+0000","last_undegraded":"2024-09-11T23:06:27.136212+0000","last_fullsized":"2024-09-11T23:06:27.136212+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:58.111448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.136082+0000","last_change":"2024-09-11T23:06:26.016804+0000","last_active":"2024-09-11T23:06:27.136082+0000","last_peered":"2024-09-11T23:06:27.136082+0000","last_clean":"2024-09-11T23:06:27.136082+0000","last_became_active":"2024-09-11T23:06:26.016334+0000","last_became_peered":"2024-09-11T23:06:26.016334+0000","last_unstale":"2024-09-11T23:06:27.136082+0000","last_undegraded":"2024-09-11T23:06:27.136082+0000","last_fullsized":"2024-09-11T23:06:27.136082+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:37.794268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.143817+0000","last_change":"2024-09-11T23:06:25.007341+0000","last_active":"2024-09-11T23:06:27.143817+0000","last_peered":"2024-09-11T23:06:27.143817+0000","last_clean":"2024-09-11T23:06:27.143817+0000","last_became_active":"2024-09-11T23:06:25.005410+0000","last_became_peered":"2024-09-11T23:06:25.005410+0000","last_unstale":"2024-09-11T23:06:27.143817+0000","last_undegraded":"2024-09-11T23:06:27.143817+0000","last_fullsized":"2024-09-11T23:06:27.143817+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:34.528572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.137696+0000","last_change":"2024-09-11T23:06:26.025023+0000","last_active":"2024-09-11T23:06:27.137696+0000","last_peered":"2024-09-11T23:06:27.137696+0000","last_clean":"2024-09-11T23:06:27.137696+0000","last_became_active":"2024-09-11T23:06:26.023848+0000","last_became_peered":"2024-09-11T23:06:26.023848+0000","last_unstale":"2024-09-11T23:06:27.137696+0000","last_undegraded":"2024-09-11T23:06:27.137696+0000","last_fullsized":"2024-09-11T23:06:27.137696+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:22.899419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"64'1","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.137309+0000","last_change":"2024-09-11T23:06:25.008645+0000","last_active":"2024-09-11T23:06:27.137309+0000","last_peered":"2024-09-11T23:06:27.137309+0000","last_clean":"2024-09-11T23:06:27.137309+0000","last_became_active":"2024-09-11T23:06:25.008186+0000","last_became_peered":"2024-09-11T23:06:25.008186+0000","last_unstale":"2024-09-11T23:06:27.137309+0000","last_undegraded":"2024-09-11T23:06:27.137309+0000","last_fullsized":"2024-09-11T23:06:27.137309+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:07.629486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"65'1854","reported_seq":2136,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:29.535789+0000","last_change":"2024-09-11T23:03:26.382905+0000","last_active":"2024-09-11T23:06:29.535789+0000","last_peered":"2024-09-11T23:06:29.535789+0000","last_clean":"2024-09-11T23:06:29.535789+0000","last_became_active":"2024-09-11T23:03:26.380590+0000","last_became_peered":"2024-09-11T23:03:26.380590+0000","last_unstale":"2024-09-11T23:06:29.535789+0000","last_undegraded":"2024-09-11T23:06:29.535789+0000","last_fullsized":"2024-09-11T23:06:29.535789+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:24.361793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:24.361793+0000","last_clean_scrub_stamp":"2024-09-11T23:03:24.361793+0000","objects_scrubbed":0,"log_size":1854,"log_dups_size":0,"ondisk_log_size":1854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:46.577063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":534,"num_read_kb":1018,"num_write":219,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":534,"num_read_kb":1018,"num_write":219,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1854,"ondisk_log_size":1854,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738406,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31816,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":643072,"data_stored":247190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738406,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36536,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335304,"statfs":{"total":96636764160,"available":96599351296,"internally_reserved":0,"allocated":1220608,"data_stored":835376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738406,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36548,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335292,"statfs":{"total":96636764160,"available":96599339008,"internally_reserved":0,"allocated":1232896,"data_stored":837432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:06:31.995 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:31.991+0000 7f02a2c51640 -1 client.4935: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.4890:b65aeaeb-3f3a-4da2-97b5-6988dece6be2:v1:172.21.15.12:0/2496375865] 2024-09-11T23:06:32.980 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:32.975+0000 7f02a2c51640 -1 client.4935: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.4890:b65aeaeb-3f3a-4da2-97b5-6988dece6be2:v1:172.21.15.12:0/2496375865] 2024-09-11T23:06:33.973 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:33.967+0000 7f02a2c51640 -1 client.4935: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.4890:b65aeaeb-3f3a-4da2-97b5-6988dece6be2:v1:172.21.15.12:0/2496375865] 2024-09-11T23:06:34.692 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:06:34.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:34.831+0000 7f60252dd640 1 Processor -- start 2024-09-11T23:06:34.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:34.835+0000 7f60252dd640 1 -- start start 2024-09-11T23:06:34.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:34.835+0000 7f60252dd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f602009f150 0x7f60200a0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:34.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:34.835+0000 7f60252dd640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f602006ed80 con 0x7f602009f530 2024-09-11T23:06:34.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:34.835+0000 7f60252dd640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f602006eac0 con 0x7f602009f150 2024-09-11T23:06:34.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:34.835+0000 7f601effd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f602009f150 0x7f60200a0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:34.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:34.835+0000 7f6017fff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f602009f530 0x7f6020139b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42082/0 (socket says 172.21.15.12:42082) 2024-09-11T23:06:34.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:34.835+0000 7f6017fff640 1 -- 172.21.15.12:0/493573472 learned_addr learned my addr 172.21.15.12:0/493573472 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:34.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:34.835+0000 7f601effd640 1 -- 172.21.15.12:0/493573472 >> v1:172.21.15.12:6789/0 conn(0x7f602009f530 legacy=0x7f6020139b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:34.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:34.835+0000 7f601effd640 1 -- 172.21.15.12:0/493573472 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60200a00d0 con 0x7f602009f150 2024-09-11T23:06:34.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:34.835+0000 7f601effd640 1 --2- 172.21.15.12:0/493573472 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f602009f150 0x7f60200a0500 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f6010009740 tx=0x7f601001c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ac29fc814074dfa server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:34.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:34.835+0000 7f601e7fc640 1 -- 172.21.15.12:0/493573472 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60100b0070 con 0x7f602009f150 2024-09-11T23:06:34.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:34.835+0000 7f601e7fc640 1 -- 172.21.15.12:0/493573472 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60100ab400 con 0x7f602009f150 2024-09-11T23:06:34.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:34.835+0000 7f601e7fc640 1 -- 172.21.15.12:0/493573472 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60100ab700 con 0x7f602009f150 2024-09-11T23:06:34.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:34.839+0000 7f60252dd640 1 -- 172.21.15.12:0/493573472 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f602009f150 msgr2=0x7f60200a0500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:34.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:34.839+0000 7f60252dd640 1 --2- 172.21.15.12:0/493573472 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f602009f150 0x7f60200a0500 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f6010009740 tx=0x7f601001c390 comp rx=0 tx=0).stop 2024-09-11T23:06:34.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:34.839+0000 7f60252dd640 1 -- 172.21.15.12:0/493573472 shutdown_connections 2024-09-11T23:06:34.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:34.839+0000 7f60252dd640 1 --2- 172.21.15.12:0/493573472 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f602009f150 0x7f60200a0500 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:34.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:34.839+0000 7f60252dd640 1 -- 172.21.15.12:0/493573472 >> 172.21.15.12:0/493573472 conn(0x7f60200aa2c0 msgr2=0x7f60200aa6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:34.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:34.839+0000 7f60252dd640 1 -- 172.21.15.12:0/493573472 shutdown_connections 2024-09-11T23:06:34.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:34.839+0000 7f60252dd640 1 -- 172.21.15.12:0/493573472 wait complete. 2024-09-11T23:06:34.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:34.839+0000 7f60252dd640 1 Processor -- start 2024-09-11T23:06:34.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:34.839+0000 7f60252dd640 1 -- start start 2024-09-11T23:06:34.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:34.839+0000 7f60252dd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f602009f150 0x7f602013ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:34.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:34.839+0000 7f60252dd640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6020142240 con 0x7f602009f150 2024-09-11T23:06:34.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:34.839+0000 7f601effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f602009f150 0x7f602013ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:34.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:34.839+0000 7f601effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f602009f150 0x7f602013ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49172/0 (socket says 172.21.15.12:49172) 2024-09-11T23:06:34.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:34.839+0000 7f601effd640 1 -- 172.21.15.12:0/3777438127 learned_addr learned my addr 172.21.15.12:0/3777438127 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:34.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:34.839+0000 7f601effd640 1 -- 172.21.15.12:0/3777438127 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f602013f910 con 0x7f602009f150 2024-09-11T23:06:34.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:34.839+0000 7f601effd640 1 --2- 172.21.15.12:0/3777438127 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f602009f150 0x7f602013ece0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f6010019fc0 tx=0x7f601001abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:34.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:34.839+0000 7f60177fe640 1 -- 172.21.15.12:0/3777438127 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60100b0050 con 0x7f602009f150 2024-09-11T23:06:34.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:34.839+0000 7f60177fe640 1 -- 172.21.15.12:0/3777438127 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60100b1040 con 0x7f602009f150 2024-09-11T23:06:34.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:34.839+0000 7f60252dd640 1 -- 172.21.15.12:0/3777438127 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f602013fbb0 con 0x7f602009f150 2024-09-11T23:06:34.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:34.839+0000 7f60177fe640 1 -- 172.21.15.12:0/3777438127 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60100b76d0 con 0x7f602009f150 2024-09-11T23:06:34.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:34.839+0000 7f60252dd640 1 -- 172.21.15.12:0/3777438127 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f602013c0d0 con 0x7f602009f150 2024-09-11T23:06:34.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:34.839+0000 7f60252dd640 1 -- 172.21.15.12:0/3777438127 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60200a0500 con 0x7f602009f150 2024-09-11T23:06:34.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:34.843+0000 7f60177fe640 1 -- 172.21.15.12:0/3777438127 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 32) ==== 43997+0+0 (secure 0 0 0) 0x7f60100be030 con 0x7f602009f150 2024-09-11T23:06:34.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:34.843+0000 7f60177fe640 1 --2- 172.21.15.12:0/3777438127 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f6000035d20 0x7f60000381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:34.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:34.843+0000 7f60177fe640 1 -- 172.21.15.12:0/3777438127 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 3439+0+0 (secure 0 0 0) 0x7f60100bc070 con 0x7f602009f150 2024-09-11T23:06:34.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:34.843+0000 7f6017fff640 1 --2- 172.21.15.12:0/3777438127 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f6000035d20 0x7f60000381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:34.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:34.843+0000 7f6017fff640 1 --2- 172.21.15.12:0/3777438127 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f6000035d20 0x7f60000381e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6008007fd0 tx=0x7f6008007960 comp rx=0 tx=0).ready entity=mgr.4903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:34.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:34.847+0000 7f60177fe640 1 -- 172.21.15.12:0/3777438127 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f60100c5060 con 0x7f602009f150 2024-09-11T23:06:34.934 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:34.931+0000 7f02a2c51640 -1 client.4935: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.4890:b65aeaeb-3f3a-4da2-97b5-6988dece6be2:v1:172.21.15.12:0/2496375865] 2024-09-11T23:06:35.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.015+0000 7f60252dd640 1 -- 172.21.15.12:0/3777438127 --> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f60201393a0 con 0x7f6000035d20 2024-09-11T23:06:35.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.023+0000 7f60177fe640 1 -- 172.21.15.12:0/3777438127 <== mgr.4903 v2:172.21.15.12:6828/4277951488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246094 (secure 0 0 0) 0x7f60201393a0 con 0x7f6000035d20 2024-09-11T23:06:35.027 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:06:35.028 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-11T23:06:35.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.027+0000 7f60252dd640 1 -- 172.21.15.12:0/3777438127 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f6000035d20 msgr2=0x7f60000381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:35.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.027+0000 7f60252dd640 1 --2- 172.21.15.12:0/3777438127 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f6000035d20 0x7f60000381e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6008007fd0 tx=0x7f6008007960 comp rx=0 tx=0).stop 2024-09-11T23:06:35.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.027+0000 7f60252dd640 1 -- 172.21.15.12:0/3777438127 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f602009f150 msgr2=0x7f602013ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:35.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.027+0000 7f60252dd640 1 --2- 172.21.15.12:0/3777438127 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f602009f150 0x7f602013ece0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f6010019fc0 tx=0x7f601001abd0 comp rx=0 tx=0).stop 2024-09-11T23:06:35.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.027+0000 7f60252dd640 1 -- 172.21.15.12:0/3777438127 shutdown_connections 2024-09-11T23:06:35.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.027+0000 7f60252dd640 1 --2- 172.21.15.12:0/3777438127 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f6000035d20 0x7f60000381e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:35.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.027+0000 7f60252dd640 1 --2- 172.21.15.12:0/3777438127 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f602009f150 0x7f602013ece0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:35.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.027+0000 7f60252dd640 1 -- 172.21.15.12:0/3777438127 >> 172.21.15.12:0/3777438127 conn(0x7f60200aa2c0 msgr2=0x7f6020137970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:35.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.027+0000 7f60252dd640 1 -- 172.21.15.12:0/3777438127 shutdown_connections 2024-09-11T23:06:35.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.027+0000 7f60252dd640 1 -- 172.21.15.12:0/3777438127 wait complete. 2024-09-11T23:06:35.046 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-11T23:06:33.541919+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":534,"num_read_kb":1018,"num_write":264,"num_write_kb":1908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1893,"ondisk_log_size":1893,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":142,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":104900,"kb_used_data":3024,"kb_used_omap":4,"kb_used_meta":101819,"kb_avail":283010620,"statfs":{"total":289910292480,"available":289802874880,"internally_reserved":0,"allocated":3096576,"data_stored":1919998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":104262991},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002083"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.136327+0000","last_change":"2024-09-11T23:06:26.017373+0000","last_active":"2024-09-11T23:06:27.136327+0000","last_peered":"2024-09-11T23:06:27.136327+0000","last_clean":"2024-09-11T23:06:27.136327+0000","last_became_active":"2024-09-11T23:06:26.016768+0000","last_became_peered":"2024-09-11T23:06:26.016768+0000","last_unstale":"2024-09-11T23:06:27.136327+0000","last_undegraded":"2024-09-11T23:06:27.136327+0000","last_fullsized":"2024-09-11T23:06:27.136327+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:08.832436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.137672+0000","last_change":"2024-09-11T23:06:26.016431+0000","last_active":"2024-09-11T23:06:27.137672+0000","last_peered":"2024-09-11T23:06:27.137672+0000","last_clean":"2024-09-11T23:06:27.137672+0000","last_became_active":"2024-09-11T23:06:26.016010+0000","last_became_peered":"2024-09-11T23:06:26.016010+0000","last_unstale":"2024-09-11T23:06:27.137672+0000","last_undegraded":"2024-09-11T23:06:27.137672+0000","last_fullsized":"2024-09-11T23:06:27.137672+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:57.112448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.001066+0000","last_change":"2024-09-11T23:06:26.015747+0000","last_active":"2024-09-11T23:06:27.001066+0000","last_peered":"2024-09-11T23:06:27.001066+0000","last_clean":"2024-09-11T23:06:27.001066+0000","last_became_active":"2024-09-11T23:06:26.014861+0000","last_became_peered":"2024-09-11T23:06:26.014861+0000","last_unstale":"2024-09-11T23:06:27.001066+0000","last_undegraded":"2024-09-11T23:06:27.001066+0000","last_fullsized":"2024-09-11T23:06:27.001066+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:30.781959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.000313+0000","last_change":"2024-09-11T23:06:26.015101+0000","last_active":"2024-09-11T23:06:27.000313+0000","last_peered":"2024-09-11T23:06:27.000313+0000","last_clean":"2024-09-11T23:06:27.000313+0000","last_became_active":"2024-09-11T23:06:26.014821+0000","last_became_peered":"2024-09-11T23:06:26.014821+0000","last_unstale":"2024-09-11T23:06:27.000313+0000","last_undegraded":"2024-09-11T23:06:27.000313+0000","last_fullsized":"2024-09-11T23:06:27.000313+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:09:08.128786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.000746+0000","last_change":"2024-09-11T23:06:26.013603+0000","last_active":"2024-09-11T23:06:27.000746+0000","last_peered":"2024-09-11T23:06:27.000746+0000","last_clean":"2024-09-11T23:06:27.000746+0000","last_became_active":"2024-09-11T23:06:26.013330+0000","last_became_peered":"2024-09-11T23:06:26.013330+0000","last_unstale":"2024-09-11T23:06:27.000746+0000","last_undegraded":"2024-09-11T23:06:27.000746+0000","last_fullsized":"2024-09-11T23:06:27.000746+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:15:00.702142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.000940+0000","last_change":"2024-09-11T23:06:26.030941+0000","last_active":"2024-09-11T23:06:27.000940+0000","last_peered":"2024-09-11T23:06:27.000940+0000","last_clean":"2024-09-11T23:06:27.000940+0000","last_became_active":"2024-09-11T23:06:26.023279+0000","last_became_peered":"2024-09-11T23:06:26.023279+0000","last_unstale":"2024-09-11T23:06:27.000940+0000","last_undegraded":"2024-09-11T23:06:27.000940+0000","last_fullsized":"2024-09-11T23:06:27.000940+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:21.708996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:26.999692+0000","last_change":"2024-09-11T23:06:25.995213+0000","last_active":"2024-09-11T23:06:26.999692+0000","last_peered":"2024-09-11T23:06:26.999692+0000","last_clean":"2024-09-11T23:06:26.999692+0000","last_became_active":"2024-09-11T23:06:25.994970+0000","last_became_peered":"2024-09-11T23:06:25.994970+0000","last_unstale":"2024-09-11T23:06:26.999692+0000","last_undegraded":"2024-09-11T23:06:26.999692+0000","last_fullsized":"2024-09-11T23:06:26.999692+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:57.137092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.143668+0000","last_change":"2024-09-11T23:06:26.012703+0000","last_active":"2024-09-11T23:06:27.143668+0000","last_peered":"2024-09-11T23:06:27.143668+0000","last_clean":"2024-09-11T23:06:27.143668+0000","last_became_active":"2024-09-11T23:06:26.011616+0000","last_became_peered":"2024-09-11T23:06:26.011616+0000","last_unstale":"2024-09-11T23:06:27.143668+0000","last_undegraded":"2024-09-11T23:06:27.143668+0000","last_fullsized":"2024-09-11T23:06:27.143668+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:53.457071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.136748+0000","last_change":"2024-09-11T23:06:26.026949+0000","last_active":"2024-09-11T23:06:27.136748+0000","last_peered":"2024-09-11T23:06:27.136748+0000","last_clean":"2024-09-11T23:06:27.136748+0000","last_became_active":"2024-09-11T23:06:26.026696+0000","last_became_peered":"2024-09-11T23:06:26.026696+0000","last_unstale":"2024-09-11T23:06:27.136748+0000","last_undegraded":"2024-09-11T23:06:27.136748+0000","last_fullsized":"2024-09-11T23:06:27.136748+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:42.264619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.001649+0000","last_change":"2024-09-11T23:06:26.013095+0000","last_active":"2024-09-11T23:06:27.001649+0000","last_peered":"2024-09-11T23:06:27.001649+0000","last_clean":"2024-09-11T23:06:27.001649+0000","last_became_active":"2024-09-11T23:06:26.012779+0000","last_became_peered":"2024-09-11T23:06:26.012779+0000","last_unstale":"2024-09-11T23:06:27.001649+0000","last_undegraded":"2024-09-11T23:06:27.001649+0000","last_fullsized":"2024-09-11T23:06:27.001649+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:30.051796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.137007+0000","last_change":"2024-09-11T23:06:26.019373+0000","last_active":"2024-09-11T23:06:27.137007+0000","last_peered":"2024-09-11T23:06:27.137007+0000","last_clean":"2024-09-11T23:06:27.137007+0000","last_became_active":"2024-09-11T23:06:26.018910+0000","last_became_peered":"2024-09-11T23:06:26.018910+0000","last_unstale":"2024-09-11T23:06:27.137007+0000","last_undegraded":"2024-09-11T23:06:27.137007+0000","last_fullsized":"2024-09-11T23:06:27.137007+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:57.744079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.145412+0000","last_change":"2024-09-11T23:06:26.022439+0000","last_active":"2024-09-11T23:06:27.145412+0000","last_peered":"2024-09-11T23:06:27.145412+0000","last_clean":"2024-09-11T23:06:27.145412+0000","last_became_active":"2024-09-11T23:06:26.021782+0000","last_became_peered":"2024-09-11T23:06:26.021782+0000","last_unstale":"2024-09-11T23:06:27.145412+0000","last_undegraded":"2024-09-11T23:06:27.145412+0000","last_fullsized":"2024-09-11T23:06:27.145412+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:24:18.106844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.146019+0000","last_change":"2024-09-11T23:06:26.022466+0000","last_active":"2024-09-11T23:06:27.146019+0000","last_peered":"2024-09-11T23:06:27.146019+0000","last_clean":"2024-09-11T23:06:27.146019+0000","last_became_active":"2024-09-11T23:06:26.008963+0000","last_became_peered":"2024-09-11T23:06:26.008963+0000","last_unstale":"2024-09-11T23:06:27.146019+0000","last_undegraded":"2024-09-11T23:06:27.146019+0000","last_fullsized":"2024-09-11T23:06:27.146019+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:25.230405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.001290+0000","last_change":"2024-09-11T23:06:26.016498+0000","last_active":"2024-09-11T23:06:27.001290+0000","last_peered":"2024-09-11T23:06:27.001290+0000","last_clean":"2024-09-11T23:06:27.001290+0000","last_became_active":"2024-09-11T23:06:26.015640+0000","last_became_peered":"2024-09-11T23:06:26.015640+0000","last_unstale":"2024-09-11T23:06:27.001290+0000","last_undegraded":"2024-09-11T23:06:27.001290+0000","last_fullsized":"2024-09-11T23:06:27.001290+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:08.581125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.135656+0000","last_change":"2024-09-11T23:06:26.029233+0000","last_active":"2024-09-11T23:06:27.135656+0000","last_peered":"2024-09-11T23:06:27.135656+0000","last_clean":"2024-09-11T23:06:27.135656+0000","last_became_active":"2024-09-11T23:06:26.028536+0000","last_became_peered":"2024-09-11T23:06:26.028536+0000","last_unstale":"2024-09-11T23:06:27.135656+0000","last_undegraded":"2024-09-11T23:06:27.135656+0000","last_fullsized":"2024-09-11T23:06:27.135656+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:24.277318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:26.999687+0000","last_change":"2024-09-11T23:06:26.005785+0000","last_active":"2024-09-11T23:06:26.999687+0000","last_peered":"2024-09-11T23:06:26.999687+0000","last_clean":"2024-09-11T23:06:26.999687+0000","last_became_active":"2024-09-11T23:06:26.005450+0000","last_became_peered":"2024-09-11T23:06:26.005450+0000","last_unstale":"2024-09-11T23:06:26.999687+0000","last_undegraded":"2024-09-11T23:06:26.999687+0000","last_fullsized":"2024-09-11T23:06:26.999687+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:30.293666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.146052+0000","last_change":"2024-09-11T23:06:26.017719+0000","last_active":"2024-09-11T23:06:27.146052+0000","last_peered":"2024-09-11T23:06:27.146052+0000","last_clean":"2024-09-11T23:06:27.146052+0000","last_became_active":"2024-09-11T23:06:26.017455+0000","last_became_peered":"2024-09-11T23:06:26.017455+0000","last_unstale":"2024-09-11T23:06:27.146052+0000","last_undegraded":"2024-09-11T23:06:27.146052+0000","last_fullsized":"2024-09-11T23:06:27.146052+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:49.461279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.002008+0000","last_change":"2024-09-11T23:06:26.026036+0000","last_active":"2024-09-11T23:06:27.002008+0000","last_peered":"2024-09-11T23:06:27.002008+0000","last_clean":"2024-09-11T23:06:27.002008+0000","last_became_active":"2024-09-11T23:06:26.025700+0000","last_became_peered":"2024-09-11T23:06:26.025700+0000","last_unstale":"2024-09-11T23:06:27.002008+0000","last_undegraded":"2024-09-11T23:06:27.002008+0000","last_fullsized":"2024-09-11T23:06:27.002008+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:53.645719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.145295+0000","last_change":"2024-09-11T23:06:26.020736+0000","last_active":"2024-09-11T23:06:27.145295+0000","last_peered":"2024-09-11T23:06:27.145295+0000","last_clean":"2024-09-11T23:06:27.145295+0000","last_became_active":"2024-09-11T23:06:26.020469+0000","last_became_peered":"2024-09-11T23:06:26.020469+0000","last_unstale":"2024-09-11T23:06:27.145295+0000","last_undegraded":"2024-09-11T23:06:27.145295+0000","last_fullsized":"2024-09-11T23:06:27.145295+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:56.915005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.000187+0000","last_change":"2024-09-11T23:06:26.023329+0000","last_active":"2024-09-11T23:06:27.000187+0000","last_peered":"2024-09-11T23:06:27.000187+0000","last_clean":"2024-09-11T23:06:27.000187+0000","last_became_active":"2024-09-11T23:06:26.020462+0000","last_became_peered":"2024-09-11T23:06:26.020462+0000","last_unstale":"2024-09-11T23:06:27.000187+0000","last_undegraded":"2024-09-11T23:06:27.000187+0000","last_fullsized":"2024-09-11T23:06:27.000187+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:26.319061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.001173+0000","last_change":"2024-09-11T23:06:26.029868+0000","last_active":"2024-09-11T23:06:27.001173+0000","last_peered":"2024-09-11T23:06:27.001173+0000","last_clean":"2024-09-11T23:06:27.001173+0000","last_became_active":"2024-09-11T23:06:26.025899+0000","last_became_peered":"2024-09-11T23:06:26.025899+0000","last_unstale":"2024-09-11T23:06:27.001173+0000","last_undegraded":"2024-09-11T23:06:27.001173+0000","last_fullsized":"2024-09-11T23:06:27.001173+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:27.921104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.136038+0000","last_change":"2024-09-11T23:06:26.027715+0000","last_active":"2024-09-11T23:06:27.136038+0000","last_peered":"2024-09-11T23:06:27.136038+0000","last_clean":"2024-09-11T23:06:27.136038+0000","last_became_active":"2024-09-11T23:06:26.027454+0000","last_became_peered":"2024-09-11T23:06:26.027454+0000","last_unstale":"2024-09-11T23:06:27.136038+0000","last_undegraded":"2024-09-11T23:06:27.136038+0000","last_fullsized":"2024-09-11T23:06:27.136038+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:02.766648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.143892+0000","last_change":"2024-09-11T23:06:26.014859+0000","last_active":"2024-09-11T23:06:27.143892+0000","last_peered":"2024-09-11T23:06:27.143892+0000","last_clean":"2024-09-11T23:06:27.143892+0000","last_became_active":"2024-09-11T23:06:26.011282+0000","last_became_peered":"2024-09-11T23:06:26.011282+0000","last_unstale":"2024-09-11T23:06:27.143892+0000","last_undegraded":"2024-09-11T23:06:27.143892+0000","last_fullsized":"2024-09-11T23:06:27.143892+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:54.096620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:26.999455+0000","last_change":"2024-09-11T23:06:26.005707+0000","last_active":"2024-09-11T23:06:26.999455+0000","last_peered":"2024-09-11T23:06:26.999455+0000","last_clean":"2024-09-11T23:06:26.999455+0000","last_became_active":"2024-09-11T23:06:26.005104+0000","last_became_peered":"2024-09-11T23:06:26.005104+0000","last_unstale":"2024-09-11T23:06:26.999455+0000","last_undegraded":"2024-09-11T23:06:26.999455+0000","last_fullsized":"2024-09-11T23:06:26.999455+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:57.112448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.136802+0000","last_change":"2024-09-11T23:06:26.026959+0000","last_active":"2024-09-11T23:06:27.136802+0000","last_peered":"2024-09-11T23:06:27.136802+0000","last_clean":"2024-09-11T23:06:27.136802+0000","last_became_active":"2024-09-11T23:06:26.026663+0000","last_became_peered":"2024-09-11T23:06:26.026663+0000","last_unstale":"2024-09-11T23:06:27.136802+0000","last_undegraded":"2024-09-11T23:06:27.136802+0000","last_fullsized":"2024-09-11T23:06:27.136802+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:13.430448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.137866+0000","last_change":"2024-09-11T23:06:26.028907+0000","last_active":"2024-09-11T23:06:27.137866+0000","last_peered":"2024-09-11T23:06:27.137866+0000","last_clean":"2024-09-11T23:06:27.137866+0000","last_became_active":"2024-09-11T23:06:26.028601+0000","last_became_peered":"2024-09-11T23:06:26.028601+0000","last_unstale":"2024-09-11T23:06:27.137866+0000","last_undegraded":"2024-09-11T23:06:27.137866+0000","last_fullsized":"2024-09-11T23:06:27.137866+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:30.293666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.001176+0000","last_change":"2024-09-11T23:06:26.022936+0000","last_active":"2024-09-11T23:06:27.001176+0000","last_peered":"2024-09-11T23:06:27.001176+0000","last_clean":"2024-09-11T23:06:27.001176+0000","last_became_active":"2024-09-11T23:06:26.020483+0000","last_became_peered":"2024-09-11T23:06:26.020483+0000","last_unstale":"2024-09-11T23:06:27.001176+0000","last_undegraded":"2024-09-11T23:06:27.001176+0000","last_fullsized":"2024-09-11T23:06:27.001176+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:52.483589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.137715+0000","last_change":"2024-09-11T23:06:26.015790+0000","last_active":"2024-09-11T23:06:27.137715+0000","last_peered":"2024-09-11T23:06:27.137715+0000","last_clean":"2024-09-11T23:06:27.137715+0000","last_became_active":"2024-09-11T23:06:26.015516+0000","last_became_peered":"2024-09-11T23:06:26.015516+0000","last_unstale":"2024-09-11T23:06:27.137715+0000","last_undegraded":"2024-09-11T23:06:27.137715+0000","last_fullsized":"2024-09-11T23:06:27.137715+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:14.299548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.135858+0000","last_change":"2024-09-11T23:06:26.030395+0000","last_active":"2024-09-11T23:06:27.135858+0000","last_peered":"2024-09-11T23:06:27.135858+0000","last_clean":"2024-09-11T23:06:27.135858+0000","last_became_active":"2024-09-11T23:06:26.030131+0000","last_became_peered":"2024-09-11T23:06:26.030131+0000","last_unstale":"2024-09-11T23:06:27.135858+0000","last_undegraded":"2024-09-11T23:06:27.135858+0000","last_fullsized":"2024-09-11T23:06:27.135858+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:55.047279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.136434+0000","last_change":"2024-09-11T23:06:26.017145+0000","last_active":"2024-09-11T23:06:27.136434+0000","last_peered":"2024-09-11T23:06:27.136434+0000","last_clean":"2024-09-11T23:06:27.136434+0000","last_became_active":"2024-09-11T23:06:26.016174+0000","last_became_peered":"2024-09-11T23:06:26.016174+0000","last_unstale":"2024-09-11T23:06:27.136434+0000","last_undegraded":"2024-09-11T23:06:27.136434+0000","last_fullsized":"2024-09-11T23:06:27.136434+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:58:46.438133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.000017+0000","last_change":"2024-09-11T23:06:26.020675+0000","last_active":"2024-09-11T23:06:27.000017+0000","last_peered":"2024-09-11T23:06:27.000017+0000","last_clean":"2024-09-11T23:06:27.000017+0000","last_became_active":"2024-09-11T23:06:26.019768+0000","last_became_peered":"2024-09-11T23:06:26.019768+0000","last_unstale":"2024-09-11T23:06:27.000017+0000","last_undegraded":"2024-09-11T23:06:27.000017+0000","last_fullsized":"2024-09-11T23:06:27.000017+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:09.269690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:26.999519+0000","last_change":"2024-09-11T23:06:26.003016+0000","last_active":"2024-09-11T23:06:26.999519+0000","last_peered":"2024-09-11T23:06:26.999519+0000","last_clean":"2024-09-11T23:06:26.999519+0000","last_became_active":"2024-09-11T23:06:26.002158+0000","last_became_peered":"2024-09-11T23:06:26.002158+0000","last_unstale":"2024-09-11T23:06:26.999519+0000","last_undegraded":"2024-09-11T23:06:26.999519+0000","last_fullsized":"2024-09-11T23:06:26.999519+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:22.899419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.145687+0000","last_change":"2024-09-11T23:06:26.027518+0000","last_active":"2024-09-11T23:06:27.145687+0000","last_peered":"2024-09-11T23:06:27.145687+0000","last_clean":"2024-09-11T23:06:27.145687+0000","last_became_active":"2024-09-11T23:06:26.026993+0000","last_became_peered":"2024-09-11T23:06:26.026993+0000","last_unstale":"2024-09-11T23:06:27.145687+0000","last_undegraded":"2024-09-11T23:06:27.145687+0000","last_fullsized":"2024-09-11T23:06:27.145687+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:37.103317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"64'4","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.145622+0000","last_change":"2024-09-11T23:06:25.016768+0000","last_active":"2024-09-11T23:06:27.145622+0000","last_peered":"2024-09-11T23:06:27.145622+0000","last_clean":"2024-09-11T23:06:27.145622+0000","last_became_active":"2024-09-11T23:06:25.016123+0000","last_became_peered":"2024-09-11T23:06:25.016123+0000","last_unstale":"2024-09-11T23:06:27.145622+0000","last_undegraded":"2024-09-11T23:06:27.145622+0000","last_fullsized":"2024-09-11T23:06:27.145622+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:04.146333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.137178+0000","last_change":"2024-09-11T23:06:26.003148+0000","last_active":"2024-09-11T23:06:27.137178+0000","last_peered":"2024-09-11T23:06:27.137178+0000","last_clean":"2024-09-11T23:06:27.137178+0000","last_became_active":"2024-09-11T23:06:26.001833+0000","last_became_peered":"2024-09-11T23:06:26.001833+0000","last_unstale":"2024-09-11T23:06:27.137178+0000","last_undegraded":"2024-09-11T23:06:27.137178+0000","last_fullsized":"2024-09-11T23:06:27.137178+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:35.598472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1e","version":"64'1","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.002132+0000","last_change":"2024-09-11T23:06:25.013858+0000","last_active":"2024-09-11T23:06:27.002132+0000","last_peered":"2024-09-11T23:06:27.002132+0000","last_clean":"2024-09-11T23:06:27.002132+0000","last_became_active":"2024-09-11T23:06:25.013140+0000","last_became_peered":"2024-09-11T23:06:25.013140+0000","last_unstale":"2024-09-11T23:06:27.002132+0000","last_undegraded":"2024-09-11T23:06:27.002132+0000","last_fullsized":"2024-09-11T23:06:27.002132+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:17.538852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.144939+0000","last_change":"2024-09-11T23:06:26.022201+0000","last_active":"2024-09-11T23:06:27.144939+0000","last_peered":"2024-09-11T23:06:27.144939+0000","last_clean":"2024-09-11T23:06:27.144939+0000","last_became_active":"2024-09-11T23:06:26.021034+0000","last_became_peered":"2024-09-11T23:06:26.021034+0000","last_unstale":"2024-09-11T23:06:27.144939+0000","last_undegraded":"2024-09-11T23:06:27.144939+0000","last_fullsized":"2024-09-11T23:06:27.144939+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:49:37.446280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1d","version":"64'2","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.145442+0000","last_change":"2024-09-11T23:06:25.018159+0000","last_active":"2024-09-11T23:06:27.145442+0000","last_peered":"2024-09-11T23:06:27.145442+0000","last_clean":"2024-09-11T23:06:27.145442+0000","last_became_active":"2024-09-11T23:06:25.017754+0000","last_became_peered":"2024-09-11T23:06:25.017754+0000","last_unstale":"2024-09-11T23:06:27.145442+0000","last_undegraded":"2024-09-11T23:06:27.145442+0000","last_fullsized":"2024-09-11T23:06:27.145442+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:03.577610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.137156+0000","last_change":"2024-09-11T23:06:26.006696+0000","last_active":"2024-09-11T23:06:27.137156+0000","last_peered":"2024-09-11T23:06:27.137156+0000","last_clean":"2024-09-11T23:06:27.137156+0000","last_became_active":"2024-09-11T23:06:26.003115+0000","last_became_peered":"2024-09-11T23:06:26.003115+0000","last_unstale":"2024-09-11T23:06:27.137156+0000","last_undegraded":"2024-09-11T23:06:27.137156+0000","last_fullsized":"2024-09-11T23:06:27.137156+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:26.600469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1c","version":"64'2","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.145942+0000","last_change":"2024-09-11T23:06:25.015931+0000","last_active":"2024-09-11T23:06:27.145942+0000","last_peered":"2024-09-11T23:06:27.145942+0000","last_clean":"2024-09-11T23:06:27.145942+0000","last_became_active":"2024-09-11T23:06:25.015171+0000","last_became_peered":"2024-09-11T23:06:25.015171+0000","last_unstale":"2024-09-11T23:06:27.145942+0000","last_undegraded":"2024-09-11T23:06:27.145942+0000","last_fullsized":"2024-09-11T23:06:27.145942+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:07.307662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.137076+0000","last_change":"2024-09-11T23:06:26.017177+0000","last_active":"2024-09-11T23:06:27.137076+0000","last_peered":"2024-09-11T23:06:27.137076+0000","last_clean":"2024-09-11T23:06:27.137076+0000","last_became_active":"2024-09-11T23:06:26.016765+0000","last_became_peered":"2024-09-11T23:06:26.016765+0000","last_unstale":"2024-09-11T23:06:27.137076+0000","last_undegraded":"2024-09-11T23:06:27.137076+0000","last_fullsized":"2024-09-11T23:06:27.137076+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:35.908813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"64'1","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.145370+0000","last_change":"2024-09-11T23:06:25.011931+0000","last_active":"2024-09-11T23:06:27.145370+0000","last_peered":"2024-09-11T23:06:27.145370+0000","last_clean":"2024-09-11T23:06:27.145370+0000","last_became_active":"2024-09-11T23:06:25.011590+0000","last_became_peered":"2024-09-11T23:06:25.011590+0000","last_unstale":"2024-09-11T23:06:27.145370+0000","last_undegraded":"2024-09-11T23:06:27.145370+0000","last_fullsized":"2024-09-11T23:06:27.145370+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:36.315943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.001497+0000","last_change":"2024-09-11T23:06:26.030111+0000","last_active":"2024-09-11T23:06:27.001497+0000","last_peered":"2024-09-11T23:06:27.001497+0000","last_clean":"2024-09-11T23:06:27.001497+0000","last_became_active":"2024-09-11T23:06:26.029590+0000","last_became_peered":"2024-09-11T23:06:26.029590+0000","last_unstale":"2024-09-11T23:06:27.001497+0000","last_undegraded":"2024-09-11T23:06:27.001497+0000","last_fullsized":"2024-09-11T23:06:27.001497+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:36.348583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1a","version":"64'1","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.001353+0000","last_change":"2024-09-11T23:06:25.015710+0000","last_active":"2024-09-11T23:06:27.001353+0000","last_peered":"2024-09-11T23:06:27.001353+0000","last_clean":"2024-09-11T23:06:27.001353+0000","last_became_active":"2024-09-11T23:06:25.014570+0000","last_became_peered":"2024-09-11T23:06:25.014570+0000","last_unstale":"2024-09-11T23:06:27.001353+0000","last_undegraded":"2024-09-11T23:06:27.001353+0000","last_fullsized":"2024-09-11T23:06:27.001353+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:57.139220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.135506+0000","last_change":"2024-09-11T23:06:26.006929+0000","last_active":"2024-09-11T23:06:27.135506+0000","last_peered":"2024-09-11T23:06:27.135506+0000","last_clean":"2024-09-11T23:06:27.135506+0000","last_became_active":"2024-09-11T23:06:26.006576+0000","last_became_peered":"2024-09-11T23:06:26.006576+0000","last_unstale":"2024-09-11T23:06:27.135506+0000","last_undegraded":"2024-09-11T23:06:27.135506+0000","last_fullsized":"2024-09-11T23:06:27.135506+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:23:12.494003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.144249+0000","last_change":"2024-09-11T23:06:25.006580+0000","last_active":"2024-09-11T23:06:27.144249+0000","last_peered":"2024-09-11T23:06:27.144249+0000","last_clean":"2024-09-11T23:06:27.144249+0000","last_became_active":"2024-09-11T23:06:25.006148+0000","last_became_peered":"2024-09-11T23:06:25.006148+0000","last_unstale":"2024-09-11T23:06:27.144249+0000","last_undegraded":"2024-09-11T23:06:27.144249+0000","last_fullsized":"2024-09-11T23:06:27.144249+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:37.667542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:26.999793+0000","last_change":"2024-09-11T23:06:26.013511+0000","last_active":"2024-09-11T23:06:26.999793+0000","last_peered":"2024-09-11T23:06:26.999793+0000","last_clean":"2024-09-11T23:06:26.999793+0000","last_became_active":"2024-09-11T23:06:26.013240+0000","last_became_peered":"2024-09-11T23:06:26.013240+0000","last_unstale":"2024-09-11T23:06:26.999793+0000","last_undegraded":"2024-09-11T23:06:26.999793+0000","last_fullsized":"2024-09-11T23:06:26.999793+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:02.516639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.136311+0000","last_change":"2024-09-11T23:06:25.007755+0000","last_active":"2024-09-11T23:06:27.136311+0000","last_peered":"2024-09-11T23:06:27.136311+0000","last_clean":"2024-09-11T23:06:27.136311+0000","last_became_active":"2024-09-11T23:06:25.007322+0000","last_became_peered":"2024-09-11T23:06:25.007322+0000","last_unstale":"2024-09-11T23:06:27.136311+0000","last_undegraded":"2024-09-11T23:06:27.136311+0000","last_fullsized":"2024-09-11T23:06:27.136311+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:10.138407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.146320+0000","last_change":"2024-09-11T23:06:26.024676+0000","last_active":"2024-09-11T23:06:27.146320+0000","last_peered":"2024-09-11T23:06:27.146320+0000","last_clean":"2024-09-11T23:06:27.146320+0000","last_became_active":"2024-09-11T23:06:26.024187+0000","last_became_peered":"2024-09-11T23:06:26.024187+0000","last_unstale":"2024-09-11T23:06:27.146320+0000","last_undegraded":"2024-09-11T23:06:27.146320+0000","last_fullsized":"2024-09-11T23:06:27.146320+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:12.991278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.137386+0000","last_change":"2024-09-11T23:06:25.009487+0000","last_active":"2024-09-11T23:06:27.137386+0000","last_peered":"2024-09-11T23:06:27.137386+0000","last_clean":"2024-09-11T23:06:27.137386+0000","last_became_active":"2024-09-11T23:06:25.008766+0000","last_became_peered":"2024-09-11T23:06:25.008766+0000","last_unstale":"2024-09-11T23:06:27.137386+0000","last_undegraded":"2024-09-11T23:06:27.137386+0000","last_fullsized":"2024-09-11T23:06:27.137386+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:48:55.422759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.137236+0000","last_change":"2024-09-11T23:06:26.002914+0000","last_active":"2024-09-11T23:06:27.137236+0000","last_peered":"2024-09-11T23:06:27.137236+0000","last_clean":"2024-09-11T23:06:27.137236+0000","last_became_active":"2024-09-11T23:06:26.001152+0000","last_became_peered":"2024-09-11T23:06:26.001152+0000","last_unstale":"2024-09-11T23:06:27.137236+0000","last_undegraded":"2024-09-11T23:06:27.137236+0000","last_fullsized":"2024-09-11T23:06:27.137236+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:28.697535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.002391+0000","last_change":"2024-09-11T23:06:25.013525+0000","last_active":"2024-09-11T23:06:27.002391+0000","last_peered":"2024-09-11T23:06:27.002391+0000","last_clean":"2024-09-11T23:06:27.002391+0000","last_became_active":"2024-09-11T23:06:25.012659+0000","last_became_peered":"2024-09-11T23:06:25.012659+0000","last_unstale":"2024-09-11T23:06:27.002391+0000","last_undegraded":"2024-09-11T23:06:27.002391+0000","last_fullsized":"2024-09-11T23:06:27.002391+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:25.295858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.146734+0000","last_change":"2024-09-11T23:06:26.013871+0000","last_active":"2024-09-11T23:06:27.146734+0000","last_peered":"2024-09-11T23:06:27.146734+0000","last_clean":"2024-09-11T23:06:27.146734+0000","last_became_active":"2024-09-11T23:06:26.009171+0000","last_became_peered":"2024-09-11T23:06:26.009171+0000","last_unstale":"2024-09-11T23:06:27.146734+0000","last_undegraded":"2024-09-11T23:06:27.146734+0000","last_fullsized":"2024-09-11T23:06:27.146734+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:46.344469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"64'3","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.137160+0000","last_change":"2024-09-11T23:06:25.013297+0000","last_active":"2024-09-11T23:06:27.137160+0000","last_peered":"2024-09-11T23:06:27.137160+0000","last_clean":"2024-09-11T23:06:27.137160+0000","last_became_active":"2024-09-11T23:06:25.012853+0000","last_became_peered":"2024-09-11T23:06:25.012853+0000","last_unstale":"2024-09-11T23:06:27.137160+0000","last_undegraded":"2024-09-11T23:06:27.137160+0000","last_fullsized":"2024-09-11T23:06:27.137160+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:34.721113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.000632+0000","last_change":"2024-09-11T23:06:26.022505+0000","last_active":"2024-09-11T23:06:27.000632+0000","last_peered":"2024-09-11T23:06:27.000632+0000","last_clean":"2024-09-11T23:06:27.000632+0000","last_became_active":"2024-09-11T23:06:26.019821+0000","last_became_peered":"2024-09-11T23:06:26.019821+0000","last_unstale":"2024-09-11T23:06:27.000632+0000","last_undegraded":"2024-09-11T23:06:27.000632+0000","last_fullsized":"2024-09-11T23:06:27.000632+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:22.399140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.14","version":"64'6","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.146218+0000","last_change":"2024-09-11T23:06:25.016215+0000","last_active":"2024-09-11T23:06:27.146218+0000","last_peered":"2024-09-11T23:06:27.146218+0000","last_clean":"2024-09-11T23:06:27.146218+0000","last_became_active":"2024-09-11T23:06:25.015590+0000","last_became_peered":"2024-09-11T23:06:25.015590+0000","last_unstale":"2024-09-11T23:06:27.146218+0000","last_undegraded":"2024-09-11T23:06:27.146218+0000","last_fullsized":"2024-09-11T23:06:27.146218+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:40:49.945457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.144399+0000","last_change":"2024-09-11T23:06:26.021397+0000","last_active":"2024-09-11T23:06:27.144399+0000","last_peered":"2024-09-11T23:06:27.144399+0000","last_clean":"2024-09-11T23:06:27.144399+0000","last_became_active":"2024-09-11T23:06:26.020998+0000","last_became_peered":"2024-09-11T23:06:26.020998+0000","last_unstale":"2024-09-11T23:06:27.144399+0000","last_undegraded":"2024-09-11T23:06:27.144399+0000","last_fullsized":"2024-09-11T23:06:27.144399+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:14.658630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"64'2","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.136105+0000","last_change":"2024-09-11T23:06:25.016390+0000","last_active":"2024-09-11T23:06:27.136105+0000","last_peered":"2024-09-11T23:06:27.136105+0000","last_clean":"2024-09-11T23:06:27.136105+0000","last_became_active":"2024-09-11T23:06:25.016129+0000","last_became_peered":"2024-09-11T23:06:25.016129+0000","last_unstale":"2024-09-11T23:06:27.136105+0000","last_undegraded":"2024-09-11T23:06:27.136105+0000","last_fullsized":"2024-09-11T23:06:27.136105+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:19.654737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.135957+0000","last_change":"2024-09-11T23:06:26.029895+0000","last_active":"2024-09-11T23:06:27.135957+0000","last_peered":"2024-09-11T23:06:27.135957+0000","last_clean":"2024-09-11T23:06:27.135957+0000","last_became_active":"2024-09-11T23:06:26.029365+0000","last_became_peered":"2024-09-11T23:06:26.029365+0000","last_unstale":"2024-09-11T23:06:27.135957+0000","last_undegraded":"2024-09-11T23:06:27.135957+0000","last_fullsized":"2024-09-11T23:06:27.135957+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:55.742076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.144457+0000","last_change":"2024-09-11T23:06:25.012067+0000","last_active":"2024-09-11T23:06:27.144457+0000","last_peered":"2024-09-11T23:06:27.144457+0000","last_clean":"2024-09-11T23:06:27.144457+0000","last_became_active":"2024-09-11T23:06:25.011656+0000","last_became_peered":"2024-09-11T23:06:25.011656+0000","last_unstale":"2024-09-11T23:06:27.144457+0000","last_undegraded":"2024-09-11T23:06:27.144457+0000","last_fullsized":"2024-09-11T23:06:27.144457+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:22.090462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.137585+0000","last_change":"2024-09-11T23:06:26.002665+0000","last_active":"2024-09-11T23:06:27.137585+0000","last_peered":"2024-09-11T23:06:27.137585+0000","last_clean":"2024-09-11T23:06:27.137585+0000","last_became_active":"2024-09-11T23:06:26.001480+0000","last_became_peered":"2024-09-11T23:06:26.001480+0000","last_unstale":"2024-09-11T23:06:27.137585+0000","last_undegraded":"2024-09-11T23:06:27.137585+0000","last_fullsized":"2024-09-11T23:06:27.137585+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:46.022278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:26.999890+0000","last_change":"2024-09-11T23:06:25.011344+0000","last_active":"2024-09-11T23:06:26.999890+0000","last_peered":"2024-09-11T23:06:26.999890+0000","last_clean":"2024-09-11T23:06:26.999890+0000","last_became_active":"2024-09-11T23:06:25.010944+0000","last_became_peered":"2024-09-11T23:06:25.010944+0000","last_unstale":"2024-09-11T23:06:26.999890+0000","last_undegraded":"2024-09-11T23:06:26.999890+0000","last_fullsized":"2024-09-11T23:06:26.999890+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:15.979164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.136556+0000","last_change":"2024-09-11T23:06:26.028578+0000","last_active":"2024-09-11T23:06:27.136556+0000","last_peered":"2024-09-11T23:06:27.136556+0000","last_clean":"2024-09-11T23:06:27.136556+0000","last_became_active":"2024-09-11T23:06:26.028258+0000","last_became_peered":"2024-09-11T23:06:26.028258+0000","last_unstale":"2024-09-11T23:06:27.136556+0000","last_undegraded":"2024-09-11T23:06:27.136556+0000","last_fullsized":"2024-09-11T23:06:27.136556+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:46.980988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"64'8","reported_seq":22,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.143626+0000","last_change":"2024-09-11T23:06:25.012217+0000","last_active":"2024-09-11T23:06:27.143626+0000","last_peered":"2024-09-11T23:06:27.143626+0000","last_clean":"2024-09-11T23:06:27.143626+0000","last_became_active":"2024-09-11T23:06:25.011817+0000","last_became_peered":"2024-09-11T23:06:25.011817+0000","last_unstale":"2024-09-11T23:06:27.143626+0000","last_undegraded":"2024-09-11T23:06:27.143626+0000","last_fullsized":"2024-09-11T23:06:27.143626+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:17.505341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.146102+0000","last_change":"2024-09-11T23:06:26.021760+0000","last_active":"2024-09-11T23:06:27.146102+0000","last_peered":"2024-09-11T23:06:27.146102+0000","last_clean":"2024-09-11T23:06:27.146102+0000","last_became_active":"2024-09-11T23:06:26.019811+0000","last_became_peered":"2024-09-11T23:06:26.019811+0000","last_unstale":"2024-09-11T23:06:27.146102+0000","last_undegraded":"2024-09-11T23:06:27.146102+0000","last_fullsized":"2024-09-11T23:06:27.146102+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:55.641339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"64'1","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.145920+0000","last_change":"2024-09-11T23:06:25.016554+0000","last_active":"2024-09-11T23:06:27.145920+0000","last_peered":"2024-09-11T23:06:27.145920+0000","last_clean":"2024-09-11T23:06:27.145920+0000","last_became_active":"2024-09-11T23:06:25.015765+0000","last_became_peered":"2024-09-11T23:06:25.015765+0000","last_unstale":"2024-09-11T23:06:27.145920+0000","last_undegraded":"2024-09-11T23:06:27.145920+0000","last_fullsized":"2024-09-11T23:06:27.145920+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:53.950650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.002826+0000","last_change":"2024-09-11T23:06:26.020318+0000","last_active":"2024-09-11T23:06:27.002826+0000","last_peered":"2024-09-11T23:06:27.002826+0000","last_clean":"2024-09-11T23:06:27.002826+0000","last_became_active":"2024-09-11T23:06:26.018478+0000","last_became_peered":"2024-09-11T23:06:26.018478+0000","last_unstale":"2024-09-11T23:06:27.002826+0000","last_undegraded":"2024-09-11T23:06:27.002826+0000","last_fullsized":"2024-09-11T23:06:27.002826+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:18.514802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"64'2","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.146399+0000","last_change":"2024-09-11T23:06:25.014587+0000","last_active":"2024-09-11T23:06:27.146399+0000","last_peered":"2024-09-11T23:06:27.146399+0000","last_clean":"2024-09-11T23:06:27.146399+0000","last_became_active":"2024-09-11T23:06:25.014329+0000","last_became_peered":"2024-09-11T23:06:25.014329+0000","last_unstale":"2024-09-11T23:06:27.146399+0000","last_undegraded":"2024-09-11T23:06:27.146399+0000","last_fullsized":"2024-09-11T23:06:27.146399+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:45.159581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.145473+0000","last_change":"2024-09-11T23:06:26.020533+0000","last_active":"2024-09-11T23:06:27.145473+0000","last_peered":"2024-09-11T23:06:27.145473+0000","last_clean":"2024-09-11T23:06:27.145473+0000","last_became_active":"2024-09-11T23:06:26.020244+0000","last_became_peered":"2024-09-11T23:06:26.020244+0000","last_unstale":"2024-09-11T23:06:27.145473+0000","last_undegraded":"2024-09-11T23:06:27.145473+0000","last_fullsized":"2024-09-11T23:06:27.145473+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:21.771740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.146476+0000","last_change":"2024-09-11T23:06:25.013336+0000","last_active":"2024-09-11T23:06:27.146476+0000","last_peered":"2024-09-11T23:06:27.146476+0000","last_clean":"2024-09-11T23:06:27.146476+0000","last_became_active":"2024-09-11T23:06:25.013012+0000","last_became_peered":"2024-09-11T23:06:25.013012+0000","last_unstale":"2024-09-11T23:06:27.146476+0000","last_undegraded":"2024-09-11T23:06:27.146476+0000","last_fullsized":"2024-09-11T23:06:27.146476+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:06.214376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.001342+0000","last_change":"2024-09-11T23:06:26.014175+0000","last_active":"2024-09-11T23:06:27.001342+0000","last_peered":"2024-09-11T23:06:27.001342+0000","last_clean":"2024-09-11T23:06:27.001342+0000","last_became_active":"2024-09-11T23:06:26.013915+0000","last_became_peered":"2024-09-11T23:06:26.013915+0000","last_unstale":"2024-09-11T23:06:27.001342+0000","last_undegraded":"2024-09-11T23:06:27.001342+0000","last_fullsized":"2024-09-11T23:06:27.001342+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:40.747910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"64'2","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.145647+0000","last_change":"2024-09-11T23:06:25.016759+0000","last_active":"2024-09-11T23:06:27.145647+0000","last_peered":"2024-09-11T23:06:27.145647+0000","last_clean":"2024-09-11T23:06:27.145647+0000","last_became_active":"2024-09-11T23:06:25.016034+0000","last_became_peered":"2024-09-11T23:06:25.016034+0000","last_unstale":"2024-09-11T23:06:27.145647+0000","last_undegraded":"2024-09-11T23:06:27.145647+0000","last_fullsized":"2024-09-11T23:06:27.145647+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:31.499827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.001746+0000","last_change":"2024-09-11T23:06:26.029956+0000","last_active":"2024-09-11T23:06:27.001746+0000","last_peered":"2024-09-11T23:06:27.001746+0000","last_clean":"2024-09-11T23:06:27.001746+0000","last_became_active":"2024-09-11T23:06:26.029363+0000","last_became_peered":"2024-09-11T23:06:26.029363+0000","last_unstale":"2024-09-11T23:06:27.001746+0000","last_undegraded":"2024-09-11T23:06:27.001746+0000","last_fullsized":"2024-09-11T23:06:27.001746+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:02.761416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.001391+0000","last_change":"2024-09-11T23:06:25.016215+0000","last_active":"2024-09-11T23:06:27.001391+0000","last_peered":"2024-09-11T23:06:27.001391+0000","last_clean":"2024-09-11T23:06:27.001391+0000","last_became_active":"2024-09-11T23:06:25.015403+0000","last_became_peered":"2024-09-11T23:06:25.015403+0000","last_unstale":"2024-09-11T23:06:27.001391+0000","last_undegraded":"2024-09-11T23:06:27.001391+0000","last_fullsized":"2024-09-11T23:06:27.001391+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:12.175093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:26.999631+0000","last_change":"2024-09-11T23:06:26.005567+0000","last_active":"2024-09-11T23:06:26.999631+0000","last_peered":"2024-09-11T23:06:26.999631+0000","last_clean":"2024-09-11T23:06:26.999631+0000","last_became_active":"2024-09-11T23:06:26.004804+0000","last_became_peered":"2024-09-11T23:06:26.004804+0000","last_unstale":"2024-09-11T23:06:26.999631+0000","last_undegraded":"2024-09-11T23:06:26.999631+0000","last_fullsized":"2024-09-11T23:06:26.999631+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:14.299548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:26.999982+0000","last_change":"2024-09-11T23:06:25.012104+0000","last_active":"2024-09-11T23:06:26.999982+0000","last_peered":"2024-09-11T23:06:26.999982+0000","last_clean":"2024-09-11T23:06:26.999982+0000","last_became_active":"2024-09-11T23:06:25.011687+0000","last_became_peered":"2024-09-11T23:06:25.011687+0000","last_unstale":"2024-09-11T23:06:26.999982+0000","last_undegraded":"2024-09-11T23:06:26.999982+0000","last_fullsized":"2024-09-11T23:06:26.999982+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:58.195654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.143948+0000","last_change":"2024-09-11T23:06:26.014617+0000","last_active":"2024-09-11T23:06:27.143948+0000","last_peered":"2024-09-11T23:06:27.143948+0000","last_clean":"2024-09-11T23:06:27.143948+0000","last_became_active":"2024-09-11T23:06:26.009266+0000","last_became_peered":"2024-09-11T23:06:26.009266+0000","last_unstale":"2024-09-11T23:06:27.143948+0000","last_undegraded":"2024-09-11T23:06:27.143948+0000","last_fullsized":"2024-09-11T23:06:27.143948+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:57.651844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:26.999745+0000","last_change":"2024-09-11T23:06:25.012605+0000","last_active":"2024-09-11T23:06:26.999745+0000","last_peered":"2024-09-11T23:06:26.999745+0000","last_clean":"2024-09-11T23:06:26.999745+0000","last_became_active":"2024-09-11T23:06:25.012288+0000","last_became_peered":"2024-09-11T23:06:25.012288+0000","last_unstale":"2024-09-11T23:06:26.999745+0000","last_undegraded":"2024-09-11T23:06:26.999745+0000","last_fullsized":"2024-09-11T23:06:26.999745+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:34.381828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.146338+0000","last_change":"2024-09-11T23:06:26.021449+0000","last_active":"2024-09-11T23:06:27.146338+0000","last_peered":"2024-09-11T23:06:27.146338+0000","last_clean":"2024-09-11T23:06:27.146338+0000","last_became_active":"2024-09-11T23:06:26.019757+0000","last_became_peered":"2024-09-11T23:06:26.019757+0000","last_unstale":"2024-09-11T23:06:27.146338+0000","last_undegraded":"2024-09-11T23:06:27.146338+0000","last_fullsized":"2024-09-11T23:06:27.146338+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:03.170800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.7","version":"64'2","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.137657+0000","last_change":"2024-09-11T23:06:25.009188+0000","last_active":"2024-09-11T23:06:27.137657+0000","last_peered":"2024-09-11T23:06:27.137657+0000","last_clean":"2024-09-11T23:06:27.137657+0000","last_became_active":"2024-09-11T23:06:25.008182+0000","last_became_peered":"2024-09-11T23:06:25.008182+0000","last_unstale":"2024-09-11T23:06:27.137657+0000","last_undegraded":"2024-09-11T23:06:27.137657+0000","last_fullsized":"2024-09-11T23:06:27.137657+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:18:33.144721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.137602+0000","last_change":"2024-09-11T23:06:26.024344+0000","last_active":"2024-09-11T23:06:27.137602+0000","last_peered":"2024-09-11T23:06:27.137602+0000","last_clean":"2024-09-11T23:06:27.137602+0000","last_became_active":"2024-09-11T23:06:26.023883+0000","last_became_peered":"2024-09-11T23:06:26.023883+0000","last_unstale":"2024-09-11T23:06:27.137602+0000","last_undegraded":"2024-09-11T23:06:27.137602+0000","last_fullsized":"2024-09-11T23:06:27.137602+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:22.278385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.6","version":"65'1","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.138090+0000","last_change":"2024-09-11T23:06:25.018398+0000","last_active":"2024-09-11T23:06:27.138090+0000","last_peered":"2024-09-11T23:06:27.138090+0000","last_clean":"2024-09-11T23:06:27.138090+0000","last_became_active":"2024-09-11T23:06:25.018128+0000","last_became_peered":"2024-09-11T23:06:25.018128+0000","last_unstale":"2024-09-11T23:06:27.138090+0000","last_undegraded":"2024-09-11T23:06:27.138090+0000","last_fullsized":"2024-09-11T23:06:27.138090+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:05.872395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.145806+0000","last_change":"2024-09-11T23:06:26.009028+0000","last_active":"2024-09-11T23:06:27.145806+0000","last_peered":"2024-09-11T23:06:27.145806+0000","last_clean":"2024-09-11T23:06:27.145806+0000","last_became_active":"2024-09-11T23:06:26.004349+0000","last_became_peered":"2024-09-11T23:06:26.004349+0000","last_unstale":"2024-09-11T23:06:27.145806+0000","last_undegraded":"2024-09-11T23:06:27.145806+0000","last_fullsized":"2024-09-11T23:06:27.145806+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:48.099513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.145604+0000","last_change":"2024-09-11T23:06:25.017795+0000","last_active":"2024-09-11T23:06:27.145604+0000","last_peered":"2024-09-11T23:06:27.145604+0000","last_clean":"2024-09-11T23:06:27.145604+0000","last_became_active":"2024-09-11T23:06:25.017424+0000","last_became_peered":"2024-09-11T23:06:25.017424+0000","last_unstale":"2024-09-11T23:06:27.145604+0000","last_undegraded":"2024-09-11T23:06:27.145604+0000","last_fullsized":"2024-09-11T23:06:27.145604+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:19.138328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.000779+0000","last_change":"2024-09-11T23:06:26.022731+0000","last_active":"2024-09-11T23:06:27.000779+0000","last_peered":"2024-09-11T23:06:27.000779+0000","last_clean":"2024-09-11T23:06:27.000779+0000","last_became_active":"2024-09-11T23:06:26.020383+0000","last_became_peered":"2024-09-11T23:06:26.020383+0000","last_unstale":"2024-09-11T23:06:27.000779+0000","last_undegraded":"2024-09-11T23:06:27.000779+0000","last_fullsized":"2024-09-11T23:06:27.000779+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:25:55.655328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.000410+0000","last_change":"2024-09-11T23:06:25.014290+0000","last_active":"2024-09-11T23:06:27.000410+0000","last_peered":"2024-09-11T23:06:27.000410+0000","last_clean":"2024-09-11T23:06:27.000410+0000","last_became_active":"2024-09-11T23:06:25.011669+0000","last_became_peered":"2024-09-11T23:06:25.011669+0000","last_unstale":"2024-09-11T23:06:27.000410+0000","last_undegraded":"2024-09-11T23:06:27.000410+0000","last_fullsized":"2024-09-11T23:06:27.000410+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:00.835163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.137251+0000","last_change":"2024-09-11T23:06:26.001681+0000","last_active":"2024-09-11T23:06:27.137251+0000","last_peered":"2024-09-11T23:06:27.137251+0000","last_clean":"2024-09-11T23:06:27.137251+0000","last_became_active":"2024-09-11T23:06:26.001383+0000","last_became_peered":"2024-09-11T23:06:26.001383+0000","last_unstale":"2024-09-11T23:06:27.137251+0000","last_undegraded":"2024-09-11T23:06:27.137251+0000","last_fullsized":"2024-09-11T23:06:27.137251+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:55.774612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.145869+0000","last_change":"2024-09-11T23:06:25.016430+0000","last_active":"2024-09-11T23:06:27.145869+0000","last_peered":"2024-09-11T23:06:27.145869+0000","last_clean":"2024-09-11T23:06:27.145869+0000","last_became_active":"2024-09-11T23:06:25.015512+0000","last_became_peered":"2024-09-11T23:06:25.015512+0000","last_unstale":"2024-09-11T23:06:27.145869+0000","last_undegraded":"2024-09-11T23:06:27.145869+0000","last_fullsized":"2024-09-11T23:06:27.145869+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:11.718895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.145208+0000","last_change":"2024-09-11T23:06:26.022753+0000","last_active":"2024-09-11T23:06:27.145208+0000","last_peered":"2024-09-11T23:06:27.145208+0000","last_clean":"2024-09-11T23:06:27.145208+0000","last_became_active":"2024-09-11T23:06:26.011701+0000","last_became_peered":"2024-09-11T23:06:26.011701+0000","last_unstale":"2024-09-11T23:06:27.145208+0000","last_undegraded":"2024-09-11T23:06:27.145208+0000","last_fullsized":"2024-09-11T23:06:27.145208+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:59:23.639279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.001475+0000","last_change":"2024-09-11T23:06:25.015961+0000","last_active":"2024-09-11T23:06:27.001475+0000","last_peered":"2024-09-11T23:06:27.001475+0000","last_clean":"2024-09-11T23:06:27.001475+0000","last_became_active":"2024-09-11T23:06:25.014998+0000","last_became_peered":"2024-09-11T23:06:25.014998+0000","last_unstale":"2024-09-11T23:06:27.001475+0000","last_undegraded":"2024-09-11T23:06:27.001475+0000","last_fullsized":"2024-09-11T23:06:27.001475+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:02.934025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.135966+0000","last_change":"2024-09-11T23:06:26.002258+0000","last_active":"2024-09-11T23:06:27.135966+0000","last_peered":"2024-09-11T23:06:27.135966+0000","last_clean":"2024-09-11T23:06:27.135966+0000","last_became_active":"2024-09-11T23:06:26.001013+0000","last_became_peered":"2024-09-11T23:06:26.001013+0000","last_unstale":"2024-09-11T23:06:27.135966+0000","last_undegraded":"2024-09-11T23:06:27.135966+0000","last_fullsized":"2024-09-11T23:06:27.135966+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:57.233238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.136212+0000","last_change":"2024-09-11T23:06:25.015268+0000","last_active":"2024-09-11T23:06:27.136212+0000","last_peered":"2024-09-11T23:06:27.136212+0000","last_clean":"2024-09-11T23:06:27.136212+0000","last_became_active":"2024-09-11T23:06:25.015020+0000","last_became_peered":"2024-09-11T23:06:25.015020+0000","last_unstale":"2024-09-11T23:06:27.136212+0000","last_undegraded":"2024-09-11T23:06:27.136212+0000","last_fullsized":"2024-09-11T23:06:27.136212+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:58.111448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.136082+0000","last_change":"2024-09-11T23:06:26.016804+0000","last_active":"2024-09-11T23:06:27.136082+0000","last_peered":"2024-09-11T23:06:27.136082+0000","last_clean":"2024-09-11T23:06:27.136082+0000","last_became_active":"2024-09-11T23:06:26.016334+0000","last_became_peered":"2024-09-11T23:06:26.016334+0000","last_unstale":"2024-09-11T23:06:27.136082+0000","last_undegraded":"2024-09-11T23:06:27.136082+0000","last_fullsized":"2024-09-11T23:06:27.136082+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:37.794268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.143817+0000","last_change":"2024-09-11T23:06:25.007341+0000","last_active":"2024-09-11T23:06:27.143817+0000","last_peered":"2024-09-11T23:06:27.143817+0000","last_clean":"2024-09-11T23:06:27.143817+0000","last_became_active":"2024-09-11T23:06:25.005410+0000","last_became_peered":"2024-09-11T23:06:25.005410+0000","last_unstale":"2024-09-11T23:06:27.143817+0000","last_undegraded":"2024-09-11T23:06:27.143817+0000","last_fullsized":"2024-09-11T23:06:27.143817+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:34.528572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.137696+0000","last_change":"2024-09-11T23:06:26.025023+0000","last_active":"2024-09-11T23:06:27.137696+0000","last_peered":"2024-09-11T23:06:27.137696+0000","last_clean":"2024-09-11T23:06:27.137696+0000","last_became_active":"2024-09-11T23:06:26.023848+0000","last_became_peered":"2024-09-11T23:06:26.023848+0000","last_unstale":"2024-09-11T23:06:27.137696+0000","last_undegraded":"2024-09-11T23:06:27.137696+0000","last_fullsized":"2024-09-11T23:06:27.137696+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:24.967462+0000","last_clean_scrub_stamp":"2024-09-11T23:06:24.967462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:22.899419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"64'1","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:27.137309+0000","last_change":"2024-09-11T23:06:25.008645+0000","last_active":"2024-09-11T23:06:27.137309+0000","last_peered":"2024-09-11T23:06:27.137309+0000","last_clean":"2024-09-11T23:06:27.137309+0000","last_became_active":"2024-09-11T23:06:25.008186+0000","last_became_peered":"2024-09-11T23:06:25.008186+0000","last_unstale":"2024-09-11T23:06:27.137309+0000","last_undegraded":"2024-09-11T23:06:27.137309+0000","last_fullsized":"2024-09-11T23:06:27.137309+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:06:23.958001+0000","last_clean_scrub_stamp":"2024-09-11T23:06:23.958001+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:07.629486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"65'1854","reported_seq":2136,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-11T23:06:29.535789+0000","last_change":"2024-09-11T23:03:26.382905+0000","last_active":"2024-09-11T23:06:29.535789+0000","last_peered":"2024-09-11T23:06:29.535789+0000","last_clean":"2024-09-11T23:06:29.535789+0000","last_became_active":"2024-09-11T23:03:26.380590+0000","last_became_peered":"2024-09-11T23:03:26.380590+0000","last_unstale":"2024-09-11T23:06:29.535789+0000","last_undegraded":"2024-09-11T23:06:29.535789+0000","last_fullsized":"2024-09-11T23:06:29.535789+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:24.361793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:24.361793+0000","last_clean_scrub_stamp":"2024-09-11T23:03:24.361793+0000","objects_scrubbed":0,"log_size":1854,"log_dups_size":0,"ondisk_log_size":1854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:46.577063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":534,"num_read_kb":1018,"num_write":219,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":534,"num_read_kb":1018,"num_write":219,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1854,"ondisk_log_size":1854,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738406,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31816,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":643072,"data_stored":247190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738406,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36536,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335304,"statfs":{"total":96636764160,"available":96599351296,"internally_reserved":0,"allocated":1220608,"data_stored":835376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738406,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36548,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335292,"statfs":{"total":96636764160,"available":96599339008,"internally_reserved":0,"allocated":1232896,"data_stored":837432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:06:35.050 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T23:06:35.050 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-11T23:06:35.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.227+0000 7f956d133640 1 Processor -- start 2024-09-11T23:06:35.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.227+0000 7f956d133640 1 -- start start 2024-09-11T23:06:35.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.227+0000 7f956d133640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f956809d9f0 0x7f95680a1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:35.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.227+0000 7f956d133640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95680ac8a0 con 0x7f956809ddd0 2024-09-11T23:06:35.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.227+0000 7f956d133640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f95680a0200 con 0x7f956809d9f0 2024-09-11T23:06:35.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.227+0000 7f9566d9d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f956809d9f0 0x7f95680a1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:35.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.227+0000 7f956659c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f956809ddd0 0x7f956809e200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42086/0 (socket says 172.21.15.12:42086) 2024-09-11T23:06:35.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.227+0000 7f956659c640 1 -- 172.21.15.12:0/3257681700 learned_addr learned my addr 172.21.15.12:0/3257681700 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:35.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.231+0000 7f9565d9b640 1 -- 172.21.15.12:0/3257681700 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1029273685 0 0) 0x7f95680ac8a0 con 0x7f956809ddd0 2024-09-11T23:06:35.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.231+0000 7f9565d9b640 1 -- 172.21.15.12:0/3257681700 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9554003530 con 0x7f956809ddd0 2024-09-11T23:06:35.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.231+0000 7f9566d9d640 1 -- 172.21.15.12:0/3257681700 >> v1:172.21.15.12:6789/0 conn(0x7f956809ddd0 legacy=0x7f956809e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:35.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.231+0000 7f9566d9d640 1 -- 172.21.15.12:0/3257681700 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95680a0cb0 con 0x7f956809d9f0 2024-09-11T23:06:35.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.231+0000 7f9566d9d640 1 --2- 172.21.15.12:0/3257681700 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f956809d9f0 0x7f95680a1a00 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f9558009740 tx=0x7f955801c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bb4e44bb31d5074 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:35.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.231+0000 7f9565d9b640 1 -- 172.21.15.12:0/3257681700 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95580b0070 con 0x7f956809d9f0 2024-09-11T23:06:35.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.231+0000 7f9565d9b640 1 -- 172.21.15.12:0/3257681700 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95580ab530 con 0x7f956809d9f0 2024-09-11T23:06:35.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.231+0000 7f9565d9b640 1 -- 172.21.15.12:0/3257681700 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95580ab810 con 0x7f956809d9f0 2024-09-11T23:06:35.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.235+0000 7f956d133640 1 -- 172.21.15.12:0/3257681700 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f956809d9f0 msgr2=0x7f95680a1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:35.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.235+0000 7f956d133640 1 --2- 172.21.15.12:0/3257681700 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f956809d9f0 0x7f95680a1a00 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f9558009740 tx=0x7f955801c390 comp rx=0 tx=0).stop 2024-09-11T23:06:35.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.235+0000 7f956d133640 1 -- 172.21.15.12:0/3257681700 shutdown_connections 2024-09-11T23:06:35.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.235+0000 7f956d133640 1 --2- 172.21.15.12:0/3257681700 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f956809d9f0 0x7f95680a1a00 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:35.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.235+0000 7f956d133640 1 -- 172.21.15.12:0/3257681700 >> 172.21.15.12:0/3257681700 conn(0x7f956806d980 msgr2=0x7f956806dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:35.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.235+0000 7f956d133640 1 -- 172.21.15.12:0/3257681700 shutdown_connections 2024-09-11T23:06:35.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.235+0000 7f956d133640 1 -- 172.21.15.12:0/3257681700 wait complete. 2024-09-11T23:06:35.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.235+0000 7f956d133640 1 Processor -- start 2024-09-11T23:06:35.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.235+0000 7f956d133640 1 -- start start 2024-09-11T23:06:35.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.235+0000 7f956d133640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f956809d9f0 0x7f95680a6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:35.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.235+0000 7f956d133640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9568141ae0 con 0x7f956809d9f0 2024-09-11T23:06:35.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.235+0000 7f9566d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f956809d9f0 0x7f95680a6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:35.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.235+0000 7f9566d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f956809d9f0 0x7f95680a6c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49190/0 (socket says 172.21.15.12:49190) 2024-09-11T23:06:35.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.235+0000 7f9566d9d640 1 -- 172.21.15.12:0/532847221 learned_addr learned my addr 172.21.15.12:0/532847221 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:35.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.235+0000 7f9566d9d640 1 -- 172.21.15.12:0/532847221 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95680a6320 con 0x7f956809d9f0 2024-09-11T23:06:35.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.235+0000 7f9566d9d640 1 --2- 172.21.15.12:0/532847221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f956809d9f0 0x7f95680a6c00 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f95580ae040 tx=0x7f9558019130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:35.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.235+0000 7f955f7fe640 1 -- 172.21.15.12:0/532847221 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95580b8020 con 0x7f956809d9f0 2024-09-11T23:06:35.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.235+0000 7f955f7fe640 1 -- 172.21.15.12:0/532847221 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95580abdb0 con 0x7f956809d9f0 2024-09-11T23:06:35.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.235+0000 7f956d133640 1 -- 172.21.15.12:0/532847221 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95681d13e0 con 0x7f956809d9f0 2024-09-11T23:06:35.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.235+0000 7f955f7fe640 1 -- 172.21.15.12:0/532847221 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95580b0040 con 0x7f956809d9f0 2024-09-11T23:06:35.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.235+0000 7f956d133640 1 -- 172.21.15.12:0/532847221 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95680a8140 con 0x7f956809d9f0 2024-09-11T23:06:35.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.235+0000 7f955f7fe640 1 -- 172.21.15.12:0/532847221 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 32) ==== 43997+0+0 (secure 0 0 0) 0x7f95580bb020 con 0x7f956809d9f0 2024-09-11T23:06:35.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.235+0000 7f956d133640 1 -- 172.21.15.12:0/532847221 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95680a1a00 con 0x7f956809d9f0 2024-09-11T23:06:35.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.235+0000 7f955f7fe640 1 --2- 172.21.15.12:0/532847221 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f9548035d20 0x7f95480381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:35.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.235+0000 7f955f7fe640 1 -- 172.21.15.12:0/532847221 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 3439+0+0 (secure 0 0 0) 0x7f95580e2190 con 0x7f956809d9f0 2024-09-11T23:06:35.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.239+0000 7f956659c640 1 --2- 172.21.15.12:0/532847221 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f9548035d20 0x7f95480381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:35.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.239+0000 7f956659c640 1 --2- 172.21.15.12:0/532847221 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f9548035d20 0x7f95480381e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9550000f70 tx=0x7f95500010b0 comp rx=0 tx=0).ready entity=mgr.4903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:35.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.243+0000 7f955f7fe640 1 -- 172.21.15.12:0/532847221 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f95580c2030 con 0x7f956809d9f0 2024-09-11T23:06:35.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.475+0000 7f956d133640 1 -- 172.21.15.12:0/532847221 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f95680734b0 con 0x7f956809d9f0 2024-09-11T23:06:35.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.479+0000 7f955f7fe640 1 -- 172.21.15.12:0/532847221 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) ==== 190+0+147 (secure 0 0 0) 0x7f95580a4e20 con 0x7f956809d9f0 2024-09-11T23:06:35.480 INFO:teuthology.orchestra.run.smithi012.stdout:[client.0] 2024-09-11T23:06:35.481 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCgIeJmTz6nGhAAveLcJxI+RD0GsD9nnR2S/w== 2024-09-11T23:06:35.481 INFO:teuthology.orchestra.run.smithi012.stdout: caps mds = "allow" 2024-09-11T23:06:35.481 INFO:teuthology.orchestra.run.smithi012.stdout: caps mon = "allow r" 2024-09-11T23:06:35.481 INFO:teuthology.orchestra.run.smithi012.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-11T23:06:35.481 INFO:teuthology.orchestra.run.smithi012.stderr:updated caps for client.0 2024-09-11T23:06:35.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.479+0000 7f956d133640 1 -- 172.21.15.12:0/532847221 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f9548035d20 msgr2=0x7f95480381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:35.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.479+0000 7f956d133640 1 --2- 172.21.15.12:0/532847221 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f9548035d20 0x7f95480381e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9550000f70 tx=0x7f95500010b0 comp rx=0 tx=0).stop 2024-09-11T23:06:35.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.479+0000 7f956d133640 1 -- 172.21.15.12:0/532847221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f956809d9f0 msgr2=0x7f95680a6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:35.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.479+0000 7f956d133640 1 --2- 172.21.15.12:0/532847221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f956809d9f0 0x7f95680a6c00 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f95580ae040 tx=0x7f9558019130 comp rx=0 tx=0).stop 2024-09-11T23:06:35.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.479+0000 7f956d133640 1 -- 172.21.15.12:0/532847221 shutdown_connections 2024-09-11T23:06:35.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.479+0000 7f956d133640 1 --2- 172.21.15.12:0/532847221 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f9548035d20 0x7f95480381e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:35.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.479+0000 7f956d133640 1 --2- 172.21.15.12:0/532847221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f956809d9f0 0x7f95680a6c00 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:35.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.479+0000 7f956d133640 1 -- 172.21.15.12:0/532847221 >> 172.21.15.12:0/532847221 conn(0x7f956806d980 msgr2=0x7f956809c260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:35.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.479+0000 7f956d133640 1 -- 172.21.15.12:0/532847221 shutdown_connections 2024-09-11T23:06:35.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.479+0000 7f956d133640 1 -- 172.21.15.12:0/532847221 wait complete. 2024-09-11T23:06:35.501 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:06:35.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.631+0000 7f1eab85b640 1 Processor -- start 2024-09-11T23:06:35.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.631+0000 7f1eab85b640 1 -- start start 2024-09-11T23:06:35.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.631+0000 7f1eab85b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1ea409f6e0 0x7f1ea413cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:35.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.631+0000 7f1eab85b640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ea409e930 con 0x7f1ea4137e60 2024-09-11T23:06:35.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.631+0000 7f1eab85b640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f1ea41379e0 con 0x7f1ea409f6e0 2024-09-11T23:06:35.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.631+0000 7f1ea8df6640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1ea409f6e0 0x7f1ea413cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:35.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.631+0000 7f1ea95f7640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1ea4137e60 0x7f1ea4138240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42100/0 (socket says 172.21.15.12:42100) 2024-09-11T23:06:35.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.631+0000 7f1ea95f7640 1 -- 172.21.15.12:0/330127460 learned_addr learned my addr 172.21.15.12:0/330127460 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:35.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.631+0000 7f1ea8df6640 1 -- 172.21.15.12:0/330127460 >> v1:172.21.15.12:6789/0 conn(0x7f1ea4137e60 legacy=0x7f1ea4138240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:35.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.631+0000 7f1ea8df6640 1 -- 172.21.15.12:0/330127460 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ea409d910 con 0x7f1ea409f6e0 2024-09-11T23:06:35.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.635+0000 7f1ea8df6640 1 --2- 172.21.15.12:0/330127460 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ea409f6e0 0x7f1ea413cc60 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f1e94009740 tx=0x7f1e9401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16598fb04a6b3319 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:35.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.635+0000 7f1e9bfff640 1 -- 172.21.15.12:0/330127460 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e940ab570 con 0x7f1ea409f6e0 2024-09-11T23:06:35.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.635+0000 7f1e9bfff640 1 -- 172.21.15.12:0/330127460 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e940b0070 con 0x7f1ea409f6e0 2024-09-11T23:06:35.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.635+0000 7f1e9bfff640 1 -- 172.21.15.12:0/330127460 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e940ab860 con 0x7f1ea409f6e0 2024-09-11T23:06:35.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.635+0000 7f1eab85b640 1 -- 172.21.15.12:0/330127460 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ea409f6e0 msgr2=0x7f1ea413cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:35.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.635+0000 7f1eab85b640 1 --2- 172.21.15.12:0/330127460 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ea409f6e0 0x7f1ea413cc60 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f1e94009740 tx=0x7f1e9401c420 comp rx=0 tx=0).stop 2024-09-11T23:06:35.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.635+0000 7f1eab85b640 1 -- 172.21.15.12:0/330127460 shutdown_connections 2024-09-11T23:06:35.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.635+0000 7f1eab85b640 1 --2- 172.21.15.12:0/330127460 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ea409f6e0 0x7f1ea413cc60 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:35.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.635+0000 7f1eab85b640 1 -- 172.21.15.12:0/330127460 >> 172.21.15.12:0/330127460 conn(0x7f1ea40a8450 msgr2=0x7f1ea40a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:35.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.635+0000 7f1eab85b640 1 -- 172.21.15.12:0/330127460 shutdown_connections 2024-09-11T23:06:35.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.635+0000 7f1eab85b640 1 -- 172.21.15.12:0/330127460 wait complete. 2024-09-11T23:06:35.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.639+0000 7f1eab85b640 1 Processor -- start 2024-09-11T23:06:35.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.639+0000 7f1eab85b640 1 -- start start 2024-09-11T23:06:35.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.639+0000 7f1eab85b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ea409f6e0 0x7f1ea41d1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:35.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.639+0000 7f1eab85b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea413fd50 con 0x7f1ea409f6e0 2024-09-11T23:06:35.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.639+0000 7f1ea95f7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ea409f6e0 0x7f1ea41d1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:35.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.639+0000 7f1ea95f7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ea409f6e0 0x7f1ea41d1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49208/0 (socket says 172.21.15.12:49208) 2024-09-11T23:06:35.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.639+0000 7f1ea95f7640 1 -- 172.21.15.12:0/2549314256 learned_addr learned my addr 172.21.15.12:0/2549314256 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:35.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.639+0000 7f1ea95f7640 1 -- 172.21.15.12:0/2549314256 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ea4071680 con 0x7f1ea409f6e0 2024-09-11T23:06:35.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.639+0000 7f1ea95f7640 1 --2- 172.21.15.12:0/2549314256 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ea409f6e0 0x7f1ea41d1f50 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f1ea000c480 tx=0x7f1ea000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:35.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.639+0000 7f1e99ffb640 1 -- 172.21.15.12:0/2549314256 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ea0017070 con 0x7f1ea409f6e0 2024-09-11T23:06:35.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.639+0000 7f1e99ffb640 1 -- 172.21.15.12:0/2549314256 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ea0005c20 con 0x7f1ea409f6e0 2024-09-11T23:06:35.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.639+0000 7f1eab85b640 1 -- 172.21.15.12:0/2549314256 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ea4070e10 con 0x7f1ea409f6e0 2024-09-11T23:06:35.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.639+0000 7f1e99ffb640 1 -- 172.21.15.12:0/2549314256 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ea0007070 con 0x7f1ea409f6e0 2024-09-11T23:06:35.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.639+0000 7f1eab85b640 1 -- 172.21.15.12:0/2549314256 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ea4070570 con 0x7f1ea409f6e0 2024-09-11T23:06:35.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.639+0000 7f1e99ffb640 1 -- 172.21.15.12:0/2549314256 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 32) ==== 43997+0+0 (secure 0 0 0) 0x7f1ea001a070 con 0x7f1ea409f6e0 2024-09-11T23:06:35.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.639+0000 7f1e99ffb640 1 --2- 172.21.15.12:0/2549314256 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f1e88035d70 0x7f1e88038230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:35.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.639+0000 7f1e99ffb640 1 -- 172.21.15.12:0/2549314256 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 3439+0+0 (secure 0 0 0) 0x7f1ea00478c0 con 0x7f1ea409f6e0 2024-09-11T23:06:35.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.639+0000 7f1eab85b640 1 -- 172.21.15.12:0/2549314256 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ea4071430 con 0x7f1ea409f6e0 2024-09-11T23:06:35.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.639+0000 7f1ea8df6640 1 --2- 172.21.15.12:0/2549314256 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f1e88035d70 0x7f1e88038230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:35.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.639+0000 7f1ea8df6640 1 --2- 172.21.15.12:0/2549314256 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f1e88035d70 0x7f1e88038230 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1e940af000 tx=0x7f1e940a7000 comp rx=0 tx=0).ready entity=mgr.4903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:35.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.647+0000 7f1e99ffb640 1 -- 172.21.15.12:0/2549314256 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1ea0007210 con 0x7f1ea409f6e0 2024-09-11T23:06:35.795 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:35.791+0000 7f02a2c51640 -1 client.4935: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.4890:b65aeaeb-3f3a-4da2-97b5-6988dece6be2:v1:172.21.15.12:0/2496375865] 2024-09-11T23:06:35.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.859+0000 7f1eab85b640 1 -- 172.21.15.12:0/2549314256 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1ea406bc60 con 0x7f1ea409f6e0 2024-09-11T23:06:35.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.859+0000 7f1e99ffb640 1 -- 172.21.15.12:0/2549314256 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+3575 (secure 0 0 0) 0x7f1ea003a020 con 0x7f1ea409f6e0 2024-09-11T23:06:35.862 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:06:35.862 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":49,"btime":"2024-09-11T23:06:29:001694+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4978,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6826/1855322655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1855322655},{"type":"v1","addr":"172.21.15.12:6826","nonce":1855322655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:06:25.374780+0000","modified":"2024-09-11T23:06:28.391440+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4979},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4979":{"gid":4979,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6827/4133903177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":4133903177},{"type":"v1","addr":"172.21.15.12:6827","nonce":4133903177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4979,"qdb_cluster":[4979]},"id":6}]} 2024-09-11T23:06:35.862 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 49 2024-09-11T23:06:35.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.859+0000 7f1eab85b640 1 -- 172.21.15.12:0/2549314256 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f1e88035d70 msgr2=0x7f1e88038230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:35.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.859+0000 7f1eab85b640 1 --2- 172.21.15.12:0/2549314256 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f1e88035d70 0x7f1e88038230 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1e940af000 tx=0x7f1e940a7000 comp rx=0 tx=0).stop 2024-09-11T23:06:35.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.859+0000 7f1eab85b640 1 -- 172.21.15.12:0/2549314256 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ea409f6e0 msgr2=0x7f1ea41d1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:35.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.859+0000 7f1eab85b640 1 --2- 172.21.15.12:0/2549314256 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ea409f6e0 0x7f1ea41d1f50 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f1ea000c480 tx=0x7f1ea000c940 comp rx=0 tx=0).stop 2024-09-11T23:06:35.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.859+0000 7f1eab85b640 1 -- 172.21.15.12:0/2549314256 shutdown_connections 2024-09-11T23:06:35.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.859+0000 7f1eab85b640 1 --2- 172.21.15.12:0/2549314256 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f1e88035d70 0x7f1e88038230 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:35.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.859+0000 7f1eab85b640 1 --2- 172.21.15.12:0/2549314256 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ea409f6e0 0x7f1ea41d1f50 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:35.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.859+0000 7f1eab85b640 1 -- 172.21.15.12:0/2549314256 >> 172.21.15.12:0/2549314256 conn(0x7f1ea40a8450 msgr2=0x7f1ea40a7260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:35.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.859+0000 7f1eab85b640 1 -- 172.21.15.12:0/2549314256 shutdown_connections 2024-09-11T23:06:35.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:35.863+0000 7f1eab85b640 1 -- 172.21.15.12:0/2549314256 wait complete. 2024-09-11T23:06:36.083 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 49, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T23:06:25.374780+0000', 'modified': '2024-09-11T23:06:28.391440+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4979}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4979': {'gid': 4979, 'name': 'a', 'rank': 0, 'incarnation': 45, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.12:6827/4133903177', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6825', 'nonce': 4133903177}, {'type': 'v1', 'addr': '172.21.15.12:6827', 'nonce': 4133903177}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4979, 'qdb_cluster': [4979]} 2024-09-11T23:06:36.083 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T23:06:36.083 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-11T23:06:36.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.219+0000 7f3c9cf9e640 1 Processor -- start 2024-09-11T23:06:36.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.219+0000 7f3c9cf9e640 1 -- start start 2024-09-11T23:06:36.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.219+0000 7f3c9cf9e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3c980a8110 0x7f3c9813ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:36.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.219+0000 7f3c9cf9e640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c980a4e40 con 0x7f3c980a71c0 2024-09-11T23:06:36.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.219+0000 7f3c9cf9e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f3c980a6af0 con 0x7f3c980a8110 2024-09-11T23:06:36.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.219+0000 7f3c8dd9b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3c980a8110 0x7f3c9813ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:36.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.219+0000 7f3c9659c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f3c980a71c0 0x7f3c980a75a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42114/0 (socket says 172.21.15.12:42114) 2024-09-11T23:06:36.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.219+0000 7f3c9659c640 1 -- 172.21.15.12:0/2220093661 learned_addr learned my addr 172.21.15.12:0/2220093661 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:36.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.219+0000 7f3c8dd9b640 1 -- 172.21.15.12:0/2220093661 >> v1:172.21.15.12:6789/0 conn(0x7f3c980a71c0 legacy=0x7f3c980a75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:36.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.219+0000 7f3c95d9b640 1 -- 172.21.15.12:0/2220093661 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1325953492 0 0) 0x7f3c980a4e40 con 0x7f3c980a71c0 2024-09-11T23:06:36.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.219+0000 7f3c8dd9b640 1 -- 172.21.15.12:0/2220093661 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c980a3f50 con 0x7f3c980a8110 2024-09-11T23:06:36.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.223+0000 7f3c8dd9b640 1 --2- 172.21.15.12:0/2220093661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c980a8110 0x7f3c9813ef50 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f3c80009740 tx=0x7f3c8001c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5b7b7ae0a1be9e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:36.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.223+0000 7f3c95d9b640 1 -- 172.21.15.12:0/2220093661 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c800b0070 con 0x7f3c980a8110 2024-09-11T23:06:36.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.223+0000 7f3c95d9b640 1 -- 172.21.15.12:0/2220093661 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c800ab530 con 0x7f3c980a8110 2024-09-11T23:06:36.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.223+0000 7f3c95d9b640 1 -- 172.21.15.12:0/2220093661 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c800ab830 con 0x7f3c980a8110 2024-09-11T23:06:36.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.223+0000 7f3c9cf9e640 1 -- 172.21.15.12:0/2220093661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c980a8110 msgr2=0x7f3c9813ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:36.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.223+0000 7f3c9cf9e640 1 --2- 172.21.15.12:0/2220093661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c980a8110 0x7f3c9813ef50 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f3c80009740 tx=0x7f3c8001c390 comp rx=0 tx=0).stop 2024-09-11T23:06:36.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.223+0000 7f3c9cf9e640 1 -- 172.21.15.12:0/2220093661 shutdown_connections 2024-09-11T23:06:36.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.223+0000 7f3c9cf9e640 1 --2- 172.21.15.12:0/2220093661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c980a8110 0x7f3c9813ef50 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:36.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.223+0000 7f3c9cf9e640 1 -- 172.21.15.12:0/2220093661 >> 172.21.15.12:0/2220093661 conn(0x7f3c980ac4f0 msgr2=0x7f3c980ac900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:36.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.223+0000 7f3c9cf9e640 1 -- 172.21.15.12:0/2220093661 shutdown_connections 2024-09-11T23:06:36.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.223+0000 7f3c9cf9e640 1 -- 172.21.15.12:0/2220093661 wait complete. 2024-09-11T23:06:36.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.223+0000 7f3c9cf9e640 1 Processor -- start 2024-09-11T23:06:36.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.227+0000 7f3c9cf9e640 1 -- start start 2024-09-11T23:06:36.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.227+0000 7f3c9cf9e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c980a71c0 0x7f3c981ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:36.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.227+0000 7f3c9cf9e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3c9806dd50 con 0x7f3c980a71c0 2024-09-11T23:06:36.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.227+0000 7f3c9659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c980a71c0 0x7f3c981ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:36.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.227+0000 7f3c9659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c980a71c0 0x7f3c981ce0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49222/0 (socket says 172.21.15.12:49222) 2024-09-11T23:06:36.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.227+0000 7f3c9659c640 1 -- 172.21.15.12:0/1799308420 learned_addr learned my addr 172.21.15.12:0/1799308420 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:36.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.227+0000 7f3c9659c640 1 -- 172.21.15.12:0/1799308420 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c980a0620 con 0x7f3c980a71c0 2024-09-11T23:06:36.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.227+0000 7f3c9659c640 1 --2- 172.21.15.12:0/1799308420 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c980a71c0 0x7f3c981ce0e0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f3c8800c420 tx=0x7f3c8800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:36.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.227+0000 7f3c8f7fe640 1 -- 172.21.15.12:0/1799308420 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c88018070 con 0x7f3c980a71c0 2024-09-11T23:06:36.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.227+0000 7f3c8f7fe640 1 -- 172.21.15.12:0/1799308420 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c880074d0 con 0x7f3c980a71c0 2024-09-11T23:06:36.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.227+0000 7f3c9cf9e640 1 -- 172.21.15.12:0/1799308420 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c9809eac0 con 0x7f3c980a71c0 2024-09-11T23:06:36.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.227+0000 7f3c8f7fe640 1 -- 172.21.15.12:0/1799308420 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c88004960 con 0x7f3c980a71c0 2024-09-11T23:06:36.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.227+0000 7f3c9cf9e640 1 -- 172.21.15.12:0/1799308420 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c9809e7e0 con 0x7f3c980a71c0 2024-09-11T23:06:36.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.227+0000 7f3c8f7fe640 1 -- 172.21.15.12:0/1799308420 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 32) ==== 43997+0+0 (secure 0 0 0) 0x7f3c8801b070 con 0x7f3c980a71c0 2024-09-11T23:06:36.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.227+0000 7f3c8f7fe640 1 --2- 172.21.15.12:0/1799308420 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f3c78035d20 0x7f3c780381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:36.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.227+0000 7f3c8f7fe640 1 -- 172.21.15.12:0/1799308420 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 3439+0+0 (secure 0 0 0) 0x7f3c880478c0 con 0x7f3c980a71c0 2024-09-11T23:06:36.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.227+0000 7f3c8dd9b640 1 --2- 172.21.15.12:0/1799308420 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f3c78035d20 0x7f3c780381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:36.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.227+0000 7f3c8dd9b640 1 --2- 172.21.15.12:0/1799308420 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f3c78035d20 0x7f3c780381e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3c800ad000 tx=0x7f3c80008040 comp rx=0 tx=0).ready entity=mgr.4903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:36.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.231+0000 7f3ca005a000 1 Processor -- start 2024-09-11T23:06:36.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.231+0000 7f3ca005a000 1 -- start start 2024-09-11T23:06:36.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.231+0000 7f3ca005a000 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cdeefa5d30 0x55cdeefaeb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:36.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.231+0000 7f3ca005a000 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55cdeee90b60 con 0x55cdeefa5d30 2024-09-11T23:06:36.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.231+0000 7f3c9659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cdeefa5d30 0x55cdeefaeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:36.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.231+0000 7f3c9659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cdeefa5d30 0x55cdeefaeb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49238/0 (socket says 172.21.15.12:49238) 2024-09-11T23:06:36.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.231+0000 7f3c9659c640 1 -- 172.21.15.12:0/1745012311 learned_addr learned my addr 172.21.15.12:0/1745012311 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:36.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.231+0000 7f3c9659c640 1 -- 172.21.15.12:0/1745012311 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cdeedafe50 con 0x55cdeefa5d30 2024-09-11T23:06:36.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.231+0000 7f3c9659c640 1 --2- 172.21.15.12:0/1745012311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cdeefa5d30 0x55cdeefaeb40 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f3c88046800 tx=0x7f3c8801a380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24dd75aafb3b2d8b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:36.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.231+0000 7f3c77fff640 1 -- 172.21.15.12:0/1745012311 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c8803d070 con 0x55cdeefa5d30 2024-09-11T23:06:36.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.231+0000 7f3c77fff640 1 -- 172.21.15.12:0/1745012311 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c88038320 con 0x55cdeefa5d30 2024-09-11T23:06:36.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.231+0000 7f3c77fff640 1 -- 172.21.15.12:0/1745012311 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c88038050 con 0x55cdeefa5d30 2024-09-11T23:06:36.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.231+0000 7f3ca005a000 1 -- 172.21.15.12:0/1745012311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cdeefa5d30 msgr2=0x55cdeefaeb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:36.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.231+0000 7f3ca005a000 1 --2- 172.21.15.12:0/1745012311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cdeefa5d30 0x55cdeefaeb40 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f3c88046800 tx=0x7f3c8801a380 comp rx=0 tx=0).stop 2024-09-11T23:06:36.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.231+0000 7f3ca005a000 1 -- 172.21.15.12:0/1745012311 shutdown_connections 2024-09-11T23:06:36.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.231+0000 7f3ca005a000 1 --2- 172.21.15.12:0/1745012311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cdeefa5d30 0x55cdeefaeb40 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:36.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.231+0000 7f3ca005a000 1 -- 172.21.15.12:0/1745012311 >> 172.21.15.12:0/1745012311 conn(0x55cdeefa0680 msgr2=0x55cdeefa5620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:36.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.231+0000 7f3ca005a000 1 -- 172.21.15.12:0/1745012311 shutdown_connections 2024-09-11T23:06:36.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.231+0000 7f3ca005a000 1 -- 172.21.15.12:0/1745012311 wait complete. 2024-09-11T23:06:36.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.231+0000 7f3ca005a000 1 -- start start 2024-09-11T23:06:36.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.231+0000 7f3ca005a000 1 Processor -- start 2024-09-11T23:06:36.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.231+0000 7f3ca005a000 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cdeefa5d30 0x55cdeefae580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:36.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.231+0000 7f3ca005a000 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55cdeed9ded0 con 0x55cdeefa5d30 2024-09-11T23:06:36.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.231+0000 7f3ca005a000 10 client.0 _ll_register_callbacks cb 0x55cdeef94820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:06:36.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.231+0000 7f3c9659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cdeefa5d30 0x55cdeefae580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:36.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.231+0000 7f3c9659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cdeefa5d30 0x55cdeefae580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49252/0 (socket says 172.21.15.12:49252) 2024-09-11T23:06:36.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.231+0000 7f3c9659c640 1 -- 172.21.15.12:0/2000169069 learned_addr learned my addr 172.21.15.12:0/2000169069 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:36.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.235+0000 7f3c9659c640 1 -- 172.21.15.12:0/2000169069 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cdeed9e120 con 0x55cdeefa5d30 2024-09-11T23:06:36.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.235+0000 7f3c9659c640 1 --2- 172.21.15.12:0/2000169069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cdeefa5d30 0x55cdeefae580 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f3c8803b040 tx=0x7f3c88044000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d52d17e1b2612dd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:36.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.235+0000 7f3c757fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-11T23:06:36.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.235+0000 7f3c757fa640 1 -- 172.21.15.12:0/2000169069 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c8803d070 con 0x55cdeefa5d30 2024-09-11T23:06:36.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.235+0000 7f3c757fa640 1 -- 172.21.15.12:0/2000169069 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(65..65 src has 1..65) ==== 3439+0+0 (secure 0 0 0) 0x7f3c8802a060 con 0x55cdeefa5d30 2024-09-11T23:06:36.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.235+0000 7f3ca005a000 1 -- 172.21.15.12:0/2000169069 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c88038320 con 0x55cdeefa5d30 2024-09-11T23:06:36.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.235+0000 7f3c757fa640 1 -- 172.21.15.12:0/2000169069 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f3c8801b360 con 0x55cdeefa5d30 2024-09-11T23:06:36.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.235+0000 7f3ca005a000 10 client.5044 fetch_fsmap learned FSMap version 49 2024-09-11T23:06:36.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.235+0000 7f3ca005a000 1 -- 172.21.15.12:0/2000169069 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) -- 0x55cdeed97450 con 0x55cdeefa5d30 2024-09-11T23:06:36.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.235+0000 7f3c757fa640 1 -- 172.21.15.12:0/2000169069 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c88038320 con 0x55cdeefa5d30 2024-09-11T23:06:36.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.235+0000 7f3c757fa640 1 -- 172.21.15.12:0/2000169069 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 49) ==== 2292+0+0 (secure 0 0 0) 0x7f3c880451b0 con 0x55cdeefa5d30 2024-09-11T23:06:36.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.235+0000 7f3ca005a000 10 client.5044 fetch_fsmap finished waiting for FSMap version 49 2024-09-11T23:06:36.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.235+0000 7f3ca005a000 10 client.5044 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-11T23:06:36.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.235+0000 7f3ca005a000 20 client.5044 populate_metadata read hostname 'smithi012' 2024-09-11T23:06:36.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.235+0000 7f3ca005a000 1 --2- 172.21.15.12:0/2000169069 >> [v2:172.21.15.12:6825/4133903177,v1:172.21.15.12:6827/4133903177] conn(0x55cdeefd3920 0x55cdeefd1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:36.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.235+0000 7f3ca005a000 4 client.5044 mds_command: new command op to 4979 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:06:36.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.235+0000 7f3ca005a000 1 -- 172.21.15.12:0/2000169069 --> [v2:172.21.15.12:6825/4133903177,v1:172.21.15.12:6827/4133903177] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cdeed91c00 con 0x55cdeefd3920 2024-09-11T23:06:36.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.235+0000 7f3c8dd9b640 1 --2- 172.21.15.12:0/2000169069 >> [v2:172.21.15.12:6825/4133903177,v1:172.21.15.12:6827/4133903177] conn(0x55cdeefd3920 0x55cdeefd1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:36.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.235+0000 7f3c8dd9b640 1 --2- 172.21.15.12:0/2000169069 >> [v2:172.21.15.12:6825/4133903177,v1:172.21.15.12:6827/4133903177] conn(0x55cdeefd3920 0x55cdeefd1ed0 crc :-1 s=READY pgs=6 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45ee3ac19eef4ec3 server_cookie=46730dc73d501f62 in_seq=0 out_seq=0 2024-09-11T23:06:36.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.235+0000 7f3c757fa640 10 client.5044 ms_handle_connect on v2:172.21.15.12:6825/4133903177 2024-09-11T23:06:36.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.235+0000 7f3c757fa640 1 -- 172.21.15.12:0/2000169069 <== mds.0 v2:172.21.15.12:6825/4133903177 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cdeed91c00 con 0x55cdeefd3920 2024-09-11T23:06:36.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.235+0000 7f3c757fa640 10 client.5044 handle_command_reply: tid=0 2024-09-11T23:06:36.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.235+0000 7f3ca005a000 1 client.5044 shutdown 2024-09-11T23:06:36.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.235+0000 7f3ca005a000 1 -- 172.21.15.12:0/2000169069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cdeefa5d30 msgr2=0x55cdeefae580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:36.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.235+0000 7f3ca005a000 1 --2- 172.21.15.12:0/2000169069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cdeefa5d30 0x55cdeefae580 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f3c8803b040 tx=0x7f3c88044000 comp rx=0 tx=0).stop 2024-09-11T23:06:36.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.235+0000 7f3ca005a000 1 -- 172.21.15.12:0/2000169069 shutdown_connections 2024-09-11T23:06:36.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.235+0000 7f3ca005a000 1 --2- 172.21.15.12:0/2000169069 >> [v2:172.21.15.12:6825/4133903177,v1:172.21.15.12:6827/4133903177] conn(0x55cdeefd3920 0x55cdeefd1ed0 crc :-1 s=READY pgs=6 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:36.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.235+0000 7f3ca005a000 1 --2- 172.21.15.12:0/2000169069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cdeefa5d30 0x55cdeefae580 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:36.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.235+0000 7f3ca005a000 1 -- 172.21.15.12:0/2000169069 >> 172.21.15.12:0/2000169069 conn(0x55cdeefa0680 msgr2=0x55cdeefa5620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:36.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.235+0000 7f3c757fa640 0 client.5044 ms_handle_reset on v2:172.21.15.12:6825/4133903177 2024-09-11T23:06:36.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.235+0000 7f3ca005a000 1 -- 172.21.15.12:0/2000169069 shutdown_connections 2024-09-11T23:06:36.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.235+0000 7f3ca005a000 1 -- 172.21.15.12:0/2000169069 wait complete. 2024-09-11T23:06:36.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.235+0000 7f3ca005a000 20 client.5044 trim_cache size 0 max 16384 2024-09-11T23:06:36.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.255+0000 7f3ca005a000 1 Processor -- start 2024-09-11T23:06:36.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.255+0000 7f3ca005a000 1 -- start start 2024-09-11T23:06:36.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.255+0000 7f3ca005a000 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cdeefa5d30 0x55cdeefae250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:36.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.255+0000 7f3ca005a000 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3c981d1f40 con 0x55cdeefa5d30 2024-09-11T23:06:36.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.255+0000 7f3c9659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cdeefa5d30 0x55cdeefae250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:36.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.255+0000 7f3c9659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cdeefa5d30 0x55cdeefae250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49264/0 (socket says 172.21.15.12:49264) 2024-09-11T23:06:36.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.255+0000 7f3c9659c640 1 -- 172.21.15.12:0/1201449842 learned_addr learned my addr 172.21.15.12:0/1201449842 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:36.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.255+0000 7f3c9659c640 1 -- 172.21.15.12:0/1201449842 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cdeed7efd0 con 0x55cdeefa5d30 2024-09-11T23:06:36.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.255+0000 7f3c9659c640 1 --2- 172.21.15.12:0/1201449842 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cdeefa5d30 0x55cdeefae250 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f3c88046830 tx=0x7f3c88023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55024bb1bf675540 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:36.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.255+0000 7f3c777fe640 1 -- 172.21.15.12:0/1201449842 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c88038050 con 0x55cdeefa5d30 2024-09-11T23:06:36.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.255+0000 7f3c777fe640 1 -- 172.21.15.12:0/1201449842 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c8803e040 con 0x55cdeefa5d30 2024-09-11T23:06:36.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.255+0000 7f3c777fe640 1 -- 172.21.15.12:0/1201449842 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c88033080 con 0x55cdeefa5d30 2024-09-11T23:06:36.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.259+0000 7f3ca005a000 1 -- 172.21.15.12:0/1201449842 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cdeefa5d30 msgr2=0x55cdeefae250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:36.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.259+0000 7f3ca005a000 1 --2- 172.21.15.12:0/1201449842 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cdeefa5d30 0x55cdeefae250 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f3c88046830 tx=0x7f3c88023000 comp rx=0 tx=0).stop 2024-09-11T23:06:36.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.259+0000 7f3ca005a000 1 -- 172.21.15.12:0/1201449842 shutdown_connections 2024-09-11T23:06:36.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.259+0000 7f3ca005a000 1 --2- 172.21.15.12:0/1201449842 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cdeefa5d30 0x55cdeefae250 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:36.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.259+0000 7f3ca005a000 1 -- 172.21.15.12:0/1201449842 >> 172.21.15.12:0/1201449842 conn(0x55cdeefa0680 msgr2=0x55cdeefadb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:36.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.259+0000 7f3ca005a000 1 -- 172.21.15.12:0/1201449842 shutdown_connections 2024-09-11T23:06:36.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.259+0000 7f3ca005a000 1 -- 172.21.15.12:0/1201449842 wait complete. 2024-09-11T23:06:36.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.259+0000 7f3ca005a000 1 -- start start 2024-09-11T23:06:36.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.259+0000 7f3ca005a000 1 Processor -- start 2024-09-11T23:06:36.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.259+0000 7f3ca005a000 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cdeefe0a00 0x55cdeefe0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:36.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.259+0000 7f3ca005a000 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55cdeedf7c70 con 0x55cdeefe0a00 2024-09-11T23:06:36.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.259+0000 7f3ca005a000 10 client.0 _ll_register_callbacks cb 0x7f3c8803b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:06:36.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.259+0000 7f3c9659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cdeefe0a00 0x55cdeefe0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:36.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.259+0000 7f3c9659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cdeefe0a00 0x55cdeefe0de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49270/0 (socket says 172.21.15.12:49270) 2024-09-11T23:06:36.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.259+0000 7f3c9659c640 1 -- 172.21.15.12:0/3605324328 learned_addr learned my addr 172.21.15.12:0/3605324328 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:36.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.259+0000 7f3c9659c640 1 -- 172.21.15.12:0/3605324328 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cdeee7a750 con 0x55cdeefe0a00 2024-09-11T23:06:36.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.259+0000 7f3c9659c640 1 --2- 172.21.15.12:0/3605324328 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cdeefe0a00 0x55cdeefe0de0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f3c88046890 tx=0x7f3c88004b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27177a96d0851e66 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:36.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.259+0000 7f3c757fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-11T23:06:36.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.259+0000 7f3c757fa640 1 -- 172.21.15.12:0/3605324328 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c88033050 con 0x55cdeefe0a00 2024-09-11T23:06:36.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.259+0000 7f3c757fa640 1 -- 172.21.15.12:0/3605324328 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(65..65 src has 1..65) ==== 3439+0+0 (secure 0 0 0) 0x7f3c88055060 con 0x55cdeefe0a00 2024-09-11T23:06:36.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.259+0000 7f3ca005a000 1 -- 172.21.15.12:0/3605324328 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c8803e040 con 0x55cdeefe0a00 2024-09-11T23:06:36.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.259+0000 7f3c757fa640 1 -- 172.21.15.12:0/3605324328 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f3c88047cd0 con 0x55cdeefe0a00 2024-09-11T23:06:36.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.259+0000 7f3ca005a000 10 client.5046 fetch_fsmap learned FSMap version 49 2024-09-11T23:06:36.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.259+0000 7f3ca005a000 1 -- 172.21.15.12:0/3605324328 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) -- 0x55cdeed85a30 con 0x55cdeefe0a00 2024-09-11T23:06:36.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.259+0000 7f3c757fa640 1 -- 172.21.15.12:0/3605324328 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c8803e040 con 0x55cdeefe0a00 2024-09-11T23:06:36.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.259+0000 7f3c757fa640 1 -- 172.21.15.12:0/3605324328 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 49) ==== 2292+0+0 (secure 0 0 0) 0x7f3c8801c3b0 con 0x55cdeefe0a00 2024-09-11T23:06:36.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.259+0000 7f3ca005a000 10 client.5046 fetch_fsmap finished waiting for FSMap version 49 2024-09-11T23:06:36.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.259+0000 7f3ca005a000 10 client.5046 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-11T23:06:36.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.259+0000 7f3ca005a000 20 client.5046 populate_metadata read hostname 'smithi012' 2024-09-11T23:06:36.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.259+0000 7f3ca005a000 1 --2- 172.21.15.12:0/3605324328 >> [v2:172.21.15.12:6825/4133903177,v1:172.21.15.12:6827/4133903177] conn(0x55cdeefe1710 0x55cdeefe1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:36.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.259+0000 7f3ca005a000 4 client.5046 mds_command: new command op to 4979 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:06:36.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.259+0000 7f3ca005a000 1 -- 172.21.15.12:0/3605324328 --> [v2:172.21.15.12:6825/4133903177,v1:172.21.15.12:6827/4133903177] -- command(tid 0: {"prefix": "status"}) -- 0x55cdeefa6480 con 0x55cdeefe1710 2024-09-11T23:06:36.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.259+0000 7f3c8dd9b640 1 --2- 172.21.15.12:0/3605324328 >> [v2:172.21.15.12:6825/4133903177,v1:172.21.15.12:6827/4133903177] conn(0x55cdeefe1710 0x55cdeefe1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:36.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.259+0000 7f3c8dd9b640 1 --2- 172.21.15.12:0/3605324328 >> [v2:172.21.15.12:6825/4133903177,v1:172.21.15.12:6827/4133903177] conn(0x55cdeefe1710 0x55cdeefe1af0 crc :-1 s=READY pgs=7 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd02aeca423b993a server_cookie=34b41d56671477dd in_seq=0 out_seq=0 2024-09-11T23:06:36.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.259+0000 7f3c757fa640 10 client.5046 ms_handle_connect on v2:172.21.15.12:6825/4133903177 2024-09-11T23:06:36.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.259+0000 7f3c757fa640 1 -- 172.21.15.12:0/3605324328 <== mds.0 v2:172.21.15.12:6825/4133903177 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55cdeefa6480 con 0x55cdeefe1710 2024-09-11T23:06:36.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.259+0000 7f3c757fa640 10 client.5046 handle_command_reply: tid=0 2024-09-11T23:06:36.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.259+0000 7f3ca005a000 1 client.5046 shutdown 2024-09-11T23:06:36.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.259+0000 7f3ca005a000 1 -- 172.21.15.12:0/3605324328 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cdeefe0a00 msgr2=0x55cdeefe0de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:36.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.259+0000 7f3ca005a000 1 --2- 172.21.15.12:0/3605324328 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cdeefe0a00 0x55cdeefe0de0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f3c88046890 tx=0x7f3c88004b80 comp rx=0 tx=0).stop 2024-09-11T23:06:36.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.259+0000 7f3ca005a000 1 -- 172.21.15.12:0/3605324328 shutdown_connections 2024-09-11T23:06:36.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.259+0000 7f3ca005a000 1 --2- 172.21.15.12:0/3605324328 >> [v2:172.21.15.12:6825/4133903177,v1:172.21.15.12:6827/4133903177] conn(0x55cdeefe1710 0x55cdeefe1af0 crc :-1 s=READY pgs=7 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:36.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.259+0000 7f3ca005a000 1 --2- 172.21.15.12:0/3605324328 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cdeefe0a00 0x55cdeefe0de0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:36.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.259+0000 7f3ca005a000 1 -- 172.21.15.12:0/3605324328 >> 172.21.15.12:0/3605324328 conn(0x55cdeefa0680 msgr2=0x55cdeefae250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:36.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.259+0000 7f3c757fa640 0 client.5046 ms_handle_reset on v2:172.21.15.12:6825/4133903177 2024-09-11T23:06:36.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.259+0000 7f3ca005a000 1 -- 172.21.15.12:0/3605324328 shutdown_connections 2024-09-11T23:06:36.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.259+0000 7f3ca005a000 1 -- 172.21.15.12:0/3605324328 wait complete. 2024-09-11T23:06:36.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.259+0000 7f3ca005a000 20 client.5046 trim_cache size 0 max 16384 2024-09-11T23:06:36.268 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T23:06:36.268 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "8be14356-3340-4500-91a2-4cbc6b511f65", 2024-09-11T23:06:36.268 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 0, 2024-09-11T23:06:36.268 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4979, 2024-09-11T23:06:36.268 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-09-11T23:06:36.268 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-09-11T23:06:36.268 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-09-11T23:06:36.268 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 10.285136427999999, 2024-09-11T23:06:36.269 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 49, 2024-09-11T23:06:36.269 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 65, 2024-09-11T23:06:36.269 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 65, 2024-09-11T23:06:36.269 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 15.251838783 2024-09-11T23:06:36.269 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T23:06:36.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.263+0000 7f3c9cf9e640 1 -- 172.21.15.12:0/1799308420 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f3c78035d20 msgr2=0x7f3c780381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:36.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.263+0000 7f3c9cf9e640 1 --2- 172.21.15.12:0/1799308420 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f3c78035d20 0x7f3c780381e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3c800ad000 tx=0x7f3c80008040 comp rx=0 tx=0).stop 2024-09-11T23:06:36.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.263+0000 7f3c9cf9e640 1 -- 172.21.15.12:0/1799308420 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c980a71c0 msgr2=0x7f3c981ce0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:36.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.263+0000 7f3c9cf9e640 1 --2- 172.21.15.12:0/1799308420 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c980a71c0 0x7f3c981ce0e0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f3c8800c420 tx=0x7f3c8800c8e0 comp rx=0 tx=0).stop 2024-09-11T23:06:36.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.263+0000 7f3c9cf9e640 1 -- 172.21.15.12:0/1799308420 shutdown_connections 2024-09-11T23:06:36.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.263+0000 7f3c9cf9e640 1 --2- 172.21.15.12:0/1799308420 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f3c78035d20 0x7f3c780381e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:36.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.263+0000 7f3c9cf9e640 1 --2- 172.21.15.12:0/1799308420 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c980a71c0 0x7f3c981ce0e0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:36.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.263+0000 7f3c9cf9e640 1 -- 172.21.15.12:0/1799308420 >> 172.21.15.12:0/1799308420 conn(0x7f3c980ac4f0 msgr2=0x7f3c98139690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:36.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.263+0000 7f3c9cf9e640 1 -- 172.21.15.12:0/1799308420 shutdown_connections 2024-09-11T23:06:36.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.263+0000 7f3c9cf9e640 1 -- 172.21.15.12:0/1799308420 wait complete. 2024-09-11T23:06:36.282 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T23:06:36.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.399+0000 7fbec7902640 1 Processor -- start 2024-09-11T23:06:36.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.399+0000 7fbec7902640 1 -- start start 2024-09-11T23:06:36.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.399+0000 7fbec7902640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbec0072700 0x7fbec013bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:36.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.399+0000 7fbec7902640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbec0133300 con 0x7fbec01337c0 2024-09-11T23:06:36.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.399+0000 7fbec7902640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fbec0073df0 con 0x7fbec0072700 2024-09-11T23:06:36.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.403+0000 7fbec4e9d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbec0072700 0x7fbec013bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:36.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.403+0000 7fbec4e9d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbec0072700 0x7fbec013bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49284/0 (socket says 172.21.15.12:49284) 2024-09-11T23:06:36.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.403+0000 7fbec4e9d640 1 -- 172.21.15.12:0/795161195 learned_addr learned my addr 172.21.15.12:0/795161195 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:36.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.403+0000 7fbec569e640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fbec01337c0 0x7fbec0133ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42128/0 (socket says 172.21.15.12:42128) 2024-09-11T23:06:36.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.403+0000 7fbec4e9d640 1 -- 172.21.15.12:0/795161195 >> v1:172.21.15.12:6789/0 conn(0x7fbec01337c0 legacy=0x7fbec0133ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:36.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.403+0000 7fbeb7fff640 1 -- 172.21.15.12:0/795161195 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2605415109 0 0) 0x7fbec0133300 con 0x7fbec01337c0 2024-09-11T23:06:36.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.403+0000 7fbec4e9d640 1 -- 172.21.15.12:0/795161195 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec0072d60 con 0x7fbec0072700 2024-09-11T23:06:36.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.403+0000 7fbec4e9d640 1 --2- 172.21.15.12:0/795161195 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbec0072700 0x7fbec013bac0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fbeb000ba90 tx=0x7fbeb001eb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb25c0c84a93d526 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:36.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.403+0000 7fbeb7fff640 1 -- 172.21.15.12:0/795161195 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbeb00b4070 con 0x7fbec0072700 2024-09-11T23:06:36.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.403+0000 7fbeb7fff640 1 -- 172.21.15.12:0/795161195 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbeb00a7910 con 0x7fbec0072700 2024-09-11T23:06:36.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.403+0000 7fbeb7fff640 1 -- 172.21.15.12:0/795161195 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbeb00a7c10 con 0x7fbec0072700 2024-09-11T23:06:36.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.403+0000 7fbec7902640 1 -- 172.21.15.12:0/795161195 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbec0072700 msgr2=0x7fbec013bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:36.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.403+0000 7fbec7902640 1 --2- 172.21.15.12:0/795161195 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbec0072700 0x7fbec013bac0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fbeb000ba90 tx=0x7fbeb001eb00 comp rx=0 tx=0).stop 2024-09-11T23:06:36.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.403+0000 7fbec7902640 1 -- 172.21.15.12:0/795161195 shutdown_connections 2024-09-11T23:06:36.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.403+0000 7fbec7902640 1 --2- 172.21.15.12:0/795161195 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbec0072700 0x7fbec013bac0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:36.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.403+0000 7fbec7902640 1 -- 172.21.15.12:0/795161195 >> 172.21.15.12:0/795161195 conn(0x7fbec009aba0 msgr2=0x7fbec009afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:36.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.403+0000 7fbec7902640 1 -- 172.21.15.12:0/795161195 shutdown_connections 2024-09-11T23:06:36.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.403+0000 7fbec7902640 1 -- 172.21.15.12:0/795161195 wait complete. 2024-09-11T23:06:36.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.407+0000 7fbec7902640 1 Processor -- start 2024-09-11T23:06:36.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.407+0000 7fbec7902640 1 -- start start 2024-09-11T23:06:36.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.407+0000 7fbec7902640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbec01337c0 0x7fbec00a4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:36.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.407+0000 7fbec7902640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbec0070ab0 con 0x7fbec01337c0 2024-09-11T23:06:36.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.407+0000 7fbec569e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbec01337c0 0x7fbec00a4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:36.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.407+0000 7fbec569e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbec01337c0 0x7fbec00a4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49292/0 (socket says 172.21.15.12:49292) 2024-09-11T23:06:36.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.407+0000 7fbec569e640 1 -- 172.21.15.12:0/406641757 learned_addr learned my addr 172.21.15.12:0/406641757 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:36.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.407+0000 7fbec569e640 1 -- 172.21.15.12:0/406641757 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec013b380 con 0x7fbec01337c0 2024-09-11T23:06:36.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.407+0000 7fbec569e640 1 --2- 172.21.15.12:0/406641757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbec01337c0 0x7fbec00a4a10 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fbebc00c420 tx=0x7fbebc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:36.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.407+0000 7fbeb5ffb640 1 -- 172.21.15.12:0/406641757 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbebc018070 con 0x7fbec01337c0 2024-09-11T23:06:36.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.407+0000 7fbeb5ffb640 1 -- 172.21.15.12:0/406641757 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbebc0074d0 con 0x7fbec01337c0 2024-09-11T23:06:36.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.407+0000 7fbec7902640 1 -- 172.21.15.12:0/406641757 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbec01d15c0 con 0x7fbec01337c0 2024-09-11T23:06:36.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.407+0000 7fbeb5ffb640 1 -- 172.21.15.12:0/406641757 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbebc004960 con 0x7fbec01337c0 2024-09-11T23:06:36.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.407+0000 7fbec7902640 1 -- 172.21.15.12:0/406641757 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbec00a5e70 con 0x7fbec01337c0 2024-09-11T23:06:36.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.407+0000 7fbeb5ffb640 1 -- 172.21.15.12:0/406641757 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 32) ==== 43997+0+0 (secure 0 0 0) 0x7fbebc01b070 con 0x7fbec01337c0 2024-09-11T23:06:36.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.407+0000 7fbeb5ffb640 1 --2- 172.21.15.12:0/406641757 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fbea4035d50 0x7fbea4038210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:36.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.407+0000 7fbec7902640 1 -- 172.21.15.12:0/406641757 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbec0133ba0 con 0x7fbec01337c0 2024-09-11T23:06:36.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.407+0000 7fbeb5ffb640 1 -- 172.21.15.12:0/406641757 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 3439+0+0 (secure 0 0 0) 0x7fbebc047990 con 0x7fbec01337c0 2024-09-11T23:06:36.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.407+0000 7fbec4e9d640 1 --2- 172.21.15.12:0/406641757 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fbea4035d50 0x7fbea4038210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:36.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.411+0000 7fbec4e9d640 1 --2- 172.21.15.12:0/406641757 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fbea4035d50 0x7fbea4038210 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbeb00b1000 tx=0x7fbeb0008040 comp rx=0 tx=0).ready entity=mgr.4903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:36.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.415+0000 7fbeb5ffb640 1 -- 172.21.15.12:0/406641757 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbebc01ae10 con 0x7fbec01337c0 2024-09-11T23:06:36.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.635+0000 7fbec7902640 1 -- 172.21.15.12:0/406641757 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fbec00754f0 con 0x7fbec01337c0 2024-09-11T23:06:36.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.635+0000 7fbeb5ffb640 1 -- 172.21.15.12:0/406641757 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v49) ==== 53+0+73 (secure 0 0 0) 0x7fbebc011920 con 0x7fbec01337c0 2024-09-11T23:06:36.638 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T23:06:36.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.639+0000 7fbec7902640 1 -- 172.21.15.12:0/406641757 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fbea4035d50 msgr2=0x7fbea4038210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:36.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.639+0000 7fbec7902640 1 --2- 172.21.15.12:0/406641757 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fbea4035d50 0x7fbea4038210 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbeb00b1000 tx=0x7fbeb0008040 comp rx=0 tx=0).stop 2024-09-11T23:06:36.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.639+0000 7fbec7902640 1 -- 172.21.15.12:0/406641757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbec01337c0 msgr2=0x7fbec00a4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:36.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.639+0000 7fbec7902640 1 --2- 172.21.15.12:0/406641757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbec01337c0 0x7fbec00a4a10 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fbebc00c420 tx=0x7fbebc00c8e0 comp rx=0 tx=0).stop 2024-09-11T23:06:36.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.639+0000 7fbec7902640 1 -- 172.21.15.12:0/406641757 shutdown_connections 2024-09-11T23:06:36.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.639+0000 7fbec7902640 1 --2- 172.21.15.12:0/406641757 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fbea4035d50 0x7fbea4038210 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:36.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.639+0000 7fbec7902640 1 --2- 172.21.15.12:0/406641757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbec01337c0 0x7fbec00a4a10 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:36.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.639+0000 7fbec7902640 1 -- 172.21.15.12:0/406641757 >> 172.21.15.12:0/406641757 conn(0x7fbec009aba0 msgr2=0x7fbec009d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:36.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.639+0000 7fbec7902640 1 -- 172.21.15.12:0/406641757 shutdown_connections 2024-09-11T23:06:36.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36.639+0000 7fbec7902640 1 -- 172.21.15.12:0/406641757 wait complete. 2024-09-11T23:06:36.658 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-11T23:06:36.658 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:06:36.658 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi012.front.sepia.ceph.com 2024-09-11T23:06:36.658 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T23:06:36.658 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T23:06:36.659 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-11T23:06:36.659 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T23:06:36.659 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:06:36.659 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:06:36.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:06:36.659 DEBUG:teuthology.orchestra.run.smithi012:> ip addr 2024-09-11T23:06:36.664 INFO:teuthology.orchestra.run.smithi012.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:06:36.664 INFO:teuthology.orchestra.run.smithi012.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:06:36.664 INFO:teuthology.orchestra.run.smithi012.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:06:36.665 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:06:36.665 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 ::1/128 scope host 2024-09-11T23:06:36.665 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:06:36.665 INFO:teuthology.orchestra.run.smithi012.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:06:36.665 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a4 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:06:36.665 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f0 2024-09-11T23:06:36.665 INFO:teuthology.orchestra.run.smithi012.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:06:36.665 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a5 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:06:36.665 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f1 2024-09-11T23:06:36.665 INFO:teuthology.orchestra.run.smithi012.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:06:36.666 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:ea brd ff:ff:ff:ff:ff:ff 2024-09-11T23:06:36.666 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f0 2024-09-11T23:06:36.666 INFO:teuthology.orchestra.run.smithi012.stdout: inet 172.21.15.12/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-11T23:06:36.666 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft 42344sec preferred_lft 42344sec 2024-09-11T23:06:36.666 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::ae1f:6bff:fef8:25ea/64 scope link 2024-09-11T23:06:36.666 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:06:36.666 INFO:teuthology.orchestra.run.smithi012.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:06:36.666 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:eb brd ff:ff:ff:ff:ff:ff 2024-09-11T23:06:36.666 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f1 2024-09-11T23:06:36.666 INFO:teuthology.orchestra.run.smithi012.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-11T23:06:36.666 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 02:42:d6:75:63:83 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:06:36.666 INFO:teuthology.orchestra.run.smithi012.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-11T23:06:36.666 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:06:36.667 INFO:teuthology.orchestra.run.smithi012.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:06:36.667 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-11T23:06:36.667 INFO:teuthology.orchestra.run.smithi012.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T23:06:36.667 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:06:36.667 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-11T23:06:36.667 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:06:36.667 INFO:teuthology.orchestra.run.smithi012.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:06:36.667 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:06:36.667 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-11T23:06:36.667 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:06:36.668 INFO:teuthology.orchestra.run.smithi012.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:06:36.668 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:06:36.668 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-11T23:06:36.668 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:06:36.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:06:36.668 DEBUG:teuthology.orchestra.run.smithi012:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:06:36.694 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:36.691+0000 7f02a2c51640 -1 client.4935: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.4890:b65aeaeb-3f3a-4da2-97b5-6988dece6be2:v1:172.21.15.12:0/2496375865] 2024-09-11T23:06:36.706 INFO:teuthology.orchestra.run.smithi012.stdout:1 2024-09-11T23:06:36.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:06:36.708 DEBUG:teuthology.orchestra.run.smithi012:> route 2024-09-11T23:06:36.758 INFO:teuthology.orchestra.run.smithi012.stdout:Kernel IP routing table 2024-09-11T23:06:36.758 INFO:teuthology.orchestra.run.smithi012.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:06:36.758 INFO:teuthology.orchestra.run.smithi012.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-11T23:06:36.758 INFO:teuthology.orchestra.run.smithi012.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-11T23:06:36.758 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-11T23:06:36.759 INFO:teuthology.orchestra.run.smithi012.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:06:36.759 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:06:36.759 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-09-11T23:06:36.759 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-11T23:06:36.759 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-11T23:06:36.759 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-11T23:06:36.759 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-09-11T23:06:36.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:06:36.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:06:36.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:06:36.892 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2024-09-11T23:06:36.897 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 1) 2024-09-11T23:06:36.897 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T23:06:36.898 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:06:36.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:06:36.898 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set brx.0 up 2024-09-11T23:06:36.952 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-11T23:06:36.952 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:06:36.952 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T23:06:37.005 INFO:teuthology.orchestra.run.smithi012.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:06:37.005 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:06:37.005 DEBUG:teuthology.orchestra.run.smithi012:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:06:37.053 DEBUG:teuthology.orchestra.run.smithi012:> sudo modprobe fuse 2024-09-11T23:06:37.115 DEBUG:teuthology.orchestra.run.smithi012:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:06:37.162 INFO:teuthology.orchestra.run.smithi012.stdout:/sys 2024-09-11T23:06:37.162 INFO:teuthology.orchestra.run.smithi012.stdout:/proc 2024-09-11T23:06:37.162 INFO:teuthology.orchestra.run.smithi012.stdout:/dev 2024-09-11T23:06:37.162 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/pts 2024-09-11T23:06:37.162 INFO:teuthology.orchestra.run.smithi012.stdout:/run 2024-09-11T23:06:37.162 INFO:teuthology.orchestra.run.smithi012.stdout:/ 2024-09-11T23:06:37.162 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/security 2024-09-11T23:06:37.162 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/shm 2024-09-11T23:06:37.162 INFO:teuthology.orchestra.run.smithi012.stdout:/run/lock 2024-09-11T23:06:37.162 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup 2024-09-11T23:06:37.162 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/pstore 2024-09-11T23:06:37.163 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/bpf 2024-09-11T23:06:37.163 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:06:37.163 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/hugepages 2024-09-11T23:06:37.163 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/mqueue 2024-09-11T23:06:37.163 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/debug 2024-09-11T23:06:37.163 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/tracing 2024-09-11T23:06:37.163 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/fs/nfsd 2024-09-11T23:06:37.163 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/fuse/connections 2024-09-11T23:06:37.163 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/config 2024-09-11T23:06:37.163 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:06:37.163 INFO:teuthology.orchestra.run.smithi012.stdout:/run/rpc_pipefs 2024-09-11T23:06:37.163 INFO:teuthology.orchestra.run.smithi012.stdout:/run/user/1000 2024-09-11T23:06:37.163 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph 2024-09-11T23:06:37.164 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:06:37.164 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:06:37.164 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:06:37.164 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns 2024-09-11T23:06:37.164 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:06:37.164 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:06:37.164 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:06:37.164 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:06:37.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:06:37.165 DEBUG:teuthology.orchestra.run.smithi012:> ls /sys/fs/fuse/connections 2024-09-11T23:06:37.213 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-11T23:06:37.213 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-11T23:06:37.258 DEBUG:teuthology.orchestra.run.smithi012:> sudo modprobe fuse 2024-09-11T23:06:37.273 DEBUG:teuthology.orchestra.run.smithi012:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:06:37.325 INFO:teuthology.orchestra.run.smithi012.stdout:/sys 2024-09-11T23:06:37.329 INFO:teuthology.orchestra.run.smithi012.stdout:/proc 2024-09-11T23:06:37.329 INFO:teuthology.orchestra.run.smithi012.stdout:/dev 2024-09-11T23:06:37.329 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/pts 2024-09-11T23:06:37.329 INFO:teuthology.orchestra.run.smithi012.stdout:/run 2024-09-11T23:06:37.329 INFO:teuthology.orchestra.run.smithi012.stdout:/ 2024-09-11T23:06:37.329 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/security 2024-09-11T23:06:37.329 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/shm 2024-09-11T23:06:37.330 INFO:teuthology.orchestra.run.smithi012.stdout:/run/lock 2024-09-11T23:06:37.330 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup 2024-09-11T23:06:37.330 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/pstore 2024-09-11T23:06:37.330 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/bpf 2024-09-11T23:06:37.330 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:06:37.330 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/hugepages 2024-09-11T23:06:37.330 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/mqueue 2024-09-11T23:06:37.330 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/debug 2024-09-11T23:06:37.330 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/tracing 2024-09-11T23:06:37.330 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/fs/nfsd 2024-09-11T23:06:37.330 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/fuse/connections 2024-09-11T23:06:37.330 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/config 2024-09-11T23:06:37.330 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:06:37.331 INFO:teuthology.orchestra.run.smithi012.stdout:/run/rpc_pipefs 2024-09-11T23:06:37.331 INFO:teuthology.orchestra.run.smithi012.stdout:/run/user/1000 2024-09-11T23:06:37.331 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph 2024-09-11T23:06:37.331 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:06:37.331 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:06:37.331 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:06:37.331 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns 2024-09-11T23:06:37.331 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:06:37.331 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:06:37.331 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:06:37.331 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:06:37.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:06:37.332 DEBUG:teuthology.orchestra.run.smithi012:> ls /sys/fs/fuse/connections 2024-09-11T23:06:37.346 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi012.stderr:2024-09-11T23:06:37.343+0000 7fbff4803580 -1 init, newargv = 0x55616f9ae9d0 newargc=15 2024-09-11T23:06:37.347 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi012.stderr:ceph-fuse[41222]: starting ceph client 2024-09-11T23:06:37.351 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi012.stderr:ceph-fuse[41222]: starting fuse 2024-09-11T23:06:37.572 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:37.567+0000 7f02a2c51640 -1 client.4935: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.4890:b65aeaeb-3f3a-4da2-97b5-6988dece6be2:v1:172.21.15.12:0/2496375865] 2024-09-11T23:06:38.452 DEBUG:teuthology.orchestra.run.smithi012:> sudo modprobe fuse 2024-09-11T23:06:38.469 DEBUG:teuthology.orchestra.run.smithi012:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:06:38.518 INFO:teuthology.orchestra.run.smithi012.stdout:/sys 2024-09-11T23:06:38.518 INFO:teuthology.orchestra.run.smithi012.stdout:/proc 2024-09-11T23:06:38.518 INFO:teuthology.orchestra.run.smithi012.stdout:/dev 2024-09-11T23:06:38.518 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/pts 2024-09-11T23:06:38.519 INFO:teuthology.orchestra.run.smithi012.stdout:/run 2024-09-11T23:06:38.519 INFO:teuthology.orchestra.run.smithi012.stdout:/ 2024-09-11T23:06:38.519 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/security 2024-09-11T23:06:38.519 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/shm 2024-09-11T23:06:38.519 INFO:teuthology.orchestra.run.smithi012.stdout:/run/lock 2024-09-11T23:06:38.519 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup 2024-09-11T23:06:38.519 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/pstore 2024-09-11T23:06:38.519 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/bpf 2024-09-11T23:06:38.519 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:06:38.519 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/hugepages 2024-09-11T23:06:38.519 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/mqueue 2024-09-11T23:06:38.519 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/debug 2024-09-11T23:06:38.520 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/tracing 2024-09-11T23:06:38.520 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/fs/nfsd 2024-09-11T23:06:38.520 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/fuse/connections 2024-09-11T23:06:38.520 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/config 2024-09-11T23:06:38.520 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:06:38.520 INFO:teuthology.orchestra.run.smithi012.stdout:/run/rpc_pipefs 2024-09-11T23:06:38.520 INFO:teuthology.orchestra.run.smithi012.stdout:/run/user/1000 2024-09-11T23:06:38.520 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph 2024-09-11T23:06:38.520 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:06:38.520 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:06:38.520 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:06:38.520 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns 2024-09-11T23:06:38.520 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:06:38.521 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:06:38.521 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:06:38.521 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:06:38.521 INFO:teuthology.orchestra.run.smithi012.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-11T23:06:38.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:06:38.521 DEBUG:teuthology.orchestra.run.smithi012:> ls /sys/fs/fuse/connections 2024-09-11T23:06:38.565 INFO:teuthology.orchestra.run.smithi012.stdout:45 2024-09-11T23:06:38.565 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-11T23:06:38.565 DEBUG:teuthology.orchestra.run.smithi012:> sudo stdin-killer -- python3 -c ' 2024-09-11T23:06:38.565 DEBUG:teuthology.orchestra.run.smithi012:> import glob 2024-09-11T23:06:38.565 DEBUG:teuthology.orchestra.run.smithi012:> import re 2024-09-11T23:06:38.566 DEBUG:teuthology.orchestra.run.smithi012:> import os 2024-09-11T23:06:38.566 DEBUG:teuthology.orchestra.run.smithi012:> import subprocess 2024-09-11T23:06:38.566 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:06:38.566 DEBUG:teuthology.orchestra.run.smithi012:> def _find_admin_socket(client_name): 2024-09-11T23:06:38.566 DEBUG:teuthology.orchestra.run.smithi012:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-11T23:06:38.566 DEBUG:teuthology.orchestra.run.smithi012:> files = glob.glob(asok_path) 2024-09-11T23:06:38.566 DEBUG:teuthology.orchestra.run.smithi012:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-11T23:06:38.566 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:06:38.566 DEBUG:teuthology.orchestra.run.smithi012:> # Given a non-glob path, it better be there 2024-09-11T23:06:38.566 DEBUG:teuthology.orchestra.run.smithi012:> if "*" not in asok_path: 2024-09-11T23:06:38.566 DEBUG:teuthology.orchestra.run.smithi012:> assert(len(files) == 1) 2024-09-11T23:06:38.566 DEBUG:teuthology.orchestra.run.smithi012:> return files[0] 2024-09-11T23:06:38.566 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:06:38.566 DEBUG:teuthology.orchestra.run.smithi012:> for f in files: 2024-09-11T23:06:38.566 DEBUG:teuthology.orchestra.run.smithi012:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T23:06:38.567 DEBUG:teuthology.orchestra.run.smithi012:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T23:06:38.567 DEBUG:teuthology.orchestra.run.smithi012:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T23:06:38.567 DEBUG:teuthology.orchestra.run.smithi012:> contents = proc_f.read() 2024-09-11T23:06:38.567 DEBUG:teuthology.orchestra.run.smithi012:> if mountpoint in contents: 2024-09-11T23:06:38.567 DEBUG:teuthology.orchestra.run.smithi012:> return f 2024-09-11T23:06:38.567 DEBUG:teuthology.orchestra.run.smithi012:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T23:06:38.567 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:06:38.567 DEBUG:teuthology.orchestra.run.smithi012:> print(_find_admin_socket("client.0")) 2024-09-11T23:06:38.567 DEBUG:teuthology.orchestra.run.smithi012:> ' 2024-09-11T23:06:38.598 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:38.595+0000 7f02a2c51640 -1 client.4935: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.4890:b65aeaeb-3f3a-4da2-97b5-6988dece6be2:v1:172.21.15.12:0/2496375865] 2024-09-11T23:06:38.687 INFO:teuthology.orchestra.run.smithi012.stdout:/var/run/ceph/ceph-client.0.41222.asok 2024-09-11T23:06:38.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:06:38.700 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.41222.asok 2024-09-11T23:06:38.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:06:38.700 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.41222.asok status 2024-09-11T23:06:38.874 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T23:06:38.874 INFO:teuthology.orchestra.run.smithi012.stdout: "metadata": { 2024-09-11T23:06:38.874 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-11T23:06:38.874 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T23:06:38.875 INFO:teuthology.orchestra.run.smithi012.stdout: "entity_id": "0", 2024-09-11T23:06:38.875 INFO:teuthology.orchestra.run.smithi012.stdout: "hostname": "smithi012", 2024-09-11T23:06:38.875 INFO:teuthology.orchestra.run.smithi012.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-11T23:06:38.875 INFO:teuthology.orchestra.run.smithi012.stdout: "pid": "41222", 2024-09-11T23:06:38.875 INFO:teuthology.orchestra.run.smithi012.stdout: "root": "/" 2024-09-11T23:06:38.875 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:06:38.875 INFO:teuthology.orchestra.run.smithi012.stdout: "dentry_count": 0, 2024-09-11T23:06:38.875 INFO:teuthology.orchestra.run.smithi012.stdout: "dentry_pinned_count": 0, 2024-09-11T23:06:38.875 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 5052, 2024-09-11T23:06:38.875 INFO:teuthology.orchestra.run.smithi012.stdout: "inst": { 2024-09-11T23:06:38.875 INFO:teuthology.orchestra.run.smithi012.stdout: "name": { 2024-09-11T23:06:38.875 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "client", 2024-09-11T23:06:38.875 INFO:teuthology.orchestra.run.smithi012.stdout: "num": 5052 2024-09-11T23:06:38.876 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:06:38.876 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": { 2024-09-11T23:06:38.876 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T23:06:38.876 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "192.168.0.1:0", 2024-09-11T23:06:38.876 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1818947016 2024-09-11T23:06:38.876 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:06:38.876 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:06:38.876 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": { 2024-09-11T23:06:38.876 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T23:06:38.876 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "192.168.0.1:0", 2024-09-11T23:06:38.876 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1818947016 2024-09-11T23:06:38.876 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:06:38.876 INFO:teuthology.orchestra.run.smithi012.stdout: "inst_str": "client.5052 192.168.0.1:0/1818947016", 2024-09-11T23:06:38.876 INFO:teuthology.orchestra.run.smithi012.stdout: "addr_str": "192.168.0.1:0/1818947016", 2024-09-11T23:06:38.877 INFO:teuthology.orchestra.run.smithi012.stdout: "inode_count": 1, 2024-09-11T23:06:38.877 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_epoch": 49, 2024-09-11T23:06:38.877 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_epoch": 65, 2024-09-11T23:06:38.877 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_epoch_barrier": 0, 2024-09-11T23:06:38.877 INFO:teuthology.orchestra.run.smithi012.stdout: "blocklisted": false, 2024-09-11T23:06:38.877 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs" 2024-09-11T23:06:38.877 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T23:06:38.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:06:38.889 DEBUG:teuthology.orchestra.run.smithi012:> stat --file-system '--printf=%T 2024-09-11T23:06:38.889 DEBUG:teuthology.orchestra.run.smithi012:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-11T23:06:38.896 INFO:teuthology.orchestra.run.smithi012.stdout:fuseblk 2024-09-11T23:06:38.896 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-11T23:06:38.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:06:38.896 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:06:38.958 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T23:06:39.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.139+0000 7f0f348c0640 1 Processor -- start 2024-09-11T23:06:39.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.139+0000 7f0f348c0640 1 -- start start 2024-09-11T23:06:39.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.139+0000 7f0f348c0640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0f3013ce50 0x7f0f3013f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:39.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.139+0000 7f0f348c0640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f30139b40 con 0x7f0f3013a000 2024-09-11T23:06:39.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.139+0000 7f0f348c0640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f0f3006cbe0 con 0x7f0f3013ce50 2024-09-11T23:06:39.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.139+0000 7f0f2e59c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f0f3013a000 0x7f0f3013a3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42130/0 (socket says 172.21.15.12:42130) 2024-09-11T23:06:39.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.139+0000 7f0f2e59c640 1 -- 172.21.15.12:0/2142310163 learned_addr learned my addr 172.21.15.12:0/2142310163 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:39.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.139+0000 7f0f2dd9b640 1 --2- 172.21.15.12:0/2142310163 >> v2:172.21.15.12:3300/0 conn(0x7f0f3013ce50 0x7f0f3013f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:39.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.139+0000 7f0f2d59a640 1 -- 172.21.15.12:0/2142310163 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1686912724 0 0) 0x7f0f30139b40 con 0x7f0f3013a000 2024-09-11T23:06:39.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.139+0000 7f0f2d59a640 1 -- 172.21.15.12:0/2142310163 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f18003530 con 0x7f0f3013a000 2024-09-11T23:06:39.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.139+0000 7f0f2dd9b640 1 -- 172.21.15.12:0/2142310163 >> v1:172.21.15.12:6789/0 conn(0x7f0f3013a000 legacy=0x7f0f3013a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:39.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.139+0000 7f0f2dd9b640 1 -- 172.21.15.12:0/2142310163 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f3006c740 con 0x7f0f3013ce50 2024-09-11T23:06:39.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.143+0000 7f0f2dd9b640 1 --2- 172.21.15.12:0/2142310163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f3013ce50 0x7f0f3013f240 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f0f20009720 tx=0x7f0f2001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a108626ed6cdb1cf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:39.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.143+0000 7f0f2d59a640 1 -- 172.21.15.12:0/2142310163 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f200b0070 con 0x7f0f3013ce50 2024-09-11T23:06:39.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.143+0000 7f0f2d59a640 1 -- 172.21.15.12:0/2142310163 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f200ab530 con 0x7f0f3013ce50 2024-09-11T23:06:39.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.143+0000 7f0f2d59a640 1 -- 172.21.15.12:0/2142310163 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f200ab810 con 0x7f0f3013ce50 2024-09-11T23:06:39.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.143+0000 7f0f348c0640 1 -- 172.21.15.12:0/2142310163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f3013ce50 msgr2=0x7f0f3013f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:39.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.143+0000 7f0f348c0640 1 --2- 172.21.15.12:0/2142310163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f3013ce50 0x7f0f3013f240 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f0f20009720 tx=0x7f0f2001c370 comp rx=0 tx=0).stop 2024-09-11T23:06:39.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.143+0000 7f0f348c0640 1 -- 172.21.15.12:0/2142310163 shutdown_connections 2024-09-11T23:06:39.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.143+0000 7f0f348c0640 1 --2- 172.21.15.12:0/2142310163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f3013ce50 0x7f0f3013f240 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:39.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.143+0000 7f0f348c0640 1 -- 172.21.15.12:0/2142310163 >> 172.21.15.12:0/2142310163 conn(0x7f0f30068000 msgr2=0x7f0f300a5910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:39.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.143+0000 7f0f348c0640 1 -- 172.21.15.12:0/2142310163 shutdown_connections 2024-09-11T23:06:39.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.143+0000 7f0f348c0640 1 -- 172.21.15.12:0/2142310163 wait complete. 2024-09-11T23:06:39.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.143+0000 7f0f348c0640 1 Processor -- start 2024-09-11T23:06:39.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.143+0000 7f0f348c0640 1 -- start start 2024-09-11T23:06:39.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.143+0000 7f0f348c0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f3013a000 0x7f0f3009cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:39.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.143+0000 7f0f348c0640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0f300a0420 con 0x7f0f3013a000 2024-09-11T23:06:39.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.143+0000 7f0f2e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f3013a000 0x7f0f3009cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:39.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.143+0000 7f0f2e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f3013a000 0x7f0f3009cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49320/0 (socket says 172.21.15.12:49320) 2024-09-11T23:06:39.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.143+0000 7f0f2e59c640 1 -- 172.21.15.12:0/1382229166 learned_addr learned my addr 172.21.15.12:0/1382229166 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:39.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.143+0000 7f0f2e59c640 1 -- 172.21.15.12:0/1382229166 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f30120190 con 0x7f0f3013a000 2024-09-11T23:06:39.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.143+0000 7f0f2e59c640 1 --2- 172.21.15.12:0/1382229166 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f3013a000 0x7f0f3009cd20 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f0f2400ca20 tx=0x7f0f2400cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:39.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.143+0000 7f0f1effd640 1 -- 172.21.15.12:0/1382229166 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f24017070 con 0x7f0f3013a000 2024-09-11T23:06:39.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.143+0000 7f0f1effd640 1 -- 172.21.15.12:0/1382229166 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f2400ab20 con 0x7f0f3013a000 2024-09-11T23:06:39.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.143+0000 7f0f348c0640 1 -- 172.21.15.12:0/1382229166 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f3009eca0 con 0x7f0f3013a000 2024-09-11T23:06:39.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.143+0000 7f0f1effd640 1 -- 172.21.15.12:0/1382229166 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f2400ae60 con 0x7f0f3013a000 2024-09-11T23:06:39.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.143+0000 7f0f348c0640 1 -- 172.21.15.12:0/1382229166 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f3011fe80 con 0x7f0f3013a000 2024-09-11T23:06:39.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.147+0000 7f0f1effd640 1 -- 172.21.15.12:0/1382229166 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 32) ==== 43997+0+0 (secure 0 0 0) 0x7f0f2401a070 con 0x7f0f3013a000 2024-09-11T23:06:39.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.147+0000 7f0f348c0640 1 -- 172.21.15.12:0/1382229166 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f3013a3e0 con 0x7f0f3013a000 2024-09-11T23:06:39.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.147+0000 7f0f1effd640 1 --2- 172.21.15.12:0/1382229166 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f0f10035cd0 0x7f0f10038190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:39.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.147+0000 7f0f1effd640 1 -- 172.21.15.12:0/1382229166 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 3439+0+0 (secure 0 0 0) 0x7f0f240482d0 con 0x7f0f3013a000 2024-09-11T23:06:39.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.147+0000 7f0f2dd9b640 1 --2- 172.21.15.12:0/1382229166 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f0f10035cd0 0x7f0f10038190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:39.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.147+0000 7f0f2dd9b640 1 --2- 172.21.15.12:0/1382229166 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f0f10035cd0 0x7f0f10038190 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0f200ad000 tx=0x7f0f20008040 comp rx=0 tx=0).ready entity=mgr.4903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:39.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.151+0000 7f0f1effd640 1 -- 172.21.15.12:0/1382229166 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0f2401a360 con 0x7f0f3013a000 2024-09-11T23:06:39.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.363+0000 7f0f348c0640 1 -- 172.21.15.12:0/1382229166 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f0f3009e210 con 0x7f0f3013a000 2024-09-11T23:06:39.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.367+0000 7f0f1effd640 1 -- 172.21.15.12:0/1382229166 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v49) ==== 53+0+73 (secure 0 0 0) 0x7f0f2404a110 con 0x7f0f3013a000 2024-09-11T23:06:39.368 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T23:06:39.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.367+0000 7f0f348c0640 1 -- 172.21.15.12:0/1382229166 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f0f10035cd0 msgr2=0x7f0f10038190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:39.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.367+0000 7f0f348c0640 1 --2- 172.21.15.12:0/1382229166 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f0f10035cd0 0x7f0f10038190 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0f200ad000 tx=0x7f0f20008040 comp rx=0 tx=0).stop 2024-09-11T23:06:39.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.367+0000 7f0f348c0640 1 -- 172.21.15.12:0/1382229166 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f3013a000 msgr2=0x7f0f3009cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:39.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.367+0000 7f0f348c0640 1 --2- 172.21.15.12:0/1382229166 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f3013a000 0x7f0f3009cd20 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f0f2400ca20 tx=0x7f0f2400cee0 comp rx=0 tx=0).stop 2024-09-11T23:06:39.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.367+0000 7f0f348c0640 1 -- 172.21.15.12:0/1382229166 shutdown_connections 2024-09-11T23:06:39.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.367+0000 7f0f348c0640 1 --2- 172.21.15.12:0/1382229166 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f0f10035cd0 0x7f0f10038190 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:39.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.367+0000 7f0f348c0640 1 --2- 172.21.15.12:0/1382229166 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f3013a000 0x7f0f3009cd20 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:39.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.367+0000 7f0f348c0640 1 -- 172.21.15.12:0/1382229166 >> 172.21.15.12:0/1382229166 conn(0x7f0f30068000 msgr2=0x7f0f300a7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:39.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.367+0000 7f0f348c0640 1 -- 172.21.15.12:0/1382229166 shutdown_connections 2024-09-11T23:06:39.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39.367+0000 7f0f348c0640 1 -- 172.21.15.12:0/1382229166 wait complete. 2024-09-11T23:06:39.388 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-11T23:06:39.388 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:06:39.388 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi012.front.sepia.ceph.com 2024-09-11T23:06:39.388 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-11T23:06:39.389 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-11T23:06:39.389 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-11T23:06:39.389 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T23:06:39.389 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:06:39.389 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:06:39.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:06:39.389 DEBUG:teuthology.orchestra.run.smithi012:> ip addr 2024-09-11T23:06:39.394 INFO:teuthology.orchestra.run.smithi012.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:06:39.395 INFO:teuthology.orchestra.run.smithi012.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:06:39.395 INFO:teuthology.orchestra.run.smithi012.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:06:39.395 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:06:39.395 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 ::1/128 scope host 2024-09-11T23:06:39.395 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:06:39.395 INFO:teuthology.orchestra.run.smithi012.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:06:39.395 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a4 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:06:39.395 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f0 2024-09-11T23:06:39.395 INFO:teuthology.orchestra.run.smithi012.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:06:39.395 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a5 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:06:39.395 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f1 2024-09-11T23:06:39.395 INFO:teuthology.orchestra.run.smithi012.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:06:39.396 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:ea brd ff:ff:ff:ff:ff:ff 2024-09-11T23:06:39.396 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f0 2024-09-11T23:06:39.396 INFO:teuthology.orchestra.run.smithi012.stdout: inet 172.21.15.12/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-11T23:06:39.396 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft 42342sec preferred_lft 42342sec 2024-09-11T23:06:39.396 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::ae1f:6bff:fef8:25ea/64 scope link 2024-09-11T23:06:39.396 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:06:39.396 INFO:teuthology.orchestra.run.smithi012.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-11T23:06:39.396 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:eb brd ff:ff:ff:ff:ff:ff 2024-09-11T23:06:39.396 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f1 2024-09-11T23:06:39.396 INFO:teuthology.orchestra.run.smithi012.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-11T23:06:39.396 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 02:42:d6:75:63:83 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:06:39.396 INFO:teuthology.orchestra.run.smithi012.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-11T23:06:39.396 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:06:39.397 INFO:teuthology.orchestra.run.smithi012.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:06:39.397 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-11T23:06:39.397 INFO:teuthology.orchestra.run.smithi012.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T23:06:39.397 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:06:39.397 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-11T23:06:39.397 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:06:39.397 INFO:teuthology.orchestra.run.smithi012.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:06:39.397 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:06:39.397 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-11T23:06:39.398 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:06:39.398 INFO:teuthology.orchestra.run.smithi012.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:06:39.398 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:06:39.398 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-11T23:06:39.398 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:06:39.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:06:39.398 DEBUG:teuthology.orchestra.run.smithi012:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:06:39.447 INFO:teuthology.orchestra.run.smithi012.stdout:1 2024-09-11T23:06:39.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:06:39.449 DEBUG:teuthology.orchestra.run.smithi012:> route 2024-09-11T23:06:39.497 INFO:teuthology.orchestra.run.smithi012.stdout:Kernel IP routing table 2024-09-11T23:06:39.498 INFO:teuthology.orchestra.run.smithi012.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:06:39.498 INFO:teuthology.orchestra.run.smithi012.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-11T23:06:39.498 INFO:teuthology.orchestra.run.smithi012.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-11T23:06:39.498 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-11T23:06:39.498 INFO:teuthology.orchestra.run.smithi012.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:06:39.498 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:06:39.498 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-09-11T23:06:39.498 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-11T23:06:39.498 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-11T23:06:39.498 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-11T23:06:39.498 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-09-11T23:06:39.505 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:39.503+0000 7f02a2c51640 -1 client.4935: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.4890:b65aeaeb-3f3a-4da2-97b5-6988dece6be2:v1:172.21.15.12:0/2496375865] 2024-09-11T23:06:39.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:06:39.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:06:39.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:06:39.585 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2024-09-11T23:06:39.590 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 1) 2024-09-11T23:06:39.590 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T23:06:39.590 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:06:39.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:06:39.590 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set brx.1 up 2024-09-11T23:06:39.647 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-11T23:06:39.648 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:06:39.648 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-11T23:06:39.697 INFO:teuthology.orchestra.run.smithi012.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:06:39.698 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:06:39.698 DEBUG:teuthology.orchestra.run.smithi012:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-11T23:06:39.745 DEBUG:teuthology.orchestra.run.smithi012:> sudo modprobe fuse 2024-09-11T23:06:39.803 DEBUG:teuthology.orchestra.run.smithi012:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:06:39.855 INFO:teuthology.orchestra.run.smithi012.stdout:/sys 2024-09-11T23:06:39.855 INFO:teuthology.orchestra.run.smithi012.stdout:/proc 2024-09-11T23:06:39.855 INFO:teuthology.orchestra.run.smithi012.stdout:/dev 2024-09-11T23:06:39.855 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/pts 2024-09-11T23:06:39.856 INFO:teuthology.orchestra.run.smithi012.stdout:/run 2024-09-11T23:06:39.856 INFO:teuthology.orchestra.run.smithi012.stdout:/ 2024-09-11T23:06:39.856 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/security 2024-09-11T23:06:39.856 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/shm 2024-09-11T23:06:39.856 INFO:teuthology.orchestra.run.smithi012.stdout:/run/lock 2024-09-11T23:06:39.856 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup 2024-09-11T23:06:39.856 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/pstore 2024-09-11T23:06:39.856 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/bpf 2024-09-11T23:06:39.856 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:06:39.856 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/hugepages 2024-09-11T23:06:39.856 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/mqueue 2024-09-11T23:06:39.856 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/debug 2024-09-11T23:06:39.856 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/tracing 2024-09-11T23:06:39.857 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/fs/nfsd 2024-09-11T23:06:39.857 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/fuse/connections 2024-09-11T23:06:39.857 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/config 2024-09-11T23:06:39.857 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:06:39.857 INFO:teuthology.orchestra.run.smithi012.stdout:/run/rpc_pipefs 2024-09-11T23:06:39.857 INFO:teuthology.orchestra.run.smithi012.stdout:/run/user/1000 2024-09-11T23:06:39.857 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph 2024-09-11T23:06:39.857 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:06:39.857 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:06:39.857 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:06:39.857 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns 2024-09-11T23:06:39.857 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:06:39.857 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:06:39.858 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:06:39.858 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:06:39.858 INFO:teuthology.orchestra.run.smithi012.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-11T23:06:39.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:06:39.859 DEBUG:teuthology.orchestra.run.smithi012:> ls /sys/fs/fuse/connections 2024-09-11T23:06:39.909 INFO:teuthology.orchestra.run.smithi012.stdout:45 2024-09-11T23:06:39.909 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [45] 2024-09-11T23:06:39.909 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-11T23:06:39.954 DEBUG:teuthology.orchestra.run.smithi012:> sudo modprobe fuse 2024-09-11T23:06:39.969 DEBUG:teuthology.orchestra.run.smithi012:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:06:40.017 INFO:teuthology.orchestra.run.smithi012.stdout:/sys 2024-09-11T23:06:40.017 INFO:teuthology.orchestra.run.smithi012.stdout:/proc 2024-09-11T23:06:40.017 INFO:teuthology.orchestra.run.smithi012.stdout:/dev 2024-09-11T23:06:40.017 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/pts 2024-09-11T23:06:40.017 INFO:teuthology.orchestra.run.smithi012.stdout:/run 2024-09-11T23:06:40.017 INFO:teuthology.orchestra.run.smithi012.stdout:/ 2024-09-11T23:06:40.017 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/security 2024-09-11T23:06:40.017 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/shm 2024-09-11T23:06:40.018 INFO:teuthology.orchestra.run.smithi012.stdout:/run/lock 2024-09-11T23:06:40.018 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup 2024-09-11T23:06:40.018 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/pstore 2024-09-11T23:06:40.018 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/bpf 2024-09-11T23:06:40.018 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:06:40.018 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/hugepages 2024-09-11T23:06:40.018 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/mqueue 2024-09-11T23:06:40.018 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/debug 2024-09-11T23:06:40.018 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/tracing 2024-09-11T23:06:40.018 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/fs/nfsd 2024-09-11T23:06:40.018 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/fuse/connections 2024-09-11T23:06:40.018 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/config 2024-09-11T23:06:40.018 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:06:40.018 INFO:teuthology.orchestra.run.smithi012.stdout:/run/rpc_pipefs 2024-09-11T23:06:40.018 INFO:teuthology.orchestra.run.smithi012.stdout:/run/user/1000 2024-09-11T23:06:40.019 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph 2024-09-11T23:06:40.019 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:06:40.019 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:06:40.019 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:06:40.019 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns 2024-09-11T23:06:40.019 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:06:40.019 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:06:40.019 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:06:40.019 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:06:40.019 INFO:teuthology.orchestra.run.smithi012.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-11T23:06:40.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:06:40.020 DEBUG:teuthology.orchestra.run.smithi012:> ls /sys/fs/fuse/connections 2024-09-11T23:06:40.037 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi012.stderr:2024-09-11T23:06:40.035+0000 7f0a730b9580 -1 init, newargv = 0x564806fa9530 newargc=15 2024-09-11T23:06:40.037 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi012.stderr:ceph-fuse[41332]: starting ceph client 2024-09-11T23:06:40.041 INFO:teuthology.orchestra.run.smithi012.stdout:45 2024-09-11T23:06:40.042 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi012.stderr:ceph-fuse[41332]: starting fuse 2024-09-11T23:06:41.143 DEBUG:teuthology.orchestra.run.smithi012:> sudo modprobe fuse 2024-09-11T23:06:41.159 DEBUG:teuthology.orchestra.run.smithi012:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:06:41.211 INFO:teuthology.orchestra.run.smithi012.stdout:/sys 2024-09-11T23:06:41.211 INFO:teuthology.orchestra.run.smithi012.stdout:/proc 2024-09-11T23:06:41.211 INFO:teuthology.orchestra.run.smithi012.stdout:/dev 2024-09-11T23:06:41.211 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/pts 2024-09-11T23:06:41.211 INFO:teuthology.orchestra.run.smithi012.stdout:/run 2024-09-11T23:06:41.212 INFO:teuthology.orchestra.run.smithi012.stdout:/ 2024-09-11T23:06:41.212 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/security 2024-09-11T23:06:41.212 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/shm 2024-09-11T23:06:41.212 INFO:teuthology.orchestra.run.smithi012.stdout:/run/lock 2024-09-11T23:06:41.212 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup 2024-09-11T23:06:41.212 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/pstore 2024-09-11T23:06:41.212 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/bpf 2024-09-11T23:06:41.212 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:06:41.212 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/hugepages 2024-09-11T23:06:41.212 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/mqueue 2024-09-11T23:06:41.212 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/debug 2024-09-11T23:06:41.212 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/tracing 2024-09-11T23:06:41.212 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/fs/nfsd 2024-09-11T23:06:41.212 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/fuse/connections 2024-09-11T23:06:41.213 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/config 2024-09-11T23:06:41.213 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-sysusers.service 2024-09-11T23:06:41.213 INFO:teuthology.orchestra.run.smithi012.stdout:/run/rpc_pipefs 2024-09-11T23:06:41.213 INFO:teuthology.orchestra.run.smithi012.stdout:/run/user/1000 2024-09-11T23:06:41.213 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph 2024-09-11T23:06:41.213 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T23:06:41.213 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T23:06:41.213 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T23:06:41.214 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns 2024-09-11T23:06:41.214 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:06:41.214 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:06:41.214 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:06:41.214 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:06:41.214 INFO:teuthology.orchestra.run.smithi012.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-11T23:06:41.215 INFO:teuthology.orchestra.run.smithi012.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-11T23:06:41.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:06:41.216 DEBUG:teuthology.orchestra.run.smithi012:> ls /sys/fs/fuse/connections 2024-09-11T23:06:41.265 INFO:teuthology.orchestra.run.smithi012.stdout:45 2024-09-11T23:06:41.265 INFO:teuthology.orchestra.run.smithi012.stdout:46 2024-09-11T23:06:41.265 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45, 46] 2024-09-11T23:06:41.266 DEBUG:teuthology.orchestra.run.smithi012:> sudo stdin-killer -- python3 -c ' 2024-09-11T23:06:41.266 DEBUG:teuthology.orchestra.run.smithi012:> import glob 2024-09-11T23:06:41.266 DEBUG:teuthology.orchestra.run.smithi012:> import re 2024-09-11T23:06:41.266 DEBUG:teuthology.orchestra.run.smithi012:> import os 2024-09-11T23:06:41.266 DEBUG:teuthology.orchestra.run.smithi012:> import subprocess 2024-09-11T23:06:41.266 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:06:41.266 DEBUG:teuthology.orchestra.run.smithi012:> def _find_admin_socket(client_name): 2024-09-11T23:06:41.266 DEBUG:teuthology.orchestra.run.smithi012:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-11T23:06:41.266 DEBUG:teuthology.orchestra.run.smithi012:> files = glob.glob(asok_path) 2024-09-11T23:06:41.266 DEBUG:teuthology.orchestra.run.smithi012:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-11T23:06:41.266 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:06:41.266 DEBUG:teuthology.orchestra.run.smithi012:> # Given a non-glob path, it better be there 2024-09-11T23:06:41.266 DEBUG:teuthology.orchestra.run.smithi012:> if "*" not in asok_path: 2024-09-11T23:06:41.266 DEBUG:teuthology.orchestra.run.smithi012:> assert(len(files) == 1) 2024-09-11T23:06:41.267 DEBUG:teuthology.orchestra.run.smithi012:> return files[0] 2024-09-11T23:06:41.267 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:06:41.267 DEBUG:teuthology.orchestra.run.smithi012:> for f in files: 2024-09-11T23:06:41.267 DEBUG:teuthology.orchestra.run.smithi012:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T23:06:41.267 DEBUG:teuthology.orchestra.run.smithi012:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T23:06:41.267 DEBUG:teuthology.orchestra.run.smithi012:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T23:06:41.267 DEBUG:teuthology.orchestra.run.smithi012:> contents = proc_f.read() 2024-09-11T23:06:41.267 DEBUG:teuthology.orchestra.run.smithi012:> if mountpoint in contents: 2024-09-11T23:06:41.267 DEBUG:teuthology.orchestra.run.smithi012:> return f 2024-09-11T23:06:41.267 DEBUG:teuthology.orchestra.run.smithi012:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T23:06:41.267 DEBUG:teuthology.orchestra.run.smithi012:> 2024-09-11T23:06:41.267 DEBUG:teuthology.orchestra.run.smithi012:> print(_find_admin_socket("client.1")) 2024-09-11T23:06:41.267 DEBUG:teuthology.orchestra.run.smithi012:> ' 2024-09-11T23:06:41.392 INFO:teuthology.orchestra.run.smithi012.stdout:/var/run/ceph/ceph-client.1.41332.asok 2024-09-11T23:06:41.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:06:41.404 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.41332.asok 2024-09-11T23:06:41.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:06:41.405 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.41332.asok status 2024-09-11T23:06:41.566 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T23:06:41.566 INFO:teuthology.orchestra.run.smithi012.stdout: "metadata": { 2024-09-11T23:06:41.567 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-11T23:06:41.567 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T23:06:41.567 INFO:teuthology.orchestra.run.smithi012.stdout: "entity_id": "1", 2024-09-11T23:06:41.567 INFO:teuthology.orchestra.run.smithi012.stdout: "hostname": "smithi012", 2024-09-11T23:06:41.567 INFO:teuthology.orchestra.run.smithi012.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-11T23:06:41.567 INFO:teuthology.orchestra.run.smithi012.stdout: "pid": "41332", 2024-09-11T23:06:41.567 INFO:teuthology.orchestra.run.smithi012.stdout: "root": "/" 2024-09-11T23:06:41.567 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:06:41.567 INFO:teuthology.orchestra.run.smithi012.stdout: "dentry_count": 0, 2024-09-11T23:06:41.567 INFO:teuthology.orchestra.run.smithi012.stdout: "dentry_pinned_count": 0, 2024-09-11T23:06:41.567 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 5058, 2024-09-11T23:06:41.567 INFO:teuthology.orchestra.run.smithi012.stdout: "inst": { 2024-09-11T23:06:41.567 INFO:teuthology.orchestra.run.smithi012.stdout: "name": { 2024-09-11T23:06:41.568 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "client", 2024-09-11T23:06:41.568 INFO:teuthology.orchestra.run.smithi012.stdout: "num": 5058 2024-09-11T23:06:41.568 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:06:41.568 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": { 2024-09-11T23:06:41.568 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T23:06:41.568 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "192.168.0.2:0", 2024-09-11T23:06:41.568 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 3609214374 2024-09-11T23:06:41.568 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-11T23:06:41.568 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:06:41.568 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": { 2024-09-11T23:06:41.568 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-11T23:06:41.568 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "192.168.0.2:0", 2024-09-11T23:06:41.568 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 3609214374 2024-09-11T23:06:41.568 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-11T23:06:41.569 INFO:teuthology.orchestra.run.smithi012.stdout: "inst_str": "client.5058 192.168.0.2:0/3609214374", 2024-09-11T23:06:41.569 INFO:teuthology.orchestra.run.smithi012.stdout: "addr_str": "192.168.0.2:0/3609214374", 2024-09-11T23:06:41.569 INFO:teuthology.orchestra.run.smithi012.stdout: "inode_count": 1, 2024-09-11T23:06:41.569 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_epoch": 49, 2024-09-11T23:06:41.569 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_epoch": 65, 2024-09-11T23:06:41.569 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_epoch_barrier": 0, 2024-09-11T23:06:41.569 INFO:teuthology.orchestra.run.smithi012.stdout: "blocklisted": false, 2024-09-11T23:06:41.569 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs" 2024-09-11T23:06:41.569 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T23:06:41.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:06:41.580 DEBUG:teuthology.orchestra.run.smithi012:> stat --file-system '--printf=%T 2024-09-11T23:06:41.581 DEBUG:teuthology.orchestra.run.smithi012:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-11T23:06:41.586 INFO:teuthology.orchestra.run.smithi012.stdout:fuseblk 2024-09-11T23:06:41.586 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-11T23:06:41.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:06:41.586 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-11T23:06:41.640 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable stats 2024-09-11T23:06:41.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:41.807+0000 7fef02dc8640 1 Processor -- start 2024-09-11T23:06:41.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:41.807+0000 7fef02dc8640 1 -- start start 2024-09-11T23:06:41.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:41.811+0000 7fef02dc8640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7feefc0a71c0 0x7feefc0a75a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:41.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:41.811+0000 7fef02dc8640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feefc0a4e40 con 0x7feefc0a7ae0 2024-09-11T23:06:41.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:41.811+0000 7fef02dc8640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7feefc0a6af0 con 0x7feefc0a71c0 2024-09-11T23:06:41.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:41.811+0000 7fef00b64640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7feefc0a71c0 0x7feefc0a75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:41.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:41.811+0000 7feefbfff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7feefc0a7ae0 0x7feefc139c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42136/0 (socket says 172.21.15.12:42136) 2024-09-11T23:06:41.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:41.811+0000 7feefbfff640 1 -- 172.21.15.12:0/3245056462 learned_addr learned my addr 172.21.15.12:0/3245056462 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:41.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:41.811+0000 7fef00b64640 1 -- 172.21.15.12:0/3245056462 >> v1:172.21.15.12:6789/0 conn(0x7feefc0a7ae0 legacy=0x7feefc139c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:41.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:41.811+0000 7feefb7fe640 1 -- 172.21.15.12:0/3245056462 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2434934472 0 0) 0x7feefc0a4e40 con 0x7feefc0a7ae0 2024-09-11T23:06:41.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:41.811+0000 7fef00b64640 1 -- 172.21.15.12:0/3245056462 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feefc0a3f50 con 0x7feefc0a71c0 2024-09-11T23:06:41.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:41.811+0000 7fef00b64640 1 --2- 172.21.15.12:0/3245056462 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feefc0a71c0 0x7feefc0a75a0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7feeec009d90 tx=0x7feeec01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4239da023f49551b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:41.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:41.811+0000 7feefb7fe640 1 -- 172.21.15.12:0/3245056462 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feeec0b2070 con 0x7feefc0a71c0 2024-09-11T23:06:41.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:41.811+0000 7feefb7fe640 1 -- 172.21.15.12:0/3245056462 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeec0a5700 con 0x7feefc0a71c0 2024-09-11T23:06:41.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:41.811+0000 7feefb7fe640 1 -- 172.21.15.12:0/3245056462 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feeec0a5a00 con 0x7feefc0a71c0 2024-09-11T23:06:41.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:41.811+0000 7fef02dc8640 1 -- 172.21.15.12:0/3245056462 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feefc0a71c0 msgr2=0x7feefc0a75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:41.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:41.811+0000 7fef02dc8640 1 --2- 172.21.15.12:0/3245056462 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feefc0a71c0 0x7feefc0a75a0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7feeec009d90 tx=0x7feeec01c8e0 comp rx=0 tx=0).stop 2024-09-11T23:06:41.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:41.811+0000 7fef02dc8640 1 -- 172.21.15.12:0/3245056462 shutdown_connections 2024-09-11T23:06:41.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:41.811+0000 7fef02dc8640 1 --2- 172.21.15.12:0/3245056462 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feefc0a71c0 0x7feefc0a75a0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:41.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:41.811+0000 7fef02dc8640 1 -- 172.21.15.12:0/3245056462 >> 172.21.15.12:0/3245056462 conn(0x7feefc0ac4f0 msgr2=0x7feefc0ac900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:41.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:41.811+0000 7fef02dc8640 1 -- 172.21.15.12:0/3245056462 shutdown_connections 2024-09-11T23:06:41.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:41.811+0000 7fef02dc8640 1 -- 172.21.15.12:0/3245056462 wait complete. 2024-09-11T23:06:41.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:41.815+0000 7fef02dc8640 1 Processor -- start 2024-09-11T23:06:41.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:41.815+0000 7fef02dc8640 1 -- start start 2024-09-11T23:06:41.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:41.815+0000 7fef02dc8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feefc0a71c0 0x7feefc1ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:41.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:41.815+0000 7fef02dc8640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7feefc1420f0 con 0x7feefc0a71c0 2024-09-11T23:06:41.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:41.815+0000 7fef00b64640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feefc0a71c0 0x7feefc1ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:41.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:41.815+0000 7fef00b64640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feefc0a71c0 0x7feefc1ce5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49358/0 (socket says 172.21.15.12:49358) 2024-09-11T23:06:41.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:41.815+0000 7fef00b64640 1 -- 172.21.15.12:0/2670972809 learned_addr learned my addr 172.21.15.12:0/2670972809 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:41.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:41.815+0000 7fef00b64640 1 -- 172.21.15.12:0/2670972809 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feefc09c890 con 0x7feefc0a71c0 2024-09-11T23:06:41.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:41.815+0000 7fef00b64640 1 --2- 172.21.15.12:0/2670972809 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feefc0a71c0 0x7feefc1ce5a0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7feeec0194f0 tx=0x7feeec019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:41.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:41.815+0000 7feef97fa640 1 -- 172.21.15.12:0/2670972809 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feeec0bd020 con 0x7feefc0a71c0 2024-09-11T23:06:41.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:41.815+0000 7feef97fa640 1 -- 172.21.15.12:0/2670972809 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeec0b85a0 con 0x7feefc0a71c0 2024-09-11T23:06:41.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:41.815+0000 7feef97fa640 1 -- 172.21.15.12:0/2670972809 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feeec0b2040 con 0x7feefc0a71c0 2024-09-11T23:06:41.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:41.815+0000 7fef02dc8640 1 -- 172.21.15.12:0/2670972809 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feefc1ce300 con 0x7feefc0a71c0 2024-09-11T23:06:41.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:41.815+0000 7fef02dc8640 1 -- 172.21.15.12:0/2670972809 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feefc09c1e0 con 0x7feefc0a71c0 2024-09-11T23:06:41.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:41.815+0000 7fef02dc8640 1 -- 172.21.15.12:0/2670972809 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feefc0a75a0 con 0x7feefc0a71c0 2024-09-11T23:06:41.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:41.815+0000 7feef97fa640 1 -- 172.21.15.12:0/2670972809 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 32) ==== 43997+0+0 (secure 0 0 0) 0x7feeec0c0020 con 0x7feefc0a71c0 2024-09-11T23:06:41.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:41.815+0000 7feef97fa640 1 --2- 172.21.15.12:0/2670972809 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7feedc035d20 0x7feedc0381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:41.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:41.815+0000 7feef97fa640 1 -- 172.21.15.12:0/2670972809 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 3482+0+0 (secure 0 0 0) 0x7feeec0e3710 con 0x7feefc0a71c0 2024-09-11T23:06:41.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:41.815+0000 7feefbfff640 1 --2- 172.21.15.12:0/2670972809 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7feedc035d20 0x7feedc0381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:41.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:41.815+0000 7feefbfff640 1 --2- 172.21.15.12:0/2670972809 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7feedc035d20 0x7feedc0381e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7feee4007fd0 tx=0x7feee4007920 comp rx=0 tx=0).ready entity=mgr.4903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:41.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:41.823+0000 7feef97fa640 1 -- 172.21.15.12:0/2670972809 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7feeec0c7070 con 0x7feefc0a71c0 2024-09-11T23:06:42.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.031+0000 7fef02dc8640 1 -- 172.21.15.12:0/2670972809 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "stats"} v 0) -- 0x7feefc13ec10 con 0x7feefc0a71c0 2024-09-11T23:06:42.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.619+0000 7feef97fa640 1 -- 172.21.15.12:0/2670972809 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "stats"}]=0 v33) ==== 84+0+0 (secure 0 0 0) 0x7feeec016560 con 0x7feefc0a71c0 2024-09-11T23:06:42.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.619+0000 7fef02dc8640 1 -- 172.21.15.12:0/2670972809 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7feedc035d20 msgr2=0x7feedc0381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:42.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.619+0000 7fef02dc8640 1 --2- 172.21.15.12:0/2670972809 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7feedc035d20 0x7feedc0381e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7feee4007fd0 tx=0x7feee4007920 comp rx=0 tx=0).stop 2024-09-11T23:06:42.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.619+0000 7fef02dc8640 1 -- 172.21.15.12:0/2670972809 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feefc0a71c0 msgr2=0x7feefc1ce5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:42.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.619+0000 7fef02dc8640 1 --2- 172.21.15.12:0/2670972809 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feefc0a71c0 0x7feefc1ce5a0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7feeec0194f0 tx=0x7feeec019680 comp rx=0 tx=0).stop 2024-09-11T23:06:42.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.623+0000 7fef02dc8640 1 -- 172.21.15.12:0/2670972809 shutdown_connections 2024-09-11T23:06:42.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.623+0000 7fef02dc8640 1 --2- 172.21.15.12:0/2670972809 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7feedc035d20 0x7feedc0381e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:42.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.623+0000 7fef02dc8640 1 --2- 172.21.15.12:0/2670972809 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feefc0a71c0 0x7feefc1ce5a0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:42.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.623+0000 7fef02dc8640 1 -- 172.21.15.12:0/2670972809 >> 172.21.15.12:0/2670972809 conn(0x7feefc0ac4f0 msgr2=0x7feefc13f690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:42.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.623+0000 7fef02dc8640 1 -- 172.21.15.12:0/2670972809 shutdown_connections 2024-09-11T23:06:42.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.623+0000 7fef02dc8640 1 -- 172.21.15.12:0/2670972809 wait complete. 2024-09-11T23:06:42.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:06:42.645 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec cephfs-top --cluster=hpec --id=admin --selftest) 2024-09-11T23:06:42.718 INFO:teuthology.orchestra.run.smithi012.stderr:cluster hpec does not exist 2024-09-11T23:06:42.726 DEBUG:teuthology.orchestra.run:got remote process result: 255 2024-09-11T23:06:42.726 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable stats 2024-09-11T23:06:42.767 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:42.763+0000 7f80008a9180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T23:06:42.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.843+0000 7fa32f30e640 1 Processor -- start 2024-09-11T23:06:42.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.843+0000 7fa32f30e640 1 -- start start 2024-09-11T23:06:42.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.843+0000 7fa32f30e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa32809fc40 0x7fa32813ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:42.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.843+0000 7fa32f30e640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3280a1c00 con 0x7fa32813a200 2024-09-11T23:06:42.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.843+0000 7fa32f30e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fa3280a0e40 con 0x7fa32809fc40 2024-09-11T23:06:42.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.843+0000 7fa32c8a9640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa32809fc40 0x7fa32813ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:42.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.843+0000 7fa32d0aa640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa32813a200 0x7fa32813a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42156/0 (socket says 172.21.15.12:42156) 2024-09-11T23:06:42.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.843+0000 7fa32c8a9640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa32809fc40 0x7fa32813ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49376/0 (socket says 172.21.15.12:49376) 2024-09-11T23:06:42.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.843+0000 7fa32d0aa640 1 -- 172.21.15.12:0/2912232312 learned_addr learned my addr 172.21.15.12:0/2912232312 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:42.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.843+0000 7fa32c8a9640 1 -- 172.21.15.12:0/2912232312 >> v1:172.21.15.12:6789/0 conn(0x7fa32813a200 legacy=0x7fa32813a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:42.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.843+0000 7fa32c8a9640 1 -- 172.21.15.12:0/2912232312 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa32809f350 con 0x7fa32809fc40 2024-09-11T23:06:42.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.847+0000 7fa32c8a9640 1 --2- 172.21.15.12:0/2912232312 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa32809fc40 0x7fa32813ef80 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fa318009740 tx=0x7fa31801c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e7fd60d7bb7c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:42.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.847+0000 7fa31ffff640 1 -- 172.21.15.12:0/2912232312 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3180b0070 con 0x7fa32809fc40 2024-09-11T23:06:42.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.847+0000 7fa31ffff640 1 -- 172.21.15.12:0/2912232312 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3180ab530 con 0x7fa32809fc40 2024-09-11T23:06:42.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.847+0000 7fa31ffff640 1 -- 172.21.15.12:0/2912232312 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3180ab830 con 0x7fa32809fc40 2024-09-11T23:06:42.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.847+0000 7fa32f30e640 1 -- 172.21.15.12:0/2912232312 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa32809fc40 msgr2=0x7fa32813ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:42.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.847+0000 7fa32f30e640 1 --2- 172.21.15.12:0/2912232312 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa32809fc40 0x7fa32813ef80 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fa318009740 tx=0x7fa31801c390 comp rx=0 tx=0).stop 2024-09-11T23:06:42.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.847+0000 7fa32f30e640 1 -- 172.21.15.12:0/2912232312 shutdown_connections 2024-09-11T23:06:42.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.847+0000 7fa32f30e640 1 --2- 172.21.15.12:0/2912232312 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa32809fc40 0x7fa32813ef80 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:42.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.847+0000 7fa32f30e640 1 -- 172.21.15.12:0/2912232312 >> 172.21.15.12:0/2912232312 conn(0x7fa32806da30 msgr2=0x7fa32806de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:42.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.847+0000 7fa32f30e640 1 -- 172.21.15.12:0/2912232312 shutdown_connections 2024-09-11T23:06:42.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.847+0000 7fa32f30e640 1 -- 172.21.15.12:0/2912232312 wait complete. 2024-09-11T23:06:42.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.847+0000 7fa32f30e640 1 Processor -- start 2024-09-11T23:06:42.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.847+0000 7fa32f30e640 1 -- start start 2024-09-11T23:06:42.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.851+0000 7fa32f30e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa32813a200 0x7fa3280aafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:42.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.851+0000 7fa32f30e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa328141ce0 con 0x7fa32813a200 2024-09-11T23:06:42.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.851+0000 7fa32d0aa640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa32813a200 0x7fa3280aafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:42.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.851+0000 7fa32d0aa640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa32813a200 0x7fa3280aafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49390/0 (socket says 172.21.15.12:49390) 2024-09-11T23:06:42.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.851+0000 7fa32d0aa640 1 -- 172.21.15.12:0/4089530180 learned_addr learned my addr 172.21.15.12:0/4089530180 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:42.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.851+0000 7fa32d0aa640 1 -- 172.21.15.12:0/4089530180 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3280aa560 con 0x7fa32813a200 2024-09-11T23:06:42.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.851+0000 7fa32d0aa640 1 --2- 172.21.15.12:0/4089530180 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa32813a200 0x7fa3280aafa0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fa32400c480 tx=0x7fa32400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:42.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.851+0000 7fa31dffb640 1 -- 172.21.15.12:0/4089530180 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa324017070 con 0x7fa32813a200 2024-09-11T23:06:42.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.851+0000 7fa31dffb640 1 -- 172.21.15.12:0/4089530180 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa324005c20 con 0x7fa32813a200 2024-09-11T23:06:42.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.851+0000 7fa32f30e640 1 -- 172.21.15.12:0/4089530180 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3280abd10 con 0x7fa32813a200 2024-09-11T23:06:42.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.851+0000 7fa31dffb640 1 -- 172.21.15.12:0/4089530180 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa324007070 con 0x7fa32813a200 2024-09-11T23:06:42.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.851+0000 7fa32f30e640 1 -- 172.21.15.12:0/4089530180 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3280abfc0 con 0x7fa32813a200 2024-09-11T23:06:42.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.851+0000 7fa31dffb640 1 -- 172.21.15.12:0/4089530180 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 33) ==== 44062+0+0 (secure 0 0 0) 0x7fa32401a070 con 0x7fa32813a200 2024-09-11T23:06:42.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.851+0000 7fa32f30e640 1 -- 172.21.15.12:0/4089530180 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa32813a660 con 0x7fa32813a200 2024-09-11T23:06:42.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.851+0000 7fa31dffb640 1 --2- 172.21.15.12:0/4089530180 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fa30c035e00 0x7fa30c0382c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:42.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.851+0000 7fa31dffb640 1 -- 172.21.15.12:0/4089530180 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 3482+0+0 (secure 0 0 0) 0x7fa324047980 con 0x7fa32813a200 2024-09-11T23:06:42.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.851+0000 7fa32c8a9640 1 -- 172.21.15.12:0/4089530180 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fa30c035e00 msgr2=0x7fa30c0382c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6828/4277951488 2024-09-11T23:06:42.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.851+0000 7fa32c8a9640 1 --2- 172.21.15.12:0/4089530180 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fa30c035e00 0x7fa30c0382c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:06:42.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:42.855+0000 7fa31dffb640 1 -- 172.21.15.12:0/4089530180 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa324007210 con 0x7fa32813a200 2024-09-11T23:06:43.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.055+0000 7fa32c8a9640 1 -- 172.21.15.12:0/4089530180 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fa30c035e00 msgr2=0x7fa30c0382c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6828/4277951488 2024-09-11T23:06:43.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.055+0000 7fa32c8a9640 1 --2- 172.21.15.12:0/4089530180 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fa30c035e00 0x7fa30c0382c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T23:06:43.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.055+0000 7fa32f30e640 1 -- 172.21.15.12:0/4089530180 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "stats"} v 0) -- 0x7fa328073580 con 0x7fa32813a200 2024-09-11T23:06:43.167 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:43.163+0000 7f80008a9180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T23:06:43.304 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:43.299+0000 7f80008a9180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T23:06:43.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.459+0000 7fa32c8a9640 1 -- 172.21.15.12:0/4089530180 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fa30c035e00 msgr2=0x7fa30c0382c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6828/4277951488 2024-09-11T23:06:43.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.459+0000 7fa32c8a9640 1 --2- 172.21.15.12:0/4089530180 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fa30c035e00 0x7fa30c0382c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T23:06:43.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.627+0000 7fa31dffb640 1 -- 172.21.15.12:0/4089530180 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "stats"}]=0 v34) ==== 85+0+0 (secure 0 0 0) 0x7fa32401b450 con 0x7fa32813a200 2024-09-11T23:06:43.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.631+0000 7fa32f30e640 1 -- 172.21.15.12:0/4089530180 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fa30c035e00 msgr2=0x7fa30c0382c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:06:43.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.631+0000 7fa32f30e640 1 --2- 172.21.15.12:0/4089530180 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fa30c035e00 0x7fa30c0382c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:43.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.631+0000 7fa31dffb640 1 -- 172.21.15.12:0/4089530180 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mgrmap(e 34) ==== 44053+0+0 (secure 0 0 0) 0x7fa324007590 con 0x7fa32813a200 2024-09-11T23:06:43.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.631+0000 7fa32f30e640 1 -- 172.21.15.12:0/4089530180 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa32813a200 msgr2=0x7fa3280aafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:43.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.631+0000 7fa32f30e640 1 --2- 172.21.15.12:0/4089530180 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa32813a200 0x7fa3280aafa0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fa32400c480 tx=0x7fa32400c940 comp rx=0 tx=0).stop 2024-09-11T23:06:43.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.631+0000 7fa32f30e640 1 -- 172.21.15.12:0/4089530180 shutdown_connections 2024-09-11T23:06:43.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.631+0000 7fa32f30e640 1 --2- 172.21.15.12:0/4089530180 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fa30c035e00 0x7fa30c0382c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:43.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.631+0000 7fa32f30e640 1 --2- 172.21.15.12:0/4089530180 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa32813a200 0x7fa3280aafa0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:43.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.631+0000 7fa32f30e640 1 -- 172.21.15.12:0/4089530180 >> 172.21.15.12:0/4089530180 conn(0x7fa32806da30 msgr2=0x7fa32809ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:43.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.631+0000 7fa32f30e640 1 -- 172.21.15.12:0/4089530180 shutdown_connections 2024-09-11T23:06:43.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.631+0000 7fa32f30e640 1 -- 172.21.15.12:0/4089530180 wait complete. 2024-09-11T23:06:43.652 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T23:06:43.652 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:06:43.748 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:43.747+0000 7f80008a9180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T23:06:43.753 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T23:06:43.754 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:06:43.754 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T23:06:43.754 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:06:43.759 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:06:43.802 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:43.799+0000 7f80008a9180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T23:06:43.854 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:43.851+0000 7f80008a9180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T23:06:43.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.927+0000 7fa57f9e2640 1 Processor -- start 2024-09-11T23:06:43.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.927+0000 7fa57f9e2640 1 -- start start 2024-09-11T23:06:43.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.927+0000 7fa57f9e2640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa57813a0f0 0x7fa5780a03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:43.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.927+0000 7fa57f9e2640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa57806cb10 con 0x7fa57813a4d0 2024-09-11T23:06:43.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.927+0000 7fa57f9e2640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fa5780a4310 con 0x7fa57813a0f0 2024-09-11T23:06:43.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.927+0000 7fa57d77e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa57813a0f0 0x7fa5780a03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:43.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.927+0000 7fa57cf7d640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa57813a4d0 0x7fa57809ede0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42162/0 (socket says 172.21.15.12:42162) 2024-09-11T23:06:43.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.927+0000 7fa57cf7d640 1 -- 172.21.15.12:0/3501728124 learned_addr learned my addr 172.21.15.12:0/3501728124 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:43.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.927+0000 7fa57d77e640 1 -- 172.21.15.12:0/3501728124 >> v1:172.21.15.12:6789/0 conn(0x7fa57813a4d0 legacy=0x7fa57809ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:43.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.927+0000 7fa57d77e640 1 -- 172.21.15.12:0/3501728124 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5780a3f00 con 0x7fa57813a0f0 2024-09-11T23:06:43.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.927+0000 7fa57d77e640 1 --2- 172.21.15.12:0/3501728124 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa57813a0f0 0x7fa5780a03b0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fa574009740 tx=0x7fa57401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca1be5053245223f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:43.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.931+0000 7fa56bfff640 1 -- 172.21.15.12:0/3501728124 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5740b0070 con 0x7fa57813a0f0 2024-09-11T23:06:43.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.931+0000 7fa56bfff640 1 -- 172.21.15.12:0/3501728124 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5740ab530 con 0x7fa57813a0f0 2024-09-11T23:06:43.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.931+0000 7fa56bfff640 1 -- 172.21.15.12:0/3501728124 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5740ab830 con 0x7fa57813a0f0 2024-09-11T23:06:43.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.931+0000 7fa57f9e2640 1 -- 172.21.15.12:0/3501728124 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa57813a0f0 msgr2=0x7fa5780a03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:43.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.931+0000 7fa57f9e2640 1 --2- 172.21.15.12:0/3501728124 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa57813a0f0 0x7fa5780a03b0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fa574009740 tx=0x7fa57401c390 comp rx=0 tx=0).stop 2024-09-11T23:06:43.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.931+0000 7fa57f9e2640 1 -- 172.21.15.12:0/3501728124 shutdown_connections 2024-09-11T23:06:43.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.931+0000 7fa57f9e2640 1 --2- 172.21.15.12:0/3501728124 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa57813a0f0 0x7fa5780a03b0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:43.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.931+0000 7fa57f9e2640 1 -- 172.21.15.12:0/3501728124 >> 172.21.15.12:0/3501728124 conn(0x7fa5780a9320 msgr2=0x7fa5780a9730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:43.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.931+0000 7fa57f9e2640 1 -- 172.21.15.12:0/3501728124 shutdown_connections 2024-09-11T23:06:43.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.931+0000 7fa57f9e2640 1 -- 172.21.15.12:0/3501728124 wait complete. 2024-09-11T23:06:43.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.931+0000 7fa57f9e2640 1 Processor -- start 2024-09-11T23:06:43.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.931+0000 7fa57f9e2640 1 -- start start 2024-09-11T23:06:43.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.931+0000 7fa57f9e2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa57813a0f0 0x7fa57813d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:43.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.931+0000 7fa57f9e2640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa57813aa30 con 0x7fa57813a0f0 2024-09-11T23:06:43.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.931+0000 7fa57d77e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa57813a0f0 0x7fa57813d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:43.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.931+0000 7fa57d77e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa57813a0f0 0x7fa57813d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49402/0 (socket says 172.21.15.12:49402) 2024-09-11T23:06:43.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.931+0000 7fa57d77e640 1 -- 172.21.15.12:0/1853747877 learned_addr learned my addr 172.21.15.12:0/1853747877 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:43.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.931+0000 7fa57d77e640 1 -- 172.21.15.12:0/1853747877 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5781373e0 con 0x7fa57813a0f0 2024-09-11T23:06:43.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.931+0000 7fa57d77e640 1 --2- 172.21.15.12:0/1853747877 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa57813a0f0 0x7fa57813d0b0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fa574019fc0 tx=0x7fa57401abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:43.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.931+0000 7fa569ffb640 1 -- 172.21.15.12:0/1853747877 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5740b0050 con 0x7fa57813a0f0 2024-09-11T23:06:43.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.931+0000 7fa569ffb640 1 -- 172.21.15.12:0/1853747877 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5740b1040 con 0x7fa57813a0f0 2024-09-11T23:06:43.936 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:43.931+0000 7f80008a9180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T23:06:43.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.931+0000 7fa57f9e2640 1 -- 172.21.15.12:0/1853747877 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5781202a0 con 0x7fa57813a0f0 2024-09-11T23:06:43.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.931+0000 7fa569ffb640 1 -- 172.21.15.12:0/1853747877 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5740b5930 con 0x7fa57813a0f0 2024-09-11T23:06:43.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.931+0000 7fa57f9e2640 1 -- 172.21.15.12:0/1853747877 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa57813f840 con 0x7fa57813a0f0 2024-09-11T23:06:43.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.935+0000 7fa569ffb640 1 -- 172.21.15.12:0/1853747877 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 34) ==== 44053+0+0 (secure 0 0 0) 0x7fa5740be030 con 0x7fa57813a0f0 2024-09-11T23:06:43.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.935+0000 7fa57f9e2640 1 -- 172.21.15.12:0/1853747877 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5780a03b0 con 0x7fa57813a0f0 2024-09-11T23:06:43.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.935+0000 7fa569ffb640 1 --2- 172.21.15.12:0/1853747877 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fa55c035db0 0x7fa55c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:43.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.935+0000 7fa569ffb640 1 -- 172.21.15.12:0/1853747877 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 3482+0+0 (secure 0 0 0) 0x7fa5740bc070 con 0x7fa57813a0f0 2024-09-11T23:06:43.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.935+0000 7fa57cf7d640 1 -- 172.21.15.12:0/1853747877 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fa55c035db0 msgr2=0x7fa55c038270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6828/4277951488 2024-09-11T23:06:43.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.935+0000 7fa57cf7d640 1 --2- 172.21.15.12:0/1853747877 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fa55c035db0 0x7fa55c038270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:06:43.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:43.939+0000 7fa569ffb640 1 -- 172.21.15.12:0/1853747877 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa5740c5020 con 0x7fa57813a0f0 2024-09-11T23:06:43.988 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:43.987+0000 7f80008a9180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T23:06:44.068 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:44.067+0000 7f80008a9180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T23:06:44.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.115+0000 7fa57f9e2640 1 -- 172.21.15.12:0/1853747877 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa57806cd70 con 0x7fa57813a0f0 2024-09-11T23:06:44.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.115+0000 7fa569ffb640 1 -- 172.21.15.12:0/1853747877 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 1 entries v66) ==== 80+0+58 (secure 0 0 0) 0x7fa574016010 con 0x7fa57813a0f0 2024-09-11T23:06:44.118 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/2496375865 2024-09-12T00:06:39.939411+0000 2024-09-11T23:06:44.118 INFO:teuthology.orchestra.run.smithi012.stderr:listed 1 entries 2024-09-11T23:06:44.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.115+0000 7fa57f9e2640 1 -- 172.21.15.12:0/1853747877 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fa55c035db0 msgr2=0x7fa55c038270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:06:44.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.115+0000 7fa57f9e2640 1 --2- 172.21.15.12:0/1853747877 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fa55c035db0 0x7fa55c038270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:44.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.115+0000 7fa57f9e2640 1 -- 172.21.15.12:0/1853747877 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa57813a0f0 msgr2=0x7fa57813d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:44.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.115+0000 7fa57f9e2640 1 --2- 172.21.15.12:0/1853747877 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa57813a0f0 0x7fa57813d0b0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fa574019fc0 tx=0x7fa57401abd0 comp rx=0 tx=0).stop 2024-09-11T23:06:44.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.115+0000 7fa57f9e2640 1 -- 172.21.15.12:0/1853747877 shutdown_connections 2024-09-11T23:06:44.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.115+0000 7fa57f9e2640 1 --2- 172.21.15.12:0/1853747877 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7fa55c035db0 0x7fa55c038270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:44.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.115+0000 7fa57f9e2640 1 --2- 172.21.15.12:0/1853747877 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa57813a0f0 0x7fa57813d0b0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:44.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.115+0000 7fa57f9e2640 1 -- 172.21.15.12:0/1853747877 >> 172.21.15.12:0/1853747877 conn(0x7fa5780a9320 msgr2=0x7fa5780a5fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:44.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.115+0000 7fa57f9e2640 1 -- 172.21.15.12:0/1853747877 shutdown_connections 2024-09-11T23:06:44.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.115+0000 7fa57f9e2640 1 -- 172.21.15.12:0/1853747877 wait complete. 2024-09-11T23:06:44.121 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:44.119+0000 7f80008a9180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T23:06:44.136 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi012.front.sepia.ceph.com... 2024-09-11T23:06:44.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:06:44.136 DEBUG:teuthology.orchestra.run.smithi012:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-11T23:06:44.191 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi012.stderr:ceph-fuse[41222]: fuse finished with error 0 and tester_r 0 2024-09-11T23:06:44.193 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi012.front.sepia.ceph.com 2024-09-11T23:06:44.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:06:44.193 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-11T23:06:44.271 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:44.267+0000 7f80008a9180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T23:06:44.325 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:44.323+0000 7f80008a9180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T23:06:44.342 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:06:44.342 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T23:06:44.343 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:06:44.389 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:06:44.554 INFO:tasks.ceph.mgr.x.smithi012.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-11T23:06:44.554 INFO:tasks.ceph.mgr.x.smithi012.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-11T23:06:44.554 INFO:tasks.ceph.mgr.x.smithi012.stderr: from numpy import show_config as show_numpy_config 2024-09-11T23:06:44.562 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:44.559+0000 7f80008a9180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T23:06:44.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.587+0000 7f9b68953640 1 Processor -- start 2024-09-11T23:06:44.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.587+0000 7f9b68953640 1 -- start start 2024-09-11T23:06:44.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.587+0000 7f9b68953640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9b641381c0 0x7f9b6413cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:44.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.587+0000 7f9b68953640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b6409d690 con 0x7f9b64137de0 2024-09-11T23:06:44.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.587+0000 7f9b68953640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f9b6409ea90 con 0x7f9b641381c0 2024-09-11T23:06:44.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.587+0000 7f9b61d9b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9b641381c0 0x7f9b6413cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:44.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.587+0000 7f9b61d9b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9b641381c0 0x7f9b6413cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39940/0 (socket says 172.21.15.12:39940) 2024-09-11T23:06:44.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.587+0000 7f9b6259c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f9b64137de0 0x7f9b6409f190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38834/0 (socket says 172.21.15.12:38834) 2024-09-11T23:06:44.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.587+0000 7f9b61d9b640 1 -- 172.21.15.12:0/863263141 learned_addr learned my addr 172.21.15.12:0/863263141 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:44.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.587+0000 7f9b61d9b640 1 -- 172.21.15.12:0/863263141 >> v1:172.21.15.12:6789/0 conn(0x7f9b64137de0 legacy=0x7f9b6409f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:44.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.587+0000 7f9b61d9b640 1 -- 172.21.15.12:0/863263141 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b6409cf00 con 0x7f9b641381c0 2024-09-11T23:06:44.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.587+0000 7f9b61d9b640 1 --2- 172.21.15.12:0/863263141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b641381c0 0x7f9b6413cbc0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f9b580097f0 tx=0x7f9b5801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e672f4657058130 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:44.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.587+0000 7f9b6159a640 1 -- 172.21.15.12:0/863263141 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b580b2070 con 0x7f9b641381c0 2024-09-11T23:06:44.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.587+0000 7f9b6159a640 1 -- 172.21.15.12:0/863263141 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b580a9070 con 0x7f9b641381c0 2024-09-11T23:06:44.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.587+0000 7f9b6159a640 1 -- 172.21.15.12:0/863263141 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b580ad5b0 con 0x7f9b641381c0 2024-09-11T23:06:44.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.591+0000 7f9b68953640 1 -- 172.21.15.12:0/863263141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b641381c0 msgr2=0x7f9b6413cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:44.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.591+0000 7f9b68953640 1 --2- 172.21.15.12:0/863263141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b641381c0 0x7f9b6413cbc0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f9b580097f0 tx=0x7f9b5801c450 comp rx=0 tx=0).stop 2024-09-11T23:06:44.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.591+0000 7f9b68953640 1 -- 172.21.15.12:0/863263141 shutdown_connections 2024-09-11T23:06:44.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.591+0000 7f9b68953640 1 --2- 172.21.15.12:0/863263141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b641381c0 0x7f9b6413cbc0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:44.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.591+0000 7f9b68953640 1 -- 172.21.15.12:0/863263141 >> 172.21.15.12:0/863263141 conn(0x7f9b640a82f0 msgr2=0x7f9b640a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:44.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.591+0000 7f9b68953640 1 -- 172.21.15.12:0/863263141 shutdown_connections 2024-09-11T23:06:44.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.591+0000 7f9b68953640 1 -- 172.21.15.12:0/863263141 wait complete. 2024-09-11T23:06:44.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.591+0000 7f9b68953640 1 Processor -- start 2024-09-11T23:06:44.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.591+0000 7f9b68953640 1 -- start start 2024-09-11T23:06:44.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.591+0000 7f9b68953640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b64137de0 0x7f9b64071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:44.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.591+0000 7f9b68953640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9b64137860 con 0x7f9b64137de0 2024-09-11T23:06:44.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.591+0000 7f9b6259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b64137de0 0x7f9b64071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:44.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.591+0000 7f9b6259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b64137de0 0x7f9b64071fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39954/0 (socket says 172.21.15.12:39954) 2024-09-11T23:06:44.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.591+0000 7f9b6259c640 1 -- 172.21.15.12:0/2230797588 learned_addr learned my addr 172.21.15.12:0/2230797588 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:44.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.591+0000 7f9b6259c640 1 -- 172.21.15.12:0/2230797588 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b64120d70 con 0x7f9b64137de0 2024-09-11T23:06:44.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.591+0000 7f9b6259c640 1 --2- 172.21.15.12:0/2230797588 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b64137de0 0x7f9b64071fc0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f9b5400c2f0 tx=0x7f9b5400c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:44.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.591+0000 7f9b52ffd640 1 -- 172.21.15.12:0/2230797588 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b54007410 con 0x7f9b64137de0 2024-09-11T23:06:44.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.591+0000 7f9b52ffd640 1 -- 172.21.15.12:0/2230797588 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b540075b0 con 0x7f9b64137de0 2024-09-11T23:06:44.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.591+0000 7f9b68953640 1 -- 172.21.15.12:0/2230797588 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b64120480 con 0x7f9b64137de0 2024-09-11T23:06:44.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.591+0000 7f9b52ffd640 1 -- 172.21.15.12:0/2230797588 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b54004920 con 0x7f9b64137de0 2024-09-11T23:06:44.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.591+0000 7f9b68953640 1 -- 172.21.15.12:0/2230797588 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b640a3b80 con 0x7f9b64137de0 2024-09-11T23:06:44.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.591+0000 7f9b52ffd640 1 -- 172.21.15.12:0/2230797588 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 34) ==== 44053+0+0 (secure 0 0 0) 0x7f9b5401a020 con 0x7f9b64137de0 2024-09-11T23:06:44.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.591+0000 7f9b52ffd640 1 --2- 172.21.15.12:0/2230797588 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f9b44035db0 0x7f9b44038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:44.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.591+0000 7f9b52ffd640 1 -- 172.21.15.12:0/2230797588 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 3482+0+0 (secure 0 0 0) 0x7f9b54047e30 con 0x7f9b64137de0 2024-09-11T23:06:44.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.591+0000 7f9b61d9b640 1 -- 172.21.15.12:0/2230797588 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f9b44035db0 msgr2=0x7f9b44038270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6828/4277951488 2024-09-11T23:06:44.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.591+0000 7f9b61d9b640 1 --2- 172.21.15.12:0/2230797588 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f9b44035db0 0x7f9b44038270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:06:44.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.591+0000 7f9b68953640 1 -- 172.21.15.12:0/2230797588 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b6409f190 con 0x7f9b64137de0 2024-09-11T23:06:44.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.599+0000 7f9b52ffd640 1 -- 172.21.15.12:0/2230797588 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9b54019d50 con 0x7f9b64137de0 2024-09-11T23:06:44.717 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:44.715+0000 7f80008a9180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:06:44.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.787+0000 7f9b68953640 1 -- 172.21.15.12:0/2230797588 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9b6409e730 con 0x7f9b64137de0 2024-09-11T23:06:44.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.787+0000 7f9b52ffd640 1 -- 172.21.15.12:0/2230797588 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 1 entries v66) ==== 80+0+58 (secure 0 0 0) 0x7f9b54004ca0 con 0x7f9b64137de0 2024-09-11T23:06:44.790 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/2496375865 2024-09-12T00:06:39.939411+0000 2024-09-11T23:06:44.790 INFO:teuthology.orchestra.run.smithi012.stderr:listed 1 entries 2024-09-11T23:06:44.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.791+0000 7f9b68953640 1 -- 172.21.15.12:0/2230797588 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f9b44035db0 msgr2=0x7f9b44038270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:06:44.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.791+0000 7f9b68953640 1 --2- 172.21.15.12:0/2230797588 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f9b44035db0 0x7f9b44038270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:44.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.791+0000 7f9b68953640 1 -- 172.21.15.12:0/2230797588 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b64137de0 msgr2=0x7f9b64071fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:44.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.791+0000 7f9b68953640 1 --2- 172.21.15.12:0/2230797588 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b64137de0 0x7f9b64071fc0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f9b5400c2f0 tx=0x7f9b5400c7b0 comp rx=0 tx=0).stop 2024-09-11T23:06:44.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.791+0000 7f9b68953640 1 -- 172.21.15.12:0/2230797588 shutdown_connections 2024-09-11T23:06:44.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.791+0000 7f9b68953640 1 --2- 172.21.15.12:0/2230797588 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f9b44035db0 0x7f9b44038270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:44.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.791+0000 7f9b68953640 1 --2- 172.21.15.12:0/2230797588 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b64137de0 0x7f9b64071fc0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:44.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.791+0000 7f9b68953640 1 -- 172.21.15.12:0/2230797588 >> 172.21.15.12:0/2230797588 conn(0x7f9b640a82f0 msgr2=0x7f9b640a1450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:44.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.791+0000 7f9b68953640 1 -- 172.21.15.12:0/2230797588 shutdown_connections 2024-09-11T23:06:44.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:44.791+0000 7f9b68953640 1 -- 172.21.15.12:0/2230797588 wait complete. 2024-09-11T23:06:44.808 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi012.front.sepia.ceph.com... 2024-09-11T23:06:44.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:06:44.808 DEBUG:teuthology.orchestra.run.smithi012:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-11T23:06:44.820 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi012.stderr:ceph-fuse[41332]: fuse finished with error 0 and tester_r 0 2024-09-11T23:06:44.821 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi012.front.sepia.ceph.com 2024-09-11T23:06:44.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:06:44.821 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-11T23:06:44.836 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:44.835+0000 7f80008a9180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T23:06:44.901 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:44.899+0000 7f80008a9180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T23:06:44.958 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:06:45.043 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:45.039+0000 7f80008a9180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:06:45.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.115+0000 7f6bbcff3640 1 Processor -- start 2024-09-11T23:06:45.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.119+0000 7f6bbcff3640 1 -- start start 2024-09-11T23:06:45.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.119+0000 7f6bbcff3640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6bb813a410 0x7f6bb80a6af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:45.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.119+0000 7f6bbcff3640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bb80a82a0 con 0x7f6bb80a4b80 2024-09-11T23:06:45.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.119+0000 7f6bbcff3640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f6bb80a3cb0 con 0x7f6bb813a410 2024-09-11T23:06:45.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.119+0000 7f6bb659c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6bb813a410 0x7f6bb80a6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:45.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.119+0000 7f6bb5d9b640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f6bb80a4b80 0x7f6bb80a7030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38836/0 (socket says 172.21.15.12:38836) 2024-09-11T23:06:45.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.119+0000 7f6bb5d9b640 1 -- 172.21.15.12:0/398385405 learned_addr learned my addr 172.21.15.12:0/398385405 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:45.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.119+0000 7f6bb559a640 1 -- 172.21.15.12:0/398385405 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1587744774 0 0) 0x7f6bb80a82a0 con 0x7f6bb80a4b80 2024-09-11T23:06:45.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.119+0000 7f6bb559a640 1 -- 172.21.15.12:0/398385405 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ba4003530 con 0x7f6bb80a4b80 2024-09-11T23:06:45.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.119+0000 7f6bb659c640 1 -- 172.21.15.12:0/398385405 >> v1:172.21.15.12:6789/0 conn(0x7f6bb80a4b80 legacy=0x7f6bb80a7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:45.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.119+0000 7f6bb659c640 1 -- 172.21.15.12:0/398385405 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bb8139fe0 con 0x7f6bb813a410 2024-09-11T23:06:45.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.119+0000 7f6bb659c640 1 --2- 172.21.15.12:0/398385405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6bb813a410 0x7f6bb80a6af0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0009740 tx=0x7f6ba001c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6389203e7124ba43 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:45.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.119+0000 7f6bb559a640 1 -- 172.21.15.12:0/398385405 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ba00b0070 con 0x7f6bb813a410 2024-09-11T23:06:45.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.119+0000 7f6bb559a640 1 -- 172.21.15.12:0/398385405 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ba00ab530 con 0x7f6bb813a410 2024-09-11T23:06:45.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.119+0000 7f6bb559a640 1 -- 172.21.15.12:0/398385405 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ba00ab830 con 0x7f6bb813a410 2024-09-11T23:06:45.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.123+0000 7f6bbcff3640 1 -- 172.21.15.12:0/398385405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6bb813a410 msgr2=0x7f6bb80a6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:45.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.123+0000 7f6bbcff3640 1 --2- 172.21.15.12:0/398385405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6bb813a410 0x7f6bb80a6af0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0009740 tx=0x7f6ba001c390 comp rx=0 tx=0).stop 2024-09-11T23:06:45.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.123+0000 7f6bbcff3640 1 -- 172.21.15.12:0/398385405 shutdown_connections 2024-09-11T23:06:45.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.123+0000 7f6bbcff3640 1 --2- 172.21.15.12:0/398385405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6bb813a410 0x7f6bb80a6af0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:45.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.123+0000 7f6bbcff3640 1 -- 172.21.15.12:0/398385405 >> 172.21.15.12:0/398385405 conn(0x7f6bb80ac2c0 msgr2=0x7f6bb80ac6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:45.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.123+0000 7f6bbcff3640 1 -- 172.21.15.12:0/398385405 shutdown_connections 2024-09-11T23:06:45.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.123+0000 7f6bbcff3640 1 -- 172.21.15.12:0/398385405 wait complete. 2024-09-11T23:06:45.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.123+0000 7f6bbcff3640 1 Processor -- start 2024-09-11T23:06:45.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.123+0000 7f6bbcff3640 1 -- start start 2024-09-11T23:06:45.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.123+0000 7f6bbcff3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6bb80a4b80 0x7f6bb809d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:45.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.123+0000 7f6bbcff3640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb80a7740 con 0x7f6bb80a4b80 2024-09-11T23:06:45.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.123+0000 7f6bb659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6bb80a4b80 0x7f6bb809d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:45.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.123+0000 7f6bb659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6bb80a4b80 0x7f6bb809d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39962/0 (socket says 172.21.15.12:39962) 2024-09-11T23:06:45.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.123+0000 7f6bb659c640 1 -- 172.21.15.12:0/3274477042 learned_addr learned my addr 172.21.15.12:0/3274477042 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:45.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.123+0000 7f6bb659c640 1 -- 172.21.15.12:0/3274477042 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bb809bdb0 con 0x7f6bb80a4b80 2024-09-11T23:06:45.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.123+0000 7f6bb659c640 1 --2- 172.21.15.12:0/3274477042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6bb80a4b80 0x7f6bb809d170 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0019fc0 tx=0x7f6ba001abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:45.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.123+0000 7f6baeffd640 1 -- 172.21.15.12:0/3274477042 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ba00b0050 con 0x7f6bb80a4b80 2024-09-11T23:06:45.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.123+0000 7f6baeffd640 1 -- 172.21.15.12:0/3274477042 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ba00b1040 con 0x7f6bb80a4b80 2024-09-11T23:06:45.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.123+0000 7f6bbcff3640 1 -- 172.21.15.12:0/3274477042 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bb809c730 con 0x7f6bb80a4b80 2024-09-11T23:06:45.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.123+0000 7f6baeffd640 1 -- 172.21.15.12:0/3274477042 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ba00b75a0 con 0x7f6bb80a4b80 2024-09-11T23:06:45.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.123+0000 7f6bbcff3640 1 -- 172.21.15.12:0/3274477042 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bb809abd0 con 0x7f6bb80a4b80 2024-09-11T23:06:45.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.123+0000 7f6baeffd640 1 -- 172.21.15.12:0/3274477042 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 34) ==== 44053+0+0 (secure 0 0 0) 0x7f6ba00be030 con 0x7f6bb80a4b80 2024-09-11T23:06:45.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.123+0000 7f6baeffd640 1 --2- 172.21.15.12:0/3274477042 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f6b98035db0 0x7f6b98038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:45.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.123+0000 7f6baeffd640 1 -- 172.21.15.12:0/3274477042 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 3482+0+0 (secure 0 0 0) 0x7f6ba00bc070 con 0x7f6bb80a4b80 2024-09-11T23:06:45.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.123+0000 7f6bb5d9b640 1 -- 172.21.15.12:0/3274477042 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f6b98035db0 msgr2=0x7f6b98038270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6828/4277951488 2024-09-11T23:06:45.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.123+0000 7f6bb5d9b640 1 --2- 172.21.15.12:0/3274477042 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f6b98035db0 0x7f6b98038270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:06:45.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.127+0000 7f6bbcff3640 1 -- 172.21.15.12:0/3274477042 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bb80a6af0 con 0x7f6bb80a4b80 2024-09-11T23:06:45.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.131+0000 7f6baeffd640 1 -- 172.21.15.12:0/3274477042 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6ba00c5060 con 0x7f6bb80a4b80 2024-09-11T23:06:45.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.327+0000 7f6bb5d9b640 1 -- 172.21.15.12:0/3274477042 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f6b98035db0 msgr2=0x7f6b98038270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6828/4277951488 2024-09-11T23:06:45.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.327+0000 7f6bb5d9b640 1 --2- 172.21.15.12:0/3274477042 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f6b98035db0 0x7f6b98038270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T23:06:45.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.347+0000 7f6bbcff3640 1 -- 172.21.15.12:0/3274477042 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6bb809b9f0 con 0x7f6bb80a4b80 2024-09-11T23:06:45.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.347+0000 7f6baeffd640 1 -- 172.21.15.12:0/3274477042 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+3575 (secure 0 0 0) 0x7f6ba0016010 con 0x7f6bb80a4b80 2024-09-11T23:06:45.350 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:06:45.350 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":49,"btime":"2024-09-11T23:06:29:001694+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4978,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6826/1855322655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1855322655},{"type":"v1","addr":"172.21.15.12:6826","nonce":1855322655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:06:25.374780+0000","modified":"2024-09-11T23:06:28.391440+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4979},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4979":{"gid":4979,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6827/4133903177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":4133903177},{"type":"v1","addr":"172.21.15.12:6827","nonce":4133903177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4979,"qdb_cluster":[4979]},"id":6}]} 2024-09-11T23:06:45.351 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 49 2024-09-11T23:06:45.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.351+0000 7f6bbcff3640 1 -- 172.21.15.12:0/3274477042 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f6b98035db0 msgr2=0x7f6b98038270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:06:45.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.351+0000 7f6bbcff3640 1 --2- 172.21.15.12:0/3274477042 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f6b98035db0 0x7f6b98038270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:45.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.351+0000 7f6bbcff3640 1 -- 172.21.15.12:0/3274477042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6bb80a4b80 msgr2=0x7f6bb809d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:45.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.351+0000 7f6bbcff3640 1 --2- 172.21.15.12:0/3274477042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6bb80a4b80 0x7f6bb809d170 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0019fc0 tx=0x7f6ba001abd0 comp rx=0 tx=0).stop 2024-09-11T23:06:45.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.351+0000 7f6bbcff3640 1 -- 172.21.15.12:0/3274477042 shutdown_connections 2024-09-11T23:06:45.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.351+0000 7f6bbcff3640 1 --2- 172.21.15.12:0/3274477042 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f6b98035db0 0x7f6b98038270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:45.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.351+0000 7f6bbcff3640 1 --2- 172.21.15.12:0/3274477042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6bb80a4b80 0x7f6bb809d170 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:45.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.351+0000 7f6bbcff3640 1 -- 172.21.15.12:0/3274477042 >> 172.21.15.12:0/3274477042 conn(0x7f6bb80ac2c0 msgr2=0x7f6bb813f480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:45.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.351+0000 7f6bbcff3640 1 -- 172.21.15.12:0/3274477042 shutdown_connections 2024-09-11T23:06:45.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.351+0000 7f6bbcff3640 1 -- 172.21.15.12:0/3274477042 wait complete. 2024-09-11T23:06:45.368 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:06:45.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.519+0000 7f3420a1f640 1 Processor -- start 2024-09-11T23:06:45.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.519+0000 7f3420a1f640 1 -- start start 2024-09-11T23:06:45.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.523+0000 7f3420a1f640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f341c0a1bb0 0x7f341c13ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:45.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.523+0000 7f3420a1f640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f341c0a02a0 con 0x7f341c1369b0 2024-09-11T23:06:45.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.523+0000 7f3420a1f640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f341c0a0540 con 0x7f341c0a1bb0 2024-09-11T23:06:45.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.523+0000 7f3419d9b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f341c0a1bb0 0x7f341c13ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:45.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.523+0000 7f341a59c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f341c1369b0 0x7f341c136d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38844/0 (socket says 172.21.15.12:38844) 2024-09-11T23:06:45.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.523+0000 7f341a59c640 1 -- 172.21.15.12:0/605254371 learned_addr learned my addr 172.21.15.12:0/605254371 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:45.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.523+0000 7f3419d9b640 1 -- 172.21.15.12:0/605254371 >> v1:172.21.15.12:6789/0 conn(0x7f341c1369b0 legacy=0x7f341c136d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:45.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.523+0000 7f3419d9b640 1 -- 172.21.15.12:0/605254371 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f341c06bd10 con 0x7f341c0a1bb0 2024-09-11T23:06:45.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.523+0000 7f3419d9b640 1 --2- 172.21.15.12:0/605254371 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f341c0a1bb0 0x7f341c13ed80 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f3410009740 tx=0x7f341001c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c3f8e91d055a37c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:45.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.523+0000 7f341959a640 1 -- 172.21.15.12:0/605254371 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34100b0070 con 0x7f341c0a1bb0 2024-09-11T23:06:45.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.523+0000 7f341959a640 1 -- 172.21.15.12:0/605254371 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34100ab530 con 0x7f341c0a1bb0 2024-09-11T23:06:45.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.523+0000 7f341959a640 1 -- 172.21.15.12:0/605254371 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34100ab830 con 0x7f341c0a1bb0 2024-09-11T23:06:45.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.523+0000 7f3420a1f640 1 -- 172.21.15.12:0/605254371 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f341c0a1bb0 msgr2=0x7f341c13ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:45.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.523+0000 7f3420a1f640 1 --2- 172.21.15.12:0/605254371 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f341c0a1bb0 0x7f341c13ed80 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f3410009740 tx=0x7f341001c390 comp rx=0 tx=0).stop 2024-09-11T23:06:45.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.523+0000 7f3420a1f640 1 -- 172.21.15.12:0/605254371 shutdown_connections 2024-09-11T23:06:45.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.523+0000 7f3420a1f640 1 --2- 172.21.15.12:0/605254371 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f341c0a1bb0 0x7f341c13ed80 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:45.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.523+0000 7f3420a1f640 1 -- 172.21.15.12:0/605254371 >> 172.21.15.12:0/605254371 conn(0x7f341c068000 msgr2=0x7f341c0a58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:45.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.523+0000 7f3420a1f640 1 -- 172.21.15.12:0/605254371 shutdown_connections 2024-09-11T23:06:45.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.523+0000 7f3420a1f640 1 -- 172.21.15.12:0/605254371 wait complete. 2024-09-11T23:06:45.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.527+0000 7f3420a1f640 1 Processor -- start 2024-09-11T23:06:45.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.527+0000 7f3420a1f640 1 -- start start 2024-09-11T23:06:45.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.527+0000 7f3420a1f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f341c0a1bb0 0x7f341c09be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:45.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.527+0000 7f3420a1f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f341c141c60 con 0x7f341c0a1bb0 2024-09-11T23:06:45.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.527+0000 7f341a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f341c0a1bb0 0x7f341c09be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:45.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.527+0000 7f341a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f341c0a1bb0 0x7f341c09be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39988/0 (socket says 172.21.15.12:39988) 2024-09-11T23:06:45.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.527+0000 7f341a59c640 1 -- 172.21.15.12:0/973570202 learned_addr learned my addr 172.21.15.12:0/973570202 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:45.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.527+0000 7f341a59c640 1 -- 172.21.15.12:0/973570202 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f341c09f620 con 0x7f341c0a1bb0 2024-09-11T23:06:45.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.527+0000 7f341a59c640 1 --2- 172.21.15.12:0/973570202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f341c0a1bb0 0x7f341c09be50 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f340c00c3a0 tx=0x7f340c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:45.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.527+0000 7f340affd640 1 -- 172.21.15.12:0/973570202 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f340c017070 con 0x7f341c0a1bb0 2024-09-11T23:06:45.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.527+0000 7f340affd640 1 -- 172.21.15.12:0/973570202 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f340c005c20 con 0x7f341c0a1bb0 2024-09-11T23:06:45.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.527+0000 7f3420a1f640 1 -- 172.21.15.12:0/973570202 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f341c09daf0 con 0x7f341c0a1bb0 2024-09-11T23:06:45.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.527+0000 7f340affd640 1 -- 172.21.15.12:0/973570202 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f340c0070d0 con 0x7f341c0a1bb0 2024-09-11T23:06:45.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.527+0000 7f3420a1f640 1 -- 172.21.15.12:0/973570202 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f341c1392f0 con 0x7f341c0a1bb0 2024-09-11T23:06:45.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.527+0000 7f3420a1f640 1 -- 172.21.15.12:0/973570202 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f341c0008e0 con 0x7f341c0a1bb0 2024-09-11T23:06:45.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.527+0000 7f340affd640 1 -- 172.21.15.12:0/973570202 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 34) ==== 44053+0+0 (secure 0 0 0) 0x7f340c01a070 con 0x7f341c0a1bb0 2024-09-11T23:06:45.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.527+0000 7f340affd640 1 --2- 172.21.15.12:0/973570202 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f33fc035db0 0x7f33fc038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:45.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.527+0000 7f340affd640 1 -- 172.21.15.12:0/973570202 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 3482+0+0 (secure 0 0 0) 0x7f340c047920 con 0x7f341c0a1bb0 2024-09-11T23:06:45.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.527+0000 7f3419d9b640 1 -- 172.21.15.12:0/973570202 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f33fc035db0 msgr2=0x7f33fc038270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6828/4277951488 2024-09-11T23:06:45.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.527+0000 7f3419d9b640 1 --2- 172.21.15.12:0/973570202 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f33fc035db0 0x7f33fc038270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:06:45.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.531+0000 7f340affd640 1 -- 172.21.15.12:0/973570202 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f340c0104c0 con 0x7f341c0a1bb0 2024-09-11T23:06:45.584 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:45.583+0000 7f80008a9180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T23:06:45.662 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:45.659+0000 7f80008a9180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T23:06:45.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.731+0000 7f3419d9b640 1 -- 172.21.15.12:0/973570202 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f33fc035db0 msgr2=0x7f33fc038270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6828/4277951488 2024-09-11T23:06:45.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.731+0000 7f3419d9b640 1 --2- 172.21.15.12:0/973570202 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f33fc035db0 0x7f33fc038270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T23:06:45.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.743+0000 7f3420a1f640 1 -- 172.21.15.12:0/973570202 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f341c136330 con 0x7f341c0a1bb0 2024-09-11T23:06:45.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.747+0000 7f340affd640 1 -- 172.21.15.12:0/973570202 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+3575 (secure 0 0 0) 0x7f340c010720 con 0x7f341c0a1bb0 2024-09-11T23:06:45.748 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:06:45.748 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":49,"btime":"2024-09-11T23:06:29:001694+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4978,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6826/1855322655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1855322655},{"type":"v1","addr":"172.21.15.12:6826","nonce":1855322655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:06:25.374780+0000","modified":"2024-09-11T23:06:28.391440+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4979},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4979":{"gid":4979,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6827/4133903177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":4133903177},{"type":"v1","addr":"172.21.15.12:6827","nonce":4133903177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4979,"qdb_cluster":[4979]},"id":6}]} 2024-09-11T23:06:45.749 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 49 2024-09-11T23:06:45.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.747+0000 7f3420a1f640 1 -- 172.21.15.12:0/973570202 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f33fc035db0 msgr2=0x7f33fc038270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:06:45.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.747+0000 7f3420a1f640 1 --2- 172.21.15.12:0/973570202 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f33fc035db0 0x7f33fc038270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:45.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.747+0000 7f3420a1f640 1 -- 172.21.15.12:0/973570202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f341c0a1bb0 msgr2=0x7f341c09be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:45.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.747+0000 7f3420a1f640 1 --2- 172.21.15.12:0/973570202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f341c0a1bb0 0x7f341c09be50 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f340c00c3a0 tx=0x7f340c00c860 comp rx=0 tx=0).stop 2024-09-11T23:06:45.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.747+0000 7f3420a1f640 1 -- 172.21.15.12:0/973570202 shutdown_connections 2024-09-11T23:06:45.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.747+0000 7f3420a1f640 1 --2- 172.21.15.12:0/973570202 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f33fc035db0 0x7f33fc038270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:45.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.747+0000 7f3420a1f640 1 --2- 172.21.15.12:0/973570202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f341c0a1bb0 0x7f341c09be50 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:45.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.747+0000 7f3420a1f640 1 -- 172.21.15.12:0/973570202 >> 172.21.15.12:0/973570202 conn(0x7f341c068000 msgr2=0x7f341c0a36a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:45.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.747+0000 7f3420a1f640 1 -- 172.21.15.12:0/973570202 shutdown_connections 2024-09-11T23:06:45.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.747+0000 7f3420a1f640 1 -- 172.21.15.12:0/973570202 wait complete. 2024-09-11T23:06:45.767 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:06:45.817 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:45.815+0000 7f80008a9180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T23:06:45.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.875+0000 7f7b209db640 1 Processor -- start 2024-09-11T23:06:45.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.879+0000 7f7b209db640 1 -- start start 2024-09-11T23:06:45.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.879+0000 7f7b209db640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7b1c0a3ba0 0x7f7b1c13cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:45.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.879+0000 7f7b209db640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b1c0a53f0 con 0x7f7b1c0a55f0 2024-09-11T23:06:45.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.879+0000 7f7b209db640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1c0a2020 con 0x7f7b1c0a3ba0 2024-09-11T23:06:45.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.879+0000 7f7b1a59c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f7b1c0a55f0 0x7f7b1c0a59d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38854/0 (socket says 172.21.15.12:38854) 2024-09-11T23:06:45.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.879+0000 7f7b13fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7b1c0a3ba0 0x7f7b1c13cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:45.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.879+0000 7f7b1a59c640 1 -- 172.21.15.12:0/169250213 learned_addr learned my addr 172.21.15.12:0/169250213 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:45.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.879+0000 7f7b19d9b640 1 -- 172.21.15.12:0/169250213 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3489779282 0 0) 0x7f7b1c0a53f0 con 0x7f7b1c0a55f0 2024-09-11T23:06:45.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.879+0000 7f7b19d9b640 1 -- 172.21.15.12:0/169250213 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b08003530 con 0x7f7b1c0a55f0 2024-09-11T23:06:45.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.879+0000 7f7b13fff640 1 -- 172.21.15.12:0/169250213 >> v1:172.21.15.12:6789/0 conn(0x7f7b1c0a55f0 legacy=0x7f7b1c0a59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:45.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.879+0000 7f7b13fff640 1 -- 172.21.15.12:0/169250213 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b1c0a3160 con 0x7f7b1c0a3ba0 2024-09-11T23:06:45.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.879+0000 7f7b13fff640 1 --2- 172.21.15.12:0/169250213 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b1c0a3ba0 0x7f7b1c13cd20 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f7b04009720 tx=0x7f7b0401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43cf57dab3e580d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:45.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.879+0000 7f7b19d9b640 1 -- 172.21.15.12:0/169250213 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b040b0070 con 0x7f7b1c0a3ba0 2024-09-11T23:06:45.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.879+0000 7f7b19d9b640 1 -- 172.21.15.12:0/169250213 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b040ab530 con 0x7f7b1c0a3ba0 2024-09-11T23:06:45.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.879+0000 7f7b19d9b640 1 -- 172.21.15.12:0/169250213 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b040ab810 con 0x7f7b1c0a3ba0 2024-09-11T23:06:45.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.883+0000 7f7b209db640 1 -- 172.21.15.12:0/169250213 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b1c0a3ba0 msgr2=0x7f7b1c13cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:45.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.883+0000 7f7b209db640 1 --2- 172.21.15.12:0/169250213 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b1c0a3ba0 0x7f7b1c13cd20 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f7b04009720 tx=0x7f7b0401c370 comp rx=0 tx=0).stop 2024-09-11T23:06:45.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.883+0000 7f7b209db640 1 -- 172.21.15.12:0/169250213 shutdown_connections 2024-09-11T23:06:45.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.883+0000 7f7b209db640 1 --2- 172.21.15.12:0/169250213 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b1c0a3ba0 0x7f7b1c13cd20 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:45.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.883+0000 7f7b209db640 1 -- 172.21.15.12:0/169250213 >> 172.21.15.12:0/169250213 conn(0x7f7b1c0aa2c0 msgr2=0x7f7b1c0aa6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:45.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.883+0000 7f7b209db640 1 -- 172.21.15.12:0/169250213 shutdown_connections 2024-09-11T23:06:45.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.883+0000 7f7b209db640 1 -- 172.21.15.12:0/169250213 wait complete. 2024-09-11T23:06:45.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.883+0000 7f7b209db640 1 Processor -- start 2024-09-11T23:06:45.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.883+0000 7f7b209db640 1 -- start start 2024-09-11T23:06:45.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.883+0000 7f7b209db640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b1c0a3ba0 0x7f7b1c139330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:45.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.883+0000 7f7b209db640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1c0a1a80 con 0x7f7b1c0a3ba0 2024-09-11T23:06:45.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.883+0000 7f7b1a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b1c0a3ba0 0x7f7b1c139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:45.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.883+0000 7f7b1a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b1c0a3ba0 0x7f7b1c139330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39996/0 (socket says 172.21.15.12:39996) 2024-09-11T23:06:45.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.883+0000 7f7b1a59c640 1 -- 172.21.15.12:0/2559394790 learned_addr learned my addr 172.21.15.12:0/2559394790 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:45.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.883+0000 7f7b1a59c640 1 -- 172.21.15.12:0/2559394790 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b1c138970 con 0x7f7b1c0a3ba0 2024-09-11T23:06:45.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.883+0000 7f7b1a59c640 1 --2- 172.21.15.12:0/2559394790 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b1c0a3ba0 0x7f7b1c139330 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c00c3d0 tx=0x7f7b0c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:45.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.883+0000 7f7b12ffd640 1 -- 172.21.15.12:0/2559394790 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b0c017070 con 0x7f7b1c0a3ba0 2024-09-11T23:06:45.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.883+0000 7f7b12ffd640 1 -- 172.21.15.12:0/2559394790 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b0c005ce0 con 0x7f7b1c0a3ba0 2024-09-11T23:06:45.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.883+0000 7f7b209db640 1 -- 172.21.15.12:0/2559394790 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b1c13a1c0 con 0x7f7b1c0a3ba0 2024-09-11T23:06:45.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.883+0000 7f7b12ffd640 1 -- 172.21.15.12:0/2559394790 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b0c0070d0 con 0x7f7b1c0a3ba0 2024-09-11T23:06:45.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.883+0000 7f7b209db640 1 -- 172.21.15.12:0/2559394790 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b1c1cbc90 con 0x7f7b1c0a3ba0 2024-09-11T23:06:45.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.883+0000 7f7b209db640 1 -- 172.21.15.12:0/2559394790 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b1c0008e0 con 0x7f7b1c0a3ba0 2024-09-11T23:06:45.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.883+0000 7f7b12ffd640 1 -- 172.21.15.12:0/2559394790 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 34) ==== 44053+0+0 (secure 0 0 0) 0x7f7b0c01a070 con 0x7f7b1c0a3ba0 2024-09-11T23:06:45.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.883+0000 7f7b12ffd640 1 --2- 172.21.15.12:0/2559394790 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f7afc035d60 0x7f7afc038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:45.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.883+0000 7f7b12ffd640 1 -- 172.21.15.12:0/2559394790 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 3482+0+0 (secure 0 0 0) 0x7f7b0c047af0 con 0x7f7b1c0a3ba0 2024-09-11T23:06:45.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.883+0000 7f7b13fff640 1 -- 172.21.15.12:0/2559394790 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f7afc035d60 msgr2=0x7f7afc038220 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6828/4277951488 2024-09-11T23:06:45.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.883+0000 7f7b13fff640 1 --2- 172.21.15.12:0/2559394790 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f7afc035d60 0x7f7afc038220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:06:45.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:45.891+0000 7f7b12ffd640 1 -- 172.21.15.12:0/2559394790 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7b0c019e10 con 0x7f7b1c0a3ba0 2024-09-11T23:06:45.896 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:45.895+0000 7f80008a9180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T23:06:46.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.051+0000 7f7b209db640 1 -- 172.21.15.12:0/2559394790 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7b1c13fa80 con 0x7f7b1c0a3ba0 2024-09-11T23:06:46.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.051+0000 7f7b12ffd640 1 -- 172.21.15.12:0/2559394790 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) ==== 74+0+10739 (secure 0 0 0) 0x7f7b0c01b8d0 con 0x7f7b1c0a3ba0 2024-09-11T23:06:46.055 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:06:46.056 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":66,"fsid":"8be14356-3340-4500-91a2-4cbc6b511f65","created":"2024-09-11T23:03:10.620234+0000","modified":"2024-09-11T23:06:40.606466+0000","last_up_change":"2024-09-11T23:03:22.359028+0000","last_in_change":"2024-09-11T23:03:11.545817+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:03:23.587068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:06:23.143303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.4099999666213989,"score_stable":1.4099999666213989,"optimal_score":1,"raw_score_acting":1.4099999666213989,"raw_score_stable":1.4099999666213989,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-11T23:06:24.374658+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"153b72a1-40b1-400d-93ea-333e733f9bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6817","nonce":3680911937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6819","nonce":3680911937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6823","nonce":3680911937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6821","nonce":3680911937}]},"public_addr":"172.21.15.12:6817/3680911937","cluster_addr":"172.21.15.12:6819/3680911937","heartbeat_back_addr":"172.21.15.12:6823/3680911937","heartbeat_front_addr":"172.21.15.12:6821/3680911937","state":["exists","up"]},{"osd":1,"uuid":"94669e49-ee4f-4acf-9e25-e94374dda8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6801","nonce":236825163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6803","nonce":236825163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6807","nonce":236825163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6805","nonce":236825163}]},"public_addr":"172.21.15.12:6801/236825163","cluster_addr":"172.21.15.12:6803/236825163","heartbeat_back_addr":"172.21.15.12:6807/236825163","heartbeat_front_addr":"172.21.15.12:6805/236825163","state":["exists","up"]},{"osd":2,"uuid":"826dae4d-8888-4ec5-8f00-425b3be93814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6809","nonce":3263521655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6811","nonce":3263521655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6815","nonce":3263521655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6813","nonce":3263521655}]},"public_addr":"172.21.15.12:6809/3263521655","cluster_addr":"172.21.15.12:6811/3263521655","heartbeat_back_addr":"172.21.15.12:6815/3263521655","heartbeat_front_addr":"172.21.15.12:6813/3263521655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:19.398518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.761524+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.904997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/2496375865":"2024-09-12T00:06:39.939411+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:06:46.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.055+0000 7f7b209db640 1 -- 172.21.15.12:0/2559394790 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f7afc035d60 msgr2=0x7f7afc038220 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:06:46.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.055+0000 7f7b209db640 1 --2- 172.21.15.12:0/2559394790 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f7afc035d60 0x7f7afc038220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:46.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.055+0000 7f7b209db640 1 -- 172.21.15.12:0/2559394790 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b1c0a3ba0 msgr2=0x7f7b1c139330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:46.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.055+0000 7f7b209db640 1 --2- 172.21.15.12:0/2559394790 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b1c0a3ba0 0x7f7b1c139330 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c00c3d0 tx=0x7f7b0c00c890 comp rx=0 tx=0).stop 2024-09-11T23:06:46.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.055+0000 7f7b209db640 1 -- 172.21.15.12:0/2559394790 shutdown_connections 2024-09-11T23:06:46.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.055+0000 7f7b209db640 1 --2- 172.21.15.12:0/2559394790 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f7afc035d60 0x7f7afc038220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:46.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.055+0000 7f7b209db640 1 --2- 172.21.15.12:0/2559394790 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b1c0a3ba0 0x7f7b1c139330 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:46.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.055+0000 7f7b209db640 1 -- 172.21.15.12:0/2559394790 >> 172.21.15.12:0/2559394790 conn(0x7f7b1c0aa2c0 msgr2=0x7f7b1c071350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:46.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.055+0000 7f7b209db640 1 -- 172.21.15.12:0/2559394790 shutdown_connections 2024-09-11T23:06:46.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.055+0000 7f7b209db640 1 -- 172.21.15.12:0/2559394790 wait complete. 2024-09-11T23:06:46.073 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T23:06:46.074 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:06:46.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.187+0000 7f7078226640 1 Processor -- start 2024-09-11T23:06:46.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.187+0000 7f7078226640 1 -- start start 2024-09-11T23:06:46.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.191+0000 7f7078226640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f70700a4b80 0x7f70700a7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:46.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.191+0000 7f7078226640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70700a82a0 con 0x7f707013a410 2024-09-11T23:06:46.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.191+0000 7f7078226640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f70700a3cb0 con 0x7f70700a4b80 2024-09-11T23:06:46.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.191+0000 7f70757c1640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f70700a4b80 0x7f70700a7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:46.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.191+0000 7f7075fc2640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f707013a410 0x7f70700a6af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38868/0 (socket says 172.21.15.12:38868) 2024-09-11T23:06:46.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.191+0000 7f7075fc2640 1 -- 172.21.15.12:0/2237470173 learned_addr learned my addr 172.21.15.12:0/2237470173 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:46.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.191+0000 7f70757c1640 1 -- 172.21.15.12:0/2237470173 >> v1:172.21.15.12:6789/0 conn(0x7f707013a410 legacy=0x7f70700a6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:46.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.191+0000 7f70757c1640 1 -- 172.21.15.12:0/2237470173 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7070139fe0 con 0x7f70700a4b80 2024-09-11T23:06:46.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.191+0000 7f70757c1640 1 --2- 172.21.15.12:0/2237470173 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70700a4b80 0x7f70700a7200 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f7060009740 tx=0x7f706001c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72b6767e8762b9fa server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:46.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.191+0000 7f7074fc0640 1 -- 172.21.15.12:0/2237470173 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70600b0070 con 0x7f70700a4b80 2024-09-11T23:06:46.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.191+0000 7f7074fc0640 1 -- 172.21.15.12:0/2237470173 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70600ab530 con 0x7f70700a4b80 2024-09-11T23:06:46.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.191+0000 7f7074fc0640 1 -- 172.21.15.12:0/2237470173 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70600ab830 con 0x7f70700a4b80 2024-09-11T23:06:46.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.191+0000 7f7078226640 1 -- 172.21.15.12:0/2237470173 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70700a4b80 msgr2=0x7f70700a7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:46.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.191+0000 7f7078226640 1 --2- 172.21.15.12:0/2237470173 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70700a4b80 0x7f70700a7200 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f7060009740 tx=0x7f706001c390 comp rx=0 tx=0).stop 2024-09-11T23:06:46.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.191+0000 7f7078226640 1 -- 172.21.15.12:0/2237470173 shutdown_connections 2024-09-11T23:06:46.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.191+0000 7f7078226640 1 --2- 172.21.15.12:0/2237470173 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70700a4b80 0x7f70700a7200 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:46.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.191+0000 7f7078226640 1 -- 172.21.15.12:0/2237470173 >> 172.21.15.12:0/2237470173 conn(0x7f70700ac2c0 msgr2=0x7f70700ac6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:46.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.191+0000 7f7078226640 1 -- 172.21.15.12:0/2237470173 shutdown_connections 2024-09-11T23:06:46.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.191+0000 7f7078226640 1 -- 172.21.15.12:0/2237470173 wait complete. 2024-09-11T23:06:46.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.195+0000 7f7078226640 1 Processor -- start 2024-09-11T23:06:46.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.195+0000 7f7078226640 1 -- start start 2024-09-11T23:06:46.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.195+0000 7f7078226640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70700a4b80 0x7f70700a0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:46.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.195+0000 7f7078226640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f70700a7740 con 0x7f70700a4b80 2024-09-11T23:06:46.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.195+0000 7f7075fc2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70700a4b80 0x7f70700a0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:46.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.195+0000 7f7075fc2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70700a4b80 0x7f70700a0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40012/0 (socket says 172.21.15.12:40012) 2024-09-11T23:06:46.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.195+0000 7f7075fc2640 1 -- 172.21.15.12:0/3135822402 learned_addr learned my addr 172.21.15.12:0/3135822402 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:46.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.195+0000 7f7075fc2640 1 -- 172.21.15.12:0/3135822402 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70700a1710 con 0x7f70700a4b80 2024-09-11T23:06:46.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.195+0000 7f7075fc2640 1 --2- 172.21.15.12:0/3135822402 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70700a4b80 0x7f70700a0fd0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f706c00c480 tx=0x7f706c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:46.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.195+0000 7f70667fc640 1 -- 172.21.15.12:0/3135822402 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f706c017070 con 0x7f70700a4b80 2024-09-11T23:06:46.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.195+0000 7f70667fc640 1 -- 172.21.15.12:0/3135822402 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f706c005c20 con 0x7f70700a4b80 2024-09-11T23:06:46.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.195+0000 7f7078226640 1 -- 172.21.15.12:0/3135822402 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70700a1a30 con 0x7f70700a4b80 2024-09-11T23:06:46.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.195+0000 7f70667fc640 1 -- 172.21.15.12:0/3135822402 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f706c007070 con 0x7f70700a4b80 2024-09-11T23:06:46.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.195+0000 7f7078226640 1 -- 172.21.15.12:0/3135822402 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f707009f590 con 0x7f70700a4b80 2024-09-11T23:06:46.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.195+0000 7f7078226640 1 -- 172.21.15.12:0/3135822402 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70700a1510 con 0x7f70700a4b80 2024-09-11T23:06:46.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.195+0000 7f70667fc640 1 -- 172.21.15.12:0/3135822402 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 34) ==== 44053+0+0 (secure 0 0 0) 0x7f706c01a070 con 0x7f70700a4b80 2024-09-11T23:06:46.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.195+0000 7f70667fc640 1 --2- 172.21.15.12:0/3135822402 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f7054035db0 0x7f7054038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:46.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.195+0000 7f70757c1640 1 -- 172.21.15.12:0/3135822402 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f7054035db0 msgr2=0x7f7054038270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6828/4277951488 2024-09-11T23:06:46.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.195+0000 7f70667fc640 1 -- 172.21.15.12:0/3135822402 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 3482+0+0 (secure 0 0 0) 0x7f706c047a10 con 0x7f70700a4b80 2024-09-11T23:06:46.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.195+0000 7f70757c1640 1 --2- 172.21.15.12:0/3135822402 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f7054035db0 0x7f7054038270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:06:46.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.199+0000 7f70667fc640 1 -- 172.21.15.12:0/3135822402 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f706c007210 con 0x7f70700a4b80 2024-09-11T23:06:46.204 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:46.203+0000 7f80008a9180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T23:06:46.262 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:46.259+0000 7f80008a9180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T23:06:46.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.287+0000 7f70667fc640 1 -- 172.21.15.12:0/3135822402 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 35) ==== 43764+0+0 (secure 0 0 0) 0x7f706c01b400 con 0x7f70700a4b80 2024-09-11T23:06:46.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.287+0000 7f70667fc640 1 -- 172.21.15.12:0/3135822402 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f7054035db0 msgr2=0x7f7054038270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:06:46.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.287+0000 7f70667fc640 1 --2- 172.21.15.12:0/3135822402 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f7054035db0 0x7f7054038270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:46.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.403+0000 7f7078226640 1 -- 172.21.15.12:0/3135822402 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f707009ecb0 con 0x7f70700a4b80 2024-09-11T23:06:46.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.403+0000 7f70667fc640 1 -- 172.21.15.12:0/3135822402 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+3575 (secure 0 0 0) 0x7f706c018260 con 0x7f70700a4b80 2024-09-11T23:06:46.406 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:06:46.406 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":49,"btime":"2024-09-11T23:06:29:001694+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4978,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6826/1855322655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1855322655},{"type":"v1","addr":"172.21.15.12:6826","nonce":1855322655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:06:25.374780+0000","modified":"2024-09-11T23:06:28.391440+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4979},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4979":{"gid":4979,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6827/4133903177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":4133903177},{"type":"v1","addr":"172.21.15.12:6827","nonce":4133903177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4979,"qdb_cluster":[4979]},"id":6}]} 2024-09-11T23:06:46.406 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 49 2024-09-11T23:06:46.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.407+0000 7f7078226640 1 -- 172.21.15.12:0/3135822402 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70700a4b80 msgr2=0x7f70700a0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:46.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.407+0000 7f7078226640 1 --2- 172.21.15.12:0/3135822402 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70700a4b80 0x7f70700a0fd0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f706c00c480 tx=0x7f706c00c940 comp rx=0 tx=0).stop 2024-09-11T23:06:46.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.407+0000 7f7078226640 1 -- 172.21.15.12:0/3135822402 shutdown_connections 2024-09-11T23:06:46.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.407+0000 7f7078226640 1 --2- 172.21.15.12:0/3135822402 >> [v2:172.21.15.12:6828/4277951488,v1:172.21.15.12:6829/4277951488] conn(0x7f7054035db0 0x7f7054038270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:46.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.407+0000 7f7078226640 1 --2- 172.21.15.12:0/3135822402 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70700a4b80 0x7f70700a0fd0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:46.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.407+0000 7f7078226640 1 -- 172.21.15.12:0/3135822402 >> 172.21.15.12:0/3135822402 conn(0x7f70700ac2c0 msgr2=0x7f70700aa560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:46.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.407+0000 7f7078226640 1 -- 172.21.15.12:0/3135822402 shutdown_connections 2024-09-11T23:06:46.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.407+0000 7f7078226640 1 -- 172.21.15.12:0/3135822402 wait complete. 2024-09-11T23:06:46.426 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:06:46.427 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:46.423+0000 7f3cb307e180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T23:06:46.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.539+0000 7f517c0df640 1 Processor -- start 2024-09-11T23:06:46.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.539+0000 7f517c0df640 1 -- start start 2024-09-11T23:06:46.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.543+0000 7f517c0df640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5174134c10 0x7f5174134ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:46.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.543+0000 7f517c0df640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51740a0aa0 con 0x7f51741378d0 2024-09-11T23:06:46.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.543+0000 7f517c0df640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f5174135530 con 0x7f5174134c10 2024-09-11T23:06:46.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.543+0000 7f5179e7b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5174134c10 0x7f5174134ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:46.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.543+0000 7f517967a640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f51741378d0 0x7f5174137cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38880/0 (socket says 172.21.15.12:38880) 2024-09-11T23:06:46.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.543+0000 7f517967a640 1 -- 172.21.15.12:0/1552176927 learned_addr learned my addr 172.21.15.12:0/1552176927 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:46.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.543+0000 7f5179e7b640 1 -- 172.21.15.12:0/1552176927 >> v1:172.21.15.12:6789/0 conn(0x7f51741378d0 legacy=0x7f5174137cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:46.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.543+0000 7f5178e79640 1 -- 172.21.15.12:0/1552176927 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2066406495 0 0) 0x7f51740a0aa0 con 0x7f51741378d0 2024-09-11T23:06:46.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.543+0000 7f5179e7b640 1 -- 172.21.15.12:0/1552176927 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51740733d0 con 0x7f5174134c10 2024-09-11T23:06:46.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.543+0000 7f5179e7b640 1 --2- 172.21.15.12:0/1552176927 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5174134c10 0x7f5174134ff0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f5170009740 tx=0x7f517001c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=499896955b2b59ce server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:46.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.543+0000 7f5178e79640 1 -- 172.21.15.12:0/1552176927 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51700b0070 con 0x7f5174134c10 2024-09-11T23:06:46.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.543+0000 7f5178e79640 1 -- 172.21.15.12:0/1552176927 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51700ab530 con 0x7f5174134c10 2024-09-11T23:06:46.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.543+0000 7f5178e79640 1 -- 172.21.15.12:0/1552176927 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51700ab830 con 0x7f5174134c10 2024-09-11T23:06:46.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.547+0000 7f517c0df640 1 -- 172.21.15.12:0/1552176927 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5174134c10 msgr2=0x7f5174134ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:46.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.547+0000 7f517c0df640 1 --2- 172.21.15.12:0/1552176927 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5174134c10 0x7f5174134ff0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f5170009740 tx=0x7f517001c390 comp rx=0 tx=0).stop 2024-09-11T23:06:46.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.547+0000 7f517c0df640 1 -- 172.21.15.12:0/1552176927 shutdown_connections 2024-09-11T23:06:46.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.547+0000 7f517c0df640 1 --2- 172.21.15.12:0/1552176927 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5174134c10 0x7f5174134ff0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:46.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.547+0000 7f517c0df640 1 -- 172.21.15.12:0/1552176927 >> 172.21.15.12:0/1552176927 conn(0x7f51740aa330 msgr2=0x7f51740aa740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:46.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.547+0000 7f517c0df640 1 -- 172.21.15.12:0/1552176927 shutdown_connections 2024-09-11T23:06:46.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.547+0000 7f517c0df640 1 -- 172.21.15.12:0/1552176927 wait complete. 2024-09-11T23:06:46.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.547+0000 7f517c0df640 1 Processor -- start 2024-09-11T23:06:46.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.547+0000 7f517c0df640 1 -- start start 2024-09-11T23:06:46.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.547+0000 7f517c0df640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51741378d0 0x7f517409af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:46.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.547+0000 7f517c0df640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5174073790 con 0x7f51741378d0 2024-09-11T23:06:46.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.547+0000 7f5179e7b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51741378d0 0x7f517409af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:46.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.547+0000 7f5179e7b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51741378d0 0x7f517409af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40058/0 (socket says 172.21.15.12:40058) 2024-09-11T23:06:46.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.547+0000 7f5179e7b640 1 -- 172.21.15.12:0/2687586442 learned_addr learned my addr 172.21.15.12:0/2687586442 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:46.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.547+0000 7f5179e7b640 1 -- 172.21.15.12:0/2687586442 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f517413d5f0 con 0x7f51741378d0 2024-09-11T23:06:46.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.547+0000 7f5179e7b640 1 --2- 172.21.15.12:0/2687586442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51741378d0 0x7f517409af80 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f5170019fc0 tx=0x7f5170019130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:46.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.547+0000 7f51667fc640 1 -- 172.21.15.12:0/2687586442 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51700b0040 con 0x7f51741378d0 2024-09-11T23:06:46.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.547+0000 7f51667fc640 1 -- 172.21.15.12:0/2687586442 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51700abdc0 con 0x7f51741378d0 2024-09-11T23:06:46.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.547+0000 7f517c0df640 1 -- 172.21.15.12:0/2687586442 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f517413c700 con 0x7f51741378d0 2024-09-11T23:06:46.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.547+0000 7f51667fc640 1 -- 172.21.15.12:0/2687586442 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5170004160 con 0x7f51741378d0 2024-09-11T23:06:46.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.547+0000 7f517c0df640 1 -- 172.21.15.12:0/2687586442 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f517413c450 con 0x7f51741378d0 2024-09-11T23:06:46.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.547+0000 7f517c0df640 1 -- 172.21.15.12:0/2687586442 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5174134ff0 con 0x7f51741378d0 2024-09-11T23:06:46.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.547+0000 7f51667fc640 1 -- 172.21.15.12:0/2687586442 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 35) ==== 43764+0+0 (secure 0 0 0) 0x7f5170004300 con 0x7f51741378d0 2024-09-11T23:06:46.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.547+0000 7f51667fc640 1 -- 172.21.15.12:0/2687586442 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 3740+0+0 (secure 0 0 0) 0x7f51700e2200 con 0x7f51741378d0 2024-09-11T23:06:46.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.555+0000 7f51667fc640 1 -- 172.21.15.12:0/2687586442 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f51700b8020 con 0x7f51741378d0 2024-09-11T23:06:46.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.751+0000 7f517c0df640 1 -- 172.21.15.12:0/2687586442 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5174072540 con 0x7f51741378d0 2024-09-11T23:06:46.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.751+0000 7f51667fc640 1 -- 172.21.15.12:0/2687586442 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+3575 (secure 0 0 0) 0x7f51700a4e20 con 0x7f51741378d0 2024-09-11T23:06:46.755 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:06:46.755 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":49,"btime":"2024-09-11T23:06:29:001694+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4978,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6826/1855322655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1855322655},{"type":"v1","addr":"172.21.15.12:6826","nonce":1855322655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:06:25.374780+0000","modified":"2024-09-11T23:06:28.391440+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4979},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4979":{"gid":4979,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6827/4133903177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":4133903177},{"type":"v1","addr":"172.21.15.12:6827","nonce":4133903177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4979,"qdb_cluster":[4979]},"id":6}]} 2024-09-11T23:06:46.756 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 49 2024-09-11T23:06:46.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.755+0000 7f517c0df640 1 -- 172.21.15.12:0/2687586442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51741378d0 msgr2=0x7f517409af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:46.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.755+0000 7f517c0df640 1 --2- 172.21.15.12:0/2687586442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51741378d0 0x7f517409af80 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f5170019fc0 tx=0x7f5170019130 comp rx=0 tx=0).stop 2024-09-11T23:06:46.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.755+0000 7f517c0df640 1 -- 172.21.15.12:0/2687586442 shutdown_connections 2024-09-11T23:06:46.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.755+0000 7f517c0df640 1 --2- 172.21.15.12:0/2687586442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51741378d0 0x7f517409af80 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:46.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.755+0000 7f517c0df640 1 -- 172.21.15.12:0/2687586442 >> 172.21.15.12:0/2687586442 conn(0x7f51740aa330 msgr2=0x7f51741319c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:46.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.755+0000 7f517c0df640 1 -- 172.21.15.12:0/2687586442 shutdown_connections 2024-09-11T23:06:46.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.755+0000 7f517c0df640 1 -- 172.21.15.12:0/2687586442 wait complete. 2024-09-11T23:06:46.774 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:06:46.839 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:46.835+0000 7f3cb307e180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T23:06:46.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.895+0000 7f5c96a8b640 1 Processor -- start 2024-09-11T23:06:46.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.895+0000 7f5c96a8b640 1 -- start start 2024-09-11T23:06:46.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.899+0000 7f5c96a8b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5c900a4b80 0x7f5c900a7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:46.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.899+0000 7f5c96a8b640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c900a82a0 con 0x7f5c9013a410 2024-09-11T23:06:46.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.899+0000 7f5c96a8b640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f5c900a3cb0 con 0x7f5c900a4b80 2024-09-11T23:06:46.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.899+0000 7f5c94827640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f5c9013a410 0x7f5c900a6af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38896/0 (socket says 172.21.15.12:38896) 2024-09-11T23:06:46.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.899+0000 7f5c94827640 1 -- 172.21.15.12:0/824083747 learned_addr learned my addr 172.21.15.12:0/824083747 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:46.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.899+0000 7f5c8ffff640 1 --2- 172.21.15.12:0/824083747 >> v2:172.21.15.12:3300/0 conn(0x7f5c900a4b80 0x7f5c900a7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:46.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.899+0000 7f5c8f7fe640 1 -- 172.21.15.12:0/824083747 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 940437849 0 0) 0x7f5c900a82a0 con 0x7f5c9013a410 2024-09-11T23:06:46.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.899+0000 7f5c8f7fe640 1 -- 172.21.15.12:0/824083747 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c7c003530 con 0x7f5c9013a410 2024-09-11T23:06:46.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.899+0000 7f5c8ffff640 1 -- 172.21.15.12:0/824083747 >> v1:172.21.15.12:6789/0 conn(0x7f5c9013a410 legacy=0x7f5c900a6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:46.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.899+0000 7f5c8ffff640 1 -- 172.21.15.12:0/824083747 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c90139fe0 con 0x7f5c900a4b80 2024-09-11T23:06:46.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.899+0000 7f5c8ffff640 1 --2- 172.21.15.12:0/824083747 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c900a4b80 0x7f5c900a7200 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f5c78009740 tx=0x7f5c7801c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1da6af28ddfb4cf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:46.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.903+0000 7f5c8f7fe640 1 -- 172.21.15.12:0/824083747 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c780b0070 con 0x7f5c900a4b80 2024-09-11T23:06:46.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.903+0000 7f5c8f7fe640 1 -- 172.21.15.12:0/824083747 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c780ab530 con 0x7f5c900a4b80 2024-09-11T23:06:46.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.903+0000 7f5c8f7fe640 1 -- 172.21.15.12:0/824083747 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c780ab810 con 0x7f5c900a4b80 2024-09-11T23:06:46.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.903+0000 7f5c96a8b640 1 -- 172.21.15.12:0/824083747 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c900a4b80 msgr2=0x7f5c900a7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:46.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.903+0000 7f5c96a8b640 1 --2- 172.21.15.12:0/824083747 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c900a4b80 0x7f5c900a7200 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f5c78009740 tx=0x7f5c7801c390 comp rx=0 tx=0).stop 2024-09-11T23:06:46.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.903+0000 7f5c96a8b640 1 -- 172.21.15.12:0/824083747 shutdown_connections 2024-09-11T23:06:46.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.903+0000 7f5c96a8b640 1 --2- 172.21.15.12:0/824083747 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c900a4b80 0x7f5c900a7200 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:46.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.903+0000 7f5c96a8b640 1 -- 172.21.15.12:0/824083747 >> 172.21.15.12:0/824083747 conn(0x7f5c900ac2c0 msgr2=0x7f5c900ac6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:46.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.903+0000 7f5c96a8b640 1 -- 172.21.15.12:0/824083747 shutdown_connections 2024-09-11T23:06:46.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.903+0000 7f5c96a8b640 1 -- 172.21.15.12:0/824083747 wait complete. 2024-09-11T23:06:46.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.903+0000 7f5c96a8b640 1 Processor -- start 2024-09-11T23:06:46.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.903+0000 7f5c96a8b640 1 -- start start 2024-09-11T23:06:46.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.903+0000 7f5c96a8b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c900a4b80 0x7f5c901ce810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:46.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.903+0000 7f5c96a8b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5c900a7740 con 0x7f5c900a4b80 2024-09-11T23:06:46.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.903+0000 7f5c94827640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c900a4b80 0x7f5c901ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:46.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.903+0000 7f5c94827640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c900a4b80 0x7f5c901ce810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40064/0 (socket says 172.21.15.12:40064) 2024-09-11T23:06:46.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.903+0000 7f5c94827640 1 -- 172.21.15.12:0/1361490276 learned_addr learned my addr 172.21.15.12:0/1361490276 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:46.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.903+0000 7f5c94827640 1 -- 172.21.15.12:0/1361490276 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c9013ef40 con 0x7f5c900a4b80 2024-09-11T23:06:46.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.903+0000 7f5c94827640 1 --2- 172.21.15.12:0/1361490276 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c900a4b80 0x7f5c901ce810 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f5c8800cb40 tx=0x7f5c880021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:46.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.903+0000 7f5c8d7fa640 1 -- 172.21.15.12:0/1361490276 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c88017070 con 0x7f5c900a4b80 2024-09-11T23:06:46.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.903+0000 7f5c8d7fa640 1 -- 172.21.15.12:0/1361490276 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c8800ab80 con 0x7f5c900a4b80 2024-09-11T23:06:46.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.903+0000 7f5c8d7fa640 1 -- 172.21.15.12:0/1361490276 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c88012400 con 0x7f5c900a4b80 2024-09-11T23:06:46.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.903+0000 7f5c96a8b640 1 -- 172.21.15.12:0/1361490276 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c9013eb60 con 0x7f5c900a4b80 2024-09-11T23:06:46.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.903+0000 7f5c96a8b640 1 -- 172.21.15.12:0/1361490276 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c9009b430 con 0x7f5c900a4b80 2024-09-11T23:06:46.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.907+0000 7f5c8d7fa640 1 -- 172.21.15.12:0/1361490276 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 35) ==== 43764+0+0 (secure 0 0 0) 0x7f5c8801a070 con 0x7f5c900a4b80 2024-09-11T23:06:46.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.907+0000 7f5c96a8b640 1 -- 172.21.15.12:0/1361490276 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c900a6af0 con 0x7f5c900a4b80 2024-09-11T23:06:46.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.907+0000 7f5c8d7fa640 1 -- 172.21.15.12:0/1361490276 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 3740+0+0 (secure 0 0 0) 0x7f5c88048030 con 0x7f5c900a4b80 2024-09-11T23:06:46.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:46.911+0000 7f5c8d7fa640 1 -- 172.21.15.12:0/1361490276 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5c88007aa0 con 0x7f5c900a4b80 2024-09-11T23:06:46.981 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:46.979+0000 7f3cb307e180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T23:06:47.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.071+0000 7f5c96a8b640 1 -- 172.21.15.12:0/1361490276 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5c900a2eb0 con 0x7f5c900a4b80 2024-09-11T23:06:47.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.071+0000 7f5c8d7fa640 1 -- 172.21.15.12:0/1361490276 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) ==== 74+0+11116 (secure 0 0 0) 0x7f5c88007250 con 0x7f5c900a4b80 2024-09-11T23:06:47.076 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:06:47.076 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":67,"fsid":"8be14356-3340-4500-91a2-4cbc6b511f65","created":"2024-09-11T23:03:10.620234+0000","modified":"2024-09-11T23:06:46.282150+0000","last_up_change":"2024-09-11T23:03:22.359028+0000","last_in_change":"2024-09-11T23:03:11.545817+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:03:23.587068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:06:23.143303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.4099999666213989,"score_stable":1.4099999666213989,"optimal_score":1,"raw_score_acting":1.4099999666213989,"raw_score_stable":1.4099999666213989,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-11T23:06:24.374658+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"153b72a1-40b1-400d-93ea-333e733f9bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6817","nonce":3680911937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6819","nonce":3680911937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6823","nonce":3680911937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6821","nonce":3680911937}]},"public_addr":"172.21.15.12:6817/3680911937","cluster_addr":"172.21.15.12:6819/3680911937","heartbeat_back_addr":"172.21.15.12:6823/3680911937","heartbeat_front_addr":"172.21.15.12:6821/3680911937","state":["exists","up"]},{"osd":1,"uuid":"94669e49-ee4f-4acf-9e25-e94374dda8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6801","nonce":236825163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6803","nonce":236825163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6807","nonce":236825163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6805","nonce":236825163}]},"public_addr":"172.21.15.12:6801/236825163","cluster_addr":"172.21.15.12:6803/236825163","heartbeat_back_addr":"172.21.15.12:6807/236825163","heartbeat_front_addr":"172.21.15.12:6805/236825163","state":["exists","up"]},{"osd":2,"uuid":"826dae4d-8888-4ec5-8f00-425b3be93814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6809","nonce":3263521655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6811","nonce":3263521655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6815","nonce":3263521655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6813","nonce":3263521655}]},"public_addr":"172.21.15.12:6809/3263521655","cluster_addr":"172.21.15.12:6811/3263521655","heartbeat_back_addr":"172.21.15.12:6815/3263521655","heartbeat_front_addr":"172.21.15.12:6813/3263521655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:19.398518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.761524+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.904997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/3075732142":"2024-09-12T23:06:46.282060+0000","172.21.15.12:0/1282769068":"2024-09-12T23:06:46.282060+0000","172.21.15.12:0/925155409":"2024-09-12T23:06:46.282060+0000","172.21.15.12:0/1906738504":"2024-09-12T23:06:46.282060+0000","172.21.15.12:6829/4277951488":"2024-09-12T23:06:46.282060+0000","172.21.15.12:6828/4277951488":"2024-09-12T23:06:46.282060+0000","172.21.15.12:0/2496375865":"2024-09-12T00:06:39.939411+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:06:47.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.075+0000 7f5c96a8b640 1 -- 172.21.15.12:0/1361490276 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c900a4b80 msgr2=0x7f5c901ce810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:47.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.075+0000 7f5c96a8b640 1 --2- 172.21.15.12:0/1361490276 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c900a4b80 0x7f5c901ce810 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f5c8800cb40 tx=0x7f5c880021f0 comp rx=0 tx=0).stop 2024-09-11T23:06:47.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.075+0000 7f5c96a8b640 1 -- 172.21.15.12:0/1361490276 shutdown_connections 2024-09-11T23:06:47.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.075+0000 7f5c96a8b640 1 --2- 172.21.15.12:0/1361490276 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c900a4b80 0x7f5c901ce810 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:47.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.075+0000 7f5c96a8b640 1 -- 172.21.15.12:0/1361490276 >> 172.21.15.12:0/1361490276 conn(0x7f5c900ac2c0 msgr2=0x7f5c9013f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:47.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.075+0000 7f5c96a8b640 1 -- 172.21.15.12:0/1361490276 shutdown_connections 2024-09-11T23:06:47.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.075+0000 7f5c96a8b640 1 -- 172.21.15.12:0/1361490276 wait complete. 2024-09-11T23:06:47.093 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-11T23:06:47.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.219+0000 7f7ed50b6640 1 Processor -- start 2024-09-11T23:06:47.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.219+0000 7f7ed50b6640 1 -- start start 2024-09-11T23:06:47.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.219+0000 7f7ed50b6640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7ed0070080 0x7f7ed0138380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:47.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.219+0000 7f7ed50b6640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ed0137a50 con 0x7f7ed0137fa0 2024-09-11T23:06:47.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.219+0000 7f7ed50b6640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f7ed00a51e0 con 0x7f7ed0070080 2024-09-11T23:06:47.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.219+0000 7f7eced9d640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f7ed0137fa0 0x7f7ed006bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38904/0 (socket says 172.21.15.12:38904) 2024-09-11T23:06:47.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.219+0000 7f7ece59c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7ed0070080 0x7f7ed0138380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:47.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.219+0000 7f7eced9d640 1 -- 172.21.15.12:0/4237493629 learned_addr learned my addr 172.21.15.12:0/4237493629 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:47.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.219+0000 7f7ece59c640 1 -- 172.21.15.12:0/4237493629 >> v1:172.21.15.12:6789/0 conn(0x7f7ed0137fa0 legacy=0x7f7ed006bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:47.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.219+0000 7f7ece59c640 1 -- 172.21.15.12:0/4237493629 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ed00a31a0 con 0x7f7ed0070080 2024-09-11T23:06:47.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.223+0000 7f7ece59c640 1 --2- 172.21.15.12:0/4237493629 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ed0070080 0x7f7ed0138380 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f7ed00a3370 tx=0x7f7ec401cdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7771b895b87c991 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:47.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.223+0000 7f7ecdd9b640 1 -- 172.21.15.12:0/4237493629 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ec40b0070 con 0x7f7ed0070080 2024-09-11T23:06:47.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.223+0000 7f7ecdd9b640 1 -- 172.21.15.12:0/4237493629 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ec40a4e50 con 0x7f7ed0070080 2024-09-11T23:06:47.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.223+0000 7f7ecdd9b640 1 -- 172.21.15.12:0/4237493629 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ec40ab680 con 0x7f7ed0070080 2024-09-11T23:06:47.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.223+0000 7f7ed50b6640 1 -- 172.21.15.12:0/4237493629 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ed0070080 msgr2=0x7f7ed0138380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:47.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.223+0000 7f7ed50b6640 1 --2- 172.21.15.12:0/4237493629 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ed0070080 0x7f7ed0138380 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f7ed00a3370 tx=0x7f7ec401cdf0 comp rx=0 tx=0).stop 2024-09-11T23:06:47.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.223+0000 7f7ed50b6640 1 -- 172.21.15.12:0/4237493629 shutdown_connections 2024-09-11T23:06:47.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.223+0000 7f7ed50b6640 1 --2- 172.21.15.12:0/4237493629 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ed0070080 0x7f7ed0138380 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:47.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.223+0000 7f7ed50b6640 1 -- 172.21.15.12:0/4237493629 >> 172.21.15.12:0/4237493629 conn(0x7f7ed00a9320 msgr2=0x7f7ed00a9730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:47.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.223+0000 7f7ed50b6640 1 -- 172.21.15.12:0/4237493629 shutdown_connections 2024-09-11T23:06:47.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.223+0000 7f7ed50b6640 1 -- 172.21.15.12:0/4237493629 wait complete. 2024-09-11T23:06:47.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.223+0000 7f7ed50b6640 1 Processor -- start 2024-09-11T23:06:47.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.223+0000 7f7ed50b6640 1 -- start start 2024-09-11T23:06:47.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.223+0000 7f7ed50b6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ed0070080 0x7f7ed013b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:47.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.223+0000 7f7ed50b6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed013fd90 con 0x7f7ed0070080 2024-09-11T23:06:47.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.223+0000 7f7eced9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ed0070080 0x7f7ed013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:47.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.223+0000 7f7eced9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ed0070080 0x7f7ed013b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40088/0 (socket says 172.21.15.12:40088) 2024-09-11T23:06:47.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.223+0000 7f7eced9d640 1 -- 172.21.15.12:0/1707470740 learned_addr learned my addr 172.21.15.12:0/1707470740 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:47.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.223+0000 7f7eced9d640 1 -- 172.21.15.12:0/1707470740 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ed013c5b0 con 0x7f7ed0070080 2024-09-11T23:06:47.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.223+0000 7f7eced9d640 1 --2- 172.21.15.12:0/1707470740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ed0070080 0x7f7ed013b550 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f7ec800c480 tx=0x7f7ec800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:47.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.223+0000 7f7eb77fe640 1 -- 172.21.15.12:0/1707470740 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ec8017070 con 0x7f7ed0070080 2024-09-11T23:06:47.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.223+0000 7f7eb77fe640 1 -- 172.21.15.12:0/1707470740 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ec8005c20 con 0x7f7ed0070080 2024-09-11T23:06:47.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.223+0000 7f7eb77fe640 1 -- 172.21.15.12:0/1707470740 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ec8007070 con 0x7f7ed0070080 2024-09-11T23:06:47.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.223+0000 7f7ed50b6640 1 -- 172.21.15.12:0/1707470740 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ed013c8e0 con 0x7f7ed0070080 2024-09-11T23:06:47.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.223+0000 7f7ed50b6640 1 -- 172.21.15.12:0/1707470740 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ed0138ad0 con 0x7f7ed0070080 2024-09-11T23:06:47.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.227+0000 7f7eb77fe640 1 -- 172.21.15.12:0/1707470740 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 35) ==== 43764+0+0 (secure 0 0 0) 0x7f7ec801a070 con 0x7f7ed0070080 2024-09-11T23:06:47.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.227+0000 7f7eb77fe640 1 -- 172.21.15.12:0/1707470740 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 3740+0+0 (secure 0 0 0) 0x7f7ec8047510 con 0x7f7ed0070080 2024-09-11T23:06:47.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.227+0000 7f7ed50b6640 1 -- 172.21.15.12:0/1707470740 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ed013aa50 con 0x7f7ed0070080 2024-09-11T23:06:47.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.231+0000 7f7eb77fe640 1 -- 172.21.15.12:0/1707470740 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7ec8007210 con 0x7f7ed0070080 2024-09-11T23:06:47.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.423+0000 7f7ed50b6640 1 -- 172.21.15.12:0/1707470740 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f7ed00a0090 con 0x7f7ed0070080 2024-09-11T23:06:47.427 INFO:tasks.ceph.mon.a.smithi012.stderr:2024-09-11T23:06:47.423+0000 7fd71c996640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T23:06:47.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.427+0000 7f7eb77fe640 1 -- 172.21.15.12:0/1707470740 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v50) ==== 161+0+0 (secure 0 0 0) 0x7f7ec801b3b0 con 0x7f7ed0070080 2024-09-11T23:06:47.428 INFO:teuthology.orchestra.run.smithi012.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T23:06:47.429 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:47.427+0000 7f3cb307e180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T23:06:47.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.427+0000 7f7ed50b6640 1 -- 172.21.15.12:0/1707470740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ed0070080 msgr2=0x7f7ed013b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:47.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.427+0000 7f7ed50b6640 1 --2- 172.21.15.12:0/1707470740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ed0070080 0x7f7ed013b550 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f7ec800c480 tx=0x7f7ec800c940 comp rx=0 tx=0).stop 2024-09-11T23:06:47.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.427+0000 7f7ed50b6640 1 -- 172.21.15.12:0/1707470740 shutdown_connections 2024-09-11T23:06:47.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.427+0000 7f7ed50b6640 1 --2- 172.21.15.12:0/1707470740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ed0070080 0x7f7ed013b550 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:47.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.427+0000 7f7ed50b6640 1 -- 172.21.15.12:0/1707470740 >> 172.21.15.12:0/1707470740 conn(0x7f7ed00a9320 msgr2=0x7f7ed00a6d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:47.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.427+0000 7f7ed50b6640 1 -- 172.21.15.12:0/1707470740 shutdown_connections 2024-09-11T23:06:47.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.427+0000 7f7ed50b6640 1 -- 172.21.15.12:0/1707470740 wait complete. 2024-09-11T23:06:47.435 INFO:tasks.ceph.mds.a.smithi012.stderr: -2429> 2024-09-11T23:06:21.007+0000 7f2469168640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6824/0: (98) Address already in use 2024-09-11T23:06:47.439 INFO:tasks.ceph.mds.a.smithi012.stderr: -1331> 2024-09-11T23:06:27.959+0000 7f246315c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T23:06:47.450 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-11T23:06:47.487 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:47.483+0000 7f3cb307e180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T23:06:47.494 INFO:tasks.ceph.mds.a.smithi012.stdout:starting mds.a at 2024-09-11T23:06:47.542 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:47.539+0000 7f3cb307e180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T23:06:47.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.563+0000 7f113c09a640 1 Processor -- start 2024-09-11T23:06:47.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.563+0000 7f113c09a640 1 -- start start 2024-09-11T23:06:47.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.567+0000 7f113c09a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1134133d40 0x7f1134071940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:47.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.567+0000 7f113c09a640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11341341d0 con 0x7f1134133960 2024-09-11T23:06:47.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.567+0000 7f113c09a640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f1134072db0 con 0x7f1134133d40 2024-09-11T23:06:47.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.567+0000 7f1139635640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1134133d40 0x7f1134071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:47.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.567+0000 7f1139e36640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1134133960 0x7f1134071230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38910/0 (socket says 172.21.15.12:38910) 2024-09-11T23:06:47.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.567+0000 7f1139e36640 1 -- 172.21.15.12:0/1236664765 learned_addr learned my addr 172.21.15.12:0/1236664765 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:47.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.567+0000 7f1138e34640 1 -- 172.21.15.12:0/1236664765 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3289760586 0 0) 0x7f11341341d0 con 0x7f1134133960 2024-09-11T23:06:47.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.567+0000 7f1139635640 1 -- 172.21.15.12:0/1236664765 >> v1:172.21.15.12:6789/0 conn(0x7f1134133960 legacy=0x7f1134071230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:47.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.567+0000 7f1139635640 1 -- 172.21.15.12:0/1236664765 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f113409bea0 con 0x7f1134133d40 2024-09-11T23:06:47.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.567+0000 7f1139635640 1 --2- 172.21.15.12:0/1236664765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1134133d40 0x7f1134071940 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f1124009740 tx=0x7f112401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=567b0afd76324515 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:47.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.567+0000 7f1138e34640 1 -- 172.21.15.12:0/1236664765 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11240b0070 con 0x7f1134133d40 2024-09-11T23:06:47.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.567+0000 7f1138e34640 1 -- 172.21.15.12:0/1236664765 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11240ab530 con 0x7f1134133d40 2024-09-11T23:06:47.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.571+0000 7f1138e34640 1 -- 172.21.15.12:0/1236664765 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11240ab830 con 0x7f1134133d40 2024-09-11T23:06:47.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.571+0000 7f113c09a640 1 -- 172.21.15.12:0/1236664765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1134133d40 msgr2=0x7f1134071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:47.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.571+0000 7f113c09a640 1 --2- 172.21.15.12:0/1236664765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1134133d40 0x7f1134071940 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f1124009740 tx=0x7f112401c390 comp rx=0 tx=0).stop 2024-09-11T23:06:47.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.571+0000 7f113c09a640 1 -- 172.21.15.12:0/1236664765 shutdown_connections 2024-09-11T23:06:47.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.571+0000 7f113c09a640 1 --2- 172.21.15.12:0/1236664765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1134133d40 0x7f1134071940 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:47.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.571+0000 7f113c09a640 1 -- 172.21.15.12:0/1236664765 >> 172.21.15.12:0/1236664765 conn(0x7f113409aba0 msgr2=0x7f113409afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:47.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.571+0000 7f113c09a640 1 -- 172.21.15.12:0/1236664765 shutdown_connections 2024-09-11T23:06:47.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.571+0000 7f113c09a640 1 -- 172.21.15.12:0/1236664765 wait complete. 2024-09-11T23:06:47.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.571+0000 7f113c09a640 1 Processor -- start 2024-09-11T23:06:47.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.571+0000 7f113c09a640 1 -- start start 2024-09-11T23:06:47.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.571+0000 7f113c09a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1134133960 0x7f11340a72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:47.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.571+0000 7f113c09a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f11340728f0 con 0x7f1134133960 2024-09-11T23:06:47.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.571+0000 7f1139e36640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1134133960 0x7f11340a72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:47.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.571+0000 7f1139e36640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1134133960 0x7f11340a72d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40114/0 (socket says 172.21.15.12:40114) 2024-09-11T23:06:47.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.571+0000 7f1139e36640 1 -- 172.21.15.12:0/4114219600 learned_addr learned my addr 172.21.15.12:0/4114219600 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:47.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.571+0000 7f1139e36640 1 -- 172.21.15.12:0/4114219600 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11340a8f30 con 0x7f1134133960 2024-09-11T23:06:47.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.571+0000 7f1139e36640 1 --2- 172.21.15.12:0/4114219600 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1134133960 0x7f11340a72d0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f113000c420 tx=0x7f113000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:47.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.571+0000 7f112a7fc640 1 -- 172.21.15.12:0/4114219600 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1130018070 con 0x7f1134133960 2024-09-11T23:06:47.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.571+0000 7f112a7fc640 1 -- 172.21.15.12:0/4114219600 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11300074d0 con 0x7f1134133960 2024-09-11T23:06:47.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.571+0000 7f113c09a640 1 -- 172.21.15.12:0/4114219600 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11340a5680 con 0x7f1134133960 2024-09-11T23:06:47.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.571+0000 7f112a7fc640 1 -- 172.21.15.12:0/4114219600 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1130004960 con 0x7f1134133960 2024-09-11T23:06:47.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.571+0000 7f113c09a640 1 -- 172.21.15.12:0/4114219600 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1134136680 con 0x7f1134133960 2024-09-11T23:06:47.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.571+0000 7f112a7fc640 1 -- 172.21.15.12:0/4114219600 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 35) ==== 43764+0+0 (secure 0 0 0) 0x7f113001b070 con 0x7f1134133960 2024-09-11T23:06:47.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.571+0000 7f113c09a640 1 -- 172.21.15.12:0/4114219600 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11340a7870 con 0x7f1134133960 2024-09-11T23:06:47.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.571+0000 7f112a7fc640 1 -- 172.21.15.12:0/4114219600 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 3826+0+0 (secure 0 0 0) 0x7f1130047680 con 0x7f1134133960 2024-09-11T23:06:47.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.579+0000 7f112a7fc640 1 -- 172.21.15.12:0/4114219600 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f113001ca00 con 0x7f1134133960 2024-09-11T23:06:47.624 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:47.619+0000 7f3cb307e180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T23:06:47.677 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:47.675+0000 7f3cb307e180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T23:06:47.754 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:47.751+0000 7f3cb307e180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T23:06:47.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:47.775+0000 7f113c09a640 1 -- 172.21.15.12:0/4114219600 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f1134071230 con 0x7f1134133960 2024-09-11T23:06:47.807 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:47.803+0000 7f3cb307e180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T23:06:47.953 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:47.951+0000 7f3cb307e180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T23:06:48.007 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:48.003+0000 7f3cb307e180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T23:06:48.239 INFO:tasks.ceph.mgr.x.smithi012.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-11T23:06:48.239 INFO:tasks.ceph.mgr.x.smithi012.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-11T23:06:48.239 INFO:tasks.ceph.mgr.x.smithi012.stderr: from numpy import show_config as show_numpy_config 2024-09-11T23:06:48.247 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:48.243+0000 7f3cb307e180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T23:06:48.390 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:48.387+0000 7f3cb307e180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:06:48.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:48.427+0000 7f112a7fc640 1 -- 172.21.15.12:0/4114219600 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v51) ==== 104+0+0 (secure 0 0 0) 0x7f1130022030 con 0x7f1134133960 2024-09-11T23:06:48.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:48.431+0000 7f113c09a640 1 -- 172.21.15.12:0/4114219600 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1134133960 msgr2=0x7f11340a72d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:48.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:48.431+0000 7f113c09a640 1 --2- 172.21.15.12:0/4114219600 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1134133960 0x7f11340a72d0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f113000c420 tx=0x7f113000c8e0 comp rx=0 tx=0).stop 2024-09-11T23:06:48.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:48.431+0000 7f113c09a640 1 -- 172.21.15.12:0/4114219600 shutdown_connections 2024-09-11T23:06:48.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:48.431+0000 7f113c09a640 1 --2- 172.21.15.12:0/4114219600 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1134133960 0x7f11340a72d0 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:48.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:48.431+0000 7f113c09a640 1 -- 172.21.15.12:0/4114219600 >> 172.21.15.12:0/4114219600 conn(0x7f113409aba0 msgr2=0x7f1134070120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:48.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:48.431+0000 7f113c09a640 1 -- 172.21.15.12:0/4114219600 shutdown_connections 2024-09-11T23:06:48.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:48.431+0000 7f113c09a640 1 -- 172.21.15.12:0/4114219600 wait complete. 2024-09-11T23:06:48.453 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-11T23:06:48.507 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:48.503+0000 7f3cb307e180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T23:06:48.573 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:48.571+0000 7f3cb307e180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T23:06:48.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:48.615+0000 7f0af25c0640 1 Processor -- start 2024-09-11T23:06:48.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:48.615+0000 7f0af25c0640 1 -- start start 2024-09-11T23:06:48.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:48.615+0000 7f0af25c0640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0aec09dcf0 0x7f0aec09b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:48.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:48.615+0000 7f0af25c0640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0aec09c820 con 0x7f0aec0a9a80 2024-09-11T23:06:48.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:48.615+0000 7f0af25c0640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f0aec09e360 con 0x7f0aec09dcf0 2024-09-11T23:06:48.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:48.615+0000 7f0aeb7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0aec09dcf0 0x7f0aec09b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:48.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:48.615+0000 7f0aebfff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f0aec0a9a80 0x7f0aec09a9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38914/0 (socket says 172.21.15.12:38914) 2024-09-11T23:06:48.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:48.615+0000 7f0aebfff640 1 -- 172.21.15.12:0/2944999867 learned_addr learned my addr 172.21.15.12:0/2944999867 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:48.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:48.615+0000 7f0aeb7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0aec09dcf0 0x7f0aec09b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40120/0 (socket says 172.21.15.12:40120) 2024-09-11T23:06:48.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:48.615+0000 7f0aeb7fe640 1 -- 172.21.15.12:0/2944999867 >> v1:172.21.15.12:6789/0 conn(0x7f0aec0a9a80 legacy=0x7f0aec09a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:48.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:48.619+0000 7f0aeb7fe640 1 -- 172.21.15.12:0/2944999867 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aec09d030 con 0x7f0aec09dcf0 2024-09-11T23:06:48.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:48.619+0000 7f0aeaffd640 1 -- 172.21.15.12:0/2944999867 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3604244878 0 0) 0x7f0aec09c820 con 0x7f0aec0a9a80 2024-09-11T23:06:48.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:48.619+0000 7f0aeb7fe640 1 --2- 172.21.15.12:0/2944999867 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0aec09dcf0 0x7f0aec09b0e0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0009740 tx=0x7f0ae001c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=573fe837ec4f2848 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:48.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:48.619+0000 7f0aeaffd640 1 -- 172.21.15.12:0/2944999867 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ae00b1070 con 0x7f0aec09dcf0 2024-09-11T23:06:48.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:48.619+0000 7f0aeaffd640 1 -- 172.21.15.12:0/2944999867 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ae00ac410 con 0x7f0aec09dcf0 2024-09-11T23:06:48.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:48.619+0000 7f0aeaffd640 1 -- 172.21.15.12:0/2944999867 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ae00ac710 con 0x7f0aec09dcf0 2024-09-11T23:06:48.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:48.619+0000 7f0af25c0640 1 -- 172.21.15.12:0/2944999867 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0aec09dcf0 msgr2=0x7f0aec09b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:48.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:48.619+0000 7f0af25c0640 1 --2- 172.21.15.12:0/2944999867 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0aec09dcf0 0x7f0aec09b0e0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0009740 tx=0x7f0ae001c390 comp rx=0 tx=0).stop 2024-09-11T23:06:48.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:48.619+0000 7f0af25c0640 1 -- 172.21.15.12:0/2944999867 shutdown_connections 2024-09-11T23:06:48.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:48.619+0000 7f0af25c0640 1 --2- 172.21.15.12:0/2944999867 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0aec09dcf0 0x7f0aec09b0e0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:48.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:48.619+0000 7f0af25c0640 1 -- 172.21.15.12:0/2944999867 >> 172.21.15.12:0/2944999867 conn(0x7f0aec06fc80 msgr2=0x7f0aec0720a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:48.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:48.619+0000 7f0af25c0640 1 -- 172.21.15.12:0/2944999867 shutdown_connections 2024-09-11T23:06:48.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:48.619+0000 7f0af25c0640 1 -- 172.21.15.12:0/2944999867 wait complete. 2024-09-11T23:06:48.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:48.623+0000 7f0af25c0640 1 Processor -- start 2024-09-11T23:06:48.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:48.623+0000 7f0af25c0640 1 -- start start 2024-09-11T23:06:48.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:48.623+0000 7f0af25c0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0aec09dcf0 0x7f0aec122560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:48.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:48.623+0000 7f0af25c0640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0aec1422b0 con 0x7f0aec09dcf0 2024-09-11T23:06:48.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:48.623+0000 7f0aebfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0aec09dcf0 0x7f0aec122560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:48.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:48.623+0000 7f0aebfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0aec09dcf0 0x7f0aec122560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40136/0 (socket says 172.21.15.12:40136) 2024-09-11T23:06:48.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:48.623+0000 7f0aebfff640 1 -- 172.21.15.12:0/2270333587 learned_addr learned my addr 172.21.15.12:0/2270333587 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:48.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:48.623+0000 7f0aebfff640 1 -- 172.21.15.12:0/2270333587 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aec122290 con 0x7f0aec09dcf0 2024-09-11T23:06:48.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:48.623+0000 7f0aebfff640 1 --2- 172.21.15.12:0/2270333587 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0aec09dcf0 0x7f0aec122560 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f0adc00c420 tx=0x7f0adc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:48.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:48.623+0000 7f0ae8ff9640 1 -- 172.21.15.12:0/2270333587 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0adc018070 con 0x7f0aec09dcf0 2024-09-11T23:06:48.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:48.623+0000 7f0ae8ff9640 1 -- 172.21.15.12:0/2270333587 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0adc0074d0 con 0x7f0aec09dcf0 2024-09-11T23:06:48.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:48.623+0000 7f0ae8ff9640 1 -- 172.21.15.12:0/2270333587 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0adc004960 con 0x7f0aec09dcf0 2024-09-11T23:06:48.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:48.623+0000 7f0af25c0640 1 -- 172.21.15.12:0/2270333587 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0aec1ce8c0 con 0x7f0aec09dcf0 2024-09-11T23:06:48.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:48.623+0000 7f0af25c0640 1 -- 172.21.15.12:0/2270333587 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0aec1237d0 con 0x7f0aec09dcf0 2024-09-11T23:06:48.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:48.623+0000 7f0af25c0640 1 -- 172.21.15.12:0/2270333587 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0aec09a9d0 con 0x7f0aec09dcf0 2024-09-11T23:06:48.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:48.623+0000 7f0ae8ff9640 1 -- 172.21.15.12:0/2270333587 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 35) ==== 43764+0+0 (secure 0 0 0) 0x7f0adc01b070 con 0x7f0aec09dcf0 2024-09-11T23:06:48.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:48.623+0000 7f0ae8ff9640 1 -- 172.21.15.12:0/2270333587 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 3826+0+0 (secure 0 0 0) 0x7f0adc047660 con 0x7f0aec09dcf0 2024-09-11T23:06:48.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:48.627+0000 7f0ae8ff9640 1 -- 172.21.15.12:0/2270333587 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0adc011950 con 0x7f0aec09dcf0 2024-09-11T23:06:48.718 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:48.715+0000 7f3cb307e180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:06:48.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:48.791+0000 7f0af25c0640 1 -- 172.21.15.12:0/2270333587 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0aec06cf40 con 0x7f0aec09dcf0 2024-09-11T23:06:49.227 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:49.223+0000 7f3cb307e180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T23:06:49.303 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:49.299+0000 7f3cb307e180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T23:06:49.456 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:49.451+0000 7f3cb307e180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T23:06:49.531 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:49.527+0000 7f3cb307e180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T23:06:49.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:49.643+0000 7f0ae8ff9640 1 -- 172.21.15.12:0/2270333587 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v69) ==== 181+0+0 (secure 0 0 0) 0x7f0adc004d90 con 0x7f0aec09dcf0 2024-09-11T23:06:49.648 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' removed 2024-09-11T23:06:49.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:49.647+0000 7f0af25c0640 1 -- 172.21.15.12:0/2270333587 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0aec09dcf0 msgr2=0x7f0aec122560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:49.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:49.647+0000 7f0af25c0640 1 --2- 172.21.15.12:0/2270333587 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0aec09dcf0 0x7f0aec122560 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f0adc00c420 tx=0x7f0adc00c8e0 comp rx=0 tx=0).stop 2024-09-11T23:06:49.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:49.647+0000 7f0af25c0640 1 -- 172.21.15.12:0/2270333587 shutdown_connections 2024-09-11T23:06:49.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:49.647+0000 7f0af25c0640 1 --2- 172.21.15.12:0/2270333587 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0aec09dcf0 0x7f0aec122560 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:49.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:49.647+0000 7f0af25c0640 1 -- 172.21.15.12:0/2270333587 >> 172.21.15.12:0/2270333587 conn(0x7f0aec06fc80 msgr2=0x7f0aec071230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:49.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:49.647+0000 7f0af25c0640 1 -- 172.21.15.12:0/2270333587 shutdown_connections 2024-09-11T23:06:49.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:49.647+0000 7f0af25c0640 1 -- 172.21.15.12:0/2270333587 wait complete. 2024-09-11T23:06:49.671 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-11T23:06:49.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:49.835+0000 7f8d053a9640 1 Processor -- start 2024-09-11T23:06:49.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:49.835+0000 7f8d053a9640 1 -- start start 2024-09-11T23:06:49.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:49.835+0000 7f8d053a9640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8d000a03b0 0x7f8d0013ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:49.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:49.835+0000 7f8d053a9640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d0009fb00 con 0x7f8d0013a030 2024-09-11T23:06:49.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:49.835+0000 7f8d053a9640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f8d00139b70 con 0x7f8d000a03b0 2024-09-11T23:06:49.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:49.835+0000 7f8cfe7fc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8d000a03b0 0x7f8d0013ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:49.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:49.835+0000 7f8cfe7fc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8d000a03b0 0x7f8d0013ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40144/0 (socket says 172.21.15.12:40144) 2024-09-11T23:06:49.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:49.835+0000 7f8cfe7fc640 1 -- 172.21.15.12:0/2387227848 learned_addr learned my addr 172.21.15.12:0/2387227848 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:49.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:49.835+0000 7f8cfeffd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f8d0013a030 0x7f8d0013a410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38930/0 (socket says 172.21.15.12:38930) 2024-09-11T23:06:49.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:49.835+0000 7f8cfe7fc640 1 -- 172.21.15.12:0/2387227848 >> v1:172.21.15.12:6789/0 conn(0x7f8d0013a030 legacy=0x7f8d0013a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:49.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:49.835+0000 7f8cfe7fc640 1 -- 172.21.15.12:0/2387227848 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d0006c1f0 con 0x7f8d000a03b0 2024-09-11T23:06:49.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:49.839+0000 7f8cfe7fc640 1 --2- 172.21.15.12:0/2387227848 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d000a03b0 0x7f8d0013ee90 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f8cf40097f0 tx=0x7f8cf401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3066b4c38c30fff5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:49.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:49.839+0000 7f8cfdffb640 1 -- 172.21.15.12:0/2387227848 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cf40ab520 con 0x7f8d000a03b0 2024-09-11T23:06:49.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:49.839+0000 7f8cfdffb640 1 -- 172.21.15.12:0/2387227848 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cf40b0070 con 0x7f8d000a03b0 2024-09-11T23:06:49.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:49.839+0000 7f8cfdffb640 1 -- 172.21.15.12:0/2387227848 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cf40ab810 con 0x7f8d000a03b0 2024-09-11T23:06:49.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:49.839+0000 7f8d053a9640 1 -- 172.21.15.12:0/2387227848 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d000a03b0 msgr2=0x7f8d0013ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:49.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:49.839+0000 7f8d053a9640 1 --2- 172.21.15.12:0/2387227848 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d000a03b0 0x7f8d0013ee90 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f8cf40097f0 tx=0x7f8cf401c4e0 comp rx=0 tx=0).stop 2024-09-11T23:06:49.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:49.839+0000 7f8d053a9640 1 -- 172.21.15.12:0/2387227848 shutdown_connections 2024-09-11T23:06:49.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:49.839+0000 7f8d053a9640 1 --2- 172.21.15.12:0/2387227848 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d000a03b0 0x7f8d0013ee90 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:49.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:49.839+0000 7f8d053a9640 1 -- 172.21.15.12:0/2387227848 >> 172.21.15.12:0/2387227848 conn(0x7f8d00068000 msgr2=0x7f8d000a59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:49.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:49.839+0000 7f8d053a9640 1 -- 172.21.15.12:0/2387227848 shutdown_connections 2024-09-11T23:06:49.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:49.839+0000 7f8d053a9640 1 -- 172.21.15.12:0/2387227848 wait complete. 2024-09-11T23:06:49.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:49.843+0000 7f8d053a9640 1 Processor -- start 2024-09-11T23:06:49.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:49.843+0000 7f8d053a9640 1 -- start start 2024-09-11T23:06:49.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:49.843+0000 7f8d053a9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d000a03b0 0x7f8d00120a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:49.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:49.843+0000 7f8d053a9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8d00141f80 con 0x7f8d000a03b0 2024-09-11T23:06:49.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:49.843+0000 7f8cfeffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d000a03b0 0x7f8d00120a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:49.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:49.843+0000 7f8cfeffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d000a03b0 0x7f8d00120a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40158/0 (socket says 172.21.15.12:40158) 2024-09-11T23:06:49.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:49.843+0000 7f8cfeffd640 1 -- 172.21.15.12:0/2520570155 learned_addr learned my addr 172.21.15.12:0/2520570155 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:49.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:49.843+0000 7f8cfeffd640 1 -- 172.21.15.12:0/2520570155 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d0013ddf0 con 0x7f8d000a03b0 2024-09-11T23:06:49.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:49.843+0000 7f8cfeffd640 1 --2- 172.21.15.12:0/2520570155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d000a03b0 0x7f8d00120a30 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f8cf000c410 tx=0x7f8cf000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:49.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:49.843+0000 7f8ce77fe640 1 -- 172.21.15.12:0/2520570155 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cf0007410 con 0x7f8d000a03b0 2024-09-11T23:06:49.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:49.843+0000 7f8ce77fe640 1 -- 172.21.15.12:0/2520570155 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cf00075b0 con 0x7f8d000a03b0 2024-09-11T23:06:49.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:49.843+0000 7f8ce77fe640 1 -- 172.21.15.12:0/2520570155 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cf0004920 con 0x7f8d000a03b0 2024-09-11T23:06:49.849 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:49.843+0000 7f3cb307e180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T23:06:49.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:49.843+0000 7f8d053a9640 1 -- 172.21.15.12:0/2520570155 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d001202e0 con 0x7f8d000a03b0 2024-09-11T23:06:49.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:49.843+0000 7f8d053a9640 1 -- 172.21.15.12:0/2520570155 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d0013ec80 con 0x7f8d000a03b0 2024-09-11T23:06:49.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:49.843+0000 7f8d053a9640 1 -- 172.21.15.12:0/2520570155 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d0013e0d0 con 0x7f8d000a03b0 2024-09-11T23:06:49.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:49.843+0000 7f8ce77fe640 1 -- 172.21.15.12:0/2520570155 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 35) ==== 43764+0+0 (secure 0 0 0) 0x7f8cf001a020 con 0x7f8d000a03b0 2024-09-11T23:06:49.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:49.843+0000 7f8ce77fe640 1 -- 172.21.15.12:0/2520570155 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 3388+0+0 (secure 0 0 0) 0x7f8cf00479a0 con 0x7f8d000a03b0 2024-09-11T23:06:49.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:49.847+0000 7f8ce77fe640 1 -- 172.21.15.12:0/2520570155 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8cf001b960 con 0x7f8d000a03b0 2024-09-11T23:06:49.904 INFO:tasks.ceph.mgr.x.smithi012.stderr:2024-09-11T23:06:49.899+0000 7f3cb307e180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T23:06:49.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:49.923+0000 7f8ce77fe640 1 -- 172.21.15.12:0/2520570155 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 36) ==== 43764+0+0 (secure 0 0 0) 0x7f8cf0013920 con 0x7f8d000a03b0 2024-09-11T23:06:50.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:50.031+0000 7f8d053a9640 1 -- 172.21.15.12:0/2520570155 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8d0013e9b0 con 0x7f8d000a03b0 2024-09-11T23:06:50.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:50.927+0000 7f8ce77fe640 1 -- 172.21.15.12:0/2520570155 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mgrmap(e 37) ==== 43891+0+0 (secure 0 0 0) 0x7f8cf0013400 con 0x7f8d000a03b0 2024-09-11T23:06:50.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:50.927+0000 7f8ce77fe640 1 --2- 172.21.15.12:0/2520570155 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f8cec039500 0x7f8cec03b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:50.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:50.931+0000 7f8cfe7fc640 1 --2- 172.21.15.12:0/2520570155 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f8cec039500 0x7f8cec03b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:50.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:50.935+0000 7f8cfe7fc640 1 --2- 172.21.15.12:0/2520570155 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f8cec039500 0x7f8cec03b8f0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f8cf40af000 tx=0x7f8cf40a7000 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:50.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:50.935+0000 7f8ce77fe640 1 -- 172.21.15.12:0/2520570155 <== mon.0 v2:172.21.15.12:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v71) ==== 169+0+0 (secure 0 0 0) 0x7f8cf000a1b0 con 0x7f8d000a03b0 2024-09-11T23:06:50.940 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' removed 2024-09-11T23:06:50.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:50.947+0000 7f8d053a9640 1 -- 172.21.15.12:0/2520570155 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f8cec039500 msgr2=0x7f8cec03b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:50.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:50.947+0000 7f8d053a9640 1 --2- 172.21.15.12:0/2520570155 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f8cec039500 0x7f8cec03b8f0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f8cf40af000 tx=0x7f8cf40a7000 comp rx=0 tx=0).stop 2024-09-11T23:06:50.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:50.947+0000 7f8d053a9640 1 -- 172.21.15.12:0/2520570155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d000a03b0 msgr2=0x7f8d00120a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:50.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:50.947+0000 7f8d053a9640 1 --2- 172.21.15.12:0/2520570155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d000a03b0 0x7f8d00120a30 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f8cf000c410 tx=0x7f8cf000c8d0 comp rx=0 tx=0).stop 2024-09-11T23:06:50.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:50.947+0000 7f8d053a9640 1 -- 172.21.15.12:0/2520570155 shutdown_connections 2024-09-11T23:06:50.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:50.947+0000 7f8d053a9640 1 --2- 172.21.15.12:0/2520570155 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f8cec039500 0x7f8cec03b8f0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:50.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:50.947+0000 7f8d053a9640 1 --2- 172.21.15.12:0/2520570155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d000a03b0 0x7f8d00120a30 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:50.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:50.947+0000 7f8d053a9640 1 -- 172.21.15.12:0/2520570155 >> 172.21.15.12:0/2520570155 conn(0x7f8d00068000 msgr2=0x7f8d000a6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:50.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:50.947+0000 7f8d053a9640 1 -- 172.21.15.12:0/2520570155 shutdown_connections 2024-09-11T23:06:50.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:50.947+0000 7f8d053a9640 1 -- 172.21.15.12:0/2520570155 wait complete. 2024-09-11T23:06:50.971 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-11T23:06:51.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.087+0000 7f885c441640 1 Processor -- start 2024-09-11T23:06:51.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.087+0000 7f885c441640 1 -- start start 2024-09-11T23:06:51.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.087+0000 7f885c441640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f88541381c0 0x7f885413cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:51.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.087+0000 7f885c441640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f885409d690 con 0x7f8854137de0 2024-09-11T23:06:51.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.087+0000 7f885c441640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f885409ea90 con 0x7f88541381c0 2024-09-11T23:06:51.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.087+0000 7f885a1dd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f8854137de0 0x7f885409f190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38946/0 (socket says 172.21.15.12:38946) 2024-09-11T23:06:51.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.087+0000 7f88599dc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f88541381c0 0x7f885413cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:51.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.087+0000 7f885a1dd640 1 -- 172.21.15.12:0/2821833969 learned_addr learned my addr 172.21.15.12:0/2821833969 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:51.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.087+0000 7f88599dc640 1 -- 172.21.15.12:0/2821833969 >> v1:172.21.15.12:6789/0 conn(0x7f8854137de0 legacy=0x7f885409f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:51.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.087+0000 7f88599dc640 1 -- 172.21.15.12:0/2821833969 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f885409cf00 con 0x7f88541381c0 2024-09-11T23:06:51.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.087+0000 7f88591db640 1 -- 172.21.15.12:0/2821833969 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2209378244 0 0) 0x7f885409d690 con 0x7f8854137de0 2024-09-11T23:06:51.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.091+0000 7f88599dc640 1 --2- 172.21.15.12:0/2821833969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88541381c0 0x7f885413cbc0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f8844009d90 tx=0x7f884401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44968b9a5cf57577 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:51.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.091+0000 7f88591db640 1 -- 172.21.15.12:0/2821833969 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88440b2070 con 0x7f88541381c0 2024-09-11T23:06:51.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.091+0000 7f88591db640 1 -- 172.21.15.12:0/2821833969 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88440a5760 con 0x7f88541381c0 2024-09-11T23:06:51.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.091+0000 7f88591db640 1 -- 172.21.15.12:0/2821833969 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88440a5a60 con 0x7f88541381c0 2024-09-11T23:06:51.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.091+0000 7f885c441640 1 -- 172.21.15.12:0/2821833969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88541381c0 msgr2=0x7f885413cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:51.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.091+0000 7f885c441640 1 --2- 172.21.15.12:0/2821833969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88541381c0 0x7f885413cbc0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f8844009d90 tx=0x7f884401c8e0 comp rx=0 tx=0).stop 2024-09-11T23:06:51.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.091+0000 7f885c441640 1 -- 172.21.15.12:0/2821833969 shutdown_connections 2024-09-11T23:06:51.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.091+0000 7f885c441640 1 --2- 172.21.15.12:0/2821833969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88541381c0 0x7f885413cbc0 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:51.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.091+0000 7f885c441640 1 -- 172.21.15.12:0/2821833969 >> 172.21.15.12:0/2821833969 conn(0x7f88540a82f0 msgr2=0x7f88540a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:51.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.091+0000 7f885c441640 1 -- 172.21.15.12:0/2821833969 shutdown_connections 2024-09-11T23:06:51.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.091+0000 7f885c441640 1 -- 172.21.15.12:0/2821833969 wait complete. 2024-09-11T23:06:51.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.091+0000 7f885c441640 1 Processor -- start 2024-09-11T23:06:51.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.091+0000 7f885c441640 1 -- start start 2024-09-11T23:06:51.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.095+0000 7f885c441640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8854137de0 0x7f8854071c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:51.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.095+0000 7f885c441640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8854137860 con 0x7f8854137de0 2024-09-11T23:06:51.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.095+0000 7f885a1dd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8854137de0 0x7f8854071c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:51.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.095+0000 7f885a1dd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8854137de0 0x7f8854071c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40238/0 (socket says 172.21.15.12:40238) 2024-09-11T23:06:51.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.095+0000 7f885a1dd640 1 -- 172.21.15.12:0/129532866 learned_addr learned my addr 172.21.15.12:0/129532866 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:51.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.095+0000 7f885a1dd640 1 -- 172.21.15.12:0/129532866 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8854120170 con 0x7f8854137de0 2024-09-11T23:06:51.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.095+0000 7f885a1dd640 1 --2- 172.21.15.12:0/129532866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8854137de0 0x7f8854071c60 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f884800c390 tx=0x7f884800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:51.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.095+0000 7f8852ffd640 1 -- 172.21.15.12:0/129532866 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8848007410 con 0x7f8854137de0 2024-09-11T23:06:51.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.095+0000 7f8852ffd640 1 -- 172.21.15.12:0/129532866 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88480075d0 con 0x7f8854137de0 2024-09-11T23:06:51.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.095+0000 7f885c441640 1 -- 172.21.15.12:0/129532866 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f885411f000 con 0x7f8854137de0 2024-09-11T23:06:51.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.095+0000 7f8852ffd640 1 -- 172.21.15.12:0/129532866 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8848004960 con 0x7f8854137de0 2024-09-11T23:06:51.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.095+0000 7f885c441640 1 -- 172.21.15.12:0/129532866 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f885411fe60 con 0x7f8854137de0 2024-09-11T23:06:51.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.095+0000 7f885c441640 1 -- 172.21.15.12:0/129532866 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f885409f190 con 0x7f8854137de0 2024-09-11T23:06:51.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.095+0000 7f8852ffd640 1 -- 172.21.15.12:0/129532866 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 37) ==== 43891+0+0 (secure 0 0 0) 0x7f8848011070 con 0x7f8854137de0 2024-09-11T23:06:51.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.095+0000 7f8852ffd640 1 --2- 172.21.15.12:0/129532866 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f8840035c00 0x7f88400380c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:51.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.095+0000 7f8852ffd640 1 -- 172.21.15.12:0/129532866 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 2974+0+0 (secure 0 0 0) 0x7f8848047d30 con 0x7f8854137de0 2024-09-11T23:06:51.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.095+0000 7f88599dc640 1 --2- 172.21.15.12:0/129532866 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f8840035c00 0x7f88400380c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:51.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.095+0000 7f88599dc640 1 --2- 172.21.15.12:0/129532866 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f8840035c00 0x7f88400380c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f88440af000 tx=0x7f88440a7070 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:51.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.099+0000 7f8852ffd640 1 -- 172.21.15.12:0/129532866 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8848004d90 con 0x7f8854137de0 2024-09-11T23:06:51.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.263+0000 7f885c441640 1 -- 172.21.15.12:0/129532866 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f885409e730 con 0x7f8854137de0 2024-09-11T23:06:51.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.267+0000 7f8852ffd640 1 -- 172.21.15.12:0/129532866 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v12) ==== 104+0+0 (secure 0 0 0) 0x7f88480138e0 con 0x7f8854137de0 2024-09-11T23:06:51.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.271+0000 7f885c441640 1 -- 172.21.15.12:0/129532866 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f8840035c00 msgr2=0x7f88400380c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:51.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.271+0000 7f885c441640 1 --2- 172.21.15.12:0/129532866 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f8840035c00 0x7f88400380c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f88440af000 tx=0x7f88440a7070 comp rx=0 tx=0).stop 2024-09-11T23:06:51.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.271+0000 7f885c441640 1 -- 172.21.15.12:0/129532866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8854137de0 msgr2=0x7f8854071c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:51.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.271+0000 7f885c441640 1 --2- 172.21.15.12:0/129532866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8854137de0 0x7f8854071c60 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f884800c390 tx=0x7f884800c850 comp rx=0 tx=0).stop 2024-09-11T23:06:51.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.271+0000 7f885c441640 1 -- 172.21.15.12:0/129532866 shutdown_connections 2024-09-11T23:06:51.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.271+0000 7f885c441640 1 --2- 172.21.15.12:0/129532866 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f8840035c00 0x7f88400380c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:51.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.271+0000 7f885c441640 1 --2- 172.21.15.12:0/129532866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8854137de0 0x7f8854071c60 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:51.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.271+0000 7f885c441640 1 -- 172.21.15.12:0/129532866 >> 172.21.15.12:0/129532866 conn(0x7f88540a82f0 msgr2=0x7f88540a1490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:51.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.271+0000 7f885c441640 1 -- 172.21.15.12:0/129532866 shutdown_connections 2024-09-11T23:06:51.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.271+0000 7f885c441640 1 -- 172.21.15.12:0/129532866 wait complete. 2024-09-11T23:06:51.290 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_fstop.TestFSTop.test_fstop_non_existent_cluster' 2024-09-11T23:06:51.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.415+0000 7f09de919640 1 Processor -- start 2024-09-11T23:06:51.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.415+0000 7f09de919640 1 -- start start 2024-09-11T23:06:51.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.415+0000 7f09de919640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f09d80a0bc0 0x7f09d813ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:51.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.415+0000 7f09de919640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09d8139d60 con 0x7f09d813a220 2024-09-11T23:06:51.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.415+0000 7f09de919640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f09d8072c90 con 0x7f09d80a0bc0 2024-09-11T23:06:51.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.415+0000 7f09d7fff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f09d813a220 0x7f09d813a600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38952/0 (socket says 172.21.15.12:38952) 2024-09-11T23:06:51.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.415+0000 7f09d7fff640 1 -- 172.21.15.12:0/432882429 learned_addr learned my addr 172.21.15.12:0/432882429 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:51.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.415+0000 7f09d77fe640 1 --2- 172.21.15.12:0/432882429 >> v2:172.21.15.12:3300/0 conn(0x7f09d80a0bc0 0x7f09d813ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:51.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.415+0000 7f09d6ffd640 1 -- 172.21.15.12:0/432882429 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1193783132 0 0) 0x7f09d8139d60 con 0x7f09d813a220 2024-09-11T23:06:51.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.415+0000 7f09d6ffd640 1 -- 172.21.15.12:0/432882429 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09c0003530 con 0x7f09d813a220 2024-09-11T23:06:51.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.415+0000 7f09d77fe640 1 -- 172.21.15.12:0/432882429 >> v1:172.21.15.12:6789/0 conn(0x7f09d813a220 legacy=0x7f09d813a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:51.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.415+0000 7f09d77fe640 1 -- 172.21.15.12:0/432882429 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09d809fc10 con 0x7f09d80a0bc0 2024-09-11T23:06:51.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.419+0000 7f09d77fe640 1 --2- 172.21.15.12:0/432882429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09d80a0bc0 0x7f09d813ef70 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f09d8139f30 tx=0x7f09cc01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b82e49c4ed443bd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:51.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.419+0000 7f09d6ffd640 1 -- 172.21.15.12:0/432882429 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09cc0b0070 con 0x7f09d80a0bc0 2024-09-11T23:06:51.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.419+0000 7f09d6ffd640 1 -- 172.21.15.12:0/432882429 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09cc0ab400 con 0x7f09d80a0bc0 2024-09-11T23:06:51.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.419+0000 7f09d6ffd640 1 -- 172.21.15.12:0/432882429 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09cc0ab700 con 0x7f09d80a0bc0 2024-09-11T23:06:51.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.419+0000 7f09de919640 1 -- 172.21.15.12:0/432882429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09d80a0bc0 msgr2=0x7f09d813ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:51.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.419+0000 7f09de919640 1 --2- 172.21.15.12:0/432882429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09d80a0bc0 0x7f09d813ef70 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f09d8139f30 tx=0x7f09cc01c390 comp rx=0 tx=0).stop 2024-09-11T23:06:51.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.419+0000 7f09de919640 1 -- 172.21.15.12:0/432882429 shutdown_connections 2024-09-11T23:06:51.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.419+0000 7f09de919640 1 --2- 172.21.15.12:0/432882429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09d80a0bc0 0x7f09d813ef70 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:51.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.419+0000 7f09de919640 1 -- 172.21.15.12:0/432882429 >> 172.21.15.12:0/432882429 conn(0x7f09d80a8450 msgr2=0x7f09d80a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:51.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.419+0000 7f09de919640 1 -- 172.21.15.12:0/432882429 shutdown_connections 2024-09-11T23:06:51.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.419+0000 7f09de919640 1 -- 172.21.15.12:0/432882429 wait complete. 2024-09-11T23:06:51.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.419+0000 7f09de919640 1 Processor -- start 2024-09-11T23:06:51.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.419+0000 7f09de919640 1 -- start start 2024-09-11T23:06:51.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.419+0000 7f09de919640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09d80a0bc0 0x7f09d813c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:51.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.419+0000 7f09de919640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f09d8142060 con 0x7f09d80a0bc0 2024-09-11T23:06:51.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.419+0000 7f09d7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09d80a0bc0 0x7f09d813c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:51.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.419+0000 7f09d7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09d80a0bc0 0x7f09d813c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40262/0 (socket says 172.21.15.12:40262) 2024-09-11T23:06:51.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.419+0000 7f09d7fff640 1 -- 172.21.15.12:0/1939250240 learned_addr learned my addr 172.21.15.12:0/1939250240 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:51.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.419+0000 7f09d7fff640 1 -- 172.21.15.12:0/1939250240 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09d813bb30 con 0x7f09d80a0bc0 2024-09-11T23:06:51.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.419+0000 7f09d7fff640 1 --2- 172.21.15.12:0/1939250240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09d80a0bc0 0x7f09d813c1d0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f09c800c450 tx=0x7f09c800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:51.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.419+0000 7f09d4ff9640 1 -- 172.21.15.12:0/1939250240 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09c8017070 con 0x7f09d80a0bc0 2024-09-11T23:06:51.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.419+0000 7f09d4ff9640 1 -- 172.21.15.12:0/1939250240 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09c8005c20 con 0x7f09d80a0bc0 2024-09-11T23:06:51.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.419+0000 7f09d4ff9640 1 -- 172.21.15.12:0/1939250240 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09c8007070 con 0x7f09d80a0bc0 2024-09-11T23:06:51.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.419+0000 7f09de919640 1 -- 172.21.15.12:0/1939250240 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09d809c080 con 0x7f09d80a0bc0 2024-09-11T23:06:51.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.419+0000 7f09de919640 1 -- 172.21.15.12:0/1939250240 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09d809e3c0 con 0x7f09d80a0bc0 2024-09-11T23:06:51.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.423+0000 7f09d4ff9640 1 -- 172.21.15.12:0/1939250240 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 37) ==== 43891+0+0 (secure 0 0 0) 0x7f09c801a070 con 0x7f09d80a0bc0 2024-09-11T23:06:51.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.423+0000 7f09de919640 1 -- 172.21.15.12:0/1939250240 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09d813c710 con 0x7f09d80a0bc0 2024-09-11T23:06:51.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.423+0000 7f09d4ff9640 1 --2- 172.21.15.12:0/1939250240 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f09c4035c00 0x7f09c40380c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:51.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.423+0000 7f09d4ff9640 1 -- 172.21.15.12:0/1939250240 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 2974+0+0 (secure 0 0 0) 0x7f09c8047440 con 0x7f09d80a0bc0 2024-09-11T23:06:51.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.423+0000 7f09d77fe640 1 --2- 172.21.15.12:0/1939250240 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f09c4035c00 0x7f09c40380c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:51.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.423+0000 7f09d77fe640 1 --2- 172.21.15.12:0/1939250240 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f09c4035c00 0x7f09c40380c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f09cc0ad000 tx=0x7f09cc008040 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:51.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.427+0000 7f09d4ff9640 1 -- 172.21.15.12:0/1939250240 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f09c8012400 con 0x7f09d80a0bc0 2024-09-11T23:06:51.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.655+0000 7f09de919640 1 -- 172.21.15.12:0/1939250240 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_fstop.TestFSTop.test_fstop_non_existent_cluster"]} v 0) -- 0x7f09d813b060 con 0x7f09d80a0bc0 2024-09-11T23:06:51.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.927+0000 7f09d4ff9640 1 -- 172.21.15.12:0/1939250240 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_fstop.TestFSTop.test_fstop_non_existent_cluster"]}]=0 v198) ==== 144+0+0 (secure 0 0 0) 0x7f09c801ac10 con 0x7f09d80a0bc0 2024-09-11T23:06:51.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.931+0000 7f09de919640 1 -- 172.21.15.12:0/1939250240 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f09c4035c00 msgr2=0x7f09c40380c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:51.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.931+0000 7f09de919640 1 --2- 172.21.15.12:0/1939250240 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f09c4035c00 0x7f09c40380c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f09cc0ad000 tx=0x7f09cc008040 comp rx=0 tx=0).stop 2024-09-11T23:06:51.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.931+0000 7f09de919640 1 -- 172.21.15.12:0/1939250240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09d80a0bc0 msgr2=0x7f09d813c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:51.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.931+0000 7f09de919640 1 --2- 172.21.15.12:0/1939250240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09d80a0bc0 0x7f09d813c1d0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f09c800c450 tx=0x7f09c800c910 comp rx=0 tx=0).stop 2024-09-11T23:06:51.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.931+0000 7f09de919640 1 -- 172.21.15.12:0/1939250240 shutdown_connections 2024-09-11T23:06:51.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.931+0000 7f09de919640 1 --2- 172.21.15.12:0/1939250240 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f09c4035c00 0x7f09c40380c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:51.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.931+0000 7f09de919640 1 --2- 172.21.15.12:0/1939250240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09d80a0bc0 0x7f09d813c1d0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:51.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.931+0000 7f09de919640 1 -- 172.21.15.12:0/1939250240 >> 172.21.15.12:0/1939250240 conn(0x7f09d80a8450 msgr2=0x7f09d80a70e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:51.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.931+0000 7f09de919640 1 -- 172.21.15.12:0/1939250240 shutdown_connections 2024-09-11T23:06:51.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:51.931+0000 7f09de919640 1 -- 172.21.15.12:0/1939250240 wait complete. 2024-09-11T23:06:51.956 INFO:tasks.cephfs_test_runner:test_fstop_non_existent_cluster (tasks.cephfs.test_fstop.TestFSTop) ... ok 2024-09-11T23:06:51.956 INFO:tasks.cephfs_test_runner: 2024-09-11T23:06:51.956 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-11T23:06:51.956 INFO:tasks.cephfs_test_runner:Ran 4 tests in 182.972s 2024-09-11T23:06:51.956 INFO:tasks.cephfs_test_runner: 2024-09-11T23:06:51.956 INFO:tasks.cephfs_test_runner:OK 2024-09-11T23:06:51.957 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-11T23:06:51.966 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-11T23:06:52.000 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-11T23:06:52.000 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T23:06:52.001 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:06:52.007 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339568k,nr_inodes=4084892,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15839 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275300k,nr_inodes=818825,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-09-11T23:06:52.007 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-11T23:06:52.007 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:06:52.054 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339568k,nr_inodes=4084892,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15839 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275300k,nr_inodes=818825,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-09-11T23:06:52.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:06:52.054 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2024-09-11T23:06:52.101 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 1) 2024-09-11T23:06:52.101 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T23:06:52.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:06:52.101 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:06:52.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:06:52.156 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:06:52.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:06:52.241 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link delete ceph-brx 2024-09-11T23:06:52.458 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-11T23:06:52.467 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T23:06:52.467 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:06:52.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.587+0000 7f1235d74640 1 Processor -- start 2024-09-11T23:06:52.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.587+0000 7f1235d74640 1 -- start start 2024-09-11T23:06:52.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.591+0000 7f1235d74640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1230070420 0x7f1230070800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:52.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.591+0000 7f1235d74640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1230071ee0 con 0x7f1230070040 2024-09-11T23:06:52.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.591+0000 7f1235d74640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f12300732a0 con 0x7f1230070420 2024-09-11T23:06:52.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.591+0000 7f122effd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1230070420 0x7f1230070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:52.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.591+0000 7f122f7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1230070040 0x7f1230073b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38962/0 (socket says 172.21.15.12:38962) 2024-09-11T23:06:52.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.591+0000 7f122f7fe640 1 -- 172.21.15.12:0/2670200136 learned_addr learned my addr 172.21.15.12:0/2670200136 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:52.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.591+0000 7f122effd640 1 -- 172.21.15.12:0/2670200136 >> v1:172.21.15.12:6789/0 conn(0x7f1230070040 legacy=0x7f1230073b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:52.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.591+0000 7f122effd640 1 -- 172.21.15.12:0/2670200136 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12300729b0 con 0x7f1230070420 2024-09-11T23:06:52.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.591+0000 7f122effd640 1 --2- 172.21.15.12:0/2670200136 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1230070420 0x7f1230070800 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f1220009740 tx=0x7f122001c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb5c528c66f08f7d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:52.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.591+0000 7f122e7fc640 1 -- 172.21.15.12:0/2670200136 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12200b1070 con 0x7f1230070420 2024-09-11T23:06:52.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.591+0000 7f122e7fc640 1 -- 172.21.15.12:0/2670200136 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12200ac540 con 0x7f1230070420 2024-09-11T23:06:52.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.591+0000 7f122e7fc640 1 -- 172.21.15.12:0/2670200136 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12200ac840 con 0x7f1230070420 2024-09-11T23:06:52.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.595+0000 7f1235d74640 1 -- 172.21.15.12:0/2670200136 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1230070420 msgr2=0x7f1230070800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:52.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.595+0000 7f1235d74640 1 --2- 172.21.15.12:0/2670200136 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1230070420 0x7f1230070800 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f1220009740 tx=0x7f122001c390 comp rx=0 tx=0).stop 2024-09-11T23:06:52.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.595+0000 7f1235d74640 1 -- 172.21.15.12:0/2670200136 shutdown_connections 2024-09-11T23:06:52.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.595+0000 7f1235d74640 1 --2- 172.21.15.12:0/2670200136 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1230070420 0x7f1230070800 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:52.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.595+0000 7f1235d74640 1 -- 172.21.15.12:0/2670200136 >> 172.21.15.12:0/2670200136 conn(0x7f123009aba0 msgr2=0x7f123009cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:52.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.595+0000 7f1235d74640 1 -- 172.21.15.12:0/2670200136 shutdown_connections 2024-09-11T23:06:52.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.595+0000 7f1235d74640 1 -- 172.21.15.12:0/2670200136 wait complete. 2024-09-11T23:06:52.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.595+0000 7f1235d74640 1 Processor -- start 2024-09-11T23:06:52.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.595+0000 7f1235d74640 1 -- start start 2024-09-11T23:06:52.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.595+0000 7f1235d74640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1230070040 0x7f1230120220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:52.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.595+0000 7f1235d74640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1230141c10 con 0x7f1230070040 2024-09-11T23:06:52.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.595+0000 7f122f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1230070040 0x7f1230120220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:52.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.595+0000 7f122f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1230070040 0x7f1230120220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40308/0 (socket says 172.21.15.12:40308) 2024-09-11T23:06:52.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.595+0000 7f122f7fe640 1 -- 172.21.15.12:0/2142794379 learned_addr learned my addr 172.21.15.12:0/2142794379 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:52.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.595+0000 7f122f7fe640 1 -- 172.21.15.12:0/2142794379 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12300a7970 con 0x7f1230070040 2024-09-11T23:06:52.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.595+0000 7f122f7fe640 1 --2- 172.21.15.12:0/2142794379 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1230070040 0x7f1230120220 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f122400c480 tx=0x7f122400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:52.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.595+0000 7f1217fff640 1 -- 172.21.15.12:0/2142794379 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1224017070 con 0x7f1230070040 2024-09-11T23:06:52.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.595+0000 7f1217fff640 1 -- 172.21.15.12:0/2142794379 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1224005c20 con 0x7f1230070040 2024-09-11T23:06:52.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.595+0000 7f1235d74640 1 -- 172.21.15.12:0/2142794379 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f123011fad0 con 0x7f1230070040 2024-09-11T23:06:52.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.595+0000 7f1217fff640 1 -- 172.21.15.12:0/2142794379 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1224007070 con 0x7f1230070040 2024-09-11T23:06:52.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.595+0000 7f1235d74640 1 -- 172.21.15.12:0/2142794379 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f123011ee10 con 0x7f1230070040 2024-09-11T23:06:52.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.595+0000 7f1217fff640 1 -- 172.21.15.12:0/2142794379 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 37) ==== 43891+0+0 (secure 0 0 0) 0x7f122401a070 con 0x7f1230070040 2024-09-11T23:06:52.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.595+0000 7f1235d74640 1 -- 172.21.15.12:0/2142794379 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f123011f160 con 0x7f1230070040 2024-09-11T23:06:52.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.595+0000 7f1217fff640 1 --2- 172.21.15.12:0/2142794379 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f121c035c00 0x7f121c0380c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:52.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.595+0000 7f1217fff640 1 -- 172.21.15.12:0/2142794379 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 2974+0+0 (secure 0 0 0) 0x7f12240473f0 con 0x7f1230070040 2024-09-11T23:06:52.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.595+0000 7f122effd640 1 --2- 172.21.15.12:0/2142794379 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f121c035c00 0x7f121c0380c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:52.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.599+0000 7f122effd640 1 --2- 172.21.15.12:0/2142794379 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f121c035c00 0x7f121c0380c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f12200ae000 tx=0x7f1220008040 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:52.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.603+0000 7f1217fff640 1 -- 172.21.15.12:0/2142794379 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1224007210 con 0x7f1230070040 2024-09-11T23:06:52.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.767+0000 7f1235d74640 1 -- 172.21.15.12:0/2142794379 --> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1230075460 con 0x7f121c035c00 2024-09-11T23:06:52.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.767+0000 7f1217fff640 1 -- 172.21.15.12:0/2142794379 <== mgr.5090 v2:172.21.15.12:6828/1853698227 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+9714 (secure 0 0 0) 0x7f1230075460 con 0x7f121c035c00 2024-09-11T23:06:52.770 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:06:52.771 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-11T23:06:52.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.771+0000 7f1235d74640 1 -- 172.21.15.12:0/2142794379 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f121c035c00 msgr2=0x7f121c0380c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:52.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.771+0000 7f1235d74640 1 --2- 172.21.15.12:0/2142794379 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f121c035c00 0x7f121c0380c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f12200ae000 tx=0x7f1220008040 comp rx=0 tx=0).stop 2024-09-11T23:06:52.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.771+0000 7f1235d74640 1 -- 172.21.15.12:0/2142794379 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1230070040 msgr2=0x7f1230120220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:52.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.771+0000 7f1235d74640 1 --2- 172.21.15.12:0/2142794379 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1230070040 0x7f1230120220 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f122400c480 tx=0x7f122400c940 comp rx=0 tx=0).stop 2024-09-11T23:06:52.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.771+0000 7f1235d74640 1 -- 172.21.15.12:0/2142794379 shutdown_connections 2024-09-11T23:06:52.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.771+0000 7f1235d74640 1 --2- 172.21.15.12:0/2142794379 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f121c035c00 0x7f121c0380c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:52.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.771+0000 7f1235d74640 1 --2- 172.21.15.12:0/2142794379 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1230070040 0x7f1230120220 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:52.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.771+0000 7f1235d74640 1 -- 172.21.15.12:0/2142794379 >> 172.21.15.12:0/2142794379 conn(0x7f123009aba0 msgr2=0x7f123013a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:52.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.771+0000 7f1235d74640 1 -- 172.21.15.12:0/2142794379 shutdown_connections 2024-09-11T23:06:52.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.771+0000 7f1235d74640 1 -- 172.21.15.12:0/2142794379 wait complete. 2024-09-11T23:06:52.789 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-09-11T23:06:51.943051+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":636,"num_read_kb":1232,"num_write":239,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3003,"ondisk_log_size":3003,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":154,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":121604,"kb_used_data":3076,"kb_used_omap":4,"kb_used_meta":118459,"kb_avail":282993916,"statfs":{"total":289910292480,"available":289785769984,"internally_reserved":0,"allocated":3149824,"data_stored":1963133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":121302351},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.000849"},"pg_stats":[{"pgid":"1.0","version":"66'3003","reported_seq":3332,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:06:50.347147+0000","last_change":"2024-09-11T23:03:26.382905+0000","last_active":"2024-09-11T23:06:50.347147+0000","last_peered":"2024-09-11T23:06:50.347147+0000","last_clean":"2024-09-11T23:06:50.347147+0000","last_became_active":"2024-09-11T23:03:26.380590+0000","last_became_peered":"2024-09-11T23:03:26.380590+0000","last_unstale":"2024-09-11T23:06:50.347147+0000","last_undegraded":"2024-09-11T23:06:50.347147+0000","last_fullsized":"2024-09-11T23:06:50.347147+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:24.361793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:24.361793+0000","last_clean_scrub_stamp":"2024-09-11T23:03:24.361793+0000","objects_scrubbed":0,"log_size":3003,"log_dups_size":0,"ondisk_log_size":3003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:46.577063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":636,"num_read_kb":1232,"num_write":239,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":636,"num_read_kb":1232,"num_write":239,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3003,"ondisk_log_size":3003,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":8,"seq":34359738409,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44884,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326956,"statfs":{"total":96636764160,"available":96590802944,"internally_reserved":0,"allocated":1245184,"data_stored":847411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738409,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31836,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":659456,"data_stored":264471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738409,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44884,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326956,"statfs":{"total":96636764160,"available":96590802944,"internally_reserved":0,"allocated":1245184,"data_stored":851251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:06:52.790 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:06:52.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.907+0000 7f9d718b5640 1 Processor -- start 2024-09-11T23:06:52.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.907+0000 7f9d718b5640 1 -- start start 2024-09-11T23:06:52.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.907+0000 7f9d718b5640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9d6c09f6e0 0x7f9d6c13cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:52.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.907+0000 7f9d718b5640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d6c09e930 con 0x7f9d6c137e60 2024-09-11T23:06:52.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.907+0000 7f9d718b5640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f9d6c1379e0 con 0x7f9d6c09f6e0 2024-09-11T23:06:52.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.907+0000 7f9d6a7fc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9d6c09f6e0 0x7f9d6c13cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:52.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.907+0000 7f9d6affd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f9d6c137e60 0x7f9d6c138240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38976/0 (socket says 172.21.15.12:38976) 2024-09-11T23:06:52.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.907+0000 7f9d6affd640 1 -- 172.21.15.12:0/1729594719 learned_addr learned my addr 172.21.15.12:0/1729594719 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:52.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.907+0000 7f9d6a7fc640 1 -- 172.21.15.12:0/1729594719 >> v1:172.21.15.12:6789/0 conn(0x7f9d6c137e60 legacy=0x7f9d6c138240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:52.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.911+0000 7f9d6a7fc640 1 -- 172.21.15.12:0/1729594719 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d6c09d910 con 0x7f9d6c09f6e0 2024-09-11T23:06:52.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.911+0000 7f9d69ffb640 1 -- 172.21.15.12:0/1729594719 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1092661227 0 0) 0x7f9d6c09e930 con 0x7f9d6c137e60 2024-09-11T23:06:52.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.911+0000 7f9d6a7fc640 1 --2- 172.21.15.12:0/1729594719 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d6c09f6e0 0x7f9d6c13cc60 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f9d54009d90 tx=0x7f9d5401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd09ef80da71a119 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:52.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.911+0000 7f9d69ffb640 1 -- 172.21.15.12:0/1729594719 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d540b2070 con 0x7f9d6c09f6e0 2024-09-11T23:06:52.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.911+0000 7f9d69ffb640 1 -- 172.21.15.12:0/1729594719 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d540a5900 con 0x7f9d6c09f6e0 2024-09-11T23:06:52.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.911+0000 7f9d69ffb640 1 -- 172.21.15.12:0/1729594719 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d540a5c00 con 0x7f9d6c09f6e0 2024-09-11T23:06:52.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.911+0000 7f9d718b5640 1 -- 172.21.15.12:0/1729594719 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d6c09f6e0 msgr2=0x7f9d6c13cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:52.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.911+0000 7f9d718b5640 1 --2- 172.21.15.12:0/1729594719 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d6c09f6e0 0x7f9d6c13cc60 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f9d54009d90 tx=0x7f9d5401c970 comp rx=0 tx=0).stop 2024-09-11T23:06:52.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.911+0000 7f9d718b5640 1 -- 172.21.15.12:0/1729594719 shutdown_connections 2024-09-11T23:06:52.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.911+0000 7f9d718b5640 1 --2- 172.21.15.12:0/1729594719 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d6c09f6e0 0x7f9d6c13cc60 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:52.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.911+0000 7f9d718b5640 1 -- 172.21.15.12:0/1729594719 >> 172.21.15.12:0/1729594719 conn(0x7f9d6c0a8450 msgr2=0x7f9d6c0a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:52.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.911+0000 7f9d718b5640 1 -- 172.21.15.12:0/1729594719 shutdown_connections 2024-09-11T23:06:52.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.911+0000 7f9d718b5640 1 -- 172.21.15.12:0/1729594719 wait complete. 2024-09-11T23:06:52.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.911+0000 7f9d718b5640 1 Processor -- start 2024-09-11T23:06:52.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.915+0000 7f9d718b5640 1 -- start start 2024-09-11T23:06:52.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.915+0000 7f9d718b5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d6c09f6e0 0x7f9d6c0722e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:52.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.915+0000 7f9d718b5640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9d6c13fd50 con 0x7f9d6c09f6e0 2024-09-11T23:06:52.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.915+0000 7f9d6affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d6c09f6e0 0x7f9d6c0722e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:52.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.915+0000 7f9d6affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d6c09f6e0 0x7f9d6c0722e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40322/0 (socket says 172.21.15.12:40322) 2024-09-11T23:06:52.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.915+0000 7f9d6affd640 1 -- 172.21.15.12:0/2445546543 learned_addr learned my addr 172.21.15.12:0/2445546543 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:52.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.915+0000 7f9d6affd640 1 -- 172.21.15.12:0/2445546543 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d6c09c690 con 0x7f9d6c09f6e0 2024-09-11T23:06:52.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.915+0000 7f9d6affd640 1 --2- 172.21.15.12:0/2445546543 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d6c09f6e0 0x7f9d6c0722e0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c00c450 tx=0x7f9d5c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:52.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.915+0000 7f9d63fff640 1 -- 172.21.15.12:0/2445546543 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d5c005c20 con 0x7f9d6c09f6e0 2024-09-11T23:06:52.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.915+0000 7f9d63fff640 1 -- 172.21.15.12:0/2445546543 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d5c005dc0 con 0x7f9d6c09f6e0 2024-09-11T23:06:52.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.915+0000 7f9d63fff640 1 -- 172.21.15.12:0/2445546543 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d5c0071a0 con 0x7f9d6c09f6e0 2024-09-11T23:06:52.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.915+0000 7f9d718b5640 1 -- 172.21.15.12:0/2445546543 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d6c071cc0 con 0x7f9d6c09f6e0 2024-09-11T23:06:52.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.915+0000 7f9d718b5640 1 -- 172.21.15.12:0/2445546543 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d6c134ae0 con 0x7f9d6c09f6e0 2024-09-11T23:06:52.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.915+0000 7f9d63fff640 1 -- 172.21.15.12:0/2445546543 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 37) ==== 43891+0+0 (secure 0 0 0) 0x7f9d5c007400 con 0x7f9d6c09f6e0 2024-09-11T23:06:52.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.915+0000 7f9d718b5640 1 -- 172.21.15.12:0/2445546543 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d6c09bef0 con 0x7f9d6c09f6e0 2024-09-11T23:06:52.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.915+0000 7f9d63fff640 1 --2- 172.21.15.12:0/2445546543 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f9d4c035bb0 0x7f9d4c038070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:52.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.915+0000 7f9d63fff640 1 -- 172.21.15.12:0/2445546543 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 2974+0+0 (secure 0 0 0) 0x7f9d5c047e30 con 0x7f9d6c09f6e0 2024-09-11T23:06:52.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.915+0000 7f9d6a7fc640 1 --2- 172.21.15.12:0/2445546543 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f9d4c035bb0 0x7f9d4c038070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:52.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.915+0000 7f9d6a7fc640 1 --2- 172.21.15.12:0/2445546543 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f9d4c035bb0 0x7f9d4c038070 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9d540af000 tx=0x7f9d540a7070 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:52.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.919+0000 7f9d63fff640 1 -- 172.21.15.12:0/2445546543 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9d5c0182b0 con 0x7f9d6c09f6e0 2024-09-11T23:06:52.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:52.935+0000 7f9d63fff640 1 -- 172.21.15.12:0/2445546543 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 38) ==== 43997+0+0 (secure 0 0 0) 0x7f9d5c01bca0 con 0x7f9d6c09f6e0 2024-09-11T23:06:53.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.079+0000 7f9d718b5640 1 -- 172.21.15.12:0/2445546543 --> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9d6c070e20 con 0x7f9d4c035bb0 2024-09-11T23:06:53.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.083+0000 7f9d63fff640 1 -- 172.21.15.12:0/2445546543 <== mgr.5090 v2:172.21.15.12:6828/1853698227 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+9714 (secure 0 0 0) 0x7f9d540a5950 con 0x7f9d4c035bb0 2024-09-11T23:06:53.085 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:06:53.086 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-11T23:06:53.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.083+0000 7f9d718b5640 1 -- 172.21.15.12:0/2445546543 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f9d4c035bb0 msgr2=0x7f9d4c038070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:53.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.083+0000 7f9d718b5640 1 --2- 172.21.15.12:0/2445546543 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f9d4c035bb0 0x7f9d4c038070 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9d540af000 tx=0x7f9d540a7070 comp rx=0 tx=0).stop 2024-09-11T23:06:53.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.083+0000 7f9d718b5640 1 -- 172.21.15.12:0/2445546543 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d6c09f6e0 msgr2=0x7f9d6c0722e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:53.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.083+0000 7f9d718b5640 1 --2- 172.21.15.12:0/2445546543 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d6c09f6e0 0x7f9d6c0722e0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c00c450 tx=0x7f9d5c00c910 comp rx=0 tx=0).stop 2024-09-11T23:06:53.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.083+0000 7f9d718b5640 1 -- 172.21.15.12:0/2445546543 shutdown_connections 2024-09-11T23:06:53.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.083+0000 7f9d718b5640 1 --2- 172.21.15.12:0/2445546543 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f9d4c035bb0 0x7f9d4c038070 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:53.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.083+0000 7f9d718b5640 1 --2- 172.21.15.12:0/2445546543 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d6c09f6e0 0x7f9d6c0722e0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:53.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.083+0000 7f9d718b5640 1 -- 172.21.15.12:0/2445546543 >> 172.21.15.12:0/2445546543 conn(0x7f9d6c0a8450 msgr2=0x7f9d6c0a1430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:53.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.083+0000 7f9d718b5640 1 -- 172.21.15.12:0/2445546543 shutdown_connections 2024-09-11T23:06:53.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.083+0000 7f9d718b5640 1 -- 172.21.15.12:0/2445546543 wait complete. 2024-09-11T23:06:53.104 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-09-11T23:06:51.943051+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":636,"num_read_kb":1232,"num_write":239,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3003,"ondisk_log_size":3003,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":154,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":121604,"kb_used_data":3076,"kb_used_omap":4,"kb_used_meta":118459,"kb_avail":282993916,"statfs":{"total":289910292480,"available":289785769984,"internally_reserved":0,"allocated":3149824,"data_stored":1963133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":121302351},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.000849"},"pg_stats":[{"pgid":"1.0","version":"66'3003","reported_seq":3332,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:06:50.347147+0000","last_change":"2024-09-11T23:03:26.382905+0000","last_active":"2024-09-11T23:06:50.347147+0000","last_peered":"2024-09-11T23:06:50.347147+0000","last_clean":"2024-09-11T23:06:50.347147+0000","last_became_active":"2024-09-11T23:03:26.380590+0000","last_became_peered":"2024-09-11T23:03:26.380590+0000","last_unstale":"2024-09-11T23:06:50.347147+0000","last_undegraded":"2024-09-11T23:06:50.347147+0000","last_fullsized":"2024-09-11T23:06:50.347147+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:24.361793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:24.361793+0000","last_clean_scrub_stamp":"2024-09-11T23:03:24.361793+0000","objects_scrubbed":0,"log_size":3003,"log_dups_size":0,"ondisk_log_size":3003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:46.577063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":636,"num_read_kb":1232,"num_write":239,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":636,"num_read_kb":1232,"num_write":239,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3003,"ondisk_log_size":3003,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":8,"seq":34359738409,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44884,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326956,"statfs":{"total":96636764160,"available":96590802944,"internally_reserved":0,"allocated":1245184,"data_stored":847411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738409,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31836,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":659456,"data_stored":264471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738409,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44884,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326956,"statfs":{"total":96636764160,"available":96590802944,"internally_reserved":0,"allocated":1245184,"data_stored":851251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:06:53.104 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T23:06:53.104 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:06:53.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.211+0000 7fd10d7a4640 1 Processor -- start 2024-09-11T23:06:53.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.211+0000 7fd10d7a4640 1 -- start start 2024-09-11T23:06:53.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.215+0000 7fd10d7a4640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd108137e60 0x7fd108138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:53.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.215+0000 7fd10d7a4640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd10809e930 con 0x7fd10809f6e0 2024-09-11T23:06:53.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.215+0000 7fd10d7a4640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fd1081379e0 con 0x7fd108137e60 2024-09-11T23:06:53.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.215+0000 7fd106ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd108137e60 0x7fd108138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:53.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.215+0000 7fd1067fc640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd10809f6e0 0x7fd1080a36a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38980/0 (socket says 172.21.15.12:38980) 2024-09-11T23:06:53.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.215+0000 7fd1067fc640 1 -- 172.21.15.12:0/2160630840 learned_addr learned my addr 172.21.15.12:0/2160630840 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:53.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.215+0000 7fd105ffb640 1 -- 172.21.15.12:0/2160630840 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1893332666 0 0) 0x7fd10809e930 con 0x7fd10809f6e0 2024-09-11T23:06:53.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.215+0000 7fd105ffb640 1 -- 172.21.15.12:0/2160630840 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0f4003530 con 0x7fd10809f6e0 2024-09-11T23:06:53.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.215+0000 7fd106ffd640 1 -- 172.21.15.12:0/2160630840 >> v1:172.21.15.12:6789/0 conn(0x7fd10809f6e0 legacy=0x7fd1080a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:53.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.215+0000 7fd106ffd640 1 -- 172.21.15.12:0/2160630840 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd10809d910 con 0x7fd108137e60 2024-09-11T23:06:53.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.215+0000 7fd106ffd640 1 --2- 172.21.15.12:0/2160630840 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd108137e60 0x7fd108138240 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fd100009740 tx=0x7fd10001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62dc8fd8f15f0bbb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:53.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.215+0000 7fd105ffb640 1 -- 172.21.15.12:0/2160630840 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1000ab570 con 0x7fd108137e60 2024-09-11T23:06:53.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.215+0000 7fd105ffb640 1 -- 172.21.15.12:0/2160630840 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1000b0070 con 0x7fd108137e60 2024-09-11T23:06:53.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.215+0000 7fd105ffb640 1 -- 172.21.15.12:0/2160630840 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1000ab860 con 0x7fd108137e60 2024-09-11T23:06:53.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.219+0000 7fd10d7a4640 1 -- 172.21.15.12:0/2160630840 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd108137e60 msgr2=0x7fd108138240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:53.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.219+0000 7fd10d7a4640 1 --2- 172.21.15.12:0/2160630840 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd108137e60 0x7fd108138240 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fd100009740 tx=0x7fd10001c420 comp rx=0 tx=0).stop 2024-09-11T23:06:53.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.219+0000 7fd10d7a4640 1 -- 172.21.15.12:0/2160630840 shutdown_connections 2024-09-11T23:06:53.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.219+0000 7fd10d7a4640 1 --2- 172.21.15.12:0/2160630840 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd108137e60 0x7fd108138240 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:53.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.219+0000 7fd10d7a4640 1 -- 172.21.15.12:0/2160630840 >> 172.21.15.12:0/2160630840 conn(0x7fd1080a8450 msgr2=0x7fd1080a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:53.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.219+0000 7fd10d7a4640 1 -- 172.21.15.12:0/2160630840 shutdown_connections 2024-09-11T23:06:53.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.219+0000 7fd10d7a4640 1 -- 172.21.15.12:0/2160630840 wait complete. 2024-09-11T23:06:53.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.219+0000 7fd10d7a4640 1 Processor -- start 2024-09-11T23:06:53.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.219+0000 7fd10d7a4640 1 -- start start 2024-09-11T23:06:53.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.219+0000 7fd10d7a4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd10809f6e0 0x7fd108132970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:53.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.219+0000 7fd10d7a4640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd10813fe00 con 0x7fd10809f6e0 2024-09-11T23:06:53.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.219+0000 7fd106ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd10809f6e0 0x7fd108132970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:53.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.219+0000 7fd106ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd10809f6e0 0x7fd108132970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40338/0 (socket says 172.21.15.12:40338) 2024-09-11T23:06:53.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.219+0000 7fd106ffd640 1 -- 172.21.15.12:0/3631538176 learned_addr learned my addr 172.21.15.12:0/3631538176 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:53.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.219+0000 7fd106ffd640 1 -- 172.21.15.12:0/3631538176 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd108070920 con 0x7fd10809f6e0 2024-09-11T23:06:53.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.219+0000 7fd106ffd640 1 --2- 172.21.15.12:0/3631538176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd10809f6e0 0x7fd108132970 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fd1000ad040 tx=0x7fd10001ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:53.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.219+0000 7fd0ff7fe640 1 -- 172.21.15.12:0/3631538176 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1000abc50 con 0x7fd10809f6e0 2024-09-11T23:06:53.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.219+0000 7fd0ff7fe640 1 -- 172.21.15.12:0/3631538176 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1000abdf0 con 0x7fd10809f6e0 2024-09-11T23:06:53.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.219+0000 7fd0ff7fe640 1 -- 172.21.15.12:0/3631538176 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1000bf540 con 0x7fd10809f6e0 2024-09-11T23:06:53.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.219+0000 7fd10d7a4640 1 -- 172.21.15.12:0/3631538176 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1080715d0 con 0x7fd10809f6e0 2024-09-11T23:06:53.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.219+0000 7fd10d7a4640 1 -- 172.21.15.12:0/3631538176 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd10813bfb0 con 0x7fd10809f6e0 2024-09-11T23:06:53.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.219+0000 7fd10d7a4640 1 -- 172.21.15.12:0/3631538176 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1080710e0 con 0x7fd10809f6e0 2024-09-11T23:06:53.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.219+0000 7fd0ff7fe640 1 -- 172.21.15.12:0/3631538176 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 38) ==== 43997+0+0 (secure 0 0 0) 0x7fd1000bd020 con 0x7fd10809f6e0 2024-09-11T23:06:53.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.219+0000 7fd0ff7fe640 1 --2- 172.21.15.12:0/3631538176 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7fd0e8035d20 0x7fd0e80381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:53.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.219+0000 7fd0ff7fe640 1 -- 172.21.15.12:0/3631538176 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 2974+0+0 (secure 0 0 0) 0x7fd1000e2e00 con 0x7fd10809f6e0 2024-09-11T23:06:53.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.219+0000 7fd1067fc640 1 --2- 172.21.15.12:0/3631538176 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7fd0e8035d20 0x7fd0e80381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:53.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.223+0000 7fd1067fc640 1 --2- 172.21.15.12:0/3631538176 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7fd0e8035d20 0x7fd0e80381e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd0f0007fd0 tx=0x7fd0f0007980 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:53.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.227+0000 7fd0ff7fe640 1 -- 172.21.15.12:0/3631538176 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd100016010 con 0x7fd10809f6e0 2024-09-11T23:06:53.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.386+0000 7fd10d7a4640 1 -- 172.21.15.12:0/3631538176 --> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd10806bc60 con 0x7fd0e8035d20 2024-09-11T23:06:53.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.386+0000 7fd0ff7fe640 1 -- 172.21.15.12:0/3631538176 <== mgr.5090 v2:172.21.15.12:6828/1853698227 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+9714 (secure 0 0 0) 0x7fd10806bc60 con 0x7fd0e8035d20 2024-09-11T23:06:53.391 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:06:53.391 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-11T23:06:53.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.390+0000 7fd10d7a4640 1 -- 172.21.15.12:0/3631538176 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7fd0e8035d20 msgr2=0x7fd0e80381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:53.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.390+0000 7fd10d7a4640 1 --2- 172.21.15.12:0/3631538176 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7fd0e8035d20 0x7fd0e80381e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd0f0007fd0 tx=0x7fd0f0007980 comp rx=0 tx=0).stop 2024-09-11T23:06:53.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.390+0000 7fd10d7a4640 1 -- 172.21.15.12:0/3631538176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd10809f6e0 msgr2=0x7fd108132970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:53.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.390+0000 7fd10d7a4640 1 --2- 172.21.15.12:0/3631538176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd10809f6e0 0x7fd108132970 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fd1000ad040 tx=0x7fd10001ac60 comp rx=0 tx=0).stop 2024-09-11T23:06:53.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.390+0000 7fd10d7a4640 1 -- 172.21.15.12:0/3631538176 shutdown_connections 2024-09-11T23:06:53.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.390+0000 7fd10d7a4640 1 --2- 172.21.15.12:0/3631538176 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7fd0e8035d20 0x7fd0e80381e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:53.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.390+0000 7fd10d7a4640 1 --2- 172.21.15.12:0/3631538176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd10809f6e0 0x7fd108132970 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:53.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.390+0000 7fd10d7a4640 1 -- 172.21.15.12:0/3631538176 >> 172.21.15.12:0/3631538176 conn(0x7fd1080a8450 msgr2=0x7fd108134800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:53.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.390+0000 7fd10d7a4640 1 -- 172.21.15.12:0/3631538176 shutdown_connections 2024-09-11T23:06:53.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.390+0000 7fd10d7a4640 1 -- 172.21.15.12:0/3631538176 wait complete. 2024-09-11T23:06:53.409 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-09-11T23:06:51.943051+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":636,"num_read_kb":1232,"num_write":239,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3003,"ondisk_log_size":3003,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":154,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":121604,"kb_used_data":3076,"kb_used_omap":4,"kb_used_meta":118459,"kb_avail":282993916,"statfs":{"total":289910292480,"available":289785769984,"internally_reserved":0,"allocated":3149824,"data_stored":1963133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":121302351},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.000849"},"pg_stats":[{"pgid":"1.0","version":"66'3003","reported_seq":3332,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:06:50.347147+0000","last_change":"2024-09-11T23:03:26.382905+0000","last_active":"2024-09-11T23:06:50.347147+0000","last_peered":"2024-09-11T23:06:50.347147+0000","last_clean":"2024-09-11T23:06:50.347147+0000","last_became_active":"2024-09-11T23:03:26.380590+0000","last_became_peered":"2024-09-11T23:03:26.380590+0000","last_unstale":"2024-09-11T23:06:50.347147+0000","last_undegraded":"2024-09-11T23:06:50.347147+0000","last_fullsized":"2024-09-11T23:06:50.347147+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:24.361793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:24.361793+0000","last_clean_scrub_stamp":"2024-09-11T23:03:24.361793+0000","objects_scrubbed":0,"log_size":3003,"log_dups_size":0,"ondisk_log_size":3003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:46.577063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":636,"num_read_kb":1232,"num_write":239,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":636,"num_read_kb":1232,"num_write":239,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3003,"ondisk_log_size":3003,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":8,"seq":34359738409,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44884,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326956,"statfs":{"total":96636764160,"available":96590802944,"internally_reserved":0,"allocated":1245184,"data_stored":847411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738409,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31836,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":659456,"data_stored":264471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738409,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44884,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326956,"statfs":{"total":96636764160,"available":96590802944,"internally_reserved":0,"allocated":1245184,"data_stored":851251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:06:53.410 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:06:53.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.514+0000 7f6086346640 1 Processor -- start 2024-09-11T23:06:53.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.514+0000 7f6086346640 1 -- start start 2024-09-11T23:06:53.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.518+0000 7f6086346640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6080137e60 0x7f6080138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:53.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.518+0000 7f6086346640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f608009e930 con 0x7f608009f6e0 2024-09-11T23:06:53.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.518+0000 7f6086346640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f60801379e0 con 0x7f6080137e60 2024-09-11T23:06:53.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.518+0000 7f607ffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6080137e60 0x7f6080138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:53.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.518+0000 7f607f7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f608009f6e0 0x7f60800a36a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38996/0 (socket says 172.21.15.12:38996) 2024-09-11T23:06:53.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.518+0000 7f607f7fe640 1 -- 172.21.15.12:0/228997598 learned_addr learned my addr 172.21.15.12:0/228997598 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:53.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.518+0000 7f607effd640 1 -- 172.21.15.12:0/228997598 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3786548812 0 0) 0x7f608009e930 con 0x7f608009f6e0 2024-09-11T23:06:53.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.518+0000 7f607effd640 1 -- 172.21.15.12:0/228997598 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6068003530 con 0x7f608009f6e0 2024-09-11T23:06:53.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.518+0000 7f607ffff640 1 -- 172.21.15.12:0/228997598 >> v1:172.21.15.12:6789/0 conn(0x7f608009f6e0 legacy=0x7f60800a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:53.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.518+0000 7f607ffff640 1 -- 172.21.15.12:0/228997598 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f608009d910 con 0x7f6080137e60 2024-09-11T23:06:53.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.518+0000 7f607ffff640 1 --2- 172.21.15.12:0/228997598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6080137e60 0x7f6080138240 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f6070009740 tx=0x7f607001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7d4f4521c975f75 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:53.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.518+0000 7f607effd640 1 -- 172.21.15.12:0/228997598 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60700ab570 con 0x7f6080137e60 2024-09-11T23:06:53.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.518+0000 7f607effd640 1 -- 172.21.15.12:0/228997598 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60700b0070 con 0x7f6080137e60 2024-09-11T23:06:53.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.518+0000 7f607effd640 1 -- 172.21.15.12:0/228997598 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60700ab840 con 0x7f6080137e60 2024-09-11T23:06:53.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.522+0000 7f6086346640 1 -- 172.21.15.12:0/228997598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6080137e60 msgr2=0x7f6080138240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:53.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.522+0000 7f6086346640 1 --2- 172.21.15.12:0/228997598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6080137e60 0x7f6080138240 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f6070009740 tx=0x7f607001c420 comp rx=0 tx=0).stop 2024-09-11T23:06:53.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.522+0000 7f6086346640 1 -- 172.21.15.12:0/228997598 shutdown_connections 2024-09-11T23:06:53.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.522+0000 7f6086346640 1 --2- 172.21.15.12:0/228997598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6080137e60 0x7f6080138240 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:53.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.522+0000 7f6086346640 1 -- 172.21.15.12:0/228997598 >> 172.21.15.12:0/228997598 conn(0x7f60800a8450 msgr2=0x7f60800a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:53.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.522+0000 7f6086346640 1 -- 172.21.15.12:0/228997598 shutdown_connections 2024-09-11T23:06:53.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.522+0000 7f6086346640 1 -- 172.21.15.12:0/228997598 wait complete. 2024-09-11T23:06:53.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.522+0000 7f6086346640 1 Processor -- start 2024-09-11T23:06:53.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.522+0000 7f6086346640 1 -- start start 2024-09-11T23:06:53.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.522+0000 7f6086346640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f608009f6e0 0x7f6080132970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:53.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.522+0000 7f6086346640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f608013fe00 con 0x7f608009f6e0 2024-09-11T23:06:53.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.522+0000 7f607ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f608009f6e0 0x7f6080132970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:53.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.522+0000 7f607ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f608009f6e0 0x7f6080132970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40358/0 (socket says 172.21.15.12:40358) 2024-09-11T23:06:53.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.522+0000 7f607ffff640 1 -- 172.21.15.12:0/2186633995 learned_addr learned my addr 172.21.15.12:0/2186633995 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:53.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.522+0000 7f607ffff640 1 -- 172.21.15.12:0/2186633995 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6080070920 con 0x7f608009f6e0 2024-09-11T23:06:53.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.522+0000 7f607ffff640 1 --2- 172.21.15.12:0/2186633995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f608009f6e0 0x7f6080132970 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f607001aad0 tx=0x7f60700191c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:53.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.522+0000 7f607cff9640 1 -- 172.21.15.12:0/2186633995 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6070003620 con 0x7f608009f6e0 2024-09-11T23:06:53.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.522+0000 7f607cff9640 1 -- 172.21.15.12:0/2186633995 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60700037c0 con 0x7f608009f6e0 2024-09-11T23:06:53.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.522+0000 7f607cff9640 1 -- 172.21.15.12:0/2186633995 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6070003aa0 con 0x7f608009f6e0 2024-09-11T23:06:53.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.522+0000 7f6086346640 1 -- 172.21.15.12:0/2186633995 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60800715d0 con 0x7f608009f6e0 2024-09-11T23:06:53.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.522+0000 7f6086346640 1 -- 172.21.15.12:0/2186633995 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f608013bfb0 con 0x7f608009f6e0 2024-09-11T23:06:53.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.522+0000 7f607cff9640 1 -- 172.21.15.12:0/2186633995 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 38) ==== 43997+0+0 (secure 0 0 0) 0x7f60700c3060 con 0x7f608009f6e0 2024-09-11T23:06:53.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.522+0000 7f6086346640 1 -- 172.21.15.12:0/2186633995 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60800710e0 con 0x7f608009f6e0 2024-09-11T23:06:53.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.522+0000 7f607cff9640 1 --2- 172.21.15.12:0/2186633995 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f606c035d20 0x7f606c0381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:53.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.522+0000 7f607cff9640 1 -- 172.21.15.12:0/2186633995 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 2974+0+0 (secure 0 0 0) 0x7f60700e1e10 con 0x7f608009f6e0 2024-09-11T23:06:53.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.522+0000 7f607f7fe640 1 --2- 172.21.15.12:0/2186633995 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f606c035d20 0x7f606c0381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:53.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.526+0000 7f607f7fe640 1 --2- 172.21.15.12:0/2186633995 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f606c035d20 0x7f606c0381e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6074000f70 tx=0x7f60740010b0 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:53.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.530+0000 7f607cff9640 1 -- 172.21.15.12:0/2186633995 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6070016010 con 0x7f608009f6e0 2024-09-11T23:06:53.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.690+0000 7f6086346640 1 -- 172.21.15.12:0/2186633995 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f608006bc60 con 0x7f608009f6e0 2024-09-11T23:06:53.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.690+0000 7f607cff9640 1 -- 172.21.15.12:0/2186633995 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) ==== 74+0+7362 (secure 0 0 0) 0x7f60700b4c50 con 0x7f608009f6e0 2024-09-11T23:06:53.694 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:06:53.694 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":71,"fsid":"8be14356-3340-4500-91a2-4cbc6b511f65","created":"2024-09-11T23:03:10.620234+0000","modified":"2024-09-11T23:06:50.926801+0000","last_up_change":"2024-09-11T23:03:22.359028+0000","last_in_change":"2024-09-11T23:03:11.545817+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:03:23.587068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"153b72a1-40b1-400d-93ea-333e733f9bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6817","nonce":3680911937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6819","nonce":3680911937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6823","nonce":3680911937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3680911937},{"type":"v1","addr":"172.21.15.12:6821","nonce":3680911937}]},"public_addr":"172.21.15.12:6817/3680911937","cluster_addr":"172.21.15.12:6819/3680911937","heartbeat_back_addr":"172.21.15.12:6823/3680911937","heartbeat_front_addr":"172.21.15.12:6821/3680911937","state":["exists","up"]},{"osd":1,"uuid":"94669e49-ee4f-4acf-9e25-e94374dda8a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6801","nonce":236825163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6803","nonce":236825163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6807","nonce":236825163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":236825163},{"type":"v1","addr":"172.21.15.12:6805","nonce":236825163}]},"public_addr":"172.21.15.12:6801/236825163","cluster_addr":"172.21.15.12:6803/236825163","heartbeat_back_addr":"172.21.15.12:6807/236825163","heartbeat_front_addr":"172.21.15.12:6805/236825163","state":["exists","up"]},{"osd":2,"uuid":"826dae4d-8888-4ec5-8f00-425b3be93814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6809","nonce":3263521655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6811","nonce":3263521655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6815","nonce":3263521655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":3263521655},{"type":"v1","addr":"172.21.15.12:6813","nonce":3263521655}]},"public_addr":"172.21.15.12:6809/3263521655","cluster_addr":"172.21.15.12:6811/3263521655","heartbeat_back_addr":"172.21.15.12:6815/3263521655","heartbeat_front_addr":"172.21.15.12:6813/3263521655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:19.398518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.761524+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:03:18.904997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:6827/4133903177":"2024-09-12T23:06:47.427481+0000","172.21.15.12:6825/4133903177":"2024-09-12T23:06:47.427481+0000","172.21.15.12:0/3075732142":"2024-09-12T23:06:46.282060+0000","172.21.15.12:0/1282769068":"2024-09-12T23:06:46.282060+0000","172.21.15.12:0/925155409":"2024-09-12T23:06:46.282060+0000","172.21.15.12:0/1906738504":"2024-09-12T23:06:46.282060+0000","172.21.15.12:6829/4277951488":"2024-09-12T23:06:46.282060+0000","172.21.15.12:6828/4277951488":"2024-09-12T23:06:46.282060+0000","172.21.15.12:0/2496375865":"2024-09-12T00:06:39.939411+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:06:53.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.690+0000 7f6086346640 1 -- 172.21.15.12:0/2186633995 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f606c035d20 msgr2=0x7f606c0381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:53.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.690+0000 7f6086346640 1 --2- 172.21.15.12:0/2186633995 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f606c035d20 0x7f606c0381e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6074000f70 tx=0x7f60740010b0 comp rx=0 tx=0).stop 2024-09-11T23:06:53.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.690+0000 7f6086346640 1 -- 172.21.15.12:0/2186633995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f608009f6e0 msgr2=0x7f6080132970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:53.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.690+0000 7f6086346640 1 --2- 172.21.15.12:0/2186633995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f608009f6e0 0x7f6080132970 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f607001aad0 tx=0x7f60700191c0 comp rx=0 tx=0).stop 2024-09-11T23:06:53.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.694+0000 7f6086346640 1 -- 172.21.15.12:0/2186633995 shutdown_connections 2024-09-11T23:06:53.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.694+0000 7f6086346640 1 --2- 172.21.15.12:0/2186633995 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f606c035d20 0x7f606c0381e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:53.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.694+0000 7f6086346640 1 --2- 172.21.15.12:0/2186633995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f608009f6e0 0x7f6080132970 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:53.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.694+0000 7f6086346640 1 -- 172.21.15.12:0/2186633995 >> 172.21.15.12:0/2186633995 conn(0x7f60800a8450 msgr2=0x7f6080134800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:53.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.694+0000 7f6086346640 1 -- 172.21.15.12:0/2186633995 shutdown_connections 2024-09-11T23:06:53.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:53.694+0000 7f6086346640 1 -- 172.21.15.12:0/2186633995 wait complete. 2024-09-11T23:06:54.713 INFO:tasks.ceph:Scrubbing osd.0 2024-09-11T23:06:54.714 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-11T23:06:54.789 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:06:54.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.850+0000 7f013ed7b640 1 Processor -- start 2024-09-11T23:06:54.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.850+0000 7f013ed7b640 1 -- start start 2024-09-11T23:06:54.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.850+0000 7f013ed7b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f013809f3a0 0x7f013813cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:54.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.850+0000 7f013ed7b640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f013809f7a0 con 0x7f0138134a30 2024-09-11T23:06:54.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.850+0000 7f013ed7b640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f013809db90 con 0x7f013809f3a0 2024-09-11T23:06:54.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.850+0000 7f0137fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f013809f3a0 0x7f013813cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:54.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.850+0000 7f0137fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f013809f3a0 0x7f013813cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57524/0 (socket says 172.21.15.12:57524) 2024-09-11T23:06:54.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.850+0000 7f013cb17640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f0138134a30 0x7f0138134e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43846/0 (socket says 172.21.15.12:43846) 2024-09-11T23:06:54.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.850+0000 7f0137fff640 1 -- 172.21.15.12:0/1347895111 learned_addr learned my addr 172.21.15.12:0/1347895111 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:54.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.850+0000 7f0137fff640 1 -- 172.21.15.12:0/1347895111 >> v1:172.21.15.12:6789/0 conn(0x7f0138134a30 legacy=0x7f0138134e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:54.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.850+0000 7f0137fff640 1 -- 172.21.15.12:0/1347895111 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f013809e930 con 0x7f013809f3a0 2024-09-11T23:06:54.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.854+0000 7f0137fff640 1 --2- 172.21.15.12:0/1347895111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f013809f3a0 0x7f013813cd20 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f012c009e50 tx=0x7f012c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28ec1133a10b00a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:54.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.854+0000 7f01377fe640 1 -- 172.21.15.12:0/1347895111 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f012c009200 con 0x7f013809f3a0 2024-09-11T23:06:54.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.854+0000 7f01377fe640 1 -- 172.21.15.12:0/1347895111 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f012c0a55e0 con 0x7f013809f3a0 2024-09-11T23:06:54.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.854+0000 7f01377fe640 1 -- 172.21.15.12:0/1347895111 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f012c0a58e0 con 0x7f013809f3a0 2024-09-11T23:06:54.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.854+0000 7f013ed7b640 1 -- 172.21.15.12:0/1347895111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f013809f3a0 msgr2=0x7f013813cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:54.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.854+0000 7f013ed7b640 1 --2- 172.21.15.12:0/1347895111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f013809f3a0 0x7f013813cd20 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f012c009e50 tx=0x7f012c01c9a0 comp rx=0 tx=0).stop 2024-09-11T23:06:54.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.854+0000 7f013ed7b640 1 -- 172.21.15.12:0/1347895111 shutdown_connections 2024-09-11T23:06:54.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.854+0000 7f013ed7b640 1 --2- 172.21.15.12:0/1347895111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f013809f3a0 0x7f013813cd20 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:54.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.854+0000 7f013ed7b640 1 -- 172.21.15.12:0/1347895111 >> 172.21.15.12:0/1347895111 conn(0x7f01380a85b0 msgr2=0x7f01380a49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:54.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.854+0000 7f013ed7b640 1 -- 172.21.15.12:0/1347895111 shutdown_connections 2024-09-11T23:06:54.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.854+0000 7f013ed7b640 1 -- 172.21.15.12:0/1347895111 wait complete. 2024-09-11T23:06:54.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.854+0000 7f013ed7b640 1 Processor -- start 2024-09-11T23:06:54.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.854+0000 7f013ed7b640 1 -- start start 2024-09-11T23:06:54.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.854+0000 7f013ed7b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f013809f3a0 0x7f013813ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:54.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.854+0000 7f013ed7b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f013813fc00 con 0x7f013809f3a0 2024-09-11T23:06:54.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.854+0000 7f013cb17640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f013809f3a0 0x7f013813ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:54.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.854+0000 7f013cb17640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f013809f3a0 0x7f013813ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57540/0 (socket says 172.21.15.12:57540) 2024-09-11T23:06:54.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.854+0000 7f013cb17640 1 -- 172.21.15.12:0/784795996 learned_addr learned my addr 172.21.15.12:0/784795996 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:54.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.854+0000 7f013cb17640 1 -- 172.21.15.12:0/784795996 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f013809bdc0 con 0x7f013809f3a0 2024-09-11T23:06:54.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.858+0000 7f013cb17640 1 --2- 172.21.15.12:0/784795996 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f013809f3a0 0x7f013813ae30 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f013000c480 tx=0x7f013000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:54.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.858+0000 7f01357fa640 1 -- 172.21.15.12:0/784795996 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0130007410 con 0x7f013809f3a0 2024-09-11T23:06:54.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.858+0000 7f01357fa640 1 -- 172.21.15.12:0/784795996 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01300075b0 con 0x7f013809f3a0 2024-09-11T23:06:54.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.858+0000 7f013ed7b640 1 -- 172.21.15.12:0/784795996 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f013809c380 con 0x7f013809f3a0 2024-09-11T23:06:54.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.858+0000 7f01357fa640 1 -- 172.21.15.12:0/784795996 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0130004960 con 0x7f013809f3a0 2024-09-11T23:06:54.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.858+0000 7f013ed7b640 1 -- 172.21.15.12:0/784795996 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f013809b7f0 con 0x7f013809f3a0 2024-09-11T23:06:54.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.858+0000 7f013ed7b640 1 -- 172.21.15.12:0/784795996 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f013813c0b0 con 0x7f013809f3a0 2024-09-11T23:06:54.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.858+0000 7f01357fa640 1 -- 172.21.15.12:0/784795996 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 38) ==== 43997+0+0 (secure 0 0 0) 0x7f013001a020 con 0x7f013809f3a0 2024-09-11T23:06:54.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.858+0000 7f01357fa640 1 --2- 172.21.15.12:0/784795996 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f0124035d20 0x7f01240381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:54.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.858+0000 7f01357fa640 1 -- 172.21.15.12:0/784795996 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 2974+0+0 (secure 0 0 0) 0x7f0130047b20 con 0x7f013809f3a0 2024-09-11T23:06:54.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.858+0000 7f01357fa640 1 --2- 172.21.15.12:0/784795996 >> [v2:172.21.15.12:6816/3680911937,v1:172.21.15.12:6817/3680911937] conn(0x7f012403ab10 0x7f012403cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:54.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.858+0000 7f0137fff640 1 --2- 172.21.15.12:0/784795996 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f0124035d20 0x7f01240381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:54.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.858+0000 7f01357fa640 1 -- 172.21.15.12:0/784795996 --> [v2:172.21.15.12:6816/3680911937,v1:172.21.15.12:6817/3680911937] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f012403d620 con 0x7f012403ab10 2024-09-11T23:06:54.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.858+0000 7f01357fa640 1 -- 172.21.15.12:0/784795996 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f013004c2a0 con 0x7f013809f3a0 2024-09-11T23:06:54.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.858+0000 7f013d318640 1 --2- 172.21.15.12:0/784795996 >> [v2:172.21.15.12:6816/3680911937,v1:172.21.15.12:6817/3680911937] conn(0x7f012403ab10 0x7f012403cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:54.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.858+0000 7f0137fff640 1 --2- 172.21.15.12:0/784795996 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f0124035d20 0x7f01240381e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f012c0ae000 tx=0x7f012c0a7070 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:54.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.858+0000 7f013d318640 1 --2- 172.21.15.12:0/784795996 >> [v2:172.21.15.12:6816/3680911937,v1:172.21.15.12:6817/3680911937] conn(0x7f012403ab10 0x7f012403cf50 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:54.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.858+0000 7f01357fa640 1 -- 172.21.15.12:0/784795996 <== osd.0 v2:172.21.15.12:6816/3680911937 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f012403d620 con 0x7f012403ab10 2024-09-11T23:06:54.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.870+0000 7f013ed7b640 1 -- 172.21.15.12:0/784795996 --> [v2:172.21.15.12:6816/3680911937,v1:172.21.15.12:6817/3680911937] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f013809ba20 con 0x7f012403ab10 2024-09-11T23:06:54.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.874+0000 7f01357fa640 1 -- 172.21.15.12:0/784795996 <== osd.0 v2:172.21.15.12:6816/3680911937 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f013809ba20 con 0x7f012403ab10 2024-09-11T23:06:54.876 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T23:06:54.876 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T23:06:54.876 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T23:06:54.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.874+0000 7f013ed7b640 1 -- 172.21.15.12:0/784795996 >> [v2:172.21.15.12:6816/3680911937,v1:172.21.15.12:6817/3680911937] conn(0x7f012403ab10 msgr2=0x7f012403cf50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:54.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.874+0000 7f013ed7b640 1 --2- 172.21.15.12:0/784795996 >> [v2:172.21.15.12:6816/3680911937,v1:172.21.15.12:6817/3680911937] conn(0x7f012403ab10 0x7f012403cf50 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:54.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.874+0000 7f013ed7b640 1 -- 172.21.15.12:0/784795996 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f0124035d20 msgr2=0x7f01240381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:54.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.874+0000 7f013ed7b640 1 --2- 172.21.15.12:0/784795996 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f0124035d20 0x7f01240381e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f012c0ae000 tx=0x7f012c0a7070 comp rx=0 tx=0).stop 2024-09-11T23:06:54.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.874+0000 7f013ed7b640 1 -- 172.21.15.12:0/784795996 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f013809f3a0 msgr2=0x7f013813ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:54.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.874+0000 7f013ed7b640 1 --2- 172.21.15.12:0/784795996 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f013809f3a0 0x7f013813ae30 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f013000c480 tx=0x7f013000c940 comp rx=0 tx=0).stop 2024-09-11T23:06:54.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.874+0000 7f013ed7b640 1 -- 172.21.15.12:0/784795996 shutdown_connections 2024-09-11T23:06:54.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.874+0000 7f013ed7b640 1 --2- 172.21.15.12:0/784795996 >> [v2:172.21.15.12:6816/3680911937,v1:172.21.15.12:6817/3680911937] conn(0x7f012403ab10 0x7f012403cf50 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:54.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.874+0000 7f013ed7b640 1 --2- 172.21.15.12:0/784795996 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f0124035d20 0x7f01240381e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:54.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.874+0000 7f013ed7b640 1 --2- 172.21.15.12:0/784795996 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f013809f3a0 0x7f013813ae30 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:54.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.874+0000 7f013ed7b640 1 -- 172.21.15.12:0/784795996 >> 172.21.15.12:0/784795996 conn(0x7f01380a85b0 msgr2=0x7f0138133a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:54.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.874+0000 7f013ed7b640 1 -- 172.21.15.12:0/784795996 shutdown_connections 2024-09-11T23:06:54.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:54.874+0000 7f013ed7b640 1 -- 172.21.15.12:0/784795996 wait complete. 2024-09-11T23:06:54.892 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-11T23:06:55.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.062+0000 7f1d74e5e640 1 Processor -- start 2024-09-11T23:06:55.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.062+0000 7f1d74e5e640 1 -- start start 2024-09-11T23:06:55.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.062+0000 7f1d74e5e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1d7006bc60 0x7f1d7013ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:55.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.062+0000 7f1d74e5e640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d70137500 con 0x7f1d70136a10 2024-09-11T23:06:55.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.062+0000 7f1d74e5e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f1d7006c8f0 con 0x7f1d7006bc60 2024-09-11T23:06:55.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.062+0000 7f1d6dd9b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1d7006bc60 0x7f1d7013ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:55.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.062+0000 7f1d6e59c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1d70136a10 0x7f1d70136df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43858/0 (socket says 172.21.15.12:43858) 2024-09-11T23:06:55.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.062+0000 7f1d6e59c640 1 -- 172.21.15.12:0/97621214 learned_addr learned my addr 172.21.15.12:0/97621214 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:55.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.062+0000 7f1d6dd9b640 1 --2- 172.21.15.12:0/97621214 >> v2:172.21.15.12:3300/0 conn(0x7f1d7006bc60 0x7f1d7013ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57542/0 (socket says 172.21.15.12:57542) 2024-09-11T23:06:55.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.062+0000 7f1d6dd9b640 1 -- 172.21.15.12:0/97621214 >> v1:172.21.15.12:6789/0 conn(0x7f1d70136a10 legacy=0x7f1d70136df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:55.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.062+0000 7f1d6dd9b640 1 -- 172.21.15.12:0/97621214 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d700a4f40 con 0x7f1d7006bc60 2024-09-11T23:06:55.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.066+0000 7f1d6dd9b640 1 --2- 172.21.15.12:0/97621214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d7006bc60 0x7f1d7013ee20 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f1d64009740 tx=0x7f1d6401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebd8e544aa08175b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:55.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.066+0000 7f1d6d59a640 1 -- 172.21.15.12:0/97621214 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d640b0070 con 0x7f1d7006bc60 2024-09-11T23:06:55.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.066+0000 7f1d6d59a640 1 -- 172.21.15.12:0/97621214 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d640ab530 con 0x7f1d7006bc60 2024-09-11T23:06:55.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.066+0000 7f1d6d59a640 1 -- 172.21.15.12:0/97621214 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d640ab830 con 0x7f1d7006bc60 2024-09-11T23:06:55.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.066+0000 7f1d74e5e640 1 -- 172.21.15.12:0/97621214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d7006bc60 msgr2=0x7f1d7013ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:55.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.066+0000 7f1d74e5e640 1 --2- 172.21.15.12:0/97621214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d7006bc60 0x7f1d7013ee20 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f1d64009740 tx=0x7f1d6401c390 comp rx=0 tx=0).stop 2024-09-11T23:06:55.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.066+0000 7f1d74e5e640 1 -- 172.21.15.12:0/97621214 shutdown_connections 2024-09-11T23:06:55.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.066+0000 7f1d74e5e640 1 --2- 172.21.15.12:0/97621214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d7006bc60 0x7f1d7013ee20 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:55.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.066+0000 7f1d74e5e640 1 -- 172.21.15.12:0/97621214 >> 172.21.15.12:0/97621214 conn(0x7f1d70067e00 msgr2=0x7f1d70068210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:55.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.066+0000 7f1d74e5e640 1 -- 172.21.15.12:0/97621214 shutdown_connections 2024-09-11T23:06:55.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.066+0000 7f1d74e5e640 1 -- 172.21.15.12:0/97621214 wait complete. 2024-09-11T23:06:55.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.066+0000 7f1d74e5e640 1 Processor -- start 2024-09-11T23:06:55.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.066+0000 7f1d74e5e640 1 -- start start 2024-09-11T23:06:55.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.066+0000 7f1d74e5e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d7006bc60 0x7f1d7013db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:55.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.066+0000 7f1d74e5e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1d70141d00 con 0x7f1d7006bc60 2024-09-11T23:06:55.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.066+0000 7f1d6e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d7006bc60 0x7f1d7013db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:55.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.066+0000 7f1d6e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d7006bc60 0x7f1d7013db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57546/0 (socket says 172.21.15.12:57546) 2024-09-11T23:06:55.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.066+0000 7f1d6e59c640 1 -- 172.21.15.12:0/2508110169 learned_addr learned my addr 172.21.15.12:0/2508110169 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:55.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.066+0000 7f1d6e59c640 1 -- 172.21.15.12:0/2508110169 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d70136520 con 0x7f1d7006bc60 2024-09-11T23:06:55.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.066+0000 7f1d6e59c640 1 --2- 172.21.15.12:0/2508110169 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d7006bc60 0x7f1d7013db20 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f1d6000c480 tx=0x7f1d6000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:55.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.066+0000 7f1d5effd640 1 -- 172.21.15.12:0/2508110169 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d60017070 con 0x7f1d7006bc60 2024-09-11T23:06:55.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.066+0000 7f1d5effd640 1 -- 172.21.15.12:0/2508110169 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d60005c20 con 0x7f1d7006bc60 2024-09-11T23:06:55.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.066+0000 7f1d74e5e640 1 -- 172.21.15.12:0/2508110169 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d7013ea60 con 0x7f1d7006bc60 2024-09-11T23:06:55.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.066+0000 7f1d5effd640 1 -- 172.21.15.12:0/2508110169 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d60007070 con 0x7f1d7006bc60 2024-09-11T23:06:55.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.066+0000 7f1d74e5e640 1 -- 172.21.15.12:0/2508110169 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d700a7620 con 0x7f1d7006bc60 2024-09-11T23:06:55.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.070+0000 7f1d5effd640 1 -- 172.21.15.12:0/2508110169 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 39) ==== 44053+0+0 (secure 0 0 0) 0x7f1d6001a070 con 0x7f1d7006bc60 2024-09-11T23:06:55.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.070+0000 7f1d74e5e640 1 -- 172.21.15.12:0/2508110169 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d700008e0 con 0x7f1d7006bc60 2024-09-11T23:06:55.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.070+0000 7f1d5effd640 1 --2- 172.21.15.12:0/2508110169 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f1d50035d60 0x7f1d50038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:55.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.070+0000 7f1d5effd640 1 -- 172.21.15.12:0/2508110169 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 2974+0+0 (secure 0 0 0) 0x7f1d60047780 con 0x7f1d7006bc60 2024-09-11T23:06:55.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.070+0000 7f1d6dd9b640 1 --2- 172.21.15.12:0/2508110169 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f1d50035d60 0x7f1d50038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:55.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.070+0000 7f1d6dd9b640 1 --2- 172.21.15.12:0/2508110169 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f1d50035d60 0x7f1d50038220 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1d640ad000 tx=0x7f1d64008040 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:55.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.074+0000 7f1d5effd640 1 -- 172.21.15.12:0/2508110169 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1d60007210 con 0x7f1d7006bc60 2024-09-11T23:06:55.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.234+0000 7f1d74e5e640 1 -- 172.21.15.12:0/2508110169 --> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f1d7013cc20 con 0x7f1d50035d60 2024-09-11T23:06:55.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.238+0000 7f1d5effd640 1 -- 172.21.15.12:0/2508110169 <== mgr.5090 v2:172.21.15.12:6828/1853698227 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f1d7013cc20 con 0x7f1d50035d60 2024-09-11T23:06:55.240 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 0 to deep-scrub 2024-09-11T23:06:55.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.238+0000 7f1d74e5e640 1 -- 172.21.15.12:0/2508110169 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f1d50035d60 msgr2=0x7f1d50038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:55.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.238+0000 7f1d74e5e640 1 --2- 172.21.15.12:0/2508110169 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f1d50035d60 0x7f1d50038220 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1d640ad000 tx=0x7f1d64008040 comp rx=0 tx=0).stop 2024-09-11T23:06:55.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.238+0000 7f1d74e5e640 1 -- 172.21.15.12:0/2508110169 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d7006bc60 msgr2=0x7f1d7013db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:55.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.238+0000 7f1d74e5e640 1 --2- 172.21.15.12:0/2508110169 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d7006bc60 0x7f1d7013db20 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f1d6000c480 tx=0x7f1d6000c940 comp rx=0 tx=0).stop 2024-09-11T23:06:55.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.238+0000 7f1d74e5e640 1 -- 172.21.15.12:0/2508110169 shutdown_connections 2024-09-11T23:06:55.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.238+0000 7f1d74e5e640 1 --2- 172.21.15.12:0/2508110169 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f1d50035d60 0x7f1d50038220 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:55.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.238+0000 7f1d74e5e640 1 --2- 172.21.15.12:0/2508110169 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d7006bc60 0x7f1d7013db20 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:55.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.238+0000 7f1d74e5e640 1 -- 172.21.15.12:0/2508110169 >> 172.21.15.12:0/2508110169 conn(0x7f1d70067e00 msgr2=0x7f1d700a8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:55.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.238+0000 7f1d74e5e640 1 -- 172.21.15.12:0/2508110169 shutdown_connections 2024-09-11T23:06:55.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.238+0000 7f1d74e5e640 1 -- 172.21.15.12:0/2508110169 wait complete. 2024-09-11T23:06:55.259 INFO:tasks.ceph:Scrubbing osd.1 2024-09-11T23:06:55.259 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-11T23:06:55.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.386+0000 7f940328a640 1 Processor -- start 2024-09-11T23:06:55.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.386+0000 7f940328a640 1 -- start start 2024-09-11T23:06:55.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.386+0000 7f940328a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f93fc0a17f0 0x7f93fc13ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:55.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.386+0000 7f940328a640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93fc0a1e30 con 0x7f93fc13a090 2024-09-11T23:06:55.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.386+0000 7f940328a640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f93fc0a10a0 con 0x7f93fc0a17f0 2024-09-11T23:06:55.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.386+0000 7f9401026640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f93fc13a090 0x7f93fc13a470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43864/0 (socket says 172.21.15.12:43864) 2024-09-11T23:06:55.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.386+0000 7f9401026640 1 -- 172.21.15.12:0/1089598832 learned_addr learned my addr 172.21.15.12:0/1089598832 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:55.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.386+0000 7f9400825640 1 --2- 172.21.15.12:0/1089598832 >> v2:172.21.15.12:3300/0 conn(0x7f93fc0a17f0 0x7f93fc13ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:55.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.386+0000 7f93fbfff640 1 -- 172.21.15.12:0/1089598832 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 14475032 0 0) 0x7f93fc0a1e30 con 0x7f93fc13a090 2024-09-11T23:06:55.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.390+0000 7f93fbfff640 1 -- 172.21.15.12:0/1089598832 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f93e4003530 con 0x7f93fc13a090 2024-09-11T23:06:55.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.390+0000 7f9400825640 1 -- 172.21.15.12:0/1089598832 >> v1:172.21.15.12:6789/0 conn(0x7f93fc13a090 legacy=0x7f93fc13a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:55.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.390+0000 7f9400825640 1 -- 172.21.15.12:0/1089598832 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93fc09f380 con 0x7f93fc0a17f0 2024-09-11T23:06:55.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.390+0000 7f9400825640 1 --2- 172.21.15.12:0/1089598832 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f93fc0a17f0 0x7f93fc13ef10 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f93f0009d90 tx=0x7f93f001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c287c66fb5d5b5e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:55.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.390+0000 7f93fbfff640 1 -- 172.21.15.12:0/1089598832 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93f00b2070 con 0x7f93fc0a17f0 2024-09-11T23:06:55.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.390+0000 7f93fbfff640 1 -- 172.21.15.12:0/1089598832 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93f00a5650 con 0x7f93fc0a17f0 2024-09-11T23:06:55.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.390+0000 7f93fbfff640 1 -- 172.21.15.12:0/1089598832 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93f00a5930 con 0x7f93fc0a17f0 2024-09-11T23:06:55.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.390+0000 7f940328a640 1 -- 172.21.15.12:0/1089598832 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f93fc0a17f0 msgr2=0x7f93fc13ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:55.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.390+0000 7f940328a640 1 --2- 172.21.15.12:0/1089598832 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f93fc0a17f0 0x7f93fc13ef10 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f93f0009d90 tx=0x7f93f001c8e0 comp rx=0 tx=0).stop 2024-09-11T23:06:55.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.390+0000 7f940328a640 1 -- 172.21.15.12:0/1089598832 shutdown_connections 2024-09-11T23:06:55.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.390+0000 7f940328a640 1 --2- 172.21.15.12:0/1089598832 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f93fc0a17f0 0x7f93fc13ef10 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:55.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.390+0000 7f940328a640 1 -- 172.21.15.12:0/1089598832 >> 172.21.15.12:0/1089598832 conn(0x7f93fc06da30 msgr2=0x7f93fc06de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:55.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.390+0000 7f940328a640 1 -- 172.21.15.12:0/1089598832 shutdown_connections 2024-09-11T23:06:55.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.390+0000 7f940328a640 1 -- 172.21.15.12:0/1089598832 wait complete. 2024-09-11T23:06:55.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.394+0000 7f940328a640 1 Processor -- start 2024-09-11T23:06:55.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.394+0000 7f940328a640 1 -- start start 2024-09-11T23:06:55.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.394+0000 7f940328a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f93fc0a17f0 0x7f93fc0a5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:55.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.394+0000 7f940328a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f93fc141df0 con 0x7f93fc0a17f0 2024-09-11T23:06:55.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.394+0000 7f9401026640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f93fc0a17f0 0x7f93fc0a5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:55.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.394+0000 7f9401026640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f93fc0a17f0 0x7f93fc0a5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57572/0 (socket says 172.21.15.12:57572) 2024-09-11T23:06:55.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.394+0000 7f9401026640 1 -- 172.21.15.12:0/4210439473 learned_addr learned my addr 172.21.15.12:0/4210439473 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:55.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.394+0000 7f9401026640 1 -- 172.21.15.12:0/4210439473 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93fc0a5390 con 0x7f93fc0a17f0 2024-09-11T23:06:55.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.394+0000 7f9401026640 1 --2- 172.21.15.12:0/4210439473 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f93fc0a17f0 0x7f93fc0a5d50 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f93ec00c3d0 tx=0x7f93ec00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:55.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.394+0000 7f93f9ffb640 1 -- 172.21.15.12:0/4210439473 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93ec017070 con 0x7f93fc0a17f0 2024-09-11T23:06:55.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.394+0000 7f93f9ffb640 1 -- 172.21.15.12:0/4210439473 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93ec005ce0 con 0x7f93fc0a17f0 2024-09-11T23:06:55.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.394+0000 7f940328a640 1 -- 172.21.15.12:0/4210439473 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93fc1ce160 con 0x7f93fc0a17f0 2024-09-11T23:06:55.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.394+0000 7f93f9ffb640 1 -- 172.21.15.12:0/4210439473 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93ec0070d0 con 0x7f93fc0a17f0 2024-09-11T23:06:55.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.394+0000 7f940328a640 1 -- 172.21.15.12:0/4210439473 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93fc0a71b0 con 0x7f93fc0a17f0 2024-09-11T23:06:55.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.394+0000 7f940328a640 1 -- 172.21.15.12:0/4210439473 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f93fc0a7b80 con 0x7f93fc0a17f0 2024-09-11T23:06:55.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.394+0000 7f93f9ffb640 1 -- 172.21.15.12:0/4210439473 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 39) ==== 44053+0+0 (secure 0 0 0) 0x7f93ec01a070 con 0x7f93fc0a17f0 2024-09-11T23:06:55.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.394+0000 7f93f9ffb640 1 --2- 172.21.15.12:0/4210439473 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f93e8035e00 0x7f93e80382c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:55.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.394+0000 7f93f9ffb640 1 -- 172.21.15.12:0/4210439473 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 2974+0+0 (secure 0 0 0) 0x7f93ec047960 con 0x7f93fc0a17f0 2024-09-11T23:06:55.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.394+0000 7f9400825640 1 --2- 172.21.15.12:0/4210439473 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f93e8035e00 0x7f93e80382c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:55.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.394+0000 7f93f9ffb640 1 --2- 172.21.15.12:0/4210439473 >> [v2:172.21.15.12:6800/236825163,v1:172.21.15.12:6801/236825163] conn(0x7f93e803abf0 0x7f93e803d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:55.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.394+0000 7f93f9ffb640 1 -- 172.21.15.12:0/4210439473 --> [v2:172.21.15.12:6800/236825163,v1:172.21.15.12:6801/236825163] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f93ec016ec0 con 0x7f93e803abf0 2024-09-11T23:06:55.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.394+0000 7f93f9ffb640 1 -- 172.21.15.12:0/4210439473 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f93ec04e050 con 0x7f93fc0a17f0 2024-09-11T23:06:55.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.394+0000 7f9401827640 1 --2- 172.21.15.12:0/4210439473 >> [v2:172.21.15.12:6800/236825163,v1:172.21.15.12:6801/236825163] conn(0x7f93e803abf0 0x7f93e803d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:55.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.394+0000 7f9400825640 1 --2- 172.21.15.12:0/4210439473 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f93e8035e00 0x7f93e80382c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f93f00af000 tx=0x7f93f00a7070 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:55.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.394+0000 7f9401827640 1 --2- 172.21.15.12:0/4210439473 >> [v2:172.21.15.12:6800/236825163,v1:172.21.15.12:6801/236825163] conn(0x7f93e803abf0 0x7f93e803d030 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:55.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.398+0000 7f93f9ffb640 1 -- 172.21.15.12:0/4210439473 <== osd.1 v2:172.21.15.12:6800/236825163 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f93ec016ec0 con 0x7f93e803abf0 2024-09-11T23:06:55.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.410+0000 7f940328a640 1 -- 172.21.15.12:0/4210439473 --> [v2:172.21.15.12:6800/236825163,v1:172.21.15.12:6801/236825163] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f93fc13a2e0 con 0x7f93e803abf0 2024-09-11T23:06:55.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.410+0000 7f93f9ffb640 1 -- 172.21.15.12:0/4210439473 <== osd.1 v2:172.21.15.12:6800/236825163 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f93fc13a2e0 con 0x7f93e803abf0 2024-09-11T23:06:55.414 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T23:06:55.414 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T23:06:55.414 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T23:06:55.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.410+0000 7f940328a640 1 -- 172.21.15.12:0/4210439473 >> [v2:172.21.15.12:6800/236825163,v1:172.21.15.12:6801/236825163] conn(0x7f93e803abf0 msgr2=0x7f93e803d030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:55.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.410+0000 7f940328a640 1 --2- 172.21.15.12:0/4210439473 >> [v2:172.21.15.12:6800/236825163,v1:172.21.15.12:6801/236825163] conn(0x7f93e803abf0 0x7f93e803d030 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:55.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.410+0000 7f940328a640 1 -- 172.21.15.12:0/4210439473 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f93e8035e00 msgr2=0x7f93e80382c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:55.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.410+0000 7f940328a640 1 --2- 172.21.15.12:0/4210439473 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f93e8035e00 0x7f93e80382c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f93f00af000 tx=0x7f93f00a7070 comp rx=0 tx=0).stop 2024-09-11T23:06:55.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.410+0000 7f940328a640 1 -- 172.21.15.12:0/4210439473 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f93fc0a17f0 msgr2=0x7f93fc0a5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:55.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.410+0000 7f940328a640 1 --2- 172.21.15.12:0/4210439473 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f93fc0a17f0 0x7f93fc0a5d50 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f93ec00c3d0 tx=0x7f93ec00c890 comp rx=0 tx=0).stop 2024-09-11T23:06:55.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.410+0000 7f940328a640 1 -- 172.21.15.12:0/4210439473 shutdown_connections 2024-09-11T23:06:55.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.410+0000 7f940328a640 1 --2- 172.21.15.12:0/4210439473 >> [v2:172.21.15.12:6800/236825163,v1:172.21.15.12:6801/236825163] conn(0x7f93e803abf0 0x7f93e803d030 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:55.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.410+0000 7f940328a640 1 --2- 172.21.15.12:0/4210439473 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f93e8035e00 0x7f93e80382c0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:55.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.410+0000 7f940328a640 1 --2- 172.21.15.12:0/4210439473 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f93fc0a17f0 0x7f93fc0a5d50 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:55.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.410+0000 7f940328a640 1 -- 172.21.15.12:0/4210439473 >> 172.21.15.12:0/4210439473 conn(0x7f93fc06da30 msgr2=0x7f93fc09c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:55.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.410+0000 7f940328a640 1 -- 172.21.15.12:0/4210439473 shutdown_connections 2024-09-11T23:06:55.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.410+0000 7f940328a640 1 -- 172.21.15.12:0/4210439473 wait complete. 2024-09-11T23:06:55.430 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-11T23:06:55.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.546+0000 7faa9d198640 1 Processor -- start 2024-09-11T23:06:55.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.546+0000 7faa9d198640 1 -- start start 2024-09-11T23:06:55.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.546+0000 7faa9d198640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7faa9813e4a0 0x7faa9813e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:55.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.546+0000 7faa9d198640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa9813edc0 con 0x7faa980a19b0 2024-09-11T23:06:55.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.546+0000 7faa9d198640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7faa9813de40 con 0x7faa9813e4a0 2024-09-11T23:06:55.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.546+0000 7faa96d9d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7faa9813e4a0 0x7faa9813e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:55.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.546+0000 7faa9659c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7faa980a19b0 0x7faa980a36a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43878/0 (socket says 172.21.15.12:43878) 2024-09-11T23:06:55.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.546+0000 7faa9659c640 1 -- 172.21.15.12:0/2014887206 learned_addr learned my addr 172.21.15.12:0/2014887206 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:55.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.546+0000 7faa96d9d640 1 -- 172.21.15.12:0/2014887206 >> v1:172.21.15.12:6789/0 conn(0x7faa980a19b0 legacy=0x7faa980a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:55.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.546+0000 7faa96d9d640 1 -- 172.21.15.12:0/2014887206 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa9813e070 con 0x7faa9813e4a0 2024-09-11T23:06:55.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.546+0000 7faa95d9b640 1 -- 172.21.15.12:0/2014887206 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4017182667 0 0) 0x7faa9813edc0 con 0x7faa980a19b0 2024-09-11T23:06:55.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.550+0000 7faa96d9d640 1 --2- 172.21.15.12:0/2014887206 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa9813e4a0 0x7faa9813e880 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7faa88009740 tx=0x7faa8801c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de46d20a7df78b06 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:55.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.550+0000 7faa95d9b640 1 -- 172.21.15.12:0/2014887206 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa880b0070 con 0x7faa9813e4a0 2024-09-11T23:06:55.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.550+0000 7faa95d9b640 1 -- 172.21.15.12:0/2014887206 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa880ab530 con 0x7faa9813e4a0 2024-09-11T23:06:55.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.550+0000 7faa95d9b640 1 -- 172.21.15.12:0/2014887206 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa880ab830 con 0x7faa9813e4a0 2024-09-11T23:06:55.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.550+0000 7faa9d198640 1 -- 172.21.15.12:0/2014887206 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa9813e4a0 msgr2=0x7faa9813e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:55.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.550+0000 7faa9d198640 1 --2- 172.21.15.12:0/2014887206 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa9813e4a0 0x7faa9813e880 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7faa88009740 tx=0x7faa8801c390 comp rx=0 tx=0).stop 2024-09-11T23:06:55.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.550+0000 7faa9d198640 1 -- 172.21.15.12:0/2014887206 shutdown_connections 2024-09-11T23:06:55.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.550+0000 7faa9d198640 1 --2- 172.21.15.12:0/2014887206 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa9813e4a0 0x7faa9813e880 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:55.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.550+0000 7faa9d198640 1 -- 172.21.15.12:0/2014887206 >> 172.21.15.12:0/2014887206 conn(0x7faa980a82f0 msgr2=0x7faa980a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:55.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.550+0000 7faa9d198640 1 -- 172.21.15.12:0/2014887206 shutdown_connections 2024-09-11T23:06:55.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.550+0000 7faa9d198640 1 -- 172.21.15.12:0/2014887206 wait complete. 2024-09-11T23:06:55.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.550+0000 7faa9d198640 1 Processor -- start 2024-09-11T23:06:55.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.550+0000 7faa9d198640 1 -- start start 2024-09-11T23:06:55.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.550+0000 7faa9d198640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa980a19b0 0x7faa98070ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:55.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.550+0000 7faa9d198640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7faa98146360 con 0x7faa980a19b0 2024-09-11T23:06:55.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.550+0000 7faa96d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa980a19b0 0x7faa98070ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:55.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.550+0000 7faa96d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa980a19b0 0x7faa98070ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57582/0 (socket says 172.21.15.12:57582) 2024-09-11T23:06:55.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.550+0000 7faa96d9d640 1 -- 172.21.15.12:0/1928023236 learned_addr learned my addr 172.21.15.12:0/1928023236 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:55.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.550+0000 7faa96d9d640 1 -- 172.21.15.12:0/1928023236 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa98070480 con 0x7faa980a19b0 2024-09-11T23:06:55.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.550+0000 7faa96d9d640 1 --2- 172.21.15.12:0/1928023236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa980a19b0 0x7faa98070ec0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7faa880ae040 tx=0x7faa8801abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:55.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.554+0000 7faa7f7fe640 1 -- 172.21.15.12:0/1928023236 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa880b0050 con 0x7faa980a19b0 2024-09-11T23:06:55.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.554+0000 7faa7f7fe640 1 -- 172.21.15.12:0/1928023236 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa880b1040 con 0x7faa980a19b0 2024-09-11T23:06:55.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.554+0000 7faa7f7fe640 1 -- 172.21.15.12:0/1928023236 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa880b5780 con 0x7faa980a19b0 2024-09-11T23:06:55.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.554+0000 7faa9d198640 1 -- 172.21.15.12:0/1928023236 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa9806e940 con 0x7faa980a19b0 2024-09-11T23:06:55.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.554+0000 7faa9d198640 1 -- 172.21.15.12:0/1928023236 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa98070170 con 0x7faa980a19b0 2024-09-11T23:06:55.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.554+0000 7faa7f7fe640 1 -- 172.21.15.12:0/1928023236 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 39) ==== 44053+0+0 (secure 0 0 0) 0x7faa880be030 con 0x7faa980a19b0 2024-09-11T23:06:55.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.554+0000 7faa9d198640 1 -- 172.21.15.12:0/1928023236 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa98142990 con 0x7faa980a19b0 2024-09-11T23:06:55.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.554+0000 7faa7f7fe640 1 --2- 172.21.15.12:0/1928023236 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7faa84035db0 0x7faa84038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:55.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.554+0000 7faa7f7fe640 1 -- 172.21.15.12:0/1928023236 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 2974+0+0 (secure 0 0 0) 0x7faa880bc070 con 0x7faa980a19b0 2024-09-11T23:06:55.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.554+0000 7faa9659c640 1 --2- 172.21.15.12:0/1928023236 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7faa84035db0 0x7faa84038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:55.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.554+0000 7faa9659c640 1 --2- 172.21.15.12:0/1928023236 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7faa84035db0 0x7faa84038270 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7faa8c007fd0 tx=0x7faa8c007920 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:55.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.558+0000 7faa7f7fe640 1 -- 172.21.15.12:0/1928023236 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7faa880c5060 con 0x7faa980a19b0 2024-09-11T23:06:55.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.722+0000 7faa9d198640 1 -- 172.21.15.12:0/1928023236 --> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7faa98073870 con 0x7faa84035db0 2024-09-11T23:06:55.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.722+0000 7faa7f7fe640 1 -- 172.21.15.12:0/1928023236 <== mgr.5090 v2:172.21.15.12:6828/1853698227 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7faa98073870 con 0x7faa84035db0 2024-09-11T23:06:55.732 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 1 to deep-scrub 2024-09-11T23:06:55.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.722+0000 7faa9d198640 1 -- 172.21.15.12:0/1928023236 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7faa84035db0 msgr2=0x7faa84038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:55.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.722+0000 7faa9d198640 1 --2- 172.21.15.12:0/1928023236 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7faa84035db0 0x7faa84038270 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7faa8c007fd0 tx=0x7faa8c007920 comp rx=0 tx=0).stop 2024-09-11T23:06:55.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.722+0000 7faa9d198640 1 -- 172.21.15.12:0/1928023236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa980a19b0 msgr2=0x7faa98070ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:55.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.722+0000 7faa9d198640 1 --2- 172.21.15.12:0/1928023236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa980a19b0 0x7faa98070ec0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7faa880ae040 tx=0x7faa8801abd0 comp rx=0 tx=0).stop 2024-09-11T23:06:55.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.722+0000 7faa9d198640 1 -- 172.21.15.12:0/1928023236 shutdown_connections 2024-09-11T23:06:55.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.722+0000 7faa9d198640 1 --2- 172.21.15.12:0/1928023236 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7faa84035db0 0x7faa84038270 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:55.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.722+0000 7faa9d198640 1 --2- 172.21.15.12:0/1928023236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa980a19b0 0x7faa98070ec0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:55.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.722+0000 7faa9d198640 1 -- 172.21.15.12:0/1928023236 >> 172.21.15.12:0/1928023236 conn(0x7faa980a82f0 msgr2=0x7faa9813af60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:55.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.722+0000 7faa9d198640 1 -- 172.21.15.12:0/1928023236 shutdown_connections 2024-09-11T23:06:55.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.722+0000 7faa9d198640 1 -- 172.21.15.12:0/1928023236 wait complete. 2024-09-11T23:06:55.742 INFO:tasks.ceph:Scrubbing osd.2 2024-09-11T23:06:55.742 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-11T23:06:55.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.854+0000 7f7212055640 1 Processor -- start 2024-09-11T23:06:55.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.854+0000 7f7212055640 1 -- start start 2024-09-11T23:06:55.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.854+0000 7f7212055640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f720c0a0dd0 0x7f720c13ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:55.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.854+0000 7f7212055640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f720c0a0130 con 0x7f720c1359b0 2024-09-11T23:06:55.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.854+0000 7f7212055640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f720c072e60 con 0x7f720c0a0dd0 2024-09-11T23:06:55.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.854+0000 7f720affd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f720c0a0dd0 0x7f720c13ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:55.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.854+0000 7f720affd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f720c0a0dd0 0x7f720c13ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57594/0 (socket says 172.21.15.12:57594) 2024-09-11T23:06:55.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.854+0000 7f720affd640 1 -- 172.21.15.12:0/2558144970 learned_addr learned my addr 172.21.15.12:0/2558144970 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:55.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.854+0000 7f720affd640 1 -- 172.21.15.12:0/2558144970 >> v1:172.21.15.12:6789/0 conn(0x7f720c1359b0 legacy=0x7f720c135d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:55.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.854+0000 7f720affd640 1 -- 172.21.15.12:0/2558144970 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f720c09fe20 con 0x7f720c0a0dd0 2024-09-11T23:06:55.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.858+0000 7f720affd640 1 --2- 172.21.15.12:0/2558144970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f720c0a0dd0 0x7f720c13ef70 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f71f40097f0 tx=0x7f71f401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57fad9ae4be898c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:55.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.858+0000 7f720a7fc640 1 -- 172.21.15.12:0/2558144970 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71f40b0070 con 0x7f720c0a0dd0 2024-09-11T23:06:55.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.858+0000 7f720a7fc640 1 -- 172.21.15.12:0/2558144970 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71f40ab530 con 0x7f720c0a0dd0 2024-09-11T23:06:55.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.858+0000 7f720a7fc640 1 -- 172.21.15.12:0/2558144970 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71f40ab830 con 0x7f720c0a0dd0 2024-09-11T23:06:55.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.858+0000 7f7212055640 1 -- 172.21.15.12:0/2558144970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f720c0a0dd0 msgr2=0x7f720c13ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:55.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.858+0000 7f7212055640 1 --2- 172.21.15.12:0/2558144970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f720c0a0dd0 0x7f720c13ef70 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f71f40097f0 tx=0x7f71f401c4e0 comp rx=0 tx=0).stop 2024-09-11T23:06:55.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.858+0000 7f7212055640 1 -- 172.21.15.12:0/2558144970 shutdown_connections 2024-09-11T23:06:55.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.858+0000 7f7212055640 1 --2- 172.21.15.12:0/2558144970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f720c0a0dd0 0x7f720c13ef70 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:55.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.858+0000 7f7212055640 1 -- 172.21.15.12:0/2558144970 >> 172.21.15.12:0/2558144970 conn(0x7f720c0a85b0 msgr2=0x7f720c0a49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:55.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.858+0000 7f7212055640 1 -- 172.21.15.12:0/2558144970 shutdown_connections 2024-09-11T23:06:55.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.858+0000 7f7212055640 1 -- 172.21.15.12:0/2558144970 wait complete. 2024-09-11T23:06:55.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.858+0000 7f7212055640 1 Processor -- start 2024-09-11T23:06:55.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.858+0000 7f7212055640 1 -- start start 2024-09-11T23:06:55.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.858+0000 7f7212055640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f720c0a0dd0 0x7f720c09b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:55.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.858+0000 7f7212055640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f720c141e50 con 0x7f720c0a0dd0 2024-09-11T23:06:55.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.858+0000 7f720b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f720c0a0dd0 0x7f720c09b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:55.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.858+0000 7f720b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f720c0a0dd0 0x7f720c09b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57606/0 (socket says 172.21.15.12:57606) 2024-09-11T23:06:55.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.858+0000 7f720b7fe640 1 -- 172.21.15.12:0/405377169 learned_addr learned my addr 172.21.15.12:0/405377169 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:55.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.858+0000 7f720b7fe640 1 -- 172.21.15.12:0/405377169 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f720c138ae0 con 0x7f720c0a0dd0 2024-09-11T23:06:55.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.858+0000 7f720b7fe640 1 --2- 172.21.15.12:0/405377169 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f720c0a0dd0 0x7f720c09b090 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f720400c480 tx=0x7f720400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:55.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.858+0000 7f7203fff640 1 -- 172.21.15.12:0/405377169 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7204005150 con 0x7f720c0a0dd0 2024-09-11T23:06:55.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.862+0000 7f7203fff640 1 -- 172.21.15.12:0/405377169 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72040052f0 con 0x7f720c0a0dd0 2024-09-11T23:06:55.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.862+0000 7f7212055640 1 -- 172.21.15.12:0/405377169 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f720c11ede0 con 0x7f720c0a0dd0 2024-09-11T23:06:55.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.862+0000 7f7203fff640 1 -- 172.21.15.12:0/405377169 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7204007030 con 0x7f720c0a0dd0 2024-09-11T23:06:55.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.862+0000 7f7212055640 1 -- 172.21.15.12:0/405377169 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f720c09d630 con 0x7f720c0a0dd0 2024-09-11T23:06:55.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.862+0000 7f7212055640 1 -- 172.21.15.12:0/405377169 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f720c138fa0 con 0x7f720c0a0dd0 2024-09-11T23:06:55.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.862+0000 7f7203fff640 1 -- 172.21.15.12:0/405377169 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 39) ==== 44053+0+0 (secure 0 0 0) 0x7f7204019020 con 0x7f720c0a0dd0 2024-09-11T23:06:55.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.862+0000 7f7203fff640 1 --2- 172.21.15.12:0/405377169 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f71ec035db0 0x7f71ec038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:55.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.862+0000 7f7203fff640 1 -- 172.21.15.12:0/405377169 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 2974+0+0 (secure 0 0 0) 0x7f72040477b0 con 0x7f720c0a0dd0 2024-09-11T23:06:55.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.862+0000 7f720affd640 1 --2- 172.21.15.12:0/405377169 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f71ec035db0 0x7f71ec038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:55.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.862+0000 7f7203fff640 1 --2- 172.21.15.12:0/405377169 >> [v2:172.21.15.12:6808/3263521655,v1:172.21.15.12:6809/3263521655] conn(0x7f71ec03aba0 0x7f71ec03cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:55.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.862+0000 7f7203fff640 1 -- 172.21.15.12:0/405377169 --> [v2:172.21.15.12:6808/3263521655,v1:172.21.15.12:6809/3263521655] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f71ec03d6b0 con 0x7f71ec03aba0 2024-09-11T23:06:55.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.862+0000 7f7203fff640 1 -- 172.21.15.12:0/405377169 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f720404e050 con 0x7f720c0a0dd0 2024-09-11T23:06:55.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.862+0000 7f720bfff640 1 --2- 172.21.15.12:0/405377169 >> [v2:172.21.15.12:6808/3263521655,v1:172.21.15.12:6809/3263521655] conn(0x7f71ec03aba0 0x7f71ec03cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:55.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.862+0000 7f720affd640 1 --2- 172.21.15.12:0/405377169 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f71ec035db0 0x7f71ec038270 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f71f40ad000 tx=0x7f71f40a6000 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:55.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.862+0000 7f720bfff640 1 --2- 172.21.15.12:0/405377169 >> [v2:172.21.15.12:6808/3263521655,v1:172.21.15.12:6809/3263521655] conn(0x7f71ec03aba0 0x7f71ec03cfe0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:55.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.862+0000 7f7203fff640 1 -- 172.21.15.12:0/405377169 <== osd.2 v2:172.21.15.12:6808/3263521655 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f71ec03d6b0 con 0x7f71ec03aba0 2024-09-11T23:06:55.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.874+0000 7f7212055640 1 -- 172.21.15.12:0/405377169 --> [v2:172.21.15.12:6808/3263521655,v1:172.21.15.12:6809/3263521655] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f720c11e710 con 0x7f71ec03aba0 2024-09-11T23:06:55.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.874+0000 7f7203fff640 1 -- 172.21.15.12:0/405377169 <== osd.2 v2:172.21.15.12:6808/3263521655 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f71fc00ad10 con 0x7f71ec03aba0 2024-09-11T23:06:55.879 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-11T23:06:55.880 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T23:06:55.880 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-11T23:06:55.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.874+0000 7f7212055640 1 -- 172.21.15.12:0/405377169 >> [v2:172.21.15.12:6808/3263521655,v1:172.21.15.12:6809/3263521655] conn(0x7f71ec03aba0 msgr2=0x7f71ec03cfe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:55.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.874+0000 7f7212055640 1 --2- 172.21.15.12:0/405377169 >> [v2:172.21.15.12:6808/3263521655,v1:172.21.15.12:6809/3263521655] conn(0x7f71ec03aba0 0x7f71ec03cfe0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:55.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.874+0000 7f7212055640 1 -- 172.21.15.12:0/405377169 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f71ec035db0 msgr2=0x7f71ec038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:55.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.874+0000 7f7212055640 1 --2- 172.21.15.12:0/405377169 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f71ec035db0 0x7f71ec038270 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f71f40ad000 tx=0x7f71f40a6000 comp rx=0 tx=0).stop 2024-09-11T23:06:55.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.874+0000 7f7212055640 1 -- 172.21.15.12:0/405377169 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f720c0a0dd0 msgr2=0x7f720c09b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:55.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.874+0000 7f7212055640 1 --2- 172.21.15.12:0/405377169 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f720c0a0dd0 0x7f720c09b090 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f720400c480 tx=0x7f720400c940 comp rx=0 tx=0).stop 2024-09-11T23:06:55.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.874+0000 7f7212055640 1 -- 172.21.15.12:0/405377169 shutdown_connections 2024-09-11T23:06:55.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.878+0000 7f7212055640 1 --2- 172.21.15.12:0/405377169 >> [v2:172.21.15.12:6808/3263521655,v1:172.21.15.12:6809/3263521655] conn(0x7f71ec03aba0 0x7f71ec03cfe0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:55.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.878+0000 7f7212055640 1 --2- 172.21.15.12:0/405377169 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f71ec035db0 0x7f71ec038270 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:55.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.878+0000 7f7212055640 1 --2- 172.21.15.12:0/405377169 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f720c0a0dd0 0x7f720c09b090 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:55.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.878+0000 7f7212055640 1 -- 172.21.15.12:0/405377169 >> 172.21.15.12:0/405377169 conn(0x7f720c0a85b0 msgr2=0x7f720c136750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:55.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.878+0000 7f7212055640 1 -- 172.21.15.12:0/405377169 shutdown_connections 2024-09-11T23:06:55.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:55.878+0000 7f7212055640 1 -- 172.21.15.12:0/405377169 wait complete. 2024-09-11T23:06:55.895 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-11T23:06:56.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.006+0000 7f1a6c144640 1 Processor -- start 2024-09-11T23:06:56.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.006+0000 7f1a6c144640 1 -- start start 2024-09-11T23:06:56.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.006+0000 7f1a6c144640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1a640a8110 0x7f1a6413ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:56.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.006+0000 7f1a6c144640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a640a4e40 con 0x7f1a640a71c0 2024-09-11T23:06:56.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.006+0000 7f1a6c144640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f1a640a6af0 con 0x7f1a640a8110 2024-09-11T23:06:56.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.006+0000 7f1a69ee0640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1a640a71c0 0x7f1a640a75a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43904/0 (socket says 172.21.15.12:43904) 2024-09-11T23:06:56.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.006+0000 7f1a69ee0640 1 -- 172.21.15.12:0/556217745 learned_addr learned my addr 172.21.15.12:0/556217745 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:06:56.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.006+0000 7f1a696df640 1 --2- 172.21.15.12:0/556217745 >> v2:172.21.15.12:3300/0 conn(0x7f1a640a8110 0x7f1a6413ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:56.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.006+0000 7f1a68ede640 1 -- 172.21.15.12:0/556217745 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4067036646 0 0) 0x7f1a640a4e40 con 0x7f1a640a71c0 2024-09-11T23:06:56.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.006+0000 7f1a68ede640 1 -- 172.21.15.12:0/556217745 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a50003530 con 0x7f1a640a71c0 2024-09-11T23:06:56.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.006+0000 7f1a696df640 1 -- 172.21.15.12:0/556217745 >> v1:172.21.15.12:6789/0 conn(0x7f1a640a71c0 legacy=0x7f1a640a75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:56.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.006+0000 7f1a696df640 1 -- 172.21.15.12:0/556217745 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a640a3f50 con 0x7f1a640a8110 2024-09-11T23:06:56.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.010+0000 7f1a696df640 1 --2- 172.21.15.12:0/556217745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a640a8110 0x7f1a6413ef50 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f1a54009740 tx=0x7f1a5401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf4949654bc0f93e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:56.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.010+0000 7f1a68ede640 1 -- 172.21.15.12:0/556217745 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a540b0070 con 0x7f1a640a8110 2024-09-11T23:06:56.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.010+0000 7f1a68ede640 1 -- 172.21.15.12:0/556217745 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a540ab530 con 0x7f1a640a8110 2024-09-11T23:06:56.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.010+0000 7f1a68ede640 1 -- 172.21.15.12:0/556217745 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a540ab830 con 0x7f1a640a8110 2024-09-11T23:06:56.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.010+0000 7f1a6c144640 1 -- 172.21.15.12:0/556217745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a640a8110 msgr2=0x7f1a6413ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:56.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.010+0000 7f1a6c144640 1 --2- 172.21.15.12:0/556217745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a640a8110 0x7f1a6413ef50 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f1a54009740 tx=0x7f1a5401c390 comp rx=0 tx=0).stop 2024-09-11T23:06:56.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.010+0000 7f1a6c144640 1 -- 172.21.15.12:0/556217745 shutdown_connections 2024-09-11T23:06:56.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.010+0000 7f1a6c144640 1 --2- 172.21.15.12:0/556217745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a640a8110 0x7f1a6413ef50 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:56.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.010+0000 7f1a6c144640 1 -- 172.21.15.12:0/556217745 >> 172.21.15.12:0/556217745 conn(0x7f1a640ac4f0 msgr2=0x7f1a640ac900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:56.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.010+0000 7f1a6c144640 1 -- 172.21.15.12:0/556217745 shutdown_connections 2024-09-11T23:06:56.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.010+0000 7f1a6c144640 1 -- 172.21.15.12:0/556217745 wait complete. 2024-09-11T23:06:56.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.010+0000 7f1a6c144640 1 Processor -- start 2024-09-11T23:06:56.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.010+0000 7f1a6c144640 1 -- start start 2024-09-11T23:06:56.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.010+0000 7f1a6c144640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a640a71c0 0x7f1a640a1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:56.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.010+0000 7f1a6c144640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1a6406dd50 con 0x7f1a640a71c0 2024-09-11T23:06:56.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.010+0000 7f1a69ee0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a640a71c0 0x7f1a640a1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:56.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.010+0000 7f1a69ee0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a640a71c0 0x7f1a640a1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57618/0 (socket says 172.21.15.12:57618) 2024-09-11T23:06:56.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.010+0000 7f1a69ee0640 1 -- 172.21.15.12:0/3432646625 learned_addr learned my addr 172.21.15.12:0/3432646625 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:56.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.010+0000 7f1a69ee0640 1 -- 172.21.15.12:0/3432646625 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a640a0650 con 0x7f1a640a71c0 2024-09-11T23:06:56.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.014+0000 7f1a69ee0640 1 --2- 172.21.15.12:0/3432646625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a640a71c0 0x7f1a640a1090 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f1a6000c450 tx=0x7f1a6000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:56.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.014+0000 7f1a5a7fc640 1 -- 172.21.15.12:0/3432646625 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a60017070 con 0x7f1a640a71c0 2024-09-11T23:06:56.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.014+0000 7f1a5a7fc640 1 -- 172.21.15.12:0/3432646625 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a60005c20 con 0x7f1a640a71c0 2024-09-11T23:06:56.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.014+0000 7f1a6c144640 1 -- 172.21.15.12:0/3432646625 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a6409eaf0 con 0x7f1a640a71c0 2024-09-11T23:06:56.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.014+0000 7f1a5a7fc640 1 -- 172.21.15.12:0/3432646625 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a60007070 con 0x7f1a640a71c0 2024-09-11T23:06:56.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.014+0000 7f1a6c144640 1 -- 172.21.15.12:0/3432646625 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a6409e810 con 0x7f1a640a71c0 2024-09-11T23:06:56.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.014+0000 7f1a6c144640 1 -- 172.21.15.12:0/3432646625 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a640a75a0 con 0x7f1a640a71c0 2024-09-11T23:06:56.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.014+0000 7f1a5a7fc640 1 -- 172.21.15.12:0/3432646625 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 39) ==== 44053+0+0 (secure 0 0 0) 0x7f1a6001a070 con 0x7f1a640a71c0 2024-09-11T23:06:56.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.014+0000 7f1a5a7fc640 1 --2- 172.21.15.12:0/3432646625 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f1a48035db0 0x7f1a48038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:56.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.014+0000 7f1a5a7fc640 1 -- 172.21.15.12:0/3432646625 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 2974+0+0 (secure 0 0 0) 0x7f1a600476f0 con 0x7f1a640a71c0 2024-09-11T23:06:56.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.014+0000 7f1a696df640 1 --2- 172.21.15.12:0/3432646625 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f1a48035db0 0x7f1a48038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:56.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.014+0000 7f1a696df640 1 --2- 172.21.15.12:0/3432646625 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f1a48035db0 0x7f1a48038270 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1a540ad000 tx=0x7f1a540a6000 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:56.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.018+0000 7f1a5a7fc640 1 -- 172.21.15.12:0/3432646625 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1a60007210 con 0x7f1a640a71c0 2024-09-11T23:06:56.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.182+0000 7f1a6c144640 1 -- 172.21.15.12:0/3432646625 --> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f1a64073390 con 0x7f1a48035db0 2024-09-11T23:06:56.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.182+0000 7f1a5a7fc640 1 -- 172.21.15.12:0/3432646625 <== mgr.5090 v2:172.21.15.12:6828/1853698227 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f1a64073390 con 0x7f1a48035db0 2024-09-11T23:06:56.186 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 2 to deep-scrub 2024-09-11T23:06:56.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.182+0000 7f1a6c144640 1 -- 172.21.15.12:0/3432646625 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f1a48035db0 msgr2=0x7f1a48038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:56.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.182+0000 7f1a6c144640 1 --2- 172.21.15.12:0/3432646625 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f1a48035db0 0x7f1a48038270 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1a540ad000 tx=0x7f1a540a6000 comp rx=0 tx=0).stop 2024-09-11T23:06:56.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.182+0000 7f1a6c144640 1 -- 172.21.15.12:0/3432646625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a640a71c0 msgr2=0x7f1a640a1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:56.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.182+0000 7f1a6c144640 1 --2- 172.21.15.12:0/3432646625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a640a71c0 0x7f1a640a1090 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f1a6000c450 tx=0x7f1a6000c910 comp rx=0 tx=0).stop 2024-09-11T23:06:56.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.182+0000 7f1a6c144640 1 -- 172.21.15.12:0/3432646625 shutdown_connections 2024-09-11T23:06:56.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.182+0000 7f1a6c144640 1 --2- 172.21.15.12:0/3432646625 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f1a48035db0 0x7f1a48038270 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:56.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.182+0000 7f1a6c144640 1 --2- 172.21.15.12:0/3432646625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a640a71c0 0x7f1a640a1090 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:56.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.182+0000 7f1a6c144640 1 -- 172.21.15.12:0/3432646625 >> 172.21.15.12:0/3432646625 conn(0x7f1a640ac4f0 msgr2=0x7f1a641398a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:56.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.182+0000 7f1a6c144640 1 -- 172.21.15.12:0/3432646625 shutdown_connections 2024-09-11T23:06:56.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.182+0000 7f1a6c144640 1 -- 172.21.15.12:0/3432646625 wait complete. 2024-09-11T23:06:56.204 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:06:56.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.318+0000 7fec68823640 1 Processor -- start 2024-09-11T23:06:56.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.318+0000 7fec68823640 1 -- start start 2024-09-11T23:06:56.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.318+0000 7fec68823640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fec6409f6e0 0x7fec6413cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:56.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.318+0000 7fec68823640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec6409e930 con 0x7fec64137e60 2024-09-11T23:06:56.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.318+0000 7fec68823640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fec641379e0 con 0x7fec6409f6e0 2024-09-11T23:06:56.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.322+0000 7fec61d9b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fec6409f6e0 0x7fec6413cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:56.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.322+0000 7fec61d9b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fec6409f6e0 0x7fec6413cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57622/0 (socket says 172.21.15.12:57622) 2024-09-11T23:06:56.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.322+0000 7fec61d9b640 1 -- 172.21.15.12:0/3393202487 learned_addr learned my addr 172.21.15.12:0/3393202487 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:56.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.322+0000 7fec61d9b640 1 -- 172.21.15.12:0/3393202487 >> v1:172.21.15.12:6789/0 conn(0x7fec64137e60 legacy=0x7fec64138240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:56.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.322+0000 7fec61d9b640 1 -- 172.21.15.12:0/3393202487 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec6409d910 con 0x7fec6409f6e0 2024-09-11T23:06:56.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.322+0000 7fec61d9b640 1 --2- 172.21.15.12:0/3393202487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec6409f6e0 0x7fec6413cc60 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fec580097f0 tx=0x7fec5801c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a843896532ec273 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:56.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.322+0000 7fec6159a640 1 -- 172.21.15.12:0/3393202487 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec580aa590 con 0x7fec6409f6e0 2024-09-11T23:06:56.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.322+0000 7fec6159a640 1 -- 172.21.15.12:0/3393202487 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec580af070 con 0x7fec6409f6e0 2024-09-11T23:06:56.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.322+0000 7fec6159a640 1 -- 172.21.15.12:0/3393202487 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec580aa880 con 0x7fec6409f6e0 2024-09-11T23:06:56.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.322+0000 7fec68823640 1 -- 172.21.15.12:0/3393202487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec6409f6e0 msgr2=0x7fec6413cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:56.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.322+0000 7fec68823640 1 --2- 172.21.15.12:0/3393202487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec6409f6e0 0x7fec6413cc60 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fec580097f0 tx=0x7fec5801c4e0 comp rx=0 tx=0).stop 2024-09-11T23:06:56.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.322+0000 7fec68823640 1 -- 172.21.15.12:0/3393202487 shutdown_connections 2024-09-11T23:06:56.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.322+0000 7fec68823640 1 --2- 172.21.15.12:0/3393202487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec6409f6e0 0x7fec6413cc60 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:56.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.322+0000 7fec68823640 1 -- 172.21.15.12:0/3393202487 >> 172.21.15.12:0/3393202487 conn(0x7fec640a8450 msgr2=0x7fec640a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:56.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.322+0000 7fec68823640 1 -- 172.21.15.12:0/3393202487 shutdown_connections 2024-09-11T23:06:56.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.322+0000 7fec68823640 1 -- 172.21.15.12:0/3393202487 wait complete. 2024-09-11T23:06:56.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.326+0000 7fec68823640 1 Processor -- start 2024-09-11T23:06:56.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.326+0000 7fec68823640 1 -- start start 2024-09-11T23:06:56.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.326+0000 7fec68823640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec6409f6e0 0x7fec6406fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:56.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.326+0000 7fec68823640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fec6413fd50 con 0x7fec6409f6e0 2024-09-11T23:06:56.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.326+0000 7fec6259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec6409f6e0 0x7fec6406fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:56.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.326+0000 7fec6259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec6409f6e0 0x7fec6406fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57628/0 (socket says 172.21.15.12:57628) 2024-09-11T23:06:56.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.326+0000 7fec6259c640 1 -- 172.21.15.12:0/800878026 learned_addr learned my addr 172.21.15.12:0/800878026 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:06:56.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.326+0000 7fec6259c640 1 -- 172.21.15.12:0/800878026 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec641350d0 con 0x7fec6409f6e0 2024-09-11T23:06:56.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.326+0000 7fec6259c640 1 --2- 172.21.15.12:0/800878026 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec6409f6e0 0x7fec6406fc40 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fec5400c480 tx=0x7fec5400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:56.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.326+0000 7fec52ffd640 1 -- 172.21.15.12:0/800878026 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec54005150 con 0x7fec6409f6e0 2024-09-11T23:06:56.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.326+0000 7fec52ffd640 1 -- 172.21.15.12:0/800878026 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec540052f0 con 0x7fec6409f6e0 2024-09-11T23:06:56.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.326+0000 7fec68823640 1 -- 172.21.15.12:0/800878026 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec6411e2e0 con 0x7fec6409f6e0 2024-09-11T23:06:56.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.326+0000 7fec52ffd640 1 -- 172.21.15.12:0/800878026 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec54007030 con 0x7fec6409f6e0 2024-09-11T23:06:56.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.326+0000 7fec68823640 1 -- 172.21.15.12:0/800878026 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec64073560 con 0x7fec6409f6e0 2024-09-11T23:06:56.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.326+0000 7fec52ffd640 1 -- 172.21.15.12:0/800878026 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 39) ==== 44053+0+0 (secure 0 0 0) 0x7fec54019020 con 0x7fec6409f6e0 2024-09-11T23:06:56.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.326+0000 7fec52ffd640 1 --2- 172.21.15.12:0/800878026 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7fec44035db0 0x7fec44038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:06:56.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.326+0000 7fec68823640 1 -- 172.21.15.12:0/800878026 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec6411efb0 con 0x7fec6409f6e0 2024-09-11T23:06:56.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.326+0000 7fec52ffd640 1 -- 172.21.15.12:0/800878026 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 2974+0+0 (secure 0 0 0) 0x7fec540476f0 con 0x7fec6409f6e0 2024-09-11T23:06:56.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.326+0000 7fec61d9b640 1 --2- 172.21.15.12:0/800878026 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7fec44035db0 0x7fec44038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:06:56.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.326+0000 7fec61d9b640 1 --2- 172.21.15.12:0/800878026 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7fec44035db0 0x7fec44038270 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fec580ae000 tx=0x7fec580a7000 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:06:56.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.330+0000 7fec52ffd640 1 -- 172.21.15.12:0/800878026 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fec5401a560 con 0x7fec6409f6e0 2024-09-11T23:06:56.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.490+0000 7fec68823640 1 -- 172.21.15.12:0/800878026 --> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fec64071a00 con 0x7fec44035db0 2024-09-11T23:06:56.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.490+0000 7fec52ffd640 1 -- 172.21.15.12:0/800878026 <== mgr.5090 v2:172.21.15.12:6828/1853698227 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+9676 (secure 0 0 0) 0x7fec64071a00 con 0x7fec44035db0 2024-09-11T23:06:56.493 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:06:56.494 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-11T23:06:56.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.490+0000 7fec68823640 1 -- 172.21.15.12:0/800878026 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7fec44035db0 msgr2=0x7fec44038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:56.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.490+0000 7fec68823640 1 --2- 172.21.15.12:0/800878026 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7fec44035db0 0x7fec44038270 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fec580ae000 tx=0x7fec580a7000 comp rx=0 tx=0).stop 2024-09-11T23:06:56.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.490+0000 7fec68823640 1 -- 172.21.15.12:0/800878026 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec6409f6e0 msgr2=0x7fec6406fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:06:56.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.490+0000 7fec68823640 1 --2- 172.21.15.12:0/800878026 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec6409f6e0 0x7fec6406fc40 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fec5400c480 tx=0x7fec5400c940 comp rx=0 tx=0).stop 2024-09-11T23:06:56.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.490+0000 7fec68823640 1 -- 172.21.15.12:0/800878026 shutdown_connections 2024-09-11T23:06:56.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.490+0000 7fec68823640 1 --2- 172.21.15.12:0/800878026 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7fec44035db0 0x7fec44038270 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:56.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.490+0000 7fec68823640 1 --2- 172.21.15.12:0/800878026 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec6409f6e0 0x7fec6406fc40 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:06:56.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.490+0000 7fec68823640 1 -- 172.21.15.12:0/800878026 >> 172.21.15.12:0/800878026 conn(0x7fec640a8450 msgr2=0x7fec640a7260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:06:56.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.490+0000 7fec68823640 1 -- 172.21.15.12:0/800878026 shutdown_connections 2024-09-11T23:06:56.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:06:56.490+0000 7fec68823640 1 -- 172.21.15.12:0/800878026 wait complete. 2024-09-11T23:06:56.511 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":7,"stamp":"2024-09-11T23:06:55.943858+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":732,"num_read_kb":1438,"num_write":259,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3014,"ondisk_log_size":3014,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":2,"kb":283115520,"kb_used":121656,"kb_used_data":3128,"kb_used_omap":4,"kb_used_meta":118459,"kb_avail":282993864,"statfs":{"total":289910292480,"available":289785716736,"internally_reserved":0,"allocated":3203072,"data_stored":1984937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":121302351},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":206,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.001656"},"pg_stats":[{"pgid":"1.0","version":"71'3014","reported_seq":3374,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:06:52.035096+0000","last_change":"2024-09-11T23:03:26.382905+0000","last_active":"2024-09-11T23:06:52.035096+0000","last_peered":"2024-09-11T23:06:52.035096+0000","last_clean":"2024-09-11T23:06:52.035096+0000","last_became_active":"2024-09-11T23:03:26.380590+0000","last_became_peered":"2024-09-11T23:03:26.380590+0000","last_unstale":"2024-09-11T23:06:52.035096+0000","last_undegraded":"2024-09-11T23:06:52.035096+0000","last_fullsized":"2024-09-11T23:06:52.035096+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:03:24.361793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:03:24.361793+0000","last_clean_scrub_stamp":"2024-09-11T23:03:24.361793+0000","objects_scrubbed":0,"log_size":3014,"log_dups_size":0,"ondisk_log_size":3014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":732,"num_read_kb":1438,"num_write":259,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":732,"num_read_kb":1438,"num_write":259,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3014,"ondisk_log_size":3014,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":8,"seq":34359738410,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44912,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326928,"statfs":{"total":96636764160,"available":96590774272,"internally_reserved":0,"allocated":1265664,"data_stored":858435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738410,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31844,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339996,"statfs":{"total":96636764160,"available":96604155904,"internally_reserved":0,"allocated":671744,"data_stored":268067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738410,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44900,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326940,"statfs":{"total":96636764160,"available":96590786560,"internally_reserved":0,"allocated":1265664,"data_stored":858435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:06:56.515 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-11T23:03:24.361793+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=23, tm_min=3, tm_sec=24, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=23, tm_min=6, tm_sec=53, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T23:06:56.515 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-11T23:07:16.516 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:07:16.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.646+0000 7f938979a640 1 Processor -- start 2024-09-11T23:07:16.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.646+0000 7f938979a640 1 -- start start 2024-09-11T23:07:16.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.650+0000 7f938979a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9384137e60 0x7f9384138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:07:16.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.650+0000 7f938979a640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f938409e930 con 0x7f938409f6e0 2024-09-11T23:07:16.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.650+0000 7f938979a640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f93841379e0 con 0x7f9384137e60 2024-09-11T23:07:16.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.650+0000 7f9382ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9384137e60 0x7f9384138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:07:16.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.650+0000 7f937bfff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f938409f6e0 0x7f93840a36a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38242/0 (socket says 172.21.15.12:38242) 2024-09-11T23:07:16.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.650+0000 7f937bfff640 1 -- 172.21.15.12:0/1701335871 learned_addr learned my addr 172.21.15.12:0/1701335871 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:07:16.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.650+0000 7f93827fc640 1 -- 172.21.15.12:0/1701335871 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1455292458 0 0) 0x7f938409e930 con 0x7f938409f6e0 2024-09-11T23:07:16.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.650+0000 7f93827fc640 1 -- 172.21.15.12:0/1701335871 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9370003530 con 0x7f938409f6e0 2024-09-11T23:07:16.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.650+0000 7f9382ffd640 1 -- 172.21.15.12:0/1701335871 >> v1:172.21.15.12:6789/0 conn(0x7f938409f6e0 legacy=0x7f93840a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:07:16.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.650+0000 7f9382ffd640 1 -- 172.21.15.12:0/1701335871 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f938409d910 con 0x7f9384137e60 2024-09-11T23:07:16.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.650+0000 7f9382ffd640 1 --2- 172.21.15.12:0/1701335871 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9384137e60 0x7f9384138240 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f936c009740 tx=0x7f936c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a7fbba885f3d50a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:07:16.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.650+0000 7f93827fc640 1 -- 172.21.15.12:0/1701335871 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f936c0ab570 con 0x7f9384137e60 2024-09-11T23:07:16.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.650+0000 7f93827fc640 1 -- 172.21.15.12:0/1701335871 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f936c0b0070 con 0x7f9384137e60 2024-09-11T23:07:16.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.650+0000 7f93827fc640 1 -- 172.21.15.12:0/1701335871 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f936c0ab840 con 0x7f9384137e60 2024-09-11T23:07:16.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.650+0000 7f938979a640 1 -- 172.21.15.12:0/1701335871 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9384137e60 msgr2=0x7f9384138240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:07:16.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.650+0000 7f938979a640 1 --2- 172.21.15.12:0/1701335871 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9384137e60 0x7f9384138240 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f936c009740 tx=0x7f936c01c420 comp rx=0 tx=0).stop 2024-09-11T23:07:16.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.654+0000 7f938979a640 1 -- 172.21.15.12:0/1701335871 shutdown_connections 2024-09-11T23:07:16.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.654+0000 7f938979a640 1 --2- 172.21.15.12:0/1701335871 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9384137e60 0x7f9384138240 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:07:16.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.654+0000 7f938979a640 1 -- 172.21.15.12:0/1701335871 >> 172.21.15.12:0/1701335871 conn(0x7f93840a8450 msgr2=0x7f93840a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:07:16.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.654+0000 7f938979a640 1 -- 172.21.15.12:0/1701335871 shutdown_connections 2024-09-11T23:07:16.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.654+0000 7f938979a640 1 -- 172.21.15.12:0/1701335871 wait complete. 2024-09-11T23:07:16.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.654+0000 7f938979a640 1 Processor -- start 2024-09-11T23:07:16.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.654+0000 7f938979a640 1 -- start start 2024-09-11T23:07:16.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.654+0000 7f938979a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f938409f6e0 0x7f9384132970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:07:16.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.654+0000 7f938979a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f938413fe00 con 0x7f938409f6e0 2024-09-11T23:07:16.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.654+0000 7f9382ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f938409f6e0 0x7f9384132970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:07:16.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.654+0000 7f9382ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f938409f6e0 0x7f9384132970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39244/0 (socket says 172.21.15.12:39244) 2024-09-11T23:07:16.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.654+0000 7f9382ffd640 1 -- 172.21.15.12:0/3130412357 learned_addr learned my addr 172.21.15.12:0/3130412357 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:07:16.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.654+0000 7f9382ffd640 1 -- 172.21.15.12:0/3130412357 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9384070920 con 0x7f938409f6e0 2024-09-11T23:07:16.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.654+0000 7f9382ffd640 1 --2- 172.21.15.12:0/3130412357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f938409f6e0 0x7f9384132970 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f936c0ad040 tx=0x7f936c01ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:07:16.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.654+0000 7f937b7fe640 1 -- 172.21.15.12:0/3130412357 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f936c0abca0 con 0x7f938409f6e0 2024-09-11T23:07:16.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.654+0000 7f937b7fe640 1 -- 172.21.15.12:0/3130412357 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f936c0abe40 con 0x7f938409f6e0 2024-09-11T23:07:16.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.654+0000 7f938979a640 1 -- 172.21.15.12:0/3130412357 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93840715d0 con 0x7f938409f6e0 2024-09-11T23:07:16.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.654+0000 7f937b7fe640 1 -- 172.21.15.12:0/3130412357 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f936c0bf540 con 0x7f938409f6e0 2024-09-11T23:07:16.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.654+0000 7f938979a640 1 -- 172.21.15.12:0/3130412357 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f938413bfb0 con 0x7f938409f6e0 2024-09-11T23:07:16.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.654+0000 7f937b7fe640 1 -- 172.21.15.12:0/3130412357 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 39) ==== 44053+0+0 (secure 0 0 0) 0x7f936c0bd020 con 0x7f938409f6e0 2024-09-11T23:07:16.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.654+0000 7f938979a640 1 -- 172.21.15.12:0/3130412357 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93840710e0 con 0x7f938409f6e0 2024-09-11T23:07:16.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.654+0000 7f937b7fe640 1 --2- 172.21.15.12:0/3130412357 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f9364035db0 0x7f9364038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:07:16.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.654+0000 7f937b7fe640 1 -- 172.21.15.12:0/3130412357 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 2974+0+0 (secure 0 0 0) 0x7f936c0e29f0 con 0x7f938409f6e0 2024-09-11T23:07:16.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.654+0000 7f937bfff640 1 --2- 172.21.15.12:0/3130412357 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f9364035db0 0x7f9364038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:07:16.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.658+0000 7f937bfff640 1 --2- 172.21.15.12:0/3130412357 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f9364035db0 0x7f9364038270 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9374000f70 tx=0x7f93740010b0 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:07:16.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.662+0000 7f937b7fe640 1 -- 172.21.15.12:0/3130412357 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f936c0e4e20 con 0x7f938409f6e0 2024-09-11T23:07:16.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.818+0000 7f938979a640 1 -- 172.21.15.12:0/3130412357 --> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f938406bc60 con 0x7f9364035db0 2024-09-11T23:07:16.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.822+0000 7f937b7fe640 1 -- 172.21.15.12:0/3130412357 <== mgr.5090 v2:172.21.15.12:6828/1853698227 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+9671 (secure 0 0 0) 0x7f938406bc60 con 0x7f9364035db0 2024-09-11T23:07:16.825 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:07:16.826 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-11T23:07:16.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.822+0000 7f938979a640 1 -- 172.21.15.12:0/3130412357 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f9364035db0 msgr2=0x7f9364038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:07:16.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.822+0000 7f938979a640 1 --2- 172.21.15.12:0/3130412357 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f9364035db0 0x7f9364038270 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9374000f70 tx=0x7f93740010b0 comp rx=0 tx=0).stop 2024-09-11T23:07:16.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.822+0000 7f938979a640 1 -- 172.21.15.12:0/3130412357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f938409f6e0 msgr2=0x7f9384132970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:07:16.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.822+0000 7f938979a640 1 --2- 172.21.15.12:0/3130412357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f938409f6e0 0x7f9384132970 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f936c0ad040 tx=0x7f936c01ac60 comp rx=0 tx=0).stop 2024-09-11T23:07:16.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.822+0000 7f938979a640 1 -- 172.21.15.12:0/3130412357 shutdown_connections 2024-09-11T23:07:16.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.822+0000 7f938979a640 1 --2- 172.21.15.12:0/3130412357 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f9364035db0 0x7f9364038270 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:07:16.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.822+0000 7f938979a640 1 --2- 172.21.15.12:0/3130412357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f938409f6e0 0x7f9384132970 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:07:16.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.822+0000 7f938979a640 1 -- 172.21.15.12:0/3130412357 >> 172.21.15.12:0/3130412357 conn(0x7f93840a8450 msgr2=0x7f9384134800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:07:16.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.822+0000 7f938979a640 1 -- 172.21.15.12:0/3130412357 shutdown_connections 2024-09-11T23:07:16.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.822+0000 7f938979a640 1 -- 172.21.15.12:0/3130412357 wait complete. 2024-09-11T23:07:16.845 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2024-09-11T23:07:15.948581+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":732,"num_read_kb":1438,"num_write":259,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3015,"ondisk_log_size":3015,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":2,"kb":283115520,"kb_used":121644,"kb_used_data":3128,"kb_used_omap":4,"kb_used_meta":118459,"kb_avail":282993876,"statfs":{"total":289910292480,"available":289785729024,"internally_reserved":0,"allocated":3203072,"data_stored":1984937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":121302351},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002932"},"pg_stats":[{"pgid":"1.0","version":"71'3015","reported_seq":3383,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:06:56.219640+0000","last_change":"2024-09-11T23:06:56.219681+0000","last_active":"2024-09-11T23:06:56.219640+0000","last_peered":"2024-09-11T23:06:56.219640+0000","last_clean":"2024-09-11T23:06:56.219640+0000","last_became_active":"2024-09-11T23:03:26.380590+0000","last_became_peered":"2024-09-11T23:03:26.380590+0000","last_unstale":"2024-09-11T23:06:56.219640+0000","last_undegraded":"2024-09-11T23:06:56.219640+0000","last_fullsized":"2024-09-11T23:06:56.219640+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'3015","last_scrub_stamp":"2024-09-11T23:06:56.219533+0000","last_deep_scrub":"71'3015","last_deep_scrub_stamp":"2024-09-11T23:06:56.219533+0000","last_clean_scrub_stamp":"2024-09-11T23:06:56.219533+0000","objects_scrubbed":2,"log_size":3015,"log_dups_size":0,"ondisk_log_size":3015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:23.735660+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":732,"num_read_kb":1438,"num_write":259,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":732,"num_read_kb":1438,"num_write":259,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3015,"ondisk_log_size":3015,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":8,"seq":34359738414,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44900,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326940,"statfs":{"total":96636764160,"available":96590786560,"internally_reserved":0,"allocated":1265664,"data_stored":858435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738414,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31844,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339996,"statfs":{"total":96636764160,"available":96604155904,"internally_reserved":0,"allocated":671744,"data_stored":268067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738414,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44900,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326940,"statfs":{"total":96636764160,"available":96590786560,"internally_reserved":0,"allocated":1265664,"data_stored":858435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:07:16.846 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-11T23:07:16.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.970+0000 7f8995689640 1 Processor -- start 2024-09-11T23:07:16.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.970+0000 7f8995689640 1 -- start start 2024-09-11T23:07:16.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.970+0000 7f8995689640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8990137de0 0x7f899009f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:07:16.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.970+0000 7f8995689640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f899009d690 con 0x7f89901381c0 2024-09-11T23:07:16.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.970+0000 7f8995689640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f899009ea90 con 0x7f8990137de0 2024-09-11T23:07:16.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.970+0000 7f898effd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8990137de0 0x7f899009f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:07:16.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.970+0000 7f898effd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8990137de0 0x7f899009f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39258/0 (socket says 172.21.15.12:39258) 2024-09-11T23:07:16.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.970+0000 7f898effd640 1 -- 172.21.15.12:0/1972265020 learned_addr learned my addr 172.21.15.12:0/1972265020 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:07:16.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.974+0000 7f898effd640 1 -- 172.21.15.12:0/1972265020 >> v1:172.21.15.12:6789/0 conn(0x7f89901381c0 legacy=0x7f89900a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:07:16.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.974+0000 7f898effd640 1 -- 172.21.15.12:0/1972265020 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f899009f6d0 con 0x7f8990137de0 2024-09-11T23:07:16.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.974+0000 7f898effd640 1 --2- 172.21.15.12:0/1972265020 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8990137de0 0x7f899009f190 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f8980009e50 tx=0x7f898001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=717832b74eb44c2e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:07:16.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.974+0000 7f898dffb640 1 -- 172.21.15.12:0/1972265020 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8980009200 con 0x7f8990137de0 2024-09-11T23:07:16.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.974+0000 7f898dffb640 1 -- 172.21.15.12:0/1972265020 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89800a5610 con 0x7f8990137de0 2024-09-11T23:07:16.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.974+0000 7f898dffb640 1 -- 172.21.15.12:0/1972265020 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89800a5910 con 0x7f8990137de0 2024-09-11T23:07:16.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.974+0000 7f8995689640 1 -- 172.21.15.12:0/1972265020 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8990137de0 msgr2=0x7f899009f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:07:16.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.974+0000 7f8995689640 1 --2- 172.21.15.12:0/1972265020 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8990137de0 0x7f899009f190 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f8980009e50 tx=0x7f898001c9a0 comp rx=0 tx=0).stop 2024-09-11T23:07:16.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.974+0000 7f8995689640 1 -- 172.21.15.12:0/1972265020 shutdown_connections 2024-09-11T23:07:16.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.974+0000 7f8995689640 1 --2- 172.21.15.12:0/1972265020 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8990137de0 0x7f899009f190 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:07:16.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.974+0000 7f8995689640 1 -- 172.21.15.12:0/1972265020 >> 172.21.15.12:0/1972265020 conn(0x7f89900a82f0 msgr2=0x7f89900a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:07:16.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.974+0000 7f8995689640 1 -- 172.21.15.12:0/1972265020 shutdown_connections 2024-09-11T23:07:16.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.974+0000 7f8995689640 1 -- 172.21.15.12:0/1972265020 wait complete. 2024-09-11T23:07:16.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.978+0000 7f8995689640 1 Processor -- start 2024-09-11T23:07:16.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.978+0000 7f8995689640 1 -- start start 2024-09-11T23:07:16.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.978+0000 7f8995689640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8990137de0 0x7f89901d1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:07:16.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.978+0000 7f8995689640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f899009e7d0 con 0x7f8990137de0 2024-09-11T23:07:16.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.978+0000 7f898effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8990137de0 0x7f89901d1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:07:16.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.978+0000 7f898effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8990137de0 0x7f89901d1bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39272/0 (socket says 172.21.15.12:39272) 2024-09-11T23:07:16.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.978+0000 7f898effd640 1 -- 172.21.15.12:0/2293994582 learned_addr learned my addr 172.21.15.12:0/2293994582 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:07:16.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.978+0000 7f898effd640 1 -- 172.21.15.12:0/2293994582 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8990072480 con 0x7f8990137de0 2024-09-11T23:07:16.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.978+0000 7f898effd640 1 --2- 172.21.15.12:0/2293994582 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8990137de0 0x7f89901d1bd0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f89800195b0 tx=0x7f8980019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:07:16.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.978+0000 7f89777fe640 1 -- 172.21.15.12:0/2293994582 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89800bc020 con 0x7f8990137de0 2024-09-11T23:07:16.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.978+0000 7f89777fe640 1 -- 172.21.15.12:0/2293994582 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89800b8470 con 0x7f8990137de0 2024-09-11T23:07:16.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.978+0000 7f8995689640 1 -- 172.21.15.12:0/2293994582 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f899009c600 con 0x7f8990137de0 2024-09-11T23:07:16.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.978+0000 7f89777fe640 1 -- 172.21.15.12:0/2293994582 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89800b8770 con 0x7f8990137de0 2024-09-11T23:07:16.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.978+0000 7f8995689640 1 -- 172.21.15.12:0/2293994582 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8990070390 con 0x7f8990137de0 2024-09-11T23:07:16.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.978+0000 7f8995689640 1 -- 172.21.15.12:0/2293994582 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f899009f190 con 0x7f8990137de0 2024-09-11T23:07:16.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.982+0000 7f89777fe640 1 -- 172.21.15.12:0/2293994582 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 39) ==== 44053+0+0 (secure 0 0 0) 0x7f89800bf020 con 0x7f8990137de0 2024-09-11T23:07:16.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.982+0000 7f89777fe640 1 --2- 172.21.15.12:0/2293994582 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f897c035db0 0x7f897c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:07:16.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.982+0000 7f89777fe640 1 -- 172.21.15.12:0/2293994582 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 2974+0+0 (secure 0 0 0) 0x7f89800e3850 con 0x7f8990137de0 2024-09-11T23:07:16.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.982+0000 7f898e7fc640 1 --2- 172.21.15.12:0/2293994582 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f897c035db0 0x7f897c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:07:16.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.982+0000 7f898e7fc640 1 --2- 172.21.15.12:0/2293994582 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f897c035db0 0x7f897c038270 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8984001590 tx=0x7f8984007a60 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:07:16.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:16.986+0000 7f89777fe640 1 -- 172.21.15.12:0/2293994582 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f89800c6030 con 0x7f8990137de0 2024-09-11T23:07:17.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.150+0000 7f8995689640 1 -- 172.21.15.12:0/2293994582 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f899006bc60 con 0x7f8990137de0 2024-09-11T23:07:17.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.154+0000 7f89777fe640 1 -- 172.21.15.12:0/2293994582 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v13)=0 v13) ==== 123+0+0 (secure 0 0 0) 0x7f8980016620 con 0x7f8990137de0 2024-09-11T23:07:17.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.154+0000 7f89777fe640 1 -- 172.21.15.12:0/2293994582 <== mon.0 v2:172.21.15.12:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f89800b89c0 con 0x7f8990137de0 2024-09-11T23:07:17.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.158+0000 7f8995689640 1 -- 172.21.15.12:0/2293994582 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f897c035db0 msgr2=0x7f897c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:07:17.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.158+0000 7f8995689640 1 --2- 172.21.15.12:0/2293994582 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f897c035db0 0x7f897c038270 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8984001590 tx=0x7f8984007a60 comp rx=0 tx=0).stop 2024-09-11T23:07:17.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.158+0000 7f8995689640 1 -- 172.21.15.12:0/2293994582 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8990137de0 msgr2=0x7f89901d1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:07:17.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.158+0000 7f8995689640 1 --2- 172.21.15.12:0/2293994582 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8990137de0 0x7f89901d1bd0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f89800195b0 tx=0x7f8980019740 comp rx=0 tx=0).stop 2024-09-11T23:07:17.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.158+0000 7f8995689640 1 -- 172.21.15.12:0/2293994582 shutdown_connections 2024-09-11T23:07:17.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.158+0000 7f8995689640 1 --2- 172.21.15.12:0/2293994582 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f897c035db0 0x7f897c038270 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:07:17.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.158+0000 7f8995689640 1 --2- 172.21.15.12:0/2293994582 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8990137de0 0x7f89901d1bd0 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:07:17.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.158+0000 7f8995689640 1 -- 172.21.15.12:0/2293994582 >> 172.21.15.12:0/2293994582 conn(0x7f89900a82f0 msgr2=0x7f89900a7480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:07:17.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.158+0000 7f8995689640 1 -- 172.21.15.12:0/2293994582 shutdown_connections 2024-09-11T23:07:17.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.158+0000 7f8995689640 1 -- 172.21.15.12:0/2293994582 wait complete. 2024-09-11T23:07:17.179 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T23:07:17.179 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:07:17.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.294+0000 7f7fe69ef640 1 Processor -- start 2024-09-11T23:07:17.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.294+0000 7f7fe69ef640 1 -- start start 2024-09-11T23:07:17.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.294+0000 7f7fe69ef640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7fe00a4b80 0x7f7fe00a7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:07:17.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.294+0000 7f7fe69ef640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fe00a82a0 con 0x7f7fe013a410 2024-09-11T23:07:17.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.294+0000 7f7fe69ef640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f7fe00a3cb0 con 0x7f7fe00a4b80 2024-09-11T23:07:17.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.294+0000 7f7fd77fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7fe00a4b80 0x7f7fe00a7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:07:17.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.294+0000 7f7fdffff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f7fe013a410 0x7f7fe00a6af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38256/0 (socket says 172.21.15.12:38256) 2024-09-11T23:07:17.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.294+0000 7f7fdffff640 1 -- 172.21.15.12:0/471710613 learned_addr learned my addr 172.21.15.12:0/471710613 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-11T23:07:17.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.294+0000 7f7fd77fe640 1 -- 172.21.15.12:0/471710613 >> v1:172.21.15.12:6789/0 conn(0x7f7fe013a410 legacy=0x7f7fe00a6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:07:17.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.294+0000 7f7fd77fe640 1 -- 172.21.15.12:0/471710613 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fe0139fe0 con 0x7f7fe00a4b80 2024-09-11T23:07:17.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.294+0000 7f7fdf7fe640 1 -- 172.21.15.12:0/471710613 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2378205146 0 0) 0x7f7fe00a82a0 con 0x7f7fe013a410 2024-09-11T23:07:17.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.294+0000 7f7fd77fe640 1 --2- 172.21.15.12:0/471710613 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fe00a4b80 0x7f7fe00a7200 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0009740 tx=0x7f7fd001c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=696bcca0a2e38cd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:07:17.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.294+0000 7f7fdf7fe640 1 -- 172.21.15.12:0/471710613 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fd00b0070 con 0x7f7fe00a4b80 2024-09-11T23:07:17.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.294+0000 7f7fdf7fe640 1 -- 172.21.15.12:0/471710613 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f7fd00ab530 con 0x7f7fe00a4b80 2024-09-11T23:07:17.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.294+0000 7f7fdf7fe640 1 -- 172.21.15.12:0/471710613 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fd00ab850 con 0x7f7fe00a4b80 2024-09-11T23:07:17.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.298+0000 7f7fe69ef640 1 -- 172.21.15.12:0/471710613 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fe00a4b80 msgr2=0x7f7fe00a7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:07:17.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.298+0000 7f7fe69ef640 1 --2- 172.21.15.12:0/471710613 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fe00a4b80 0x7f7fe00a7200 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0009740 tx=0x7f7fd001c390 comp rx=0 tx=0).stop 2024-09-11T23:07:17.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.298+0000 7f7fe69ef640 1 -- 172.21.15.12:0/471710613 shutdown_connections 2024-09-11T23:07:17.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.298+0000 7f7fe69ef640 1 --2- 172.21.15.12:0/471710613 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fe00a4b80 0x7f7fe00a7200 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:07:17.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.298+0000 7f7fe69ef640 1 -- 172.21.15.12:0/471710613 >> 172.21.15.12:0/471710613 conn(0x7f7fe00ac2c0 msgr2=0x7f7fe00ac6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:07:17.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.298+0000 7f7fe69ef640 1 -- 172.21.15.12:0/471710613 shutdown_connections 2024-09-11T23:07:17.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.298+0000 7f7fe69ef640 1 -- 172.21.15.12:0/471710613 wait complete. 2024-09-11T23:07:17.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.298+0000 7f7fe69ef640 1 Processor -- start 2024-09-11T23:07:17.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.298+0000 7f7fe69ef640 1 -- start start 2024-09-11T23:07:17.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.298+0000 7f7fe69ef640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fe013a410 0x7f7fe009d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:07:17.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.298+0000 7f7fe69ef640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe00a7740 con 0x7f7fe013a410 2024-09-11T23:07:17.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.298+0000 7f7fdffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fe013a410 0x7f7fe009d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:07:17.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.298+0000 7f7fdffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fe013a410 0x7f7fe009d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39284/0 (socket says 172.21.15.12:39284) 2024-09-11T23:07:17.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.298+0000 7f7fdffff640 1 -- 172.21.15.12:0/1515780666 learned_addr learned my addr 172.21.15.12:0/1515780666 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-11T23:07:17.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.298+0000 7f7fdffff640 1 -- 172.21.15.12:0/1515780666 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fe009aae0 con 0x7f7fe013a410 2024-09-11T23:07:17.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.298+0000 7f7fdffff640 1 --2- 172.21.15.12:0/1515780666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fe013a410 0x7f7fe009d130 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f7fc800c420 tx=0x7f7fc800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:07:17.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.298+0000 7f7fdd7fa640 1 -- 172.21.15.12:0/1515780666 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fc8018070 con 0x7f7fe013a410 2024-09-11T23:07:17.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.298+0000 7f7fdd7fa640 1 -- 172.21.15.12:0/1515780666 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f7fc80074d0 con 0x7f7fe013a410 2024-09-11T23:07:17.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.298+0000 7f7fe69ef640 1 -- 172.21.15.12:0/1515780666 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fe009ba40 con 0x7f7fe013a410 2024-09-11T23:07:17.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.298+0000 7f7fdd7fa640 1 -- 172.21.15.12:0/1515780666 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fc8004980 con 0x7f7fe013a410 2024-09-11T23:07:17.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.298+0000 7f7fe69ef640 1 -- 172.21.15.12:0/1515780666 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fe009b690 con 0x7f7fe013a410 2024-09-11T23:07:17.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.302+0000 7f7fdd7fa640 1 -- 172.21.15.12:0/1515780666 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 39) ==== 44053+0+0 (secure 0 0 0) 0x7f7fc801b070 con 0x7f7fe013a410 2024-09-11T23:07:17.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.302+0000 7f7fe69ef640 1 -- 172.21.15.12:0/1515780666 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fe00a6af0 con 0x7f7fe013a410 2024-09-11T23:07:17.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.302+0000 7f7fdd7fa640 1 --2- 172.21.15.12:0/1515780666 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f7fc0035db0 0x7f7fc0038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:07:17.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.302+0000 7f7fdd7fa640 1 -- 172.21.15.12:0/1515780666 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 2974+0+0 (secure 0 0 0) 0x7f7fc80477e0 con 0x7f7fe013a410 2024-09-11T23:07:17.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.302+0000 7f7fd77fe640 1 --2- 172.21.15.12:0/1515780666 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f7fc0035db0 0x7f7fc0038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:07:17.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.302+0000 7f7fd77fe640 1 --2- 172.21.15.12:0/1515780666 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f7fc0035db0 0x7f7fc0038270 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7fd00ad000 tx=0x7f7fd0008040 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:07:17.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.306+0000 7f7fdd7fa640 1 -- 172.21.15.12:0/1515780666 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7fc8004db0 con 0x7f7fe013a410 2024-09-11T23:07:17.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.502+0000 7f7fe69ef640 1 -- 172.21.15.12:0/1515780666 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7fe00a2e90 con 0x7f7fe013a410 2024-09-11T23:07:17.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.502+0000 7f7fdd7fa640 1 -- 172.21.15.12:0/1515780666 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) ==== 94+0+2261 (secure 0 0 0) 0x7f7fc8011bf0 con 0x7f7fe013a410 2024-09-11T23:07:17.505 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-11T23:07:17.505 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":51,"btime":"2024-09-11T23:06:48:429218+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4978,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6826/1855322655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1855322655},{"type":"v1","addr":"172.21.15.12:6826","nonce":1855322655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":5102,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6827/1374610345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":1374610345},{"type":"v1","addr":"172.21.15.12:6827","nonce":1374610345}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51}],"filesystems":[]} 2024-09-11T23:07:17.506 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 51 2024-09-11T23:07:17.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.506+0000 7f7fe69ef640 1 -- 172.21.15.12:0/1515780666 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f7fc0035db0 msgr2=0x7f7fc0038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:07:17.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.506+0000 7f7fe69ef640 1 --2- 172.21.15.12:0/1515780666 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f7fc0035db0 0x7f7fc0038270 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7fd00ad000 tx=0x7f7fd0008040 comp rx=0 tx=0).stop 2024-09-11T23:07:17.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.506+0000 7f7fe69ef640 1 -- 172.21.15.12:0/1515780666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fe013a410 msgr2=0x7f7fe009d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:07:17.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.506+0000 7f7fe69ef640 1 --2- 172.21.15.12:0/1515780666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fe013a410 0x7f7fe009d130 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f7fc800c420 tx=0x7f7fc800c8e0 comp rx=0 tx=0).stop 2024-09-11T23:07:17.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.506+0000 7f7fe69ef640 1 -- 172.21.15.12:0/1515780666 shutdown_connections 2024-09-11T23:07:17.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.506+0000 7f7fe69ef640 1 --2- 172.21.15.12:0/1515780666 >> [v2:172.21.15.12:6828/1853698227,v1:172.21.15.12:6829/1853698227] conn(0x7f7fc0035db0 0x7f7fc0038270 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:07:17.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.506+0000 7f7fe69ef640 1 --2- 172.21.15.12:0/1515780666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fe013a410 0x7f7fe009d130 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:07:17.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.506+0000 7f7fe69ef640 1 -- 172.21.15.12:0/1515780666 >> 172.21.15.12:0/1515780666 conn(0x7f7fe00ac2c0 msgr2=0x7f7fe013f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:07:17.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.506+0000 7f7fe69ef640 1 -- 172.21.15.12:0/1515780666 shutdown_connections 2024-09-11T23:07:17.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-11T23:07:17.506+0000 7f7fe69ef640 1 -- 172.21.15.12:0/1515780666 wait complete. 2024-09-11T23:07:17.525 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-11T23:07:17.525 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-11T23:07:17.525 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-11T23:07:17.525 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:07:17.535 INFO:tasks.ceph.mds.a:Stopped 2024-09-11T23:07:17.535 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-11T23:07:17.535 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:07:17.587 INFO:tasks.ceph.mds.b:Stopped 2024-09-11T23:07:17.588 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-11T23:07:17.588 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-11T23:07:17.588 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:07:18.934 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-09-11T23:07:23.689 INFO:tasks.ceph.osd.0:Stopped 2024-09-11T23:07:23.690 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-11T23:07:23.690 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:07:23.752 INFO:tasks.ceph.osd.1:Stopped 2024-09-11T23:07:23.752 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-11T23:07:23.752 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:07:23.848 INFO:tasks.ceph.osd.2:Stopped 2024-09-11T23:07:23.849 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-11T23:07:23.849 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-11T23:07:23.849 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:07:23.883 INFO:tasks.ceph.mgr.x:Stopped 2024-09-11T23:07:23.883 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-11T23:07:23.884 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-11T23:07:23.884 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:07:23.937 INFO:tasks.ceph.mon.a:Stopped 2024-09-11T23:07:23.938 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-11T23:07:23.938 DEBUG:teuthology.orchestra.run.smithi012:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-11T23:07:23.938 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-09-11T23:07:23.938 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-09-11T23:07:23.995 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi012.front.sepia.ceph.com 2024-09-11T23:07:23.996 DEBUG:teuthology.orchestra.run.smithi012:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-11T23:07:24.307 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi012.front.sepia.ceph.com 2024-09-11T23:07:24.307 DEBUG:teuthology.orchestra.run.smithi012:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-11T23:07:24.486 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi012.front.sepia.ceph.com 2024-09-11T23:07:24.486 DEBUG:teuthology.orchestra.run.smithi012:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-11T23:07:24.628 INFO:tasks.ceph:Archiving mon data... 2024-09-11T23:07:24.630 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901448/data/mon.a.tgz 2024-09-11T23:07:24.630 DEBUG:teuthology.orchestra.run.smithi012:> mktemp 2024-09-11T23:07:24.635 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/tmp.z414PL6Z0p 2024-09-11T23:07:24.636 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.z414PL6Z0p 2024-09-11T23:07:24.828 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:07:24.884 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0666 /tmp/tmp.z414PL6Z0p 2024-09-11T23:07:24.993 DEBUG:teuthology.orchestra.remote:smithi012:/tmp/tmp.z414PL6Z0p is 1MB 2024-09-11T23:07:25.063 DEBUG:teuthology.orchestra.run.smithi012:> rm -fr /tmp/tmp.z414PL6Z0p 2024-09-11T23:07:25.069 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-11T23:07:25.069 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-11T23:07:25.173 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-11T23:07:25.173 INFO:tasks.ceph:Archiving crash dumps... 2024-09-11T23:07:25.175 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901448/remote/smithi012/crash 2024-09-11T23:07:25.176 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-11T23:07:25.232 INFO:tasks.ceph:Shutting down logrotate 2024-09-11T23:07:25.232 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:07:25.325 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-11T23:07:25.338 INFO:tasks.ceph:Compressing logs... 2024-09-11T23:07:25.338 DEBUG:teuthology.orchestra.run.smithi012:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T23:07:25.408 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35536.log 2024-09-11T23:07:25.409 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40471.log 2024-09-11T23:07:25.409 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32440.log 2024-09-11T23:07:25.409 INFO:teuthology.orchestra.run.smithi012.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.35536.log.gz 2024-09-11T23:07:25.410 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37930.log 2024-09-11T23:07:25.410 INFO:teuthology.orchestra.run.smithi012.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.40471.log.gz 2024-09-11T23:07:25.410 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.32440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37324.log 2024-09-11T23:07:25.411 INFO:teuthology.orchestra.run.smithi012.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.32440.log.gz 2024-09-11T23:07:25.412 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33900.log 2024-09-11T23:07:25.412 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37930.log: /var/log/ceph/ceph-client.admin.37324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36762.log 2024-09-11T23:07:25.412 INFO:teuthology.orchestra.run.smithi012.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.37324.log.gz 2024-09-11T23:07:25.412 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33900.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.33900.log.gz 2024-09-11T23:07:25.412 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38477.log 2024-09-11T23:07:25.412 INFO:teuthology.orchestra.run.smithi012.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.37930.log.gz 2024-09-11T23:07:25.414 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.0.36762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42263.log 2024-09-11T23:07:25.415 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40881.log 2024-09-11T23:07:25.415 INFO:teuthology.orchestra.run.smithi012.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.38477.log.gz 2024-09-11T23:07:25.415 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34435.log 2024-09-11T23:07:25.415 INFO:teuthology.orchestra.run.smithi012.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.42263.log.gz 2024-09-11T23:07:25.415 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35641.log 2024-09-11T23:07:25.415 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40881.log: /var/log/ceph/ceph-client.admin.34435.log: 92.5% -- replaced with /var/log/ceph/ceph-client.0.36762.log.gz 2024-09-11T23:07:25.415 INFO:teuthology.orchestra.run.smithi012.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.40881.log.gz 2024-09-11T23:07:25.415 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35615.log 2024-09-11T23:07:25.415 INFO:teuthology.orchestra.run.smithi012.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.34435.log.gz 2024-09-11T23:07:25.415 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40112.log 2024-09-11T23:07:25.415 INFO:teuthology.orchestra.run.smithi012.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.35641.log.gz 2024-09-11T23:07:25.415 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34552.log 2024-09-11T23:07:25.416 INFO:teuthology.orchestra.run.smithi012.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.35615.log.gz 2024-09-11T23:07:25.416 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35503.log 2024-09-11T23:07:25.420 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34552.log: gzip -5 --verbose 85.5% -- /var/log/ceph/ceph-client.admin.39349.log -- replaced with /var/log/ceph/ceph-client.admin.40112.log.gz 2024-09-11T23:07:25.420 INFO:teuthology.orchestra.run.smithi012.stderr: 2024-09-11T23:07:25.420 INFO:teuthology.orchestra.run.smithi012.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.34552.log.gz 2024-09-11T23:07:25.420 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34790.log 2024-09-11T23:07:25.420 INFO:teuthology.orchestra.run.smithi012.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.35503.log.gz 2024-09-11T23:07:25.420 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33209.log 2024-09-11T23:07:25.420 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34790.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.39349.log.gz 2024-09-11T23:07:25.420 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34409.log 2024-09-11T23:07:25.420 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33209.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.34790.log.gz 2024-09-11T23:07:25.420 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37787.log 2024-09-11T23:07:25.420 INFO:teuthology.orchestra.run.smithi012.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.33209.log.gz 2024-09-11T23:07:25.421 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38555.log 2024-09-11T23:07:25.421 INFO:teuthology.orchestra.run.smithi012.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.34409.log.gz 2024-09-11T23:07:25.421 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41549.log 2024-09-11T23:07:25.421 INFO:teuthology.orchestra.run.smithi012.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.37787.log.gz 2024-09-11T23:07:25.421 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27743.log 2024-09-11T23:07:25.421 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38555.log: /var/log/ceph/ceph-client.admin.41549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38782.log 2024-09-11T23:07:25.421 INFO:teuthology.orchestra.run.smithi012.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.38555.log.gz 2024-09-11T23:07:25.421 INFO:teuthology.orchestra.run.smithi012.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.41549.log.gz 2024-09-11T23:07:25.421 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.27743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32663.log 2024-09-11T23:07:25.421 INFO:teuthology.orchestra.run.smithi012.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.27743.log.gz 2024-09-11T23:07:25.421 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33053.log 2024-09-11T23:07:25.421 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38782.log: /var/log/ceph/ceph-client.admin.32663.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.38782.log.gz 2024-09-11T23:07:25.421 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-11T23:07:25.421 INFO:teuthology.orchestra.run.smithi012.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.32663.log.gz 2024-09-11T23:07:25.429 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34712.log 2024-09-11T23:07:25.429 INFO:teuthology.orchestra.run.smithi012.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.33053.log.gz 2024-09-11T23:07:25.429 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42366.log 2024-09-11T23:07:25.429 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39644.log 2024-09-11T23:07:25.429 INFO:teuthology.orchestra.run.smithi012.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.34712.log.gz 2024-09-11T23:07:25.430 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40747.log 2024-09-11T23:07:25.430 INFO:teuthology.orchestra.run.smithi012.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.42366.log.gz 2024-09-11T23:07:25.430 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37820.log 2024-09-11T23:07:25.430 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40747.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.39644.log.gz 2024-09-11T23:07:25.430 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40855.log 2024-09-11T23:07:25.430 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37820.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.40747.log.gz 2024-09-11T23:07:25.430 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34608.log 2024-09-11T23:07:25.430 INFO:teuthology.orchestra.run.smithi012.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.37820.log.gz 2024-09-11T23:07:25.430 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32585.log 2024-09-11T23:07:25.430 INFO:teuthology.orchestra.run.smithi012.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.40855.log.gz 2024-09-11T23:07:25.430 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39109.log 2024-09-11T23:07:25.430 INFO:teuthology.orchestra.run.smithi012.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.34608.log.gz 2024-09-11T23:07:25.430 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.32585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36337.log 2024-09-11T23:07:25.431 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39109.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.32585.log.gz 2024-09-11T23:07:25.431 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37426.log 2024-09-11T23:07:25.431 INFO:teuthology.orchestra.run.smithi012.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.39109.log.gz 2024-09-11T23:07:25.431 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30469.log 2024-09-11T23:07:25.431 INFO:teuthology.orchestra.run.smithi012.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.36337.log.gz 2024-09-11T23:07:25.431 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41448.log 2024-09-11T23:07:25.431 INFO:teuthology.orchestra.run.smithi012.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.37426.log.gz 2024-09-11T23:07:25.431 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.30469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34463.log 2024-09-11T23:07:25.431 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41448.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.30469.log.gz 2024-09-11T23:07:25.431 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40627.log 2024-09-11T23:07:25.431 INFO:teuthology.orchestra.run.smithi012.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.41448.log.gz 2024-09-11T23:07:25.431 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33392.log 2024-09-11T23:07:25.431 INFO:teuthology.orchestra.run.smithi012.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.34463.log.gz 2024-09-11T23:07:25.431 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38503.log 2024-09-11T23:07:25.432 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.0.33392.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.40627.log.gz 2024-09-11T23:07:25.432 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32360.log 2024-09-11T23:07:25.432 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36193.log 2024-09-11T23:07:25.432 INFO:teuthology.orchestra.run.smithi012.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.0.33392.log.gz 2024-09-11T23:07:25.432 INFO:teuthology.orchestra.run.smithi012.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.38503.log.gz 2024-09-11T23:07:25.432 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.32360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32801.log 2024-09-11T23:07:25.432 INFO:teuthology.orchestra.run.smithi012.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.32360.log.gz 2024-09-11T23:07:25.432 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41942.log 2024-09-11T23:07:25.432 INFO:teuthology.orchestra.run.smithi012.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.36193.log.gz 2024-09-11T23:07:25.432 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.32801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41968.log 2024-09-11T23:07:25.432 INFO:teuthology.orchestra.run.smithi012.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.32801.log.gz 2024-09-11T23:07:25.432 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34278.log 2024-09-11T23:07:25.447 INFO:teuthology.orchestra.run.smithi012.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.41942.log.gz 2024-09-11T23:07:25.447 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32689.log 2024-09-11T23:07:25.447 INFO:teuthology.orchestra.run.smithi012.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.41968.log.gz 2024-09-11T23:07:25.448 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.37876.log 2024-09-11T23:07:25.448 INFO:teuthology.orchestra.run.smithi012.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.34278.log.gz 2024-09-11T23:07:25.448 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.32689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35415.log 2024-09-11T23:07:25.448 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.1.37876.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.32689.log.gz 2024-09-11T23:07:25.448 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38237.log 2024-09-11T23:07:25.448 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35415.log: 87.4% -- replaced with /var/log/ceph/ceph-client.1.37876.log.gzgzip 2024-09-11T23:07:25.448 INFO:teuthology.orchestra.run.smithi012.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42159.log 2024-09-11T23:07:25.448 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38237.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.35415.log.gz 2024-09-11T23:07:25.448 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41809.log 2024-09-11T23:07:25.448 INFO:teuthology.orchestra.run.smithi012.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.38237.log.gz 2024-09-11T23:07:25.448 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35306.log 2024-09-11T23:07:25.448 INFO:teuthology.orchestra.run.smithi012.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.42159.log.gz 2024-09-11T23:07:25.448 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34491.log 2024-09-11T23:07:25.449 INFO:teuthology.orchestra.run.smithi012.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.41809.log.gz 2024-09-11T23:07:25.449 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35306.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-11T23:07:25.449 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34491.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.35306.log.gz 2024-09-11T23:07:25.449 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35818.log 2024-09-11T23:07:25.449 INFO:teuthology.orchestra.run.smithi012.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.34491.log.gz 2024-09-11T23:07:25.449 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37452.log 2024-09-11T23:07:25.449 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33027.log 2024-09-11T23:07:25.449 INFO:teuthology.orchestra.run.smithi012.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.35818.log.gz 2024-09-11T23:07:25.449 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36011.log 2024-09-11T23:07:25.449 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33027.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.37452.log.gz 2024-09-11T23:07:25.449 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34526.log 2024-09-11T23:07:25.449 INFO:teuthology.orchestra.run.smithi012.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.33027.log.gz 2024-09-11T23:07:25.449 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32259.log 2024-09-11T23:07:25.449 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34526.log: gzip -5 --verbose -- 86.1% /var/log/ceph/ceph-client.1.39591.log 2024-09-11T23:07:25.450 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36011.log.gz 2024-09-11T23:07:25.450 INFO:teuthology.orchestra.run.smithi012.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.34526.log.gz 2024-09-11T23:07:25.450 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.32259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33844.log 2024-09-11T23:07:25.450 INFO:teuthology.orchestra.run.smithi012.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.32259.log.gz 2024-09-11T23:07:25.450 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.1.39591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35589.log 2024-09-11T23:07:25.450 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34634.log 2024-09-11T23:07:25.450 INFO:teuthology.orchestra.run.smithi012.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.1.39591.log.gz 2024-09-11T23:07:25.450 INFO:teuthology.orchestra.run.smithi012.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.33844.log.gz 2024-09-11T23:07:25.450 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-11T23:07:25.450 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35589.log: /var/log/ceph/ceph-client.admin.34634.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.35589.log.gz 2024-09-11T23:07:25.450 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34161.log 2024-09-11T23:07:25.450 INFO:teuthology.orchestra.run.smithi012.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.34634.log.gz 2024-09-11T23:07:25.450 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36446.log 2024-09-11T23:07:25.451 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39046.log 2024-09-11T23:07:25.451 INFO:teuthology.orchestra.run.smithi012.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.34161.log.gz 2024-09-11T23:07:25.451 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39323.log 2024-09-11T23:07:25.451 INFO:teuthology.orchestra.run.smithi012.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.36446.log.gz 2024-09-11T23:07:25.451 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35907.log 2024-09-11T23:07:25.451 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34357.log 2024-09-11T23:07:25.451 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39323.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.39046.log.gz 2024-09-11T23:07:25.451 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35907.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.39323.log.gz 2024-09-11T23:07:25.451 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40907.log 2024-09-11T23:07:25.451 INFO:teuthology.orchestra.run.smithi012.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.35907.log.gz 2024-09-11T23:07:25.451 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42079.log 2024-09-11T23:07:25.451 INFO:teuthology.orchestra.run.smithi012.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.34357.log.gz 2024-09-11T23:07:25.451 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39918.log 2024-09-11T23:07:25.451 INFO:teuthology.orchestra.run.smithi012.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.40907.log.gz 2024-09-11T23:07:25.452 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39297.log 2024-09-11T23:07:25.452 INFO:teuthology.orchestra.run.smithi012.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.42079.log.gz 2024-09-11T23:07:25.452 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33264.log 2024-09-11T23:07:25.452 INFO:teuthology.orchestra.run.smithi012.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.39918.log.gz 2024-09-11T23:07:25.452 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40601.log 2024-09-11T23:07:25.452 INFO:teuthology.orchestra.run.smithi012.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.39297.log.gz 2024-09-11T23:07:25.452 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34738.log 2024-09-11T23:07:25.452 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35855.log 2024-09-11T23:07:25.452 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40601.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.33264.log.gz 2024-09-11T23:07:25.452 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34738.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.40601.log.gz 2024-09-11T23:07:25.452 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42185.log 2024-09-11T23:07:25.452 INFO:teuthology.orchestra.run.smithi012.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.34738.log.gz 2024-09-11T23:07:25.452 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36656.log 2024-09-11T23:07:25.453 INFO:teuthology.orchestra.run.smithi012.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.35855.log.gz 2024-09-11T23:07:25.453 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38730.log 2024-09-11T23:07:25.453 INFO:teuthology.orchestra.run.smithi012.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.42185.log.gz 2024-09-11T23:07:25.453 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38047.log 2024-09-11T23:07:25.453 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36076.log 2024-09-11T23:07:25.453 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38730.log: /var/log/ceph/ceph-client.admin.38047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34896.log 2024-09-11T23:07:25.453 INFO:teuthology.orchestra.run.smithi012.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.36656.log.gz 2024-09-11T23:07:25.453 INFO:teuthology.orchestra.run.smithi012.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.38730.log.gz 2024-09-11T23:07:25.453 INFO:teuthology.orchestra.run.smithi012.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.38047.log.gz 2024-09-11T23:07:25.453 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40419.log 2024-09-11T23:07:25.453 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.0.34896.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.36076.log.gz 2024-09-11T23:07:25.453 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36311.log 2024-09-11T23:07:25.453 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33105.log 2024-09-11T23:07:25.453 INFO:teuthology.orchestra.run.smithi012.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.40419.log.gz 2024-09-11T23:07:25.454 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36311.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.23941.log 2024-09-11T23:07:25.454 INFO:teuthology.orchestra.run.smithi012.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.34896.log.gz 2024-09-11T23:07:25.454 INFO:teuthology.orchestra.run.smithi012.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.36311.log.gz 2024-09-11T23:07:25.454 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38425.log 2024-09-11T23:07:25.472 INFO:teuthology.orchestra.run.smithi012.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.33105.log.gz 2024-09-11T23:07:25.472 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.37588.log 2024-09-11T23:07:25.472 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph.tmp-client.admin.23941.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.23941.log.gz 2024-09-11T23:07:25.472 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37711.log 2024-09-11T23:07:25.472 INFO:teuthology.orchestra.run.smithi012.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.38425.log.gz 2024-09-11T23:07:25.472 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41602.log 2024-09-11T23:07:25.473 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.1.37588.log: /var/log/ceph/ceph-client.admin.37711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40959.log 2024-09-11T23:07:25.473 INFO:teuthology.orchestra.run.smithi012.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.37711.log.gz 2024-09-11T23:07:25.473 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41602.log: gzip -5 --verbose -- 89.1% /var/log/ceph/ceph-client.admin.27601.log -- replaced with /var/log/ceph/ceph-client.1.37588.log.gz 2024-09-11T23:07:25.473 INFO:teuthology.orchestra.run.smithi012.stderr: 2024-09-11T23:07:25.473 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40959.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.41602.log.gz 2024-09-11T23:07:25.473 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40086.log 2024-09-11T23:07:25.473 INFO:teuthology.orchestra.run.smithi012.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.40959.log.gz 2024-09-11T23:07:25.473 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.27601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38652.log 2024-09-11T23:07:25.473 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35477.log 2024-09-11T23:07:25.473 INFO:teuthology.orchestra.run.smithi012.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.27601.log.gz 2024-09-11T23:07:25.473 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40086.log: /var/log/ceph/ceph-client.admin.38652.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.40086.log.gz 2024-09-11T23:07:25.473 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39535.log 2024-09-11T23:07:25.473 INFO:teuthology.orchestra.run.smithi012.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.38652.log.gz 2024-09-11T23:07:25.474 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33672.log 2024-09-11T23:07:25.474 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38756.log 2024-09-11T23:07:25.474 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39535.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.35477.log.gz 2024-09-11T23:07:25.474 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33672.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.39535.log.gz 2024-09-11T23:07:25.474 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36604.log 2024-09-11T23:07:25.474 INFO:teuthology.orchestra.run.smithi012.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.33672.log.gz 2024-09-11T23:07:25.474 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40033.log 2024-09-11T23:07:25.474 INFO:teuthology.orchestra.run.smithi012.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.38756.log.gz 2024-09-11T23:07:25.474 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37125.log 2024-09-11T23:07:25.474 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34305.log 2024-09-11T23:07:25.474 INFO:teuthology.orchestra.run.smithi012.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.36604.log.gz 2024-09-11T23:07:25.474 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40033.log: /var/log/ceph/ceph-client.admin.37125.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.40033.log.gz 2024-09-11T23:07:25.474 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41063.log 2024-09-11T23:07:25.474 INFO:teuthology.orchestra.run.smithi012.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.37125.log.gz 2024-09-11T23:07:25.475 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38992.log 2024-09-11T23:07:25.475 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34305.log: /var/log/ceph/ceph-client.admin.41063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32555.log 2024-09-11T23:07:25.475 INFO:teuthology.orchestra.run.smithi012.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.34305.log.gz 2024-09-11T23:07:25.475 INFO:teuthology.orchestra.run.smithi012.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.41063.log.gz 2024-09-11T23:07:25.475 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37169.log 2024-09-11T23:07:25.475 INFO:teuthology.orchestra.run.smithi012.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.38992.log.gz 2024-09-11T23:07:25.475 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.32555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34331.log 2024-09-11T23:07:25.475 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32741.log 2024-09-11T23:07:25.475 INFO:teuthology.orchestra.run.smithi012.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.32555.log.gz 2024-09-11T23:07:25.475 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37169.log: /var/log/ceph/ceph-client.admin.34331.log: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.37169.log.gz 2024-09-11T23:07:25.475 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35562.log 2024-09-11T23:07:25.475 INFO:teuthology.orchestra.run.smithi012.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.34331.log.gz 2024-09-11T23:07:25.475 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.32741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36250.log 2024-09-11T23:07:25.475 INFO:teuthology.orchestra.run.smithi012.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.32741.log.gz 2024-09-11T23:07:25.476 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33157.log 2024-09-11T23:07:25.476 INFO:teuthology.orchestra.run.smithi012.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.35562.log.gz 2024-09-11T23:07:25.476 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42105.log 2024-09-11T23:07:25.476 INFO:teuthology.orchestra.run.smithi012.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.36250.log.gz 2024-09-11T23:07:25.476 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38867.log 2024-09-11T23:07:25.476 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41116.log 2024-09-11T23:07:25.476 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42105.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.33157.log.gz 2024-09-11T23:07:25.476 INFO:teuthology.orchestra.run.smithi012.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.42105.log.gz 2024-09-11T23:07:25.476 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37096.log 2024-09-11T23:07:25.476 INFO:teuthology.orchestra.run.smithi012.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.38867.log.gz 2024-09-11T23:07:25.476 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38607.log 2024-09-11T23:07:25.476 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32412.log 2024-09-11T23:07:25.476 INFO:teuthology.orchestra.run.smithi012.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.41116.log.gz 2024-09-11T23:07:25.477 INFO:teuthology.orchestra.run.smithi012.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.37096.log.gz 2024-09-11T23:07:25.477 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41089.log 2024-09-11T23:07:25.477 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38607.log: /var/log/ceph/ceph-client.admin.32412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40367.log 2024-09-11T23:07:25.477 INFO:teuthology.orchestra.run.smithi012.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.38607.log.gz 2024-09-11T23:07:25.477 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41089.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.32412.log.gz 2024-09-11T23:07:25.477 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37760.log 2024-09-11T23:07:25.477 INFO:teuthology.orchestra.run.smithi012.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.41089.log.gz 2024-09-11T23:07:25.477 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33594.log 2024-09-11T23:07:25.477 INFO:teuthology.orchestra.run.smithi012.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.40367.log.gz 2024-09-11T23:07:25.477 INFO:teuthology.orchestra.run.smithi012.stderr:gzip/var/log/ceph/ceph-client.admin.37760.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.41011.log 2024-09-11T23:07:25.477 INFO:teuthology.orchestra.run.smithi012.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.37760.log.gz 2024-09-11T23:07:25.477 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39018.log 2024-09-11T23:07:25.477 INFO:teuthology.orchestra.run.smithi012.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.33594.log.gz 2024-09-11T23:07:25.478 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32956.log 2024-09-11T23:07:25.478 INFO:teuthology.orchestra.run.smithi012.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.41011.log.gz 2024-09-11T23:07:25.478 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27778.log 2024-09-11T23:07:25.478 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39018.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.39018.log.gz 2024-09-11T23:07:25.478 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.32956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32957.log 2024-09-11T23:07:25.478 INFO:teuthology.orchestra.run.smithi012.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.32956.log.gz 2024-09-11T23:07:25.478 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40059.log 2024-09-11T23:07:25.478 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.27778.log: /var/log/ceph/ceph-client.admin.32957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38451.log 2024-09-11T23:07:25.478 INFO:teuthology.orchestra.run.smithi012.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.27778.log.gz 2024-09-11T23:07:25.478 INFO:teuthology.orchestra.run.smithi012.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.32957.log.gz 2024-09-11T23:07:25.478 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32637.log 2024-09-11T23:07:25.478 INFO:teuthology.orchestra.run.smithi012.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.40059.log.gz 2024-09-11T23:07:25.478 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35959.log 2024-09-11T23:07:25.478 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38451.log: /var/log/ceph/ceph-client.admin.32637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38132.log 2024-09-11T23:07:25.479 INFO:teuthology.orchestra.run.smithi012.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.38451.log.gz 2024-09-11T23:07:25.479 INFO:teuthology.orchestra.run.smithi012.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.32637.log.gz 2024-09-11T23:07:25.479 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33442.log 2024-09-11T23:07:25.479 INFO:teuthology.orchestra.run.smithi012.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.35959.log.gz 2024-09-11T23:07:25.479 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39425.log 2024-09-11T23:07:25.479 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38132.log: /var/log/ceph/ceph-client.admin.33442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37350.log 2024-09-11T23:07:25.479 INFO:teuthology.orchestra.run.smithi012.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.38132.log.gz 2024-09-11T23:07:25.479 INFO:teuthology.orchestra.run.smithi012.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.33442.log.gz 2024-09-11T23:07:25.479 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35933.log 2024-09-11T23:07:25.479 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37350.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.39425.log.gz 2024-09-11T23:07:25.479 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36167.log 2024-09-11T23:07:25.479 INFO:teuthology.orchestra.run.smithi012.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.37350.log.gz 2024-09-11T23:07:25.480 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41730.log 2024-09-11T23:07:25.480 INFO:teuthology.orchestra.run.smithi012.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.35933.log.gz 2024-09-11T23:07:25.480 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39948.log 2024-09-11T23:07:25.480 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36167.log: /var/log/ceph/ceph-client.admin.41730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39074.log 2024-09-11T23:07:25.480 INFO:teuthology.orchestra.run.smithi012.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36167.log.gz 2024-09-11T23:07:25.480 INFO:teuthology.orchestra.run.smithi012.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.41730.log.gz 2024-09-11T23:07:25.480 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39948.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-11T23:07:25.480 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39074.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.39948.log.gz 2024-09-11T23:07:25.480 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40341.log 2024-09-11T23:07:25.480 INFO:teuthology.orchestra.run.smithi012.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.39074.log.gz 2024-09-11T23:07:25.480 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34840.log 2024-09-11T23:07:25.480 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32611.log 2024-09-11T23:07:25.480 INFO:teuthology.orchestra.run.smithi012.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.40341.log.gz 2024-09-11T23:07:25.481 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39219.log 2024-09-11T23:07:25.481 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34840.log: /var/log/ceph/ceph-client.admin.32611.log: 87.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32767.log 2024-09-11T23:07:25.481 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34840.log.gz 2024-09-11T23:07:25.481 INFO:teuthology.orchestra.run.smithi012.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.32611.log.gz 2024-09-11T23:07:25.481 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40445.log 2024-09-11T23:07:25.481 INFO:teuthology.orchestra.run.smithi012.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.39219.log.gz 2024-09-11T23:07:25.481 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35359.log 2024-09-11T23:07:25.481 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.32767.log: /var/log/ceph/ceph-client.admin.40445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33079.log 2024-09-11T23:07:25.481 INFO:teuthology.orchestra.run.smithi012.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.32767.log.gz 2024-09-11T23:07:25.481 INFO:teuthology.orchestra.run.smithi012.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.40445.log.gz 2024-09-11T23:07:25.481 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38185.log 2024-09-11T23:07:25.481 INFO:teuthology.orchestra.run.smithi012.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.35359.log.gz 2024-09-11T23:07:25.482 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41576.log 2024-09-11T23:07:25.482 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33079.log: /var/log/ceph/ceph-client.admin.38185.log: 86.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34686.log 2024-09-11T23:07:25.482 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33079.log.gz 2024-09-11T23:07:25.482 INFO:teuthology.orchestra.run.smithi012.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.38185.log.gz 2024-09-11T23:07:25.482 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32503.log 2024-09-11T23:07:25.482 INFO:teuthology.orchestra.run.smithi012.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.41576.log.gz 2024-09-11T23:07:25.499 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36420.log 2024-09-11T23:07:25.499 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34686.log: /var/log/ceph/ceph-client.admin.32503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41678.log 2024-09-11T23:07:25.499 INFO:teuthology.orchestra.run.smithi012.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.34686.log.gz 2024-09-11T23:07:25.499 INFO:teuthology.orchestra.run.smithi012.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.32503.log.gz 2024-09-11T23:07:25.499 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37006.log 2024-09-11T23:07:25.499 INFO:teuthology.orchestra.run.smithi012.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.36420.log.gz 2024-09-11T23:07:25.499 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40799.log 2024-09-11T23:07:25.499 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41678.log: /var/log/ceph/ceph-client.admin.37006.log: 84.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36222.log 2024-09-11T23:07:25.500 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41678.log.gz 2024-09-11T23:07:25.500 INFO:teuthology.orchestra.run.smithi012.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.37006.log.gz 2024-09-11T23:07:25.500 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39829.log 2024-09-11T23:07:25.500 INFO:teuthology.orchestra.run.smithi012.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.40799.log.gz 2024-09-11T23:07:25.500 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36928.log 2024-09-11T23:07:25.500 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36222.log: /var/log/ceph/ceph-client.admin.39829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39135.log 2024-09-11T23:07:25.500 INFO:teuthology.orchestra.run.smithi012.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.36222.log.gz 2024-09-11T23:07:25.500 INFO:teuthology.orchestra.run.smithi012.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.39829.log.gz 2024-09-11T23:07:25.500 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38017.log 2024-09-11T23:07:25.500 INFO:teuthology.orchestra.run.smithi012.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.36928.log.gz 2024-09-11T23:07:25.500 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39271.log 2024-09-11T23:07:25.500 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39135.log: /var/log/ceph/ceph-client.admin.38017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40773.log 2024-09-11T23:07:25.500 INFO:teuthology.orchestra.run.smithi012.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.39135.log.gz 86.1% -- replaced with /var/log/ceph/ceph-client.admin.38017.log.gz 2024-09-11T23:07:25.501 INFO:teuthology.orchestra.run.smithi012.stderr: 2024-09-11T23:07:25.501 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42237.log 2024-09-11T23:07:25.501 INFO:teuthology.orchestra.run.smithi012.stderr: 85.8%/var/log/ceph/ceph-client.admin.40773.log: -- replaced with /var/log/ceph/ceph-client.admin.39271.log.gz 2024-09-11T23:07:25.501 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37070.log 2024-09-11T23:07:25.501 INFO:teuthology.orchestra.run.smithi012.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.40773.log.gz 2024-09-11T23:07:25.501 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34252.log 2024-09-11T23:07:25.501 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35985.log 2024-09-11T23:07:25.501 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37070.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42237.log.gz 2024-09-11T23:07:25.501 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34252.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.37070.log.gz 2024-09-11T23:07:25.501 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.33537.log 2024-09-11T23:07:25.501 INFO:teuthology.orchestra.run.smithi012.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.34252.log.gz 2024-09-11T23:07:25.501 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36524.log 2024-09-11T23:07:25.501 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35985.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.35985.log.gz 2024-09-11T23:07:25.502 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.1.33537.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-11T23:07:25.502 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39886.log 2024-09-11T23:07:25.502 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36524.log: /var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37986.log 2024-09-11T23:07:25.502 INFO:teuthology.orchestra.run.smithi012.stderr: 86.3% 87.6% -- replaced with /var/log/ceph/ceph-client.1.33537.log.gz 2024-09-11T23:07:25.502 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36524.log.gz 2024-09-11T23:07:25.502 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36368.log 2024-09-11T23:07:25.502 INFO:teuthology.orchestra.run.smithi012.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.39886.log.gz 2024-09-11T23:07:25.502 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41480.log 2024-09-11T23:07:25.502 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-11T23:07:25.502 INFO:teuthology.orchestra.run.smithi012.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.37986.log.gz 2024-09-11T23:07:25.502 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36368.log: /var/log/ceph/ceph-client.admin.41480.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.36368.log.gz 2024-09-11T23:07:25.502 INFO:teuthology.orchestra.run.smithi012.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.41480.log.gz 2024-09-11T23:07:25.502 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40682.log 2024-09-11T23:07:25.502 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32226.log 2024-09-11T23:07:25.503 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39481.log 2024-09-11T23:07:25.503 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40682.log: /var/log/ceph/ceph-client.admin.32226.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.40682.log.gz 2024-09-11T23:07:25.503 INFO:teuthology.orchestra.run.smithi012.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.32226.log.gz 2024-09-11T23:07:25.503 INFO:teuthology.orchestra.run.smithi012.stderr: 85.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-11T23:07:25.503 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40653.log 2024-09-11T23:07:25.503 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39668.log 2024-09-11T23:07:25.503 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.0.39481.log: /var/log/ceph/ceph-client.admin.40653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33874.log 2024-09-11T23:07:25.503 INFO:teuthology.orchestra.run.smithi012.stderr: 86.4%/var/log/ceph/ceph-client.admin.39668.log: -- replaced with /var/log/ceph/ceph-client.admin.40653.log.gz 2024-09-11T23:07:25.503 INFO:teuthology.orchestra.run.smithi012.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39668.log.gz 2024-09-11T23:07:25.503 INFO:teuthology.orchestra.run.smithi012.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.0.39481.log.gz 2024-09-11T23:07:25.503 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34383.log 2024-09-11T23:07:25.503 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41396.log 2024-09-11T23:07:25.503 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33874.log: /var/log/ceph/ceph-client.admin.34383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35791.log 2024-09-11T23:07:25.503 INFO:teuthology.orchestra.run.smithi012.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.33874.log.gz 2024-09-11T23:07:25.504 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41396.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.34383.log.gz 2024-09-11T23:07:25.504 INFO:teuthology.orchestra.run.smithi012.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.41396.log.gz 2024-09-11T23:07:25.504 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38159.log 2024-09-11T23:07:25.504 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40536.log 2024-09-11T23:07:25.504 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35791.log: /var/log/ceph/ceph-client.admin.38159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27719.log 2024-09-11T23:07:25.504 INFO:teuthology.orchestra.run.smithi012.stderr: 86.2%/var/log/ceph/ceph-client.admin.40536.log: -- replaced with /var/log/ceph/ceph-client.admin.35791.log.gz 2024-09-11T23:07:25.504 INFO:teuthology.orchestra.run.smithi012.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.38159.log.gz 2024-09-11T23:07:25.504 INFO:teuthology.orchestra.run.smithi012.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.40536.log.gz 2024-09-11T23:07:25.504 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36472.log 2024-09-11T23:07:25.504 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39245.log 2024-09-11T23:07:25.504 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.27719.log: /var/log/ceph/ceph-client.admin.36472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39974.log 2024-09-11T23:07:25.504 INFO:teuthology.orchestra.run.smithi012.stderr: 84.8%/var/log/ceph/ceph-client.admin.39245.log: -- replaced with /var/log/ceph/ceph-client.admin.27719.log.gz 2024-09-11T23:07:25.504 INFO:teuthology.orchestra.run.smithi012.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.36472.log.gz 2024-09-11T23:07:25.505 INFO:teuthology.orchestra.run.smithi012.stderr: 86.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42131.log 2024-09-11T23:07:25.505 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39245.log.gz 2024-09-11T23:07:25.505 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35059.log 2024-09-11T23:07:25.505 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39974.log: /var/log/ceph/ceph-client.admin.42131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40933.log 2024-09-11T23:07:25.505 INFO:teuthology.orchestra.run.smithi012.stderr: 87.4%/var/log/ceph/ceph-client.admin.35059.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.39974.log.gz 2024-09-11T23:07:25.505 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42131.log.gz 2024-09-11T23:07:25.505 INFO:teuthology.orchestra.run.smithi012.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.35059.log.gz 2024-09-11T23:07:25.505 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34578.log 2024-09-11T23:07:25.505 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34764.log 2024-09-11T23:07:25.505 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40933.log: /var/log/ceph/ceph-client.admin.34578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39191.log 2024-09-11T23:07:25.505 INFO:teuthology.orchestra.run.smithi012.stderr: 86.1%/var/log/ceph/ceph-client.admin.34764.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.40933.log.gz 2024-09-11T23:07:25.505 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34578.log.gz 2024-09-11T23:07:25.505 INFO:teuthology.orchestra.run.smithi012.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.34764.log.gz 2024-09-11T23:07:25.505 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32386.log 2024-09-11T23:07:25.506 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.36873.log 2024-09-11T23:07:25.506 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39191.log: /var/log/ceph/ceph-client.admin.32386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.41332.log 2024-09-11T23:07:25.506 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.1.36873.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.32386.log.gz 2024-09-11T23:07:25.506 INFO:teuthology.orchestra.run.smithi012.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.39191.log.gz 2024-09-11T23:07:25.506 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37505.log 2024-09-11T23:07:25.506 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32879.log 2024-09-11T23:07:25.506 INFO:teuthology.orchestra.run.smithi012.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.1.36873.log.gz 2024-09-11T23:07:25.506 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.1.41332.log: /var/log/ceph/ceph-client.admin.37505.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.37505.log.gzgzip 2024-09-11T23:07:25.506 INFO:teuthology.orchestra.run.smithi012.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.38808.log 2024-09-11T23:07:25.506 INFO:teuthology.orchestra.run.smithi012.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.1.41332.log.gz 2024-09-11T23:07:25.506 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.32879.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.32879.log.gz 2024-09-11T23:07:25.506 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41512.log 2024-09-11T23:07:25.506 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37665.log 2024-09-11T23:07:25.507 INFO:teuthology.orchestra.run.smithi012.stderr: 85.9%/var/log/ceph/ceph-client.admin.41512.log: -- replaced with /var/log/ceph/ceph-client.admin.38808.log.gz 2024-09-11T23:07:25.507 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36141.log 2024-09-11T23:07:25.507 INFO:teuthology.orchestra.run.smithi012.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.41512.log.gz 2024-09-11T23:07:25.507 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37665.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.37665.log.gz 2024-09-11T23:07:25.516 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42340.log 2024-09-11T23:07:25.517 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32949.log 2024-09-11T23:07:25.517 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36141.log: /var/log/ceph/ceph-client.admin.42340.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.36141.log.gz 2024-09-11T23:07:25.517 INFO:teuthology.orchestra.run.smithi012.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.42340.log.gz 2024-09-11T23:07:25.517 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34950.log 2024-09-11T23:07:25.517 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42211.log 2024-09-11T23:07:25.517 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.32949.log: /var/log/ceph/ceph-client.admin.34950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40829.log 2024-09-11T23:07:25.517 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42211.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.34950.log.gz 2024-09-11T23:07:25.517 INFO:teuthology.orchestra.run.smithi012.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.32949.log.gz 2024-09-11T23:07:25.517 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40289.log 2024-09-11T23:07:25.517 INFO:teuthology.orchestra.run.smithi012.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.42211.log.gz 2024-09-11T23:07:25.517 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42316.log 2024-09-11T23:07:25.517 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40829.log: /var/log/ceph/ceph-client.admin.40289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37642.log 2024-09-11T23:07:25.518 INFO:teuthology.orchestra.run.smithi012.stderr: 85.9%/var/log/ceph/ceph-client.admin.42316.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.40829.log.gz 2024-09-11T23:07:25.518 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40289.log.gz 2024-09-11T23:07:25.518 INFO:teuthology.orchestra.run.smithi012.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.42316.log.gz 2024-09-11T23:07:25.518 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38529.log 2024-09-11T23:07:25.518 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33183.log 2024-09-11T23:07:25.518 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37642.log: /var/log/ceph/ceph-client.admin.38529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37531.log 2024-09-11T23:07:25.518 INFO:teuthology.orchestra.run.smithi012.stderr: 86.3%/var/log/ceph/ceph-client.admin.33183.log: -- replaced with /var/log/ceph/ceph-client.admin.37642.log.gz 2024-09-11T23:07:25.518 INFO:teuthology.orchestra.run.smithi012.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.38529.log.gz 2024-09-11T23:07:25.518 INFO:teuthology.orchestra.run.smithi012.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.33183.log.gz 2024-09-11T23:07:25.518 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41704.log 2024-09-11T23:07:25.518 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27695.log 2024-09-11T23:07:25.518 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37531.log: /var/log/ceph/ceph-client.admin.41704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35258.log 2024-09-11T23:07:25.518 INFO:teuthology.orchestra.run.smithi012.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.37531.log.gz 2024-09-11T23:07:25.519 INFO:teuthology.orchestra.run.smithi012.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.41704.log.gz/var/log/ceph/ceph-client.admin.27695.log: 2024-09-11T23:07:25.519 INFO:teuthology.orchestra.run.smithi012.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.27695.log.gz 2024-09-11T23:07:25.519 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34129.log 2024-09-11T23:07:25.519 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36498.log 2024-09-11T23:07:25.519 INFO:teuthology.orchestra.run.smithi012.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.35258.log.gz/var/log/ceph/ceph-client.admin.34129.log: 2024-09-11T23:07:25.519 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32529.log 2024-09-11T23:07:25.519 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36498.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.34129.log.gz 2024-09-11T23:07:25.519 INFO:teuthology.orchestra.run.smithi012.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.36498.log.gz 2024-09-11T23:07:25.519 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35283.log 2024-09-11T23:07:25.519 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35881.log 2024-09-11T23:07:25.519 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.32529.log: /var/log/ceph/ceph-client.admin.35283.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-11T23:07:25.519 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35881.log: 86.2% 86.3% -- replaced with /var/log/ceph/ceph-client.admin.32529.log.gz -- replaced with /var/log/ceph/ceph-client.admin.35283.log.gz 2024-09-11T23:07:25.519 INFO:teuthology.orchestra.run.smithi012.stderr: 2024-09-11T23:07:25.519 INFO:teuthology.orchestra.run.smithi012.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.35881.log.gz 2024-09-11T23:07:25.520 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-11T23:07:25.520 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40985.log 2024-09-11T23:07:25.520 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33784.log 2024-09-11T23:07:25.520 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40985.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.40985.log.gz 2024-09-11T23:07:25.520 INFO:teuthology.orchestra.run.smithi012.stderr: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-11T23:07:25.520 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34103.log 2024-09-11T23:07:25.520 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37478.log 2024-09-11T23:07:25.520 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33784.log: /var/log/ceph/ceph-client.admin.34103.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.33784.log.gz 2024-09-11T23:07:25.520 INFO:teuthology.orchestra.run.smithi012.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.34103.log.gz 2024-09-11T23:07:25.520 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38581.log 2024-09-11T23:07:25.520 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34032.log 2024-09-11T23:07:25.520 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37478.log: /var/log/ceph/ceph-client.admin.38581.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.37478.log.gz 2024-09-11T23:07:25.520 INFO:teuthology.orchestra.run.smithi012.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.38581.log.gz 2024-09-11T23:07:25.520 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33131.log 2024-09-11T23:07:25.521 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36979.log 2024-09-11T23:07:25.521 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34032.log: /var/log/ceph/ceph-client.admin.33131.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.34032.log.gz 2024-09-11T23:07:25.525 INFO:teuthology.orchestra.run.smithi012.stderr: 86.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34226.log 2024-09-11T23:07:25.525 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33131.log.gz 2024-09-11T23:07:25.525 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36979.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.36979.log.gz 2024-09-11T23:07:25.525 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41276.log 2024-09-11T23:07:25.525 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32800.log 2024-09-11T23:07:25.525 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34226.log: /var/log/ceph/ceph-client.admin.41276.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.34226.log.gz 2024-09-11T23:07:25.525 INFO:teuthology.orchestra.run.smithi012.stderr: 86.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33980.log 2024-09-11T23:07:25.525 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41276.log.gz 2024-09-11T23:07:25.525 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.32800.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.32800.log.gz 2024-09-11T23:07:25.525 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37734.log 2024-09-11T23:07:25.526 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27853.log 2024-09-11T23:07:25.526 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33980.log: /var/log/ceph/ceph-client.admin.37734.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.33980.log.gz 2024-09-11T23:07:25.526 INFO:teuthology.orchestra.run.smithi012.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.37734.log.gz 2024-09-11T23:07:25.526 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33928.log 2024-09-11T23:07:25.526 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33817.log 2024-09-11T23:07:25.526 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.27853.log: /var/log/ceph/ceph-client.admin.33928.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.33928.log.gz 85.4% -- replaced with /var/log/ceph/ceph-client.admin.27853.log.gz 2024-09-11T23:07:25.526 INFO:teuthology.orchestra.run.smithi012.stderr: 2024-09-11T23:07:25.526 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37397.log 2024-09-11T23:07:25.526 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34660.log 2024-09-11T23:07:25.526 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33817.log: /var/log/ceph/ceph-client.admin.37397.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.33817.log.gz 2024-09-11T23:07:25.526 INFO:teuthology.orchestra.run.smithi012.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.37397.log.gz 2024-09-11T23:07:25.526 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42053.log 2024-09-11T23:07:25.529 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34660.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.34660.log.gz 2024-09-11T23:07:25.529 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33698.log 2024-09-11T23:07:25.529 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36578.log 2024-09-11T23:07:25.530 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42053.log: /var/log/ceph/ceph-client.admin.33698.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.42053.log.gz 2024-09-11T23:07:25.530 INFO:teuthology.orchestra.run.smithi012.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.33698.log.gz 2024-09-11T23:07:25.530 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36550.log 2024-09-11T23:07:25.530 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38073.log 2024-09-11T23:07:25.530 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36578.log: /var/log/ceph/ceph-client.admin.36550.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.36578.log.gz 2024-09-11T23:07:25.530 INFO:teuthology.orchestra.run.smithi012.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.36550.log.gz 2024-09-11T23:07:25.530 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41836.log 2024-09-11T23:07:25.530 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41222.log 2024-09-11T23:07:25.530 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38073.log: /var/log/ceph/ceph-client.admin.41836.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.38073.log.gz 2024-09-11T23:07:25.530 INFO:teuthology.orchestra.run.smithi012.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.41836.log.gz 2024-09-11T23:07:25.530 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34060.log 2024-09-11T23:07:25.531 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.35006.log 2024-09-11T23:07:25.531 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.0.41222.log: /var/log/ceph/ceph-client.admin.34060.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.34060.log.gz 2024-09-11T23:07:25.531 INFO:teuthology.orchestra.run.smithi012.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.0.41222.log.gz 2024-09-11T23:07:25.532 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41037.log 2024-09-11T23:07:25.532 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42027.log 2024-09-11T23:07:25.533 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.1.35006.log: /var/log/ceph/ceph-client.admin.41037.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.41037.log.gz 2024-09-11T23:07:25.533 INFO:teuthology.orchestra.run.smithi012.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.1.35006.log.gz 2024-09-11T23:07:25.533 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38106.log 2024-09-11T23:07:25.534 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37688.log 2024-09-11T23:07:25.534 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42027.log: /var/log/ceph/ceph-client.admin.38106.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.42027.log.gz 2024-09-11T23:07:25.534 INFO:teuthology.orchestra.run.smithi012.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.38106.log.gz 2024-09-11T23:07:25.535 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33724.log 2024-09-11T23:07:25.535 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39375.log 2024-09-11T23:07:25.536 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37688.log: /var/log/ceph/ceph-client.admin.33724.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.37688.log.gz 2024-09-11T23:07:25.536 INFO:teuthology.orchestra.run.smithi012.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.33724.log.gz 2024-09-11T23:07:25.536 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36816.log 2024-09-11T23:07:25.536 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40138.log 2024-09-11T23:07:25.537 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39375.log: /var/log/ceph/ceph-client.admin.36816.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.39375.log.gz 2024-09-11T23:07:25.537 INFO:teuthology.orchestra.run.smithi012.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.36816.log.gz 2024-09-11T23:07:25.537 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40007.log 2024-09-11T23:07:25.538 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33646.log 2024-09-11T23:07:25.538 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40138.log: /var/log/ceph/ceph-client.admin.40007.log: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.40138.log.gz 2024-09-11T23:07:25.539 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41756.log 2024-09-11T23:07:25.539 INFO:teuthology.orchestra.run.smithi012.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.40007.log.gz 2024-09-11T23:07:25.540 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33646.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.33646.log.gz 2024-09-11T23:07:25.540 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33954.log 2024-09-11T23:07:25.540 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38388.log 2024-09-11T23:07:25.540 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41756.log: /var/log/ceph/ceph-client.admin.33954.log: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.41756.log.gz 2024-09-11T23:07:25.541 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-11T23:07:25.541 INFO:teuthology.orchestra.run.smithi012.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.33954.log.gz 2024-09-11T23:07:25.542 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38388.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.38388.log.gz 2024-09-11T23:07:25.542 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35083.log 2024-09-11T23:07:25.542 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36394.log 2024-09-11T23:07:25.543 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-mds.b.log: /var/log/ceph/ceph-client.admin.35083.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35083.log.gz 2024-09-11T23:07:25.552 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38966.log 2024-09-11T23:07:25.553 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36394.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.36394.log.gz 2024-09-11T23:07:25.553 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34006.log 2024-09-11T23:07:25.554 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38966.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.38966.log.gz 2024-09-11T23:07:25.555 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36285.log 2024-09-11T23:07:25.556 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34006.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.34006.log.gz 2024-09-11T23:07:25.556 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36706.log 2024-09-11T23:07:25.557 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36285.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.36285.log.gz 2024-09-11T23:07:25.557 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41628.log 2024-09-11T23:07:25.558 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36706.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.36706.log.gz 2024-09-11T23:07:25.559 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39161.log 2024-09-11T23:07:25.560 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41628.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.41628.log.gz 2024-09-11T23:07:25.560 INFO:teuthology.orchestra.run.smithi012.stderr: 90.0% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-11T23:07:25.560 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33620.log 2024-09-11T23:07:25.561 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32878.log 2024-09-11T23:07:25.561 INFO:teuthology.orchestra.run.smithi012.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.39161.log.gz/var/log/ceph/ceph-client.admin.33620.log: 2024-09-11T23:07:25.561 INFO:teuthology.orchestra.run.smithi012.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.33620.log.gz 2024-09-11T23:07:25.562 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38704.log 2024-09-11T23:07:25.562 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42289.log 2024-09-11T23:07:25.563 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.32878.log: /var/log/ceph/ceph-client.admin.38704.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.32878.log.gz 2024-09-11T23:07:25.563 INFO:teuthology.orchestra.run.smithi012.stderr: 86.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33757.log 2024-09-11T23:07:25.563 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38704.log.gz 2024-09-11T23:07:25.564 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42289.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.42289.log.gz 2024-09-11T23:07:25.564 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40712.log 2024-09-11T23:07:25.565 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38678.log 2024-09-11T23:07:25.565 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33757.log: /var/log/ceph/ceph-client.admin.40712.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.33757.log.gz 2024-09-11T23:07:25.566 INFO:teuthology.orchestra.run.smithi012.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.40712.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40315.log 2024-09-11T23:07:25.566 INFO:teuthology.orchestra.run.smithi012.stderr: 2024-09-11T23:07:25.566 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38678.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.38678.log.gz 2024-09-11T23:07:25.567 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36044.log 2024-09-11T23:07:25.567 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41166.log 2024-09-11T23:07:25.568 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40315.log: /var/log/ceph/ceph-client.admin.36044.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.40315.log.gz 2024-09-11T23:07:25.568 INFO:teuthology.orchestra.run.smithi012.stderr: 86.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32871.log 2024-09-11T23:07:25.568 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36044.log.gz 2024-09-11T23:07:25.568 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41166.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.41166.log.gz 2024-09-11T23:07:25.569 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32468.log 2024-09-11T23:07:25.569 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40504.log 2024-09-11T23:07:25.569 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.32871.log: /var/log/ceph/ceph-client.admin.32468.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.32871.log.gz 2024-09-11T23:07:25.570 INFO:teuthology.orchestra.run.smithi012.stderr: 86.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38899.log 2024-09-11T23:07:25.570 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32468.log.gz 2024-09-11T23:07:25.571 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40504.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.40504.log.gz 2024-09-11T23:07:25.571 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37037.log 2024-09-11T23:07:25.572 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38834.log 2024-09-11T23:07:25.572 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38899.log: /var/log/ceph/ceph-client.admin.37037.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.38899.log.gz 2024-09-11T23:07:25.572 INFO:teuthology.orchestra.run.smithi012.stderr: 86.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38211.log 2024-09-11T23:07:25.573 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37037.log.gz 2024-09-11T23:07:25.573 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38834.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.38834.log.gz 2024-09-11T23:07:25.573 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35447.log 2024-09-11T23:07:25.574 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32715.log 2024-09-11T23:07:25.574 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38211.log: /var/log/ceph/ceph-client.admin.35447.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.38211.log.gz 2024-09-11T23:07:25.575 INFO:teuthology.orchestra.run.smithi012.stderr: 85.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.35447.log.gz 2024-09-11T23:07:25.575 INFO:teuthology.orchestra.run.smithi012.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.36630.log 2024-09-11T23:07:25.575 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.32715.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.32715.log.gz 2024-09-11T23:07:25.576 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35329.log 2024-09-11T23:07:25.576 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36630.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.36630.log.gz 2024-09-11T23:07:25.577 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32798.log 2024-09-11T23:07:25.577 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37298.log 2024-09-11T23:07:25.578 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35329.log: /var/log/ceph/ceph-client.admin.32798.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.35329.log.gz 2024-09-11T23:07:25.578 INFO:teuthology.orchestra.run.smithi012.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32798.log.gz 2024-09-11T23:07:25.578 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40393.log 2024-09-11T23:07:25.579 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37298.log: /var/log/ceph/ceph-client.admin.40393.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.37298.log.gz 2024-09-11T23:07:25.579 INFO:teuthology.orchestra.run.smithi012.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.40393.log.gz 2024-09-11T23:07:25.600 INFO:teuthology.orchestra.run.smithi012.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-11T23:07:25.613 INFO:teuthology.orchestra.run.smithi012.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-11T23:07:25.738 INFO:teuthology.orchestra.run.smithi012.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-11T23:07:25.976 INFO:teuthology.orchestra.run.smithi012.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-11T23:07:26.189 INFO:teuthology.orchestra.run.smithi012.stderr: 95.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-11T23:07:26.511 INFO:teuthology.orchestra.run.smithi012.stderr: 95.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-11T23:07:26.513 INFO:teuthology.orchestra.run.smithi012.stderr: 2024-09-11T23:07:26.513 INFO:teuthology.orchestra.run.smithi012.stderr:real 0m1.125s 2024-09-11T23:07:26.513 INFO:teuthology.orchestra.run.smithi012.stderr:user 0m3.092s 2024-09-11T23:07:26.513 INFO:teuthology.orchestra.run.smithi012.stderr:sys 0m0.193s 2024-09-11T23:07:26.513 INFO:tasks.ceph:Archiving logs... 2024-09-11T23:07:26.514 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901448/remote/smithi012/log 2024-09-11T23:07:26.515 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T23:07:27.105 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-11T23:07:27.121 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-11T23:07:27.121 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T23:07:27.171 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-11T23:07:27.180 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-11T23:07:27.180 DEBUG:teuthology.orchestra.run.smithi012:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T23:07:27.191 INFO:teuthology.orchestra.run.smithi012.stdout: remote refid st t when poll reach delay offset jitter 2024-09-11T23:07:27.191 INFO:teuthology.orchestra.run.smithi012.stdout:============================================================================== 2024-09-11T23:07:27.191 INFO:teuthology.orchestra.run.smithi012.stdout:+hv01.front.sepi 67.205.162.81 3 u 32 64 177 0.065 -2.376 0.655 2024-09-11T23:07:27.191 INFO:teuthology.orchestra.run.smithi012.stdout:*hv02.front.sepi 63.231.80.2 3 u 28 64 177 0.084 -0.005 0.798 2024-09-11T23:07:27.191 INFO:teuthology.orchestra.run.smithi012.stdout:+hv03.front.sepi 74.6.168.72 3 u 23 64 177 0.093 +1.056 0.767 2024-09-11T23:07:27.191 INFO:teuthology.orchestra.run.smithi012.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-11T23:07:27.192 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-11T23:07:27.253 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-11T23:07:27.254 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-11T23:07:27.288 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-11T23:07:27.320 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-11T23:07:27.353 INFO:teuthology.task.internal:Duration was 891.697919 seconds 2024-09-11T23:07:27.354 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-11T23:07:27.388 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-11T23:07:27.388 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T23:07:27.429 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-11T23:07:27.429 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi012.front.sepia.ceph.com 2024-09-11T23:07:27.429 DEBUG:teuthology.orchestra.run.smithi012:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T23:07:27.485 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-11T23:07:27.485 DEBUG:teuthology.orchestra.run.smithi012:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T23:07:27.557 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-11T23:07:27.557 DEBUG:teuthology.orchestra.run.smithi012:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T23:07:27.669 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-11T23:07:27.679 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-11T23:07:27.679 DEBUG:teuthology.orchestra.run.smithi012:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T23:07:27.692 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-11T23:07:27.740 DEBUG:teuthology.orchestra.run.smithi012:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T23:07:27.751 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern = core 2024-09-11T23:07:27.764 DEBUG:teuthology.orchestra.run.smithi012:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T23:07:27.812 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:07:27.813 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-11T23:07:27.823 INFO:teuthology.task.internal:Transferring archived files... 2024-09-11T23:07:27.824 DEBUG:teuthology.misc:Transferring archived files from smithi012:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901448/remote/smithi012 2024-09-11T23:07:27.824 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T23:07:27.876 INFO:teuthology.task.internal:Removing archive directory... 2024-09-11T23:07:27.876 DEBUG:teuthology.orchestra.run.smithi012:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T23:07:27.917 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-11T23:07:27.928 INFO:teuthology.task.internal:Not uploading archives. 2024-09-11T23:07:27.928 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-11T23:07:27.955 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-11T23:07:27.955 DEBUG:teuthology.orchestra.run.smithi012:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T23:07:27.965 INFO:teuthology.orchestra.run.smithi012.stdout: 658617 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 23:07 /home/ubuntu/cephtest 2024-09-11T23:07:27.966 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-11T23:07:27.991 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-11T23:07:28.057 INFO:teuthology.run:Summary data: description: fs/top/{begin/{0-install 1-ceph 2-logrotate 3-modules} cluster/{1-node} conf/{client mds mgr mon osd} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health pg_health} supported-random-distros$/{ubuntu_latest} tasks/fstop} duration: 891.6979191303253 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-11T23:07:28.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T23:07:28.147 INFO:teuthology.run:pass